[IGNITE-15274] Unexpected initialization of MaintainanceFileStore on client nodes

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.11
• Fix Version/s: 2.11
• Labels: newbie
• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Nikolay Izhikov
• Reporter: Anton Vinogradov
• Created: 09/Aug/21 11:47
• Updated: 13/Aug/21 13:18
• Resolved: 12/Aug/21 14:54

Description

Node has a client flag but fails on persistence check.

[2021-08-09 06:54:24,056][WARN ][main][MaintenanceProcessor] Caught exception when starting MaintenanceProcessor, maintenance mode won't be entered
class org.apache.ignite.IgniteCheckedException: Directory does not exist and cannot be created: /mnt/ssd/persistence
at org.apache.ignite.internal.util.IgniteUtils.resolveWorkDirectory(IgniteUtils.java:9670)
at org.apache.ignite.internal.processors.cache.persistence.filename.PdsConsistentIdProcessor.resolvePersistentStoreBasePath(PdsConsistentIdProcessor.java:453)
at org.apache.ignite.internal.processors.cache.persistence.filename.PdsConsistentIdProcessor.prepareNewSettings(PdsConsistentIdProcessor.java:160)
at org.apache.ignite.internal.processors.cache.persistence.filename.PdsConsistentIdProcessor.resolveFolders(PdsConsistentIdProcessor.java:140)
at org.apache.ignite.internal.maintenance.MaintenanceFileStore.init(MaintenanceFileStore.java:103)
at org.apache.ignite.internal.maintenance.MaintenanceProcessor.start(MaintenanceProcessor.java:137)
at org.apache.ignite.internal.IgniteKernal.startProcessor(IgniteKernal.java:1986)
at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1211)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2112)
at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1758)
at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1143)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:641)
at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66)
at org.apache.ignite.yardstick.IgniteNode.start(IgniteNode.java:215)
at org.apache.ignite.yardstick.IgniteAbstractBenchmark.setUp(IgniteAbstractBenchmark.java:65)
at org.apache.ignite.yardstick.cache.IgniteCacheAbstractBenchmark.setUp(IgniteCacheAbstractBenchmark.java:108)
at org.yardstickframework.BenchmarkDriverStartUp.main(BenchmarkDriverStartUp.java:130)

Such check should not happen.

Config which leads to the failure (this config was used at Yardstick, so clientMode was set by Yardstick):

<?xml version="1.0" encoding="UTF-8"?>

<!--
  Licensed to the Apache Software Foundation (ASF) under one or more
  contributor license agreements.  See the NOTICE file distributed with
  this work for additional information regarding copyright ownership.
  The ASF licenses this file to You under the Apache License, Version 2.0
  (the "License"); you may not use this file except in compliance with
  the License.  You may obtain a copy of the License at

       http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License.
-->

<beans xmlns="http://www.springframework.org/schema/beans"
       xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
       xsi:schemaLocation="
        http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-2.5.xsd">
    <import resource="ignite-base-config.xml"/>

    <bean id="grid.cfg" class="org.apache.ignite.configuration.IgniteConfiguration" parent="base-ignite.cfg">
		<property name="binaryConfiguration">
			<ref bean="binaryConfiguration"/>
		</property>
		<property name="discoverySpi">
				<bean class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
					<property name="ipFinder">
						<bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
							<property name="addresses">
								<list>
									<value>10.0.0.2:47500..47509</value>
									<value>10.0.0.3:47500..47509</value>
									<value>10.0.0.4:47500..47509</value>
								 </list>
							</property>
						</bean>
					</property>
				</bean>
		</property>
		<property name="communicationSpi">
				<bean class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi">
					<!--Default: 47100-->
					<!--property name="localPort" value="47100"/-->
				</bean>
		</property>
		<property name="dataStorageConfiguration">
				<ref bean="dataStorageConfiguration"/>
		</property>
	</bean>

    <bean id="binaryConfiguration" class="org.apache.ignite.configuration.BinaryConfiguration">
        <property name="compactFooter" value="True"/>
    </bean>

    <bean id="dataRegionConfiguration" class="org.apache.ignite.configuration.DataRegionConfiguration">
        <property name="name" value="dpl_mem_plc"/>
        <!-- Sets persistence enabled flag. -->
        <property name="persistenceEnabled" value="true"/>
        <property name="maxSize" value="#{4L * 1024 * 1024 * 1024}"/>
    </bean>

    <bean id="dataStorageConfiguration" class="org.apache.ignite.configuration.DataStorageConfiguration">
        <property name="defaultDataRegionConfiguration">
            <ref bean="dataRegionConfiguration"/>
        </property>
        <!-- Sets property that defines behavior of wal fsync. -->
        <property name="walMode" value="LOG_ONLY"/>
        <property name="pageSize" value="#{4 * 1024}"/>

        <!-- Sets a total number of checkpoints to keep in the WAL history. -->
        <property name="walHistorySize" value="2147483647"/>
        <!-- Sets size of a WAL segment. -->
        <property name="walSegmentSize" value="#{1024*1024*1024}"/>
        <property name="storagePath" value="/mnt/ssd/persistence"/>
        <property name="walPath" value="/mnt/ssd/wal"/>
    </bean>
</beans>

Issue Links

• links to: GitHub Pull Request #9319