[YARN-2927] InMemorySCMStore properties are inconsistent

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.7.0
• Labels: newbie supportability
• Hadoop Flags: Reviewed
• Assignee: Ray Chiang
• Reporter: Ray Chiang
• Created: 05/Dec/14 22:07
• Updated: 24/Apr/15 23:17
• Resolved: 08/Dec/14 06:29

Description

I see these properties in the yarn-default.xml file:

yarn.sharedcache.store.in-memory.check-period-mins
yarn.sharedcache.store.in-memory.initial-delay-mins
yarn.sharedcache.store.in-memory.staleness-period-mins

YarnConfiguration looks like it's missing some properties:

public static final String SHARED_CACHE_PREFIX = "yarn.sharedcache.";
public static final String SCM_STORE_PREFIX = SHARED_CACHE_PREFIX + "store.";
public static final String IN_MEMORY_STORE_PREFIX = SHARED_CACHE_PREFIX + "in-memory.";
public static final String IN_MEMORY_STALENESS_PERIOD_MINS = IN_MEMORY_STORE_PREFIX + "staleness-period-mins";

It looks like the definition for IN_MEMORY_STORE_PREFIX should be:

public static final String IN_MEMORY_STORE_PREFIX = SCM_STORE_PREFIX + "in-memory.";

Just to be clear, there are properties that exist in yarn-default.xml that are effectively misspelled in the Java file, not the .xml file. This is similar to YARN-2461 and MAPREDUCE-6087.

Issue Links

• blocks: HADOOP-11399 Java Configuration file and .xml files should be automatically cross-compared