[YARN-4464] Lower the default max applications stored in the RM and store

• Type: Wish
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha2
• Component/s: resourcemanager
• Target Version/s: 3.0.0-alpha2
• Hadoop Flags: Incompatible change
• Release Note: The maximum applications the RM stores in memory and in the state-store by default has been lowered from 10,000 to 1,000. This should ease the pressure on the state-store. However, installations relying on the default to be 10,000 are affected.
• Assignee: Daniel Templeton
• Reporter: KWON BYUNGCHANG
• Created: 16/Dec/15 09:03
• Updated: 12/Oct/16 05:11
• Resolved: 12/Oct/16 04:48

Description

my cluster has 120 nodes.
I configured RM Restart feature.

yarn.resourcemanager.recovery.enabled=true
yarn.resourcemanager.store.class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore
yarn.resourcemanager.fs.state-store.uri=/system/yarn/rmstore

unfortunately I did not configure yarn.resourcemanager.state-store.max-completed-applications.
so that property configured default value 10,000.

I have restarted RM due to changing another configuartion.
I expected that RM restart immediately.

recovery process was very slow. I have waited about 20min.

realize missing yarn.resourcemanager.state-store.max-completed-applications.

its default value is very huge.
need to change lower value or document notice on RM Restart page.