Whether the shared cache is enabled
yarn.sharedcache.enabled
false
The root directory for the shared cache
yarn.sharedcache.root-dir
/sharedcache
The level of nested directories before getting to the checksum
directories. It must be non-negative.
yarn.sharedcache.nested-level
3
The implementation to be used for the SCM store
yarn.sharedcache.store.class
org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
The implementation to be used for the SCM app-checker
yarn.sharedcache.app-checker.class
org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker
A resource in the in-memory store is considered stale
if the time since the last reference exceeds the staleness period.
This value is specified in minutes.
yarn.sharedcache.store.in-memory.staleness-period-mins
10080
Initial delay before the in-memory store runs its first check
to remove dead initial applications. Specified in minutes.
yarn.sharedcache.store.in-memory.initial-delay-mins
10
The frequency at which the in-memory store checks to remove
dead initial applications. Specified in minutes.
yarn.sharedcache.store.in-memory.check-period-mins
720
The address of the admin interface in the SCM (shared cache manager)
yarn.sharedcache.admin.address
0.0.0.0:8047
The number of threads used to handle SCM admin interface (1 by default)
yarn.sharedcache.admin.thread-count
1
The address of the web application in the SCM (shared cache manager)
yarn.sharedcache.webapp.address
0.0.0.0:8788
The frequency at which a cleaner task runs.
Specified in minutes.
yarn.sharedcache.cleaner.period-mins
1440
Initial delay before the first cleaner task is scheduled.
Specified in minutes.
yarn.sharedcache.cleaner.initial-delay-mins
10
The time to sleep between processing each shared cache
resource. Specified in milliseconds.
yarn.sharedcache.cleaner.resource-sleep-ms
0
The address of the node manager interface in the SCM
(shared cache manager)
yarn.sharedcache.uploader.server.address
0.0.0.0:8046
The number of threads used to handle shared cache manager
requests from the node manager (50 by default)
yarn.sharedcache.uploader.server.thread-count
50
The address of the client interface in the SCM
(shared cache manager)
yarn.sharedcache.client-server.address
0.0.0.0:8045
The number of threads used to handle shared cache manager
requests from clients (50 by default)
yarn.sharedcache.client-server.thread-count
50
The algorithm used to compute checksums of files (SHA-256 by
default)
yarn.sharedcache.checksum.algo.impl
org.apache.hadoop.yarn.sharedcache.ChecksumSHA256Impl
The replication factor for the node manager uploader for the
shared cache (10 by default)
yarn.sharedcache.nm.uploader.replication.factor
10
The number of threads used to upload files from a node manager
instance (20 by default)
yarn.sharedcache.nm.uploader.thread-count
20