Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
1.1.0
-
None
Description
Documents about running-on-YARN needs update
There are some parameters missing in the document about running-on-YARN page.
We need to add the descriptions about the following parameters:
- spark.yarn.report.interval
- spark.yarn.queue
- spark.yarn.user.classpath.first
- spark.yarn.scheduler.reporterThread.maxFailures
And the description about this default parameter is not strictly accurate:
- spark.yarn.submit.file.replication