Description
- Configured with fair-share-scheduler.
- 4-5 users submitting/running jobs concurrently via spark-thrift-server
- Spark thrift server spikes to1600+% CPU and stays there for long time
Attachments
Attachments
Issue Links
- relates to
-
SPARK-17036 Hadoop config caching could lead to memory pressure and high CPU usage in thrift server
- Resolved
- links to