-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Duplicate
-
Affects Version/s: 2.2.2, 2.3.2
-
Fix Version/s: None
-
Component/s: Spark Core
-
Labels:
We're looking into issue when even huge spark driver memory gets eventually exhausted and GC makes driver stop responding.
Used JXRay.com tool and found that most of driver heap is used by
org.apache.spark.status.AppStatusStore -> org.apache.spark.status.ElementTrackingStore -> org.apache.spark.util.kvstore.InMemoryStore
Is there is a way to tune this particular spark driver's memory region down?
- duplicates
-
SPARK-26395 Spark Thrift server memory leak
-
- Resolved
-