Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.0.3, 2.1.1, 2.2.0
-
None
Description
YARN tests currently try to override YARN's RackResolver, but that class self-initializes the first time it's called, storing state in static variables and ignoring any further config params that might override the initial behavior.
So we need a better solution for Spark tests, so that tests such as LocalityPlacementStrategySuite don't flood the DNS server with requests (making the test really slow in certain environments).