[SPARK-26615] Fixing transport server/client resource leaks in the core unittests

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0, 3.0.0
• Fix Version/s: 2.4.1, 3.0.0
• Component/s: Spark Core
• Assignee: Attila Zsolt Piros
• Reporter: Attila Zsolt Piros
• Created: 14/Jan/19 15:58
• Updated: 16/Jan/19 15:03
• Resolved: 16/Jan/19 15:01

Description

The testing of SPARK-24938 PR (https://github.com/apache/spark/pull/22114) always fails with OOM. Analysing this problem lead to identifying some resource leaks where TransportClient/TransportServer instances are nor closed properly.

Issue Links

• links to: GitHub Pull Request #23540