[SPARK-38805] Remove an expired indexFilePath from the ESS shuffleIndexCache or the PBS indexCache to save memory.

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0, 3.1.1, 3.1.2, 3.2.0, 3.2.1
• Component/s: Shuffle
• Assignee: Unassigned
• Reporter: weixiuli
• Created: 06/Apr/22 11:55
• Updated: 16/Apr/22 20:02

Description

Support to automatically remove an expired indexFilePath from the ESS shuffleIndexCache or the PBS indexCache to save memory.

Issue Links

• links to: [Github] Pull Request #36088 (weixiuli)
• links to: [Github] Pull Request #36088 (weixiuli)