[SPARK-30133] Support DELETE Jar and DELETE File functionality in spark

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.1.0
• Component/s: SQL
• Labels: Umbrella
• Assignee: Unassigned
• Reporter: Sandeep Katta
• Created: 05/Dec/19 06:10
• Updated: 28/Apr/20 16:57
• Resolved: 28/Apr/20 16:57

Description

SPARK should support delete jar feature

This feature aims at solving below use case.

Currently in spark add jar API supports to add the jar to executor and Driver ClassPath at runtime, if there is any change in this jar definition there is no way user can update the jar to executor and Driver classPath. User needs to restart the application to solve this problem which is costly operation.

After this JIRA fix user can use delete jar API to remove the jar from Driver and Executor ClassPath without the need of restarting the any spark application.