[SPARK-28185] Trigger pandas iterator UDF closing stuff when iterator stop early

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.3
• Fix Version/s: 3.0.0
• Component/s: ML, SQL
• Assignee: Weichen Xu
• Reporter: Weichen Xu
• Created: 27/Jun/19 13:13
• Updated: 12/Dec/22 18:11
• Resolved: 28/Jun/19 08:10

Description

Fix the issue Pandas UDF closing stuff won't be triggered when iterator stop early.

 

Issue Links

• links to: GitHub Pull Request #24986