[SPARK-42896] Make `mapInPandas` / mapInArrow` support barrier mode execution

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Pandas API on Spark, PySpark, SQL
• Assignee: Weichen Xu
• Reporter: Weichen Xu
• Created: 22/Mar/23 12:04
• Updated: 28/Mar/23 03:34
• Resolved: 27/Mar/23 01:42

Description

Make `mapInPandas` / mapInArrow` support barrier mode execution

Issue Links

• links to: [Github] Pull Request #40520 (WeichenXu123)
• links to: [Github] Pull Request #40571 (HyukjinKwon)