[SPARK-32452] Bump up the minimum Arrow version as 1.0.0 in SparkR

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: SparkR
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 27/Jul/20 02:18
• Updated: 12/Dec/22 18:10
• Resolved: 27/Jul/20 05:21

Description

R rather aggressively encourages people to use the latest version, and SparkR vectorization is very experimental that was added from Spark 3.0.

It should be good if we can minimise the maintenance overhead and keep the minimal version up to date.

Issue Links

• is related to: SPARK-32543 Remove arrow::as_tibble usage in SparkR
• links to: [Github] Pull Request #29253 (HyukjinKwon)