[SPARK-26922] Set socket timeout consistently in Arrow optimization

• Type: Sub-task
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SparkR
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 19/Feb/19 03:33
• Updated: 12/Dec/22 18:10
• Resolved: 05/Mar/19 23:59

Description

For instance, see

https://github.com/apache/spark/blob/e8982ca7ad94e98d907babf2d6f1068b7cd064c6/R/pkg/R/context.R#L184

it should set the timeout from SPARKR_BACKEND_CONNECTION_TIMEOUT. Or maybe we need another environment variable.

This might be able to be fixed together when some codes around there is touched.

Issue Links

• links to: GitHub Pull Request #23971