[SPARK-45783] Improve exception message when no remote url is set

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0, 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect, PySpark
• Labels: pull-request-available
• Assignee: Allison Wang
• Reporter: Allison Wang
• Created: 03/Nov/23 22:33
• Updated: 13/Nov/23 12:17
• Resolved: 13/Nov/23 12:17

Description

When "SPARK_CONNECT_MODE_ENABLED" but no spark remote url is set, PySpark currently throws this exception:

AttributeError: 'NoneType' object has no attribute 'startswith'

We should improve this.

Issue Links

• links to: GitHub Pull Request #43653