[SPARK-48056] [CONNECT][PYTHON] Session not found error should automatically retry during reattach

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.3
• Fix Version/s: 4.0.0
• Component/s: Connect, PySpark
• Labels: pull-request-available
• Assignee: Niranjan Jayakar
• Reporter: Niranjan Jayakar
• Created: 30/Apr/24 05:03
• Updated: 14/Jun/24 08:31
• Resolved: 02/May/24 12:20

Description

When an OPERATION_NOT_FOUND error is raised and no prior responses were received, the client retries the ExecutePlan RPC: https://github.com/apache/spark/blob/e6217c111fbdd73f202400494c42091e93d3041f/python/pyspark/sql/connect/client/reattach.py#L257

 

Another error SESSION_NOT_FOUND should follow the same logic.

Issue Links

• links to: GitHub Pull Request #46297
• links to: GitHub Pull Request #46377
• links to: GitHub Pull Request #46971