[SPARK-49458] ReattachExecute does not supply server-side session id

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect
• Labels: pull-request-available
• Assignee: Changgyoo Park
• Reporter: Changgyoo Park
• Created: 29/Aug/24 08:27
• Updated: 05/Sep/24 04:48
• Resolved: 05/Sep/24 04:48

Description

Related to SPARK-47380.

 

One example.

Driver restart -> session re created -> OPERATION_NOT_FOUND instead of SESSION_NOT_FOUND because the first attempt to reattach a session does not contain the last time observed server side session id.

E.g.,

Start execution (client_observed_server_side_session_id is set) -> driver restart -> reattach (client_observed_server_side_session_id is not set) -> OPERATION_NOT_FOUND instead of SESSION_NOT_FOUND.

Issue Links

• links to: GitHub Pull Request #47930