[SPARK-46075] Refactor SparkConnectSessionManager to not use guava cache

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect
• Labels: pull-request-available
• Epic Link: connect-query-lifecycle
• Assignee: Juliusz Sompolski
• Reporter: Juliusz Sompolski
• Created: 23/Nov/23 18:26
• Updated: 12/Dec/23 17:41
• Resolved: 12/Dec/23 17:41

Description

Guava cache gives limited control over session eviction. For example, there can't be more complex policies of session eviction. Refactor it to be more similar to SparkConnectExecutionManager. 

Issue Links

• links to: GitHub Pull Request #43985