[SPARK-49423] Consolidate Observation into a single class in sql/api

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect, SQL
• Labels: pull-request-available

Environment

Not sure if we should do this. Connect and Classic have different semantics, so unification is a bit tricky.

• Epic Link: Unified SQL Scala Interface
• Assignee: Herman van Hövell
• Reporter: Herman van Hövell
• Created: 28/Aug/24 01:37
• Updated: 30/Aug/24 12:01
• Resolved: 30/Aug/24 12:01

Description

Move the implementation specific bits out of the class, and only keep the Observation class. While we are at it, let's also replace the homegrown threading stuff by futures.

Issue Links

• links to: GitHub Pull Request #47921