[SPARK-45051] Connect: Use UUIDv7 for operation IDs to make operations chronologically sortable

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 3.5.1
• Component/s: Connect
• Labels: Connect

Language

Python Scala

• Assignee: Unassigned
• Reporter: Robert Dillitz
• Created: 01/Sep/23 12:26
• Updated: 05/Sep/23 17:39
• Resolved: 05/Sep/23 17:39

Description

Spark Connect currently uses UUIDv4 for operation IDs. Using UUIDv7 instead allows us to sort operations by ID to receive a chronological order while keeping the collision-free properties we require from this ID.