[SPARK-48849] Create OperatorStateMetadataV2 for the TransformWithStateExec operator

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Structured Streaming
• Labels: pull-request-available
• Epic Link: Structured Streaming - Arbitrary State API v2
• Assignee: Eric Marnadi
• Reporter: Eric Marnadi
• Created: 09/Jul/24 17:45
• Updated: 25/Jul/24 12:42
• Resolved: 25/Jul/24 12:42

Description

Introducing the OperatorStateMetadataV2 for State Metadata integration with the TransformWithStateExec operator to enforce validation for new runs

Issue Links

• links to: GitHub Pull Request #47273
• links to: GitHub Pull Request #47445