[SPARK-40432] Introduce GroupStateImpl and GroupStateTimeout in PySpark

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Structured Streaming
• Assignee: Jungtaek Lim
• Reporter: Jungtaek Lim
• Created: 15/Sep/22 02:04
• Updated: 15/Sep/22 20:31
• Resolved: 15/Sep/22 20:31

Description

Introduces GroupStateImpl and GroupStateTimeout in PySpark, and updates Scala codebase to support convenient conversion between PySpark implementation and Scala implementation.

Issue Links

• is related to: SPARK-40437 Support string representation of durationMs in GroupState.setTimeoutDuration
• is related to: SPARK-40438 Support additionalDuration parameter in GroupState.setTimeoutTimestamp
• links to: [Github] Pull Request #37889 (HeartSaVioR)
• links to: [Github] Pull Request #37889 (HeartSaVioR)