[SPARK-47272] MapState Implementation for State V2

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Structured Streaming
• Labels: pull-request-available
• Epic Link: Structured Streaming - Arbitrary State API v2
• Assignee: Jing Zhan
• Reporter: Jing Zhan
• Created: 04/Mar/24 20:03
• Updated: 12/Mar/24 22:18
• Resolved: 12/Mar/24 22:18

Description

This task adds changes for MapState implementation in State Api v2. This implementation adds a new encoder/decoder to encode grouping key and user key into a composite key to be put into RocksDB so that we could retrieve key-value pair by user specified user key by one rocksdb get.

Issue Links

• links to: GitHub Pull Request #45341