[SPARK-20165] Resolve state encoder's deserializer in driver in FlatMapGroupsWithStateExec

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: Structured Streaming
• Target Version/s: 2.2.0
• Assignee: Tathagata Das
• Reporter: Tathagata Das
• Created: 30/Mar/17 23:30
• Updated: 31/Mar/17 17:55
• Resolved: 31/Mar/17 17:55

Description

Encoder's deserializer must be resolved at the driver where the class is defined. Otherwise there are corner cases using nested classes where resolving at the executor can fail.

Issue Links

• links to: [Github] Pull Request #17488 (tdas)