[BEAM-12627] Spark Structured Streaming runner: Migrate spark Encoders Beam wrappers to spark 3

• Type: Sub-task
• Status: Triage Needed
• Priority: P2
• Resolution: Done
• Fix Version/s: Missing
• Component/s: runner-spark
• Labels: structured-streaming
• Assignee: Etienne Chauchot
• Reporter: Etienne Chauchot
• Created: 16/Jul/21 13:15
• Updated: 22/Nov/24 15:31
• Resolved: 05/Aug/21 10:09

Description

Some low level spark APIs used in the spark structured streaming runner (Encoders part) have changed so we need a spark 3 version