Description
In SPARK-3971, we copied SerDe code from Core to MLlib in order to recognize MLlib types on executors as a hotfix. This is not ideal. We should find a way to add hooks to the SerDe in Core to support MLlib types in a pluggable way.
Attachments
Issue Links
- relates to
-
SPARK-3971 Failed to deserialize Vector in cluster mode
- Resolved