Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
3.4.0
-
None
-
None
Description
In https://github.com/apache/spark/blob/master/connector/connect/src/main/scala/org/apache/spark/sql/connect/planner/DataTypeProtoConverter.scala#L34 we only support INT, STRING and STRUCT type conversion to and from catalyst and connect proto.
We should be able to support all the types defined by https://github.com/apache/spark/blob/master/connector/connect/src/main/protobuf/spark/connect/types.proto
Attachments
Issue Links
- is duplicated by
-
SPARK-41238 Support more datatypes
- Resolved