Description
In SPARK-21255, spark upstream adds support for creating encoders for java enum types, but the support is only added to Java API(for enum working within Java Beans). Since the java enum can come from third-party java library, we have use case that requires
1. using java enum types as field of scala case class
2. using java enum as the type T in Dataset[T]
Spark ExpressionEncoder already supports ser/de many java types in ScalaReflection, so we propose to add support for java enum as well, as a follow up of SPARK-21255.
Attachments
Issue Links
- is duplicated by
-
SPARK-31453 Error while converting JavaRDD to Dataframe
- Resolved
- is related to
-
SPARK-21255 NPE when creating encoder for enum
- Resolved
- links to