[SPARK-46586] Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: BingKun Pan
• Reporter: Yang Jie
• Created: 04/Jan/24 03:08
• Updated: 12/Jan/24 08:28
• Resolved: 05/Jan/24 04:09

Description

val myUdf = udf((a: immutable.ArraySeq[Int]) =>
    immutable.ArraySeq.unsafeWrapArray[Int](Array(a.head + 99)))
  checkAnswer(Seq(Array(1))
    .toDF("col")
    .select(myUdf(Column("col"))),
    Row(ArrayBuffer(100))) 

will test failed in Spark 4.0 when using Scala 2.13

Issue Links

• links to: GitHub Pull Request #44591
• links to: GitHub Pull Request #44702