[SPARK-38661] [TESTS] Replace 'abc & Symbol("abc") symbols with $"abc" in tests

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.1
• Fix Version/s: 3.4.0
• Component/s: Tests
• Assignee: Martin Tzvetanov Grigorov
• Reporter: Martin Tzvetanov Grigorov
• Created: 25/Mar/22 20:01
• Updated: 02/Apr/22 16:43
• Resolved: 02/Apr/22 16:43

Description

This ticket is a follow up of SPARK-38351.

 

When building with Scala 2.13 many test classes produce warnings like:

[warn] /home/runner/work/spark/spark/sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala:562:11: [deprecation @  | origin= | version=2.13.0] symbol literal is deprecated; use Symbol("d") instead
[warn]           'd.cast("string"),
[warn]           ^
[warn] /home/runner/work/spark/spark/sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala:563:11: [deprecation @  | origin= | version=2.13.0] symbol literal is deprecated; use Symbol("e") instead
[warn]           'e.cast("string")).collect())
 

For easier migration to Scala 3.x later it would be good to fix this warnings!

 

Also as suggested by https://github.com/HeartSaVioR it would be good to use Spark's $"abc" syntax for columns.

Issue Links

• is a clone of: SPARK-38351 [TESTS] Replace 'abc symbols with Symbol("abc") in tests
• links to: [Github] Pull Request #35976 (martin-g)