[SPARK-30010] Remove deprecated SparkConf.setAll(Traversable)

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0
• Component/s: Spark Core
• Labels: release-notes
• Target Version/s: 3.1.0
• Docs Text: The deprecated method SparkConf.setAll(Traversable) has been removed in Spark 3.1. Use SparkConf.setAll(Iterable) instead.
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 24/Nov/19 22:02
• Updated: 09/Nov/20 16:40
• Resolved: 11/Jul/20 21:34

Description

SparkConf has the following overloads, which were also driven by Scala version compatibility:

  /** Set multiple parameters together */
  def setAll(settings: Iterable[(String, String)]): SparkConf = {
    settings.foreach { case (k, v) => set(k, v) }
    this
  }

  /**
   * Set multiple parameters together
   */
  @deprecated("Use setAll(Iterable) instead", "3.0.0")
  def setAll(settings: Traversable[(String, String)]): SparkConf = {
    settings.foreach { case (k, v) => set(k, v) }
    this
  }

However this becomes ambiguous in Scala 2.13. We'll just have to remove the second one.

Issue Links

• links to: [Github] Pull Request #28971 (srowen)
• links to: GitHub Pull Request #27308