Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25075 Build and test Spark against Scala 2.13
  3. SPARK-30010

Remove deprecated SparkConf.setAll(Traversable)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.1.0
    • Component/s: Spark Core
    • Labels:
    • Target Version/s:
    • Docs Text:
      The deprecated method SparkConf.setAll(Traversable) has been removed in Spark 3.1. Use SparkConf.setAll(Iterable) instead.

      Description

      SparkConf has the following overloads, which were also driven by Scala version compatibility:

        /** Set multiple parameters together */
        def setAll(settings: Iterable[(String, String)]): SparkConf = {
          settings.foreach { case (k, v) => set(k, v) }
          this
        }
      
        /**
         * Set multiple parameters together
         */
        @deprecated("Use setAll(Iterable) instead", "3.0.0")
        def setAll(settings: Traversable[(String, String)]): SparkConf = {
          settings.foreach { case (k, v) => set(k, v) }
          this
        }
      

      However this becomes ambiguous in Scala 2.13. We'll just have to remove the second one.

        Attachments

          Activity

            People

            • Assignee:
              srowen Sean R. Owen
              Reporter:
              srowen Sean R. Owen
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: