Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25821

Remove SQLContext methods deprecated as of Spark 1.4

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 3.0.0
    • Component/s: SQL
    • Labels:
    • Target Version/s:

      Description

      There are several SQLContext methods that have been deprecate since Spark 1.4, like:

      @deprecated("Use read.parquet() instead.", "1.4.0")
      @scala.annotation.varargs
      def parquetFile(paths: String*): DataFrame = {
        if (paths.isEmpty) {
          emptyDataFrame
        } else {
          read.parquet(paths : _*)
        }
      }

      Let's remove them in Spark 3.

        Attachments

          Activity

            People

            • Assignee:
              srowen Sean Owen
              Reporter:
              srowen Sean Owen
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: