[SPARK-25821] Remove SQLContext methods deprecated as of Spark 1.4

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Labels: release-notes
• Target Version/s: 3.0.0
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 24/Oct/18 16:45
• Updated: 09/Mar/20 04:26
• Resolved: 26/Oct/18 21:50

Description

There are several SQLContext methods that have been deprecate since Spark 1.4, like:

@deprecated("Use read.parquet() instead.", "1.4.0")
@scala.annotation.varargs
def parquetFile(paths: String*): DataFrame = {
  if (paths.isEmpty) {
    emptyDataFrame
  } else {
    read.parquet(paths : _*)
  }
}

Let's remove them in Spark 3.

Issue Links

• causes: SPARK-31086 Add Back the Deprecated SQLContext methods
• links to: [Github] Pull Request #22815 (srowen)
• links to: [Github] Pull Request #22815 (srowen)
• links to: GitHub Pull Request #27839