[SPARK-32897] SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.1, 3.1.0
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: PySpark
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 16/Sep/20 03:14
• Updated: 12/Dec/22 17:51
• Resolved: 16/Sep/20 17:16

Description

In PySpark shell:

import warnings
from pyspark.sql import SparkSession, SQLContext
warnings.simplefilter('always', DeprecationWarning)
spark.stop()
SparkSession.builder.getOrCreate()

shows a deprecation warning from SQLContext

/.../spark/python/pyspark/sql/context.py:72: DeprecationWarning: Deprecated in 3.0.0. Use SparkSession.builder.getOrCreate() instead.
  DeprecationWarning)

Issue Links

• links to: [Github] Pull Request #29768 (HyukjinKwon)