[SPARK-25540] Make HiveContext in PySpark behave as the same as Scala.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 3.0.0
• Component/s: PySpark, SQL
• Assignee: Takuya Ueshin
• Reporter: Takuya Ueshin
• Created: 26/Sep/18 06:32
• Updated: 02/Oct/18 15:51
• Resolved: 27/Sep/18 01:52

Description

In Scala, HiveContext sets a config spark.sql.catalogImplementation of the given SparkContext and then passes to SparkSession.builder.
The HiveContext in PySpark should behave as the same as it in Scala.

Issue Links

• links to: [Github] Pull Request #22552 (ueshin)
• links to: [Github] Pull Request #22552 (ueshin)