[SPARK-34431] Only load hive-site.xml once

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.0.2, 3.1.1
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 13/Feb/21 11:06
• Updated: 15/Feb/21 17:33
• Resolved: 15/Feb/21 17:33

Description

Hive configs from hive-site.xml are parsed over and over again. We can optimize this, and parse it only once.

Issue Links

• relates to: SPARK-34346 io.file.buffer.size set by spark.buffer.size will override by hive-site.xml may cause perf regression
• links to: [Github] Pull Request #31556 (MaxGekk)