[SPARK-37307] Don't obtain JDBC connection for empty partition

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.1, 3.3.0
• Component/s: Spark Core
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 12/Nov/21 14:48
• Updated: 13/Nov/21 17:21
• Resolved: 13/Nov/21 17:21

Description

In JdbcUtils.scala:savePartition, the code obtains a database connection even when there is no data in the partition. It works correctly and returns it, but, may be advantageous to simply skip that and other overhead if nothing will be written at all.

Issue Links

• links to: [Github] Pull Request #34572 (srowen)