[SPARK-25547] Pluggable jdbc connection factory

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.3.1
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Frank Sauer
• Created: 26/Sep/18 21:12
• Updated: 14/Oct/20 12:59
• Resolved: 14/Oct/20 12:58

Description

The ability to provide a custom connectionFactoryProvider via JDBCOptions so that JdbcUtils.createConnectionFactory can produce a custom connection factory would be very useful. In our case we needed to have the ability to load balance connections to an AWS Aurora Postgres cluster by round-robining through the endpoints of the read replicas since their own loan balancing was insufficient. We got away with it by copying most of the spark jdbc package and provide this feature there and changing the format from jdbc to our new package. However it would be nice  if this were supported out of the box via a new option in JDBCOptions providing the classname for a ConnectionFactoryProvider. I'm creating this Jira in order to submit a PR which I have ready to go.

Issue Links

• duplicates: SPARK-32001 Create Kerberos authentication provider API in JDBC connector
• links to: [Github] Pull Request #22560 (fsauer65)
• links to: GitHub Pull Request #22560