[SPARK-26322] Simplify kafka delegation token sasl.mechanism configuration

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Structured Streaming
• Assignee: Gabor Somogyi
• Reporter: Gabor Somogyi
• Created: 10/Dec/18 13:41
• Updated: 13/Dec/18 00:49
• Resolved: 13/Dec/18 00:46

Description

When Kafka delegation token obtained, SCRAM sasl.mechanism has to be configured for authentication. This can be configured on the related source/sink which is inconvenient from user perspective. Such granularity is not required and this configuration can be implemented with one central parameter.

Kafka now supports 2 SCRAM related sasl.mechanism:

• SCRAM-SHA-256
• SCRAM-SHA-512

and these are configured on brokers, which makes this configuration global.

Issue Links

• links to: [Github] Pull Request #23274 (gaborgsomogyi)
• links to: GitHub Pull Request #23274