[SPARK-28922] Safe Kafka parameter redaction

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Structured Streaming
• Assignee: Gabor Somogyi
• Reporter: Gabor Somogyi
• Created: 30/Aug/19 02:14
• Updated: 30/Aug/19 09:21
• Resolved: 30/Aug/19 02:18

Description

At the moment Kafka parameter reduction is expecting SparkEnv. This must exist in normal queries but several unit tests are not providing it to make things simple. As an end-result such tests are throwing similar exception:

Issue Links

• links to: GitHub Pull Request #25621