[SPARK-24480] Add a config to register custom StreamingQueryListeners

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.4.0
• Component/s: Structured Streaming
• Assignee: Unassigned
• Reporter: Arun Mahadevan
• Created: 07/Jun/18 01:07
• Updated: 12/Dec/22 18:10
• Resolved: 07/Jun/18 01:16

Description

Currently a "StreamingQueryListener" can only be registered programatically. We could have a new config "spark.sql.streamingQueryListeners" similar to  "spark.sql.queryExecutionListeners" and "spark.extraListeners" for users to register custom streaming listeners.

Issue Links

• duplicates: SPARK-24479 Register StreamingQueryListener in Spark Conf
• links to: [Github] Pull Request #21504 (arunmahadevan)