[SPARK-43233] Before batch reading from Kafka, log topic partition, offset range, etc, for debuggin

• Type: Task
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.5.0
• Component/s: Structured Streaming
• Assignee: Siying Dong
• Reporter: Siying Dong
• Created: 21/Apr/23 21:28
• Updated: 25/Apr/23 00:36
• Resolved: 25/Apr/23 00:36

Description

When debugging some slowness issue in structured streaming, it is hard to map a Kafka topic and partition to a Kafka task. Adding some logging in executor might help make it easier.