[SPARK-23484] Fix possible race condition in KafkaContinuousReader

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Structured Streaming
• Target Version/s: 2.3.0
• Assignee: Tathagata Das
• Reporter: Tathagata Das
• Created: 21/Feb/18 22:14
• Updated: 13/Jul/18 05:29
• Resolved: 21/Feb/18 22:56

Description

var `KafkaContinuousReader.knownPartitions` should be threadsafe as it is accessed from multiple threads - the query thread at the time of reader factory creation, and the epoch tracking thread at the time of `needsReconfiguration`.

Issue Links

• links to: [Github] Pull Request #20655 (tdas)