[SPARK-4601] Call site of jobs generated by streaming incorrect in Spark UI

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0, 1.3.0
• Component/s: DStreams
• Target Version/s: 1.2.0
• Assignee: Tathagata Das
• Reporter: Tathagata Das
• Created: 25/Nov/14 12:55
• Updated: 25/Nov/14 14:55
• Resolved: 25/Nov/14 14:55

Description

When running the NetworkWordCount, the description of the word count jobs are set as "getCallsite at DStream:xxx" . This should be set to the line number of the streaming application that has the output operation that led to the job being created. This is because the callsite is incorrectly set in the thread launching the jobs.

Issue Links

• links to: [Github] Pull Request #3455 (tdas)