[SPARK-22733] refactor StreamExecution for extensibility

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Structured Streaming
• Assignee: Jose Torres
• Reporter: Jose Torres
• Created: 07/Dec/17 23:44
• Updated: 14/Dec/17 22:31
• Resolved: 14/Dec/17 22:31

Description

StreamExecution currently mixes together meta-logic (tracking and signalling progress, persistence, reporting) with the core behavior of generating batches and running them. We want to reuse the former but not the latter in continuous execution, so we need to split them up.

Issue Links

• links to: [Github] Pull Request #19926 (joseph-torres)