Umbrella ticket to track what's needed to make streaming DataFrame a reality.
Complete output mode does not output updated aggregated value in Structured Streaming
Add streaming support for Spark SQL module
Dataset API on top of Catalyst/DataFrame
Structured Streaming Programming Abstraction, Semantics, and APIs - Google Docs version