Uploaded image for project: 'Spark'
  1. Spark

Structured Streaming

Summary

Description

Spark Streaming with DataFrames, Datasets and SQL

Issues: Unresolved

Key Summary Due Date
New Feature SPARK-10815 Public API: Streaming Sources and Sinks
Improvement SPARK-17937 Clarify Kafka offset semantics for Structured Streaming
Bug SPARK-19690 Join a streaming DataFrame with a batch DataFrame may not work

View Issues

Issues: Updated recently

Key Summary Updated
Bug SPARK-17689 _temporary files breaks the Spark SQL streaming job.
Question SPARK-21249 Is it possible to use File Sink with mapGroupsWithState in Structured Streaming?
Bug SPARK-21248 Flaky test: o.a.s.sql.kafka010.KafkaSourceSuite.assign from specific offsets (failOnDataLoss: true)

View Issues

Versions: Unreleased

Name Release date
Unreleased 0.8.2  
Unreleased 0.9.3  
Unreleased 1.0.3  
Unreleased 1.1.2  
Unreleased 1.2.3  
Unreleased 1.3.2  
Unreleased 1.4.2  
Unreleased 1.5.3  
Unreleased 1.6.4  
Unreleased 2.0.3  
Unreleased 2.1.2  
Unreleased 2.2.0  
Unreleased 2.2.1  
Unreleased 2.3.0  
Unreleased 3.0.0  

...and 10 more

Show first 5 only