Public signup for this instance is disabled. Go to our Self serve sign up page to request an account. Report potential security issues privately

  1. Sub-task SPARK-18477
    Enable interrupts for HDFS in HDFSMetadataLog
  2. Sub-task SPARK-18474
    Add StreamingQuery.status in python
  3. Sub-task SPARK-18461
    Improve docs on StreamingQueryListener and StreamingQuery.status
  4. Sub-task SPARK-18460
    Include triggerDetails in StreamingQueryStatus.json
  5. Sub-task SPARK-18459
    Rename triggerId to batchId in StreamingQueryStatus.triggerDetails
  6. Sub-task SPARK-18440
    Fix FileStreamSink with aggregation + watermark + append mode
  7. Sub-task SPARK-18416
    State Store leaks temporary files
  8. Sub-task SPARK-18164
    ForeachSink should fail the Spark job if `process` throws exception
  9. Sub-task SPARK-18143
    History Server is broken because of the refactoring work in Structured Streaming
  10. Sub-task SPARK-17926
    Add methods to convert StreamingQueryStatus to json
  11. Sub-task SPARK-17731
    Metrics for Structured Streaming
  12. Sub-task SPARK-17372
    Running a file stream on a directory with partitioned subdirs throw NotSerializableException/StackOverflowError
  13. Sub-task SPARK-17096
    Fix StreamingQueryListener to return message and stacktrace of actual exception
  14. Sub-task SPARK-16430
    Add an option in file stream source to read 1 file at a time
  15. Sub-task SPARK-16266
    Move python DataStreamReader/Writer from pyspark.sql to pyspark.sql.streaming package
  16. Sub-task SPARK-16256
    Add Structured Streaming Programming Guide
  17. Sub-task SPARK-16116
    ConsoleSink should not require checkpointLocation
  18. Sub-task SPARK-16114
    Add network word count example
  19. Sub-task SPARK-16050
    Flaky Test: Complete aggregation with Console sink
  20. Sub-task SPARK-16020
    Fix complete mode aggregation with console sink
  21. Sub-task SPARK-16002
    Sleep when no new data arrives to avoid 100% CPU usage
  22. Sub-task SPARK-15981
    Fix bug in python DataStreamReader
  23. Sub-task SPARK-15953
    Renamed ContinuousQuery to StreamingQuery for simplicity
  24. Sub-task SPARK-15935
    Enable test for sql/streaming.py and fix these tests
  25. Sub-task SPARK-15933
    Refactor reader-writer interface for streaming DFs to use DataStreamReader/Writer
  26. Sub-task SPARK-15889
    Add a unique id to ContinuousQuery
  27. Sub-task SPARK-15853
    HDFSMetadataLog.get leaks the input stream
  28. Sub-task SPARK-15842
    Add support for socket stream.
  29. Sub-task SPARK-15812
    Allow sorting on aggregated streaming dataframe when the output mode is Complete
  30. Sub-task SPARK-15765
    Make continuous Parquet writes consistent with non-continuous Parquet writes
  31. Sub-task SPARK-15593
    Add DataFrameWriter.foreach to allow the user consuming data in ContinuousQuery
  32. Sub-task SPARK-15580
    Add ContinuousQueryInfo to make ContinuousQueryListener events serializable
  33. Sub-task SPARK-15517
    Add support for complete output mode
  34. Sub-task SPARK-15458
    Disable schema inference for streaming datasets on file streams
  35. Sub-task SPARK-15443
    Properly explain the streaming queries
  36. Sub-task SPARK-15428
    Disable support for multiple streaming aggregations
  37. Sub-task SPARK-15375
    Add ConsoleSink for structure streaming to display the dataframe on the fly
  38. Sub-task SPARK-15103
    Add support for batch jobs correctly inferring partitions from data written with file stream sink
  39. Sub-task SPARK-15077
    StreamExecution.awaitOffset may take too long because of thread starvation
  40. Sub-task SPARK-14860
    Fix flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite "event ordering"
  41. Sub-task SPARK-14837
    Add support in file stream source for reading new files added to subdirs
  42. Sub-task SPARK-14833
    Refactor StreamTests to test for source fault-tolerance correctly.
  43. Sub-task SPARK-14832
    Refactor DataSource to ensure schema is inferred only once when creating a file stream
  44. Sub-task SPARK-14716
    Add partitioned parquet support file stream sink
  45. Sub-task SPARK-14678
    Add a file sink log to support versioning and compaction
  46. Sub-task SPARK-14579
    Fix a race condition in StreamExecution.processAllAvailable
  47. Sub-task SPARK-14555
    Python API for methods introduced for Structured Streaming
  48. Sub-task SPARK-14494
    Fix the race conditions in MemoryStream and MemorySink
  49. Sub-task SPARK-14474
    Move FileSource offset log into checkpointLocation
  50. Sub-task SPARK-14473
    Define analysis rules for operations not supported in streaming
Refresh results