Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18791 Stream-Stream Joins
  3. SPARK-22136

Implement stream-stream outer joins in append mode

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: Structured Streaming
    • Labels:
      None

      Description

      Followup to inner join subtask. We can implement outer joins by generating null rows when old state gets cleaned up, given that the join has watermarks allowing that cleanup to happen.

        Attachments

          Activity

            People

            • Assignee:
              joseph.torres Jose Torres
              Reporter:
              joseph.torres Jose Torres
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: