Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2, 2.1.0
    • Component/s: Structured Streaming
    • Labels:
      None

      Description

      At any given point in a streaming query execution, we process all available data. This maximizes throughput at the cost of latency. We should add something similar to the maxFilesPerTrigger option available for files.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                cody@koeninger.org Cody Koeninger
                Reporter:
                marmbrus Michael Armbrust
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: