Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2, 2.1.0
    • Component/s: Structured Streaming
    • Labels:
      None

      Description

      At any given point in a streaming query execution, we process all available data. This maximizes throughput at the cost of latency. We should add something similar to the maxFilesPerTrigger option available for files.

        Attachments

          Activity

            People

            • Assignee:
              cody@koeninger.org Cody Koeninger
              Reporter:
              marmbrus Michael Armbrust
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: