Uploaded image for project: 'Apache Hop'
  1. Apache Hop
  2. HOP-3126

Beam: re-add support for batching

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.99
    • 0.99
    • API, Beam, Transforms
    • None

    Description

      Support for batching was somehow removed from the Beam runners.

      The idea is that you can set the copies of a transform to BATCH so that records gets batched up following the pipeline run configuration options:

      • Streaming Hop transforms flush interval
      • Hop Streaming transforms buffer size

      Attachments

        Activity

          People

            Unassigned Unassigned
            mcasters Matt Casters
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: