Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1007

Broadcast streams incompatible with GroupBySystemStreamPartitionFactory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.10.0, 0.10.1
    • 0.11.0
    • None
    • None

    Description

      Jobs using broadcast streams in combination with GroupBySystemStreamPartitionFactory do not assign broadcast inputs to any tasks.

      E.g. with the following config extract, the task consuming input-topic would not consume broadcast-input-topic.

      job.systemstreampartition.grouper.factory=org.apache.samza.container.grouper.stream.GroupBySystemStreamPartitionFactory
      task.broadcast.inputs=kafka.broadcast-input-topic#0
      task.inputs=kafka.input-topic
      

      Attachments

        1. SAMZA-1007-1.patch
          4 kB
          Neil Fordyce
        2. SAMZA-1007-0.patch
          2 kB
          Neil Fordyce

        Activity

          People

            neilfordyce Neil Fordyce
            neilfordyce Neil Fordyce
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: