Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10914

Splittable DoFn and Dataflow, "conflicting bucketing functions"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • runner-dataflow
    • None

    Description

      When creating a pipeline with an SDF like:
      FileIO.match -> readMatches -> drive the upstream side input
      OR
      [unbounded watcher, sdf] -> [ParDo with side input from File.IO] -> [bounded sdf] -> [ParDo]

      Workflow failed. Causes: Step s22 has conflicting bucketing functions

      Attached to this bug is a repro supplied by the user (TsPointsStreamingFail.java)

      Source for reported issue:
      https://lists.apache.org/thread.html/r03c77ea03d7ff2678052bde412da19c4e13050652fd34d3e03a9e30f%40%3Cuser.beam.apache.org%3E

      Attachments

        1. TsPointsStreamingFail.java
          10 kB
          Luke Cwik

        Activity

          People

            Unassigned Unassigned
            lcwik Luke Cwik
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: