Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10914

Splittable DoFn and Dataflow, "conflicting bucketing functions"

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: P3
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: runner-dataflow
    • Labels:
      None

      Description

      When creating a pipeline with an SDF like:
      FileIO.match -> readMatches -> drive the upstream side input
      OR
      [unbounded watcher, sdf] -> [ParDo with side input from File.IO] -> [bounded sdf] -> [ParDo]

      Workflow failed. Causes: Step s22 has conflicting bucketing functions

      Attached to this bug is a repro supplied by the user (TsPointsStreamingFail.java)

      Source for reported issue:
      https://lists.apache.org/thread.html/r03c77ea03d7ff2678052bde412da19c4e13050652fd34d3e03a9e30f%40%3Cuser.beam.apache.org%3E

        Attachments

        1. TsPointsStreamingFail.java
          10 kB
          Luke Cwik

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lcwik Luke Cwik
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: