-
Type:
Bug
-
Status: Resolved
-
Priority:
P2
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 2.14.0
-
Component/s: runner-flink, runner-spark
-
Labels:None
Both the flink and the spark runners attempt to override the Reshuffle transform via the urn - e.g. https://github.com/apache/beam/blob/master/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchTransformTranslators.java#L114 .
Unfortunately there's no TransformPayloadTranslatorRegistrar for Reshuffle. This means the call to urnForTransformOrNull will always return null for a Reshuffle so they are never translated.
- links to