[BEAM-3281] PTransform name not being propagated to the Flink Web UI

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Duplicate
• Affects Version/s: 2.1.0
• Fix Version/s: 2.5.0
• Component/s: runner-flink
• Labels: flink
• Assignee: Aljoscha Krettek
• Reporter: Thalita Vergilio
• Created: 02/Dec/17 18:55
• Updated: 16/May/20 13:22
• Resolved: 15/Mar/18 14:32

Description

This could be related to BEAM-1107, which was logged for Flink Batch processing.

I am experiencing a similar issue for stream processing. I would have expected the name passed to

pipeline.apply(String name, PTransform<? super PBegin,OutputT> root)

to be propagated to the Flink Web UI.

The documentation seems to suggest that this was the intended functionality:
https://beam.apache.org/documentation/sdks/javadoc/2.0.0/org/apache/beam/sdk/Pipeline.html#apply-java.lang.String-org.apache.beam.sdk.transforms.PTransform-

Here is some sample code setting the name:

p.apply("Apply Windowing Function", Window.into(FixedWindows.of(Duration.standardSeconds(10))))
                .apply("Transform the Pipeline to Key by Window",
                        ParDo.of(
                                new DoFn<KafkaRecord<byte[], byte[]>, KV<IntervalWindow, KafkaRecord<byte[], byte[]>>>() {
                                    @ProcessElement
                                    public void processElement(ProcessContext context, IntervalWindow window) {
                                        context.output(KV.of(window, context.element()));
                                    }
                                }))
                .apply("Group by Key (window)", GroupByKey.create())
                .apply("Calculate PUE", ParDo.of(new PueCalculatorFn()))
                .apply("Write output to Kafka", KafkaIO.<IntervalWindowResult, PueResult>write()
                        .withBootstrapServers(KAFKA_IP + ":" + KAFKA_PORT)
                        .withTopic("results")
                        .withKeySerializer(IntervalWindowResultSerialiser.class)
                        .withValueSerializer(PueResultSerialiser.class)
                );

I will upload a screenshot of the results.

Issue Links

• duplicates: BEAM-1107 Display user names for steps in the Flink Web UI
• relates to: BEAM-3043 Set user-specified Transform names on Flink operations