[BEAM-12080] Writing a bounded source to PubsubLiteIO using DirectRunner does not exit

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: 2.28.0
• Fix Version/s: 2.34.0
• Component/s: extensions-java-gcp, runner-direct
• Labels: PubsubLiteIO java
• Assignee: Unassigned
• Reporter: Tianzi Cai
• Created: 31/Mar/21 22:01
• Updated: 30/Nov/21 00:01
• Resolved: 30/Nov/21 00:01

Description

Writing a bounded source (with a single message) to Pub/Sub Lite using `PubsubLiteIO` via `DirectRunner` succeeds, but the pipeline does not exit after the work is completed.

When using `DataflowRunner`, the job stops and shuts down cleanly.

import com.google.cloud.pubsublite.Message;
import org.apache.beam.sdk.io.gcp.pubsublite.PubsubLiteIO;
// ...
Message message =
    Message.builder()
        .setData(ByteString.copyFromUtf8("Hello world from Dataflow!"))
        .setEventTime(fromMillis(System.currentTimeMillis()))
        .build();

pipeline
    .apply(Create.of(message.toProto()))
    .apply("Write to Pub/Sub Lite", PubsubLiteIO.write(publisherOptions));