[FLINK-23495] [GCP PubSub] Make checkpoint optional for preview/staging mode

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.13.0, 1.13.1
• Component/s: Connectors / Google Cloud PubSub
• Labels: auto-deprioritized-major auto-deprioritized-minor pull-request-available
• Assignee: Unassigned
• Reporter: Brachi Packter
• Created: 26/Jul/21 08:31
• Updated: 14/Jul/22 10:40

Description

I'm using PubSub connector with Flink sql.

The issue that I get all the time error that PubSub required checkpoints, My question is if I/you can submit a PR that adds a property that can configure PubSub to start without checkpoints, and we can describe that it is just for preview/staging mode (interactive sql, Jupiter..)
Other connectors support starting without checkpoints.

What will be the impact for this change? I tried it locally and it seems to work ok. 

That is the code that always fail the source if no checkpoint is configured, i want to add some condition here:

if (hasNoCheckpointingEnabled(getRuntimeContext())) { 
throw new IllegalArgumentException( "The PubSubSource REQUIRES Checkpointing to be enabled and " + "the checkpointing frequency must be MUCH lower than the PubSub timeout for it to retry a message."); 
}
 

Issue Links

• links to: GitHub Pull Request #16596