[NIFI-11553] Add Batch Configuration and Record handling for GCP PubSub processors

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0-M1, 1.23.0
• Assignee: Paul Grey
• Reporter: Paul Grey
• Created: 16/May/23 00:01
• Updated: 15/Nov/24 17:50
• Resolved: 13/Jun/23 16:10

Description

(1) Allow specification of endpoint via:
https://cloud.google.com/java/docs/reference/google-cloud-pubsub/latest/com.google.cloud.pubsub.v1.Publisher.Builder#com_google_cloud_pubsub_v1_Publisher_Builder_setEndpoint_java_lang_String_

(2) Allow uniform configurability of batch settings via:
https://cloud.google.com/java/docs/reference/gax/latest/com.google.api.gax.batching.BatchingSettings.Builder

Implement in the context of AbstractGCPubSubProcessor if possible, such that all implementing processors are able to leverage this configurability.

Issue Links

• is related to: NIFI-11439 Add Storage API URL to GCS Processors
• relates to: NIFI-8657 Add additional properties to GCP Pubsub to set a custom endpoint/port
• relates to: NIFI-10448 PublishGCPubSub: not writing fast enough
• relates to: NIFI-11981 PublishGCPubSub failure on usage of Record-based processing
• links to: GitHub Pull Request #7274