[BEAM-6397] Add KeyValue attribute to SyntheticDataPubSubPublisher

• Type: Improvement
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.10.0
• Component/s: testing
• Assignee: Kasia Kucharczyk
• Reporter: Kasia Kucharczyk
• Created: 09/Jan/19 14:28
• Updated: 16/May/20 13:20
• Resolved: 14/Jan/19 16:13

Description

Currently SyntheticDataPubSubPublisher sends only synthetic elements converted to ByteArray to PubSub. To perform KeyValue tranforms (such us GroupByKey) on PubSub source I propose to send generated synthetic data as Map via attributes parameter in PubsubMessage object.

Also it is required to fix NoClassDefFoundError (details in comment).

Issue Links

• is related to: BEAM-6335 GroupByKey uses data insertion pipeline in streaming tests
• is related to: BEAM-6201 Provide a "Data insertion pipeline" for Python suites
• links to: GitHub Pull Request #7449