[BEAM-7577] Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

• Type: New Feature
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: 2.13.0
• Fix Version/s: 2.16.0
• Component/s: io-py-gcp
• Assignee: EDjur
• Reporter: EDjur
• Created: 17/Jun/19 14:58
• Updated: 16/May/20 13:16
• Resolved: 30/Oct/19 20:27

Description

The current implementation of ReadFromDatastore does not support specifying the query parameter at runtime. This could potentially be fixed through the usage of a ValueProvider to specify and build the Datastore query.

Allowing specifying the query at runtime makes it easier to use dynamic queries in Dataflow templates. Currently, there is no way to have a Dataflow template that includes a dynamic query (such as filtering by a timestamp or similar).

Issue Links

• links to: GitHub Pull Request #8950