[BEAM-11384] Improve StreamingDataflow worker to avoid escaping the processing key and including with generated json logs

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.27.0
• Component/s: runner-dataflow
• Assignee: Sam Whittle
• Reporter: Sam Whittle
• Created: 02/Dec/20 19:40
• Updated: 17/Dec/20 10:26
• Resolved: 17/Dec/20 10:26

Description

As keys can be large escaping the key could be expensive and including it in all the json of logs made during processing is possibly expensive.
Additionally the sharding key is more useful to correlate with other logging and status pages within dataflow.

Issue Links

• links to: GitHub Pull Request #13459