[BEAM-12999] Improve Reshuffle Transform

• Type: Improvement
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: sdk-go, sdk-java-core, sdk-py-core
• Assignee: Unassigned
• Reporter: Ke Wu
• Created: 04/Oct/21 22:56
• Updated: 04/Jun/22 21:49

Description

See discussion https://lists.apache.org/thread.html/r83adaad3a512ad186f2f9dc9dc4bec2a789070677c07cdcaad6fcfa5%40%3Cdev.beam.apache.org%3E 

 

“beam:transform:reshuffle:v1" Transform represents different semantic transforms in different SDKs. The proposal is to replace "beam:transform:reshuffle:v1" with two new urns, one to represent reshuffle KV PCollection using the K, and the other to reshuffle based on random key.

 

Issue Links

• links to: GitHub Pull Request #15665