[BEAM-13080] Specify numBuckets in Python Reshuffle

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.35.0
• Component/s: sdk-py-core
• Assignee: Unassigned
• Reporter: Inigo San Jose Visiers
• Created: 19/Oct/21 17:33
• Updated: 12/Jan/22 10:50
• Resolved: 12/Jan/22 10:50

Description

While Java has `withNumBuckets` to set the amount of generated keys, Python doesn't.

This is particularly need when your input data is not so high and you need to take advantage for DoFn methods `start / finish bundle`.

https://beam.apache.org/releases/javadoc/2.33.0/org/apache/beam/sdk/transforms/Reshuffle.ViaRandomKey.html#withNumBuckets-java.lang.Integer-

Issue Links

• links to: GitHub Pull Request #15753
• links to: GitHub Pull Request #15912