[BEAM-3000] No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?

• Type: Improvement
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: sdk-py-core
• Labels: ccoss2019 starter
• Assignee: Unassigned
• Reporter: Rodrigo Benenson
• Created: 28/Sep/17 01:42
• Updated: 03/Jun/22 19:17

Description

Java's org.apache.beam.sdk.transforms.Sample.any will return a PCollection with bounded size (filtering strategy).
The closest python eqiuvalent is beam.Sample.FixedSizeGlobally whover, this version uses a combiner strategy, returning a list with n elements; which does not scale if n is "bigger than what fits in memory".