[BEAM-1630] Add Splittable DoFn to Python SDK

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Component/s: sdk-py-core
• Assignee: Chamikara Madhusanka Jayalath
• Reporter: Chamikara Madhusanka Jayalath
• Created: 06/Mar/17 18:12
• Updated: 16/May/20 13:39
• Resolved: 30/Jan/18 00:15

Description

Splittable DoFn [1] is currently being implemented for Java SDK [2]. We should add this to Python SDK as well.

Following document proposes an API for this.

https://docs.google.com/document/d/1h_zprJrOilivK2xfvl4L42vaX4DMYGfH1YDmi-s_ozM/edit?usp=sharing

[1] https://s.apache.org/splittable-do-fn
[2] https://lists.apache.org/thread.html/0ce61ac162460a149d5c93cdface37cc383f8030fe86ca09e5699b18@%3Cdev.beam.apache.org%3E

Issue Links

• links to: GitHub Pull Request #3333
• links to: GitHub Pull Request #3882
• links to: GitHub Pull Request #4064
• links to: GitHub Pull Request #4064
• links to: GitHub Pull Request #4342