Details
-
Wish
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
-
None
Description
As discussed with some people in the team, it would be great to add schema support in PCollections. It will allow us:
1. To expect some data type in PTransforms
2. Improve some runners with additional features (I'm thinking about Spark runner with data frames for instance).
A technical draft document has been created:
I also started a PoC on a branch, I will update this Jira with a "discussion" PR.
Attachments
Issue Links
- links to