Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
We want to expose a Table.join and Dataset.join functionalities in PyArrow which can leverage our join feature from the ExecPlan to expose.
The Table.join can easily return a new Table, questions about what Dataset.join might return are more complex as it probably doesn't make much sense to return a new Dataset given that the result won't map to any files on disk