Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
7.0.0
Description
In ARROW-14908 we solved the case of joining a dataset to an in memory table, but did not solve joining two datasets.
The previous solution was to add +1 to the thread count, because the hash join logic might be called by the scanner's IO thread. For joining more than 1 dataset, we might have more than 1 IO thread, so we either need to add a larger arbitrary number or find a way to make the state logic more resilient to unexpected threads.
Attachments
Issue Links
- is related to
-
ARROW-14908 [R] join on dataset crashes on Windows
- Resolved
- links to