[ARROW-11991] [Rust][DataFusion] Maintain partition information in Union

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Component/s: Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27822
• Assignee: Unassigned
• Reporter: Daniël Heres
• Created: 16/Mar/21 21:35
• Updated: 11/Jan/23 08:23
• Resolved: 26/Apr/21 13:32

Description

Currently it returns Partitioning::UnknownPartitioning(num_partitions) based on the sum of partition counts (if available) of the underlying inputs. In case of another partition scheme - such as hash partitioning, it would be better to keep that information available, so other optimizations could be used.

Issue Links

• links to: GitHub Pull Request #9806