[ARROW-16113] [Python] Partitioning.dictionaries in case of a subset of fields are dictionary encoded

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.0.0
• Component/s: Python
• Labels: dataset pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/31523
• Assignee: Sanjiban Sengupta
• Reporter: Joris Van den Bossche
• Created: 04/Apr/22 15:44
• Updated: 11/Jan/23 11:41
• Resolved: 05/Apr/22 08:18

Description

Follow-up on ARROW-14612, see the discussion at https://github.com/apache/arrow/pull/12530#discussion_r841760449

ARROW-14612 changes the return value of the dictionaries attribute from None to a list in case some of the partitioning schema fields are not dictionary encoded.

But this can result in a non-clear mapping between arrays in Partitioning.dictionaries and fields in Partitioning.schema

Issue Links

• is related to: ARROW-14612 [C++] Support for filename-based partitioning
• links to: GitHub Pull Request #12791