[ARROW-15150] [Doc] Add guidance on partitioning datasets

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: Documentation
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30656
• Assignee: Will Jones
• Reporter: Will Jones
• Created: 17/Dec/21 19:28
• Updated: 11/Jan/23 08:44
• Resolved: 17/Dec/21 19:30

Description

We get a fair number of questions that stem from people unknowingly creating too many files or too many row groups. We should add some basic advice to help users understand the consequences of over-partitioning.

Issue Links

• links to: GitHub Pull Request #11970