[ARROW-15827] [R] Improve UX of write_dataset(..., max_rows_per_group)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.0.0
• Component/s: R
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/31268
• Assignee: Jacob Wujciak
• Reporter: Nicola Crane
• Created: 02/Mar/22 12:19
• Updated: 11/Jan/23 11:39
• Resolved: 06/Apr/22 13:20

Description

When using write_dataset(), if we set max_rows_per_file without also setting max_rows_per_group, we always get the error shown below.

library(arrow)
td <- tempfile()
dir.create(td)
write_dataset(mtcars, td, max_rows_per_file = 5L)
#> Error: Invalid: max_rows_per_group must be less than or equal to max_rows_per_file

We should change the behaviour so we can specify one without having to also specify the other.

Issue Links

• links to: GitHub Pull Request #12799