[ARROW-14989] [R] Update num_rows methods to output doubles not integers to prevent integer overflow

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 9.0.0
• Component/s: R
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30510
• Assignee: Nicola Crane
• Reporter: Nicola Crane
• Created: 06/Dec/21 11:26
• Updated: 11/Jan/23 08:43
• Resolved: 04/Jul/22 18:47

Description

In cases where Arrow objects are particularly large, this can result in an integer overflow when returning their size. See discussion on https://github.com/apache/arrow/pull/11783 for more details of a possible solution.

library(arrow)
test_array1 <- Array$create(raw(2^31 - 1))
test_array2 <- Array$create(raw(1))
big_chunked <- chunked_array(test_array1, test_array2)

big_table <- Table$create(col = big_chunked)
big_table$num_rows
# NA

Issue Links

• links to: GitHub Pull Request #13482