[ARROW-11682] [R] Regression from 2.0.0 -> 3.0.0: Null character in string prevents dataset from loading

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Information Provided
• Affects Version/s: 3.0.0
• External issue URL: https://github.com/apache/arrow/issues/27545
• Assignee: Neal Richardson
• Reporter: Kyle Kavanagh
• Created: 18/Feb/21 01:28
• Updated: 11/Jan/23 08:21
• Resolved: 18/Feb/21 02:35

Description

When a feather file contains a valid string which happens to contain the appearance of a null character, R fails to read the file.  Example string: '#\001200\01'

Pyarrow is able to successfully read the file and correctly display the string.

This dataset was previously able to be loaded in 2.0.0 but fails in 3.0.0 with the error:
Error in Table__to_dataframe(x, use_threads = option_use_threads()) :
embedded nul in string: '#\001200\01'

Issue Links

• relates to: ARROW-6582 [R] Arrow to R fails with embedded nuls in strings
• relates to: ARROW-11478 [R] Consider ways to make arrow.skip_nul option more user-friendly