[ARROW-17425] [R] `lubridate::as_datetime()` in dplyr query should be able to handle time in sub seconds

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 9.0.0
• Fix Version/s: 11.0.0
• Component/s: R
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/32694
• Assignee: SHIMA Tatsuya
• Reporter: SHIMA Tatsuya
• Created: 15/Aug/22 18:01
• Updated: 11/Jan/23 11:50
• Resolved: 11/Jan/23 11:48

Description

Since the current unit is fixed to "s", an error will occur if a time containing sub-seconds is given.

"1970-01-01T00:00:59.123456789" |>
  arrow::arrow_table(x = _) |>
  dplyr::mutate(x = lubridate::as_datetime(x, tz = "UTC")) |>
  dplyr::collect()
#> Error in `dplyr::collect()`:
#> ! Invalid: Failed to parse string: '1970-01-01T00:00:59.123456789' as a scalar of type timestamp[s]

I thought that nanoseconds should be used, but it should be noted that POSIXct is currently supposed to be converted to microseconds, as shown in ARROW-17424.
 
 
 

 

Issue Links

• relates to: ARROW-15599 [R] Convert a column as a sub-second timestamp from CSV file with the `T` col type option
• relates to: ARROW-17424 [R] Microsecond is not sufficient unit for POSIXct
• links to: GitHub Pull Request #13890