[ARROW-16085] [C++][R] InMemoryDataset::ReplaceSchema does not alter scan output

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 7.0.0
• Fix Version/s: 9.0.0
• Component/s: C++, R
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/31498

Language

C++

• Assignee: Will Jones
• Reporter: Will Jones
• Created: 31/Mar/22 20:26
• Updated: 11/Jan/23 11:41
• Resolved: 09/May/22 17:36

Description

 

The following fails:

sub_df1 <- Table$create(
  x = Array$create(c(1, 2, 3)),
  y = Array$create(c("a", "b", "c"))
)
sub_df2 <- Table$create(
  x = Array$create(c(4, 5)),
  z = Array$create(c("d", "e"))
)

ds1 <- InMemoryDataset$create(sub_df1)
ds2 <- InMemoryDataset$create(sub_df2)
ds <- c(ds1, ds2)
actual <- ds %>% collect()

Type error: yielded batch had schema x: double
y: string which did not match InMemorySource's: x: double
y: string
z: string
/Users/willjones/Documents/arrows/arrow-quick/cpp/src/arrow/util/iterator.h:541  child_.Next()
/Users/willjones/Documents/arrows/arrow-quick/cpp/src/arrow/util/iterator.h:152  value_.status()
/Users/willjones/Documents/arrows/arrow-quick/cpp/src/arrow/util/iterator.h:180  maybe_element
/Users/willjones/Documents/arrows/arrow-quick/cpp/src/arrow/dataset/scanner.cc:840  fragments_it.ToVector()

 

Issue Links

• links to: GitHub Pull Request #13088