[ARROW-8630] [C++][Dataset] Pass schema including all materialized fields to catch CSV edge cases

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.17.0
• Fix Version/s: 4.0.0
• Component/s: C++
• Labels: dataset
• External issue URL: https://github.com/apache/arrow/issues/24792
• Assignee: Ben Kietzman
• Reporter: Ben Kietzman
• Created: 29/Apr/20 19:29
• Updated: 11/Jan/23 08:01
• Resolved: 22/Mar/21 16:08

Description

see discussion here https://github.com/apache/arrow/pull/7033#discussion_r416941674

Fields filtered but not projected will revert to their inferred type, whatever their dataset's schema may be. This can cause validated filters to fail due to type disagreements

Issue Links

• is fixed by: ARROW-11174 [C++][Dataset] Make Expressions available for projection