[ARROW-13650] [C++] Create dataset writer to encapsulate dataset writer logic

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.0.0
• Component/s: C++
• Labels: pull-request-available query-engine
• External issue URL: https://github.com/apache/arrow/issues/29288
• Assignee: Weston Pace
• Reporter: Weston Pace
• Created: 18/Aug/21 04:13
• Updated: 11/Jan/23 08:34
• Resolved: 04/Oct/21 21:07

Description

The current dataset writing logic is insufficient (ARROW-12321, ARROW-13590, ARROW-10439, ARROW-12803). This PR moves the logic into a dedicated file and addresses the issues, mainly adding back pressure and size limits.

Issue Links

• links to: GitHub Pull Request #10955