[ARROW-17089] [Python] Use `.arrow` as extension for IPC file dataset

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 8.0.0
• Fix Version/s: 10.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/32395
• Assignee: SHIMA Tatsuya
• Reporter: SHIMA Tatsuya
• Created: 15/Jul/22 15:52
• Updated: 11/Jan/23 11:48
• Resolved: 31/Aug/22 05:14

Description

Same as ARROW-17088

As noted in the following document, the recommended extension for IPC files is now `.arrow`.

> We recommend the “.arrow” extension for files created with this format.
https://arrow.apache.org/docs/format/Columnar.html#ipc-file-format

However, currently when writing a dataset with the pyarrow.dataset.write_dataset function, the default extension is .feather when arrow or ipc or feather is selected.
https://github.com/apache/arrow/blob/b8067151db9bfc04860285fdd8b5e73703346037/python/pyarrow/_dataset.pyx#L1149-L1151

Issue Links

• relates to: ARROW-17088 [R] Use `.arrow` as extension of IPC files of datasets
• relates to: ARROW-17092 [Docs] Add note about "Feather" to the IPC file format document
• links to: GitHub Pull Request #13677