[ARROW-9227] [Python][Dataset] Write a custom field to _metadata caching file size

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.17.1
• Component/s: Python
• External issue URL: https://github.com/apache/arrow/issues/17242
• Assignee: Unassigned
• Reporter: Ben Kietzman
• Created: 25/Jun/20 16:08
• Updated: 11/Jan/23 08:05

Description

https://github.com/apache/arrow/pull/7547#discussion_r445663612

This will save unecessary HEAD requests when using S3