[ARROW-9346] [C++][Python][Dataset] Add total_byte_size metadata to RowGroupInfo

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: C++, Python
• Labels: dataset dataset-dask-integration pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/25430
• Assignee: Joris Van den Bossche
• Reporter: Joris Van den Bossche
• Created: 07/Jul/20 09:17
• Updated: 11/Jan/23 08:06
• Resolved: 09/Jul/20 20:23

Description

See https://github.com/apache/arrow/pull/7546#issuecomment-651177576.

The row group information in Parquet's FileMetadata includes a "total_byte_size" field. It would be useful to expose this information on the RowGroupInfo object, similarly as we already expose "num_rows".

cc rjzamora

Issue Links

• links to: GitHub Pull Request #7690