[ARROW-14798] [Python] Limit the size of the repr for large Tables

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.0.0
• Component/s: C++, Python
• Labels: good-first-issue pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30333
• Assignee: Will Jones
• Reporter: Will Jones
• Created: 23/Nov/21 14:23
• Updated: 11/Jan/23 08:42
• Resolved: 24/Feb/22 17:22

Description

The new repr is nice that it shows a preview of the data, but this can also become very long flooding your console output for larger tables.

We already default to 10 preview cols, but each column can still consist of many chunks. So it might be good to also limit it to 2 chunks?

The ChunkedArray.to_string method already has a window keyword, but that seems to control both the number of elements to show per chunk as the number of chunks (while it would be nice to limit eg to 2 chunks but show up to 10 elements for each chunk).

cc amol-

Issue Links

• is a parent of: ARROW-15329 [Python] Add character limit to ChunkedArray repr
• links to: GitHub Pull Request #12091