[ARROW-12011] [C++][Python] Crashes and incorrect results when converting large integers to dates

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 6.0.0, 5.0.1
• Component/s: C++, Python
• Labels: pull-request-available
• Environment: OS: Windows 10 Pro (Version 20H2) ; CPU: AMD Ryzen 5 1600 Six-Core Processor 3.20 GHz ; Python: 3.8.8 AMD64 ; pyarrow is latest version installed with pip
• External issue URL: https://github.com/apache/arrow/issues/27842
• Assignee: Antoine Pitrou
• Reporter: Tim Evans
• Created: 18/Mar/21 01:44
• Updated: 11/Jan/23 08:23
• Resolved: 01/Sep/21 14:40

Description

Running this code snippet will cause a crash. This happens for a range of numbers around this one as well:

 

import pyarrow
date = pyarrow.array([-1448879500], pyarrow.date32())
print(date)

I don't know where this crash is coming from, so it might be in the C++ code rather than the Python bindings.

For other extreme numbers you get the wrong result. It looks like something is overflowing. Here is the input and result for a few different examples:

• -2000000000 -> 31179-12-27
• -1000000000 -> 16574-12-29
• 2000000000 -> -27240-01-06
• 1000000000 -> -12635-01-03

I would prefer if these gave errors rather than silently overflowing.

 

Issue Links

• relates to: ARROW-13738 [C++] Audit uses of datetime formatting
• relates to: ARROW-10924 [C++] Validate temporal data in ValidateArrayFull
• links to: GitHub Pull Request #10988