[ARROW-11450] [Python] pyarrow<3 incompatible with numpy>=1.20.0

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 3.0.0
• Environment: python>=3.7 ; Debian 5.7 x86_64
• External issue URL: https://github.com/apache/arrow/issues/27335
• Assignee: Unassigned
• Reporter: Jongbin Park
• Created: 01/Feb/21 02:01
• Updated: 11/Jan/23 08:19
• Resolved: 01/Feb/21 08:28

Description

pyarrow 1.0 and 2.0 is not compatible with numpy 1.20.0

Running the following command would fail:

pa.array(np.arange(10))

with error

pyarrow.lib.ArrowTypeError: Did not pass numpy.dtype object

Numpy release note [link] mentions about the np.dtype related compatibility breaks. Also there is a C API change, which implies numpy dependency constraints should be tighter (whether <=1.20 or >1.20) depending on the compiled numpy version (if pyarrow is depending on it; I'm not aware of the pyarrow internal).

Issue Links

• duplicates: ARROW-10833 [Python] Avoid usage of NumPy's PyArray_DescrCheck macro
• is duplicated by: ARROW-11487 [Python] Can't create array from Categorical with numpy 1.20
• supercedes: ARROW-11458 PyArrow 1.x and 2.x do not work with numpy 1.20