[ARROW-8285] [Python][Dataset] ScalarExpression doesn't accept numpy scalars

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/24479
• Assignee: Alenka Frim
• Reporter: Uwe Korn
• Created: 31/Mar/20 12:59
• Updated: 11/Jan/23 07:59
• Resolved: 27/Oct/21 09:38

Description

pyarrow.dataset.ScalarExpression doesn't accept numpy scalars. This would be useful as values coming out of pandas or numpy are such.

Example:

import pyarrow.dataset as ds
import numpy as np

ds.ScalarExpression(np.int64(2))

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-18-805083da7827> in <module>
----> 1 ds.ScalarExpression(np.int64(2))

~/miniconda3/envs/kartothek/lib/python3.7/site-packages/pyarrow/_dataset.pyx in pyarrow._dataset.ScalarExpression.__init__()

TypeError: Not yet supported scalar value: 2 

Issue Links

• links to: GitHub Pull Request #11545