[SPARK-39611] PySpark support numpy 1.23.X

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.2.2, 3.3.1, 3.4.0
• Component/s: Build
• Assignee: Yikun Jiang
• Reporter: Yikun Jiang
• Created: 27/Jun/22 02:09
• Updated: 12/Dec/22 18:11
• Resolved: 05/Jul/22 11:53

Description

======================================================================
ERROR [2.102s]: test_arithmetic_op_exceptions (pyspark.pandas.tests.test_series_datetime.SeriesDateTimeTest) 
----------------------------------------------------------------------
Traceback (most recent call last):
File "/__w/spark/spark/python/pyspark/pandas/tests/test_series_datetime.py", line 99, in test_arithmetic_op_exceptions self.assertRaisesRegex(TypeError, expected_err_msg, lambda: other / psser) File "/usr/lib/python3.9/unittest/case.py", line 1276, in assertRaisesRegex return context.handle('assertRaisesRegex', args, kwargs)
File "/usr/lib/python3.9/unittest/case.py", line 201, in handle callable_obj(*args, **kwargs)
File "/__w/spark/spark/python/pyspark/pandas/tests/test_series_datetime.py", line 99, in <lambda> self.assertRaisesRegex(TypeError, expected_err_msg, lambda: other / psser)
File "/__w/spark/spark/python/pyspark/pandas/base.py", line 465, in __array_ufunc__ 
raise NotImplementedError(NotImplementedError: pandas-on-Spark objects currently do not support <ufunc 'divide'>.
----------------------------------------------------------------------

 

 

Issue Links

• links to: [Github] Pull Request #37078 (Yikun)
• links to: [Github] Pull Request #37078 (Yikun)