[ARROW-2838] [Python] Speed up null testing with Pandas semantics

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.10.0
• Component/s: C++, Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/19214
• Assignee: Antoine Pitrou
• Reporter: Antoine Pitrou
• Created: 12/Jul/18 17:23
• Updated: 11/Jan/23 07:23
• Resolved: 13/Jul/18 14:29

Description

The PandasObjectIsNull helper function can be a significant contributor when converting a Pandas dataframe to Arrow format (e.g. when writing a dataframe to feather format). We can try to speed up the type checks in that function.

Issue Links

• is related to: ARROW-2059 [Python] Possible performance regression in Feather read/write path
• links to: GitHub Pull Request #2258