[ARROW-6325] [Python] wrong conversion of DataFrame with boolean values

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.1
• Fix Version/s: 0.15.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/16858
• Assignee: Joris Van den Bossche
• Reporter: Joris Van den Bossche
• Created: 22/Aug/19 18:11
• Updated: 11/Jan/23 07:46
• Resolved: 23/Aug/19 23:26

Description

From https://github.com/pandas-dev/pandas/issues/28090

In [19]: df = pd.DataFrame(np.ones((3, 2), dtype=bool), columns=['a', 'b']) 

In [20]: df  
Out[20]: 
      a     b
0  True  True
1  True  True
2  True  True

In [21]: table = pa.table(df) 

In [23]: table.column(0)
Out[23]: 
<pyarrow.lib.ChunkedArray object at 0x7fd08a96e090>
[
  [
    true,
    false,
    false,
  ]
]

The resulting table has False values while the original DataFrame had only true values.
It seems this has to do with the fact that it are multiple columns, as with a single column it converts correctly.

Issue Links

• duplicates: ARROW-6395 [Python] Bug when using bool arrays with stride greater than 1
• duplicates: ARROW-7112 Wrong contents when initializinga pyarrow.Table from boolean DataFrame
• links to: GitHub Pull Request #5176