[ARROW-1998] [Python] Table.from_pandas crashes when data frame is empty

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.9.0
• Component/s: Python
• Labels: pull-request-available
• Environment: Windows 10 Build 15063.850 ; Python: 3.6.3 ; Numpy: 1.14.0 ; Pandas: 0.22.0
• External issue URL: https://github.com/apache/arrow/issues/17981
• Assignee: Antoine Pitrou
• Reporter: Victor Jimenez
• Created: 15/Jan/18 22:46
• Updated: 11/Jan/23 07:18
• Resolved: 12/Feb/18 23:00

Description

Loading an empty CSV file, and then attempting to create a PyArrow Table from it makes the application crash. The following code should be able to reproduce the issue:

import numpy as np
import pandas as pd
import pyarrow as pa

FIELDS = ['id', 'name']
NUMPY_TYPES = {
    'id': np.int64,
    'name': np.unicode
}
PYARROW_SCHEMA = pa.schema([
    pa.field('id', pa.int64()),
    pa.field('name', pa.string())
])

file = open('input.csv', 'w')
file.close()

df = pd.read_csv(
    'input.csv',
    header=None,
    names=FIELDS,
    dtype=NUMPY_TYPES,
    engine='c',
)

pa.Table.from_pandas(df, schema=PYARROW_SCHEMA)

Issue Links

• links to: GitHub Pull Request #1594