Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
None
-
None
Description
Currently we convert columns irrespectively of their timezone directly to timestamps in Arrow. While in Pandas you are able to specify timezones, in Arrow we have the assumptions that a Timestamp is always the time of the specified unit since 00:00:00.000 on 1 January 1970, UTC. Thus we have to check if df['column‘].tz is set and convert if necessary to UTC before converting to an Arrow column.