Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-5540

[Python] pa.lib.tzinfo_to_string(tz) throws ValueError: Unable to convert timezone `tzoffset(None, -14400)` to string

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Python
    • Labels:
      None

      Description

      Overview:

      When trying to save DataFrame to parquet error is thrown while parsing a column with the following properties:

       

      dtype: datetime64[ns, tzoffset(None, -14400)]
      dtype.tz: tzoffset(None, -14400)
      

       

       

      Error:

      ValueError: Unable to convert timezone `tzoffset(None, -14400)` to string

       

      Error stack:

      File "pyarrow/table.pxi", line 1139, in pyarrow.lib.Table.from_pandas
      File "/home/koojav/projects/toptal/teftel/.venv/lib/python3.6/site-packages/pyarrow/pandas_compat.py", line 480, in dataframe_to_arrays
      types)
      File "/home/koojav/projects/toptal/teftel/.venv/lib/python3.6/site-packages/pyarrow/pandas_compat.py", line 209, in construct_metadata
      field_name=sanitized_name)
      File "/home/koojav/projects/toptal/teftel/.venv/lib/python3.6/site-packages/pyarrow/pandas_compat.py", line 153, in get_column_metadata
      string_dtype, extra_metadata = get_extension_dtype_info(column)
      File "/home/koojav/projects/toptal/teftel/.venv/lib/python3.6/site-packages/pyarrow/pandas_compat.py", line 126, in get_extension_dtype_info
      metadata = {'timezone': pa.lib.tzinfo_to_string(dtype.tz)}
      File "pyarrow/types.pxi", line 1149, in pyarrow.lib.tzinfo_to_string
      ValueError: Unable to convert timezone `tzoffset(None, -14400)` to string
      

      Libraries:

      • pandas 0.24.2
      • pyarrow 0.13.0

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Koojav Michał Kujawski
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: