Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2555

[Python] Provide an option to convert on coerce_timestamps instead of error

    Details

      Description

      At the moment, we error out on coerce_timestamps='ms' on pyarrow.parquet.write_table if the data contains a timestamp that would loose information when converted to milliseconds. In a lot of cases the user does not care about this granularity and rather wants the comfort functionality that the timestamp are stored regardlessly in Parquet. Thus we should provide an option to ignore the error and do the lossy conversion.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                econlon Eric Conlon
                Reporter:
                xhochy Uwe L. Korn
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 10m
                  3h 10m