Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
support int64 UNIX timestamps with a particular resolution.
Parquet supports timestamp millis and micros (no nanos)
https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#datetime-types
currently Arrow timestamps have a timezone field.
https://github.com/apache/arrow/blob/master/format/Message.fbs#L67
proposal to change timestamp as follows:
- remove "timestamp" field and say it's UTC
- add unit field (MICROS | MILLIS)