Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-315

Finalize timestamp type

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.1.0
    • Format
    • None

    Description

      support int64 UNIX timestamps with a particular resolution.

      Parquet supports timestamp millis and micros (no nanos)
      https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#datetime-types

      currently Arrow timestamps have a timezone field.
      https://github.com/apache/arrow/blob/master/format/Message.fbs#L67
      proposal to change timestamp as follows:

      • remove "timestamp" field and say it's UTC
      • add unit field (MICROS | MILLIS)

      Attachments

        Issue Links

          Activity

            People

              julienledem Julien Le Dem
              julienledem Julien Le Dem
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: