Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1943

parquet-tools cat command does not consider logical type

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 1.11.1
    • Fix Version/s: None
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      The parquet-tools cat command doesn't format timestamps, outputting them as numbers instead.  The parquet-tools dump command does format as timestamps, so the code has been written.

      Using the attached file:

      $ java jar parquet-tools<VERSION>.jar cat -j datetime_utc_adjust.parquet

      {"ID":1,"DT":1604297946277}

       

      $ java jar parquet-tools<VERSION>.jar dump datetime_utc_adjust.parquet

      ...

      INT32 ID
      --------------------------------------------------------------------------------

          • row group 1 of 1, values 1 to 1 ***
            value 1: R:0 D:1 V:1INT64 DT
            --------------------------------------------------------------------------------
          • row group 1 of 1, values 1 to 1 ***
            value 1: R:0 D:1 V:2020-11-02T06:19:06.277

       

        Attachments

        1. datetime_utc_adjust.parquet
          0.5 kB
          john lilley

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              john.lilley@redpoint.net john lilley
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: