Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Hide
      TIMESTAMP data type
      New primitive data type that supports traditional UNIX timestamp with optional nanosecond precision.

      Supported conversions:
      Integer numeric types: Interpreted as UNIX timestamp in seconds
      Floating point numeric types: Intepreted as UNIX timestamp in seconds with decimal precision
      Strings: JDBC compliant java.sql.Timestamp format "YYYY-MM-DD HH:MM:SS.fffffffff" (9 decimal place precision)

      Timestamps are interpreted to be timezoneless and stored as an offset from the UNIX epoch. Convenience UDFs for conversion to and from timezones are provided (to_utc_timestamp, from_utc_timestamp).
      All existing datetime UDFs (month, day, year, hour, etc.) will work with the TIMESTAMP data type.

      Supported SerDes:
      ColumnarSerDe
      LazyBinaryColumnarSerDe
      LazySimpleSerDe
      LazyBinarySerDe
      BinarySortableSerDe
      Show
      TIMESTAMP data type New primitive data type that supports traditional UNIX timestamp with optional nanosecond precision. Supported conversions: Integer numeric types: Interpreted as UNIX timestamp in seconds Floating point numeric types: Intepreted as UNIX timestamp in seconds with decimal precision Strings: JDBC compliant java.sql.Timestamp format "YYYY-MM-DD HH:MM:SS.fffffffff" (9 decimal place precision) Timestamps are interpreted to be timezoneless and stored as an offset from the UNIX epoch. Convenience UDFs for conversion to and from timezones are provided (to_utc_timestamp, from_utc_timestamp). All existing datetime UDFs (month, day, year, hour, etc.) will work with the TIMESTAMP data type. Supported SerDes: ColumnarSerDe LazyBinaryColumnarSerDe LazySimpleSerDe LazyBinarySerDe BinarySortableSerDe

      Description

      Add TIMESTAMP type to serde2 that supports unix timestamp (1970-01-01 00:00:01 UTC to 2038-01-19 03:14:07 UTC) with optional nanosecond precision using both LazyBinary and LazySimple SerDes.
      For LazySimpleSerDe, the data is stored in jdbc compliant java.sql.Timestamp parsable strings.

      1. hive-2272.9.patch
        236 kB
        Franklin Hu
      2. hive-2272.8.patch
        235 kB
        Franklin Hu
      3. hive-2272.7.patch
        230 kB
        Franklin Hu
      4. hive-2272.6.patch
        211 kB
        Franklin Hu
      5. hive-2272.5.patch
        212 kB
        Franklin Hu
      6. hive-2272.4.patch
        212 kB
        Franklin Hu
      7. hive-2272.3.patch
        210 kB
        Franklin Hu
      8. hive-2272.2.patch
        199 kB
        Franklin Hu
      9. hive-2272.11.patch
        230 kB
        Franklin Hu
      10. hive-2272.10.patch
        233 kB
        Franklin Hu
      11. hive-2272.1.patch
        198 kB
        Franklin Hu

        Issue Links

          Activity

          Carl Steinbach made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Siying Dong made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Franklin Hu made changes -
          Attachment hive-2272.11.patch [ 12490056 ]
          Franklin Hu made changes -
          Attachment hive-2272.10.patch [ 12489718 ]
          Franklin Hu made changes -
          Release Note TIMESTAMP data type
          New primitive data type that supports traditional UNIX timestamp with optional nanosecond precision.

          Supported conversions:
          Integer numeric types: Interpreted as UNIX timestamp in seconds
          Floating point numeric types: Intepreted as UNIX timestamp in seconds with decimal precision
          Strings: JDBC compliant java.sql.Timestamp format "YYYY-MM-DD HH:MM:SS.fffffffff" (9 decimal place precision)

          Timestamps are interpreted to be timezoneless and stored as an offset from the UNIX epoch. Convenience UDFs for conversion to and from timezones are provided (to_utc_timestamp, from_utc_timestamp).
          All existing datetime UDFs (month, day, year, hour, etc.) will work with the TIMESTAMP data type.

          Supported SerDes:
          ColumnarSerDe
          LazyBinaryColumnarSerDe
          LazySimpleSerDe
          LazyBinarySerDe
          BinarySortableSerDe
          Franklin Hu made changes -
          Attachment hive-2272.9.patch [ 12489098 ]
          Franklin Hu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.8.0 [ 12316178 ]
          Franklin Hu made changes -
          Attachment hive-2272.8.patch [ 12488151 ]
          Franklin Hu made changes -
          Attachment hive-2272.7.patch [ 12488052 ]
          Franklin Hu made changes -
          Attachment hive-2272.6.patch [ 12487884 ]
          Franklin Hu made changes -
          Attachment hive-2272.5.patch [ 12487062 ]
          Franklin Hu made changes -
          Attachment hive-2272.4.patch [ 12486540 ]
          Franklin Hu made changes -
          Link This issue is part of HIVE-1269 [ HIVE-1269 ]
          Franklin Hu made changes -
          Attachment hive-2272.3.patch [ 12486146 ]
          Franklin Hu made changes -
          Attachment hive-2272.2.patch [ 12485660 ]
          Franklin Hu made changes -
          Field Original Value New Value
          Attachment hive-2272.1.patch [ 12485634 ]
          Franklin Hu created issue -

            People

            • Assignee:
              Franklin Hu
              Reporter:
              Franklin Hu
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development