Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2272

add TIMESTAMP data type

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • None
    • None
    • Hide
      TIMESTAMP data type
      New primitive data type that supports traditional UNIX timestamp with optional nanosecond precision.

      Supported conversions:
      Integer numeric types: Interpreted as UNIX timestamp in seconds
      Floating point numeric types: Intepreted as UNIX timestamp in seconds with decimal precision
      Strings: JDBC compliant java.sql.Timestamp format "YYYY-MM-DD HH:MM:SS.fffffffff" (9 decimal place precision)

      Timestamps are interpreted to be timezoneless and stored as an offset from the UNIX epoch. Convenience UDFs for conversion to and from timezones are provided (to_utc_timestamp, from_utc_timestamp).
      All existing datetime UDFs (month, day, year, hour, etc.) will work with the TIMESTAMP data type.

      Supported SerDes:
      ColumnarSerDe
      LazyBinaryColumnarSerDe
      LazySimpleSerDe
      LazyBinarySerDe
      BinarySortableSerDe
      Show
      TIMESTAMP data type New primitive data type that supports traditional UNIX timestamp with optional nanosecond precision. Supported conversions: Integer numeric types: Interpreted as UNIX timestamp in seconds Floating point numeric types: Intepreted as UNIX timestamp in seconds with decimal precision Strings: JDBC compliant java.sql.Timestamp format "YYYY-MM-DD HH:MM:SS.fffffffff" (9 decimal place precision) Timestamps are interpreted to be timezoneless and stored as an offset from the UNIX epoch. Convenience UDFs for conversion to and from timezones are provided (to_utc_timestamp, from_utc_timestamp). All existing datetime UDFs (month, day, year, hour, etc.) will work with the TIMESTAMP data type. Supported SerDes: ColumnarSerDe LazyBinaryColumnarSerDe LazySimpleSerDe LazyBinarySerDe BinarySortableSerDe

    Description

      Add TIMESTAMP type to serde2 that supports unix timestamp (1970-01-01 00:00:01 UTC to 2038-01-19 03:14:07 UTC) with optional nanosecond precision using both LazyBinary and LazySimple SerDes.
      For LazySimpleSerDe, the data is stored in jdbc compliant java.sql.Timestamp parsable strings.

      Attachments

        1. hive-2272.9.patch
          236 kB
          Franklin Hu
        2. hive-2272.8.patch
          235 kB
          Franklin Hu
        3. hive-2272.7.patch
          230 kB
          Franklin Hu
        4. hive-2272.6.patch
          211 kB
          Franklin Hu
        5. hive-2272.5.patch
          212 kB
          Franklin Hu
        6. hive-2272.4.patch
          212 kB
          Franklin Hu
        7. hive-2272.3.patch
          210 kB
          Franklin Hu
        8. hive-2272.2.patch
          199 kB
          Franklin Hu
        9. hive-2272.11.patch
          230 kB
          Franklin Hu
        10. hive-2272.10.patch
          233 kB
          Franklin Hu
        11. hive-2272.1.patch
          198 kB
          Franklin Hu

        Issue Links

          Activity

            People

              franklinhu Franklin Hu
              franklinhu Franklin Hu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: