Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6423

Read Timestamps and Dates from Avro files (stored as Strings in ISO format)

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 0.12.0
    • None
    • HiveServer2
    • None

    Description

      Avro doesn't have native timestamp or date data types. Some tools (e.g. apache Sqoop) work around this by adding the java.sql.Types type number as an "sqlType" attribute to the Avro schema JSON field element. The attached patch makes the Avro SerDe look for an sqlType attribute, and if it is a Hive primitive type that's not an Avro primitive type (i.e. timestamp and date) it returns the appropriate Hive type (the one corresponding to the SQL type).

      Attachments

        1. HIVE-6423.patch
          17 kB
          Nick White

        Issue Links

          blocks

          Sub-task - The sub-task of the issue HIVE-8130 Support Date in Avro

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HIVE-8131 Support timestamp in Avro

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-8129 Umbrella JIRA to track Avro improvements

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              njw45 Nick White
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: