Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9252

Linking custom SerDe jar to table definition.

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      In HIVE-6047 the option was created that a jar file can be hooked to the definition of a function. (See: Language Manual DDL: Permanent Functions )

      I propose to add something similar that can be used when defining an external table that relies on a custom Serde (I expect to usually only have the Deserializer).

      Something like this:

      CREATE [TEMPORARY] [EXTERNAL] TABLE [IF NOT EXISTS] [db_name.]table_name
          ...
          STORED BY 'storage.handler.class.name' [WITH SERDEPROPERTIES (...)] 
          [USING JAR|FILE|ARCHIVE 'file_uri' [, JAR|FILE|ARCHIVE 'file_uri'] ];
      

      Using this you can define (and share !!!) a Hive table on top of a custom fileformat without the need to let the IT operations people deploy a custom SerDe jar file on all nodes.

        Attachments

        1. HIVE-9252.1.patch
          66 kB
          Ferdinand Xu

          Issue Links

            Activity

              People

              • Assignee:
                Ferd Ferdinand Xu
                Reporter:
                nielsbasjes Niels Basjes
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: