[HIVE-9252] Linking custom SerDe jar to table definition.

• Type: New Feature
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: Serializers/Deserializers
• Assignee: Ferdinand Xu
• Reporter: Niels Basjes
• Created: 04/Jan/15 16:32
• Updated: 30/Jul/18 18:21

Description

In HIVE-6047 the option was created that a jar file can be hooked to the definition of a function. (See: Language Manual DDL: Permanent Functions )

I propose to add something similar that can be used when defining an external table that relies on a custom Serde (I expect to usually only have the Deserializer).

Something like this:

CREATE [TEMPORARY] [EXTERNAL] TABLE [IF NOT EXISTS] [db_name.]table_name
    ...
    STORED BY 'storage.handler.class.name' [WITH SERDEPROPERTIES (...)] 
    [USING JAR|FILE|ARCHIVE 'file_uri' [, JAR|FILE|ARCHIVE 'file_uri'] ];

Using this you can define (and share !!!) a Hive table on top of a custom fileformat without the need to let the IT operations people deploy a custom SerDe jar file on all nodes.

Issue Links

• is depended upon by: HIVE-19842 Improve Hive UDF/SerDe Usability
• is related to: HIVE-9813 Hive JDBC - DatabaseMetaData.getColumns method cannot find classes added with "add jar" command
• links to: RB