[HIVE-18785] Make JSON SerDe First-Class SerDe

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Serializers/Deserializers
• Assignee: Aihua Xu
• Reporter: David Mollitor
• Created: 23/Feb/18 16:24
• Updated: 15/Jul/20 20:17

Description

According to the Hive SerDe Docs, there are some extra steps involved in getting the JSON SerDe to work:

ROW FORMAT SERDE
'org.apache.hive.hcatalog.data.JsonSerDe'
STORED AS TEXTFILE

In some distributions, a reference to hive-hcatalog-core.jar is required.
ADD JAR /usr/lib/hive-hcatalog/lib/hive-hcatalog-core.jar;

I would like to propose that we move this SerDe into first-class status:

STORED AS JSONFILE

The user should have to perform no additional steps to use this SerDe.

Issue Links

• depends upon: HIVE-19960 Add Column Mapping to JsonSerDe
• depends upon: HIVE-19901 Consolidate JsonSerde Classes
• depends upon: HIVE-21240 JSON SerDe Re-Write
• is a child of: HIVE-163 support loading json data into hive
• is depended upon by: HIVE-19842 Improve Hive UDF/SerDe Usability
• is duplicated by: HIVE-19899 Support stored as JsonFile
• is related to: HIVE-1640 hive-exec.jar contains JSON classes
• is superceded by: HIVE-22061 Selecting from JsonSerDe backed table fails for array type
• relates to: HIVE-15475 JsonSerDe cannot handle json file with empty lines
• relates to: HIVE-18295 Add ability to ignore invalid values in JSON SerDe
• relates to: HIVE-15826 Add 'serialization.encoding' To All SerDes
• relates to: HIVE-18545 Add UDF to parse complex types from json
• relates to: HIVE-21414 Hive JSON SerDe Does Not Properly Handle Field Comments
• supercedes: HIVE-17299 Cannot validate SerDe even if it is in Hadoop classpath
• supercedes: HIVE-10968 Windows: analyze json table via beeline failed throwing Class org.apache.hive.hcatalog.data.JsonSerDe not found

Sub-Tasks

• Support stored as JsonFile: Closed