[HIVE-25541] JsonSerDe: TBLPROPERTY treating nested json as String

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Panagiotis Garefalakis
• Reporter: Panagiotis Garefalakis
• Created: 20/Sep/21 15:59
• Updated: 17/Nov/22 08:47
• Resolved: 21/Oct/21 09:39

Description

Native Jsonserde 'org.apache.hive.hcatalog.data.JsonSerDe' currently does not support loading nested json into a string type directly. It requires the declaring the column as complex type (struct, map, array) to unpack nested json data.

Even though the data field is not a valid JSON String type there is value treating it as plain String instead of throwing an exception as we currently do.

create table json_table(data string, messageid string, publish_time bigint, attributes string);

{"data":{"H":{"event":"track_active","platform":"Android"},"B":{"device_type":"Phone","uuid":"[36ffec24-f6a4-4f5d-aa39-72e5513d2cae,11883bee-a7aa-4010-8a66-6c3c63a73f16]"}},"messageId":"2475185636801962","publish_time":1622514629783,"attributes":{"region":"IN"}}"}}

This JIRA introduces an extra Table Property allowing to Stringify Complex JSON values instead of forcing the User to define the complete nested structure

Issue Links

• is related to: HIVE-25188 JsonSerDe: Unable to read the string value from a nested json
• links to: GitHub Pull Request #2664