[HIVE-16306] Encode binary fields of complex types with base64 and wrap them up with quotes

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.2.0
• Component/s: Serializers/Deserializers
• Assignee: Unassigned
• Reporter: Yibing Shi
• Created: 27/Mar/17 23:35
• Updated: 20/Mar/24 14:40

Description

Consider a complex type that has a binary field/item. For example:

struct<field:binary>

In sink operators, the struct is encoded as a JSON string, but its binary field is directly appended to the JSON string when encoded, which often breaks downstream JSON parsers.

Can we encode binary data within a complex type into base64 strings and quote them up like normal strings? This helps JSON parsers to work properly with binary data.

Issue Links

• relates to: HIVE-26454 BINARY types within complex types are not quoted