[HOP-2476] Support for Objects and Array data types

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Migrated to GHI
• Assignee: Unassigned
• Reporter: Diethard Steiner
• Created: 29/Jan/21 09:45
• Updated: 17/Feb/23 09:52
• Resolved: 17/Feb/23 09:52

Description

As a developer I come across objects and arrays stored as part of a record fairly regularly. I'd like Hop to natively support them with dedicated data types so that extracting values becomes easier (no need to use any scripting or coding).

In example, similarly to Trifacta, Hop could offer easy to use functions like these ones then:

1) "Flatten array values into new rows":
[\{"type":"primary","colour":"green","product_number":3899},\{"type":"secondary","colour":"red","product_number":3899}]

returns two rows:

{"type":"primary","colour":"green","product_number":3899} {"type":"secondary","colour":"red","product_number":3899}

2) "Unnest values into new columns". The unnest transformation takes a nested key-value pair in the object and extracts it to a new column. e.g. unnest product_number:{"type":"secondary","colour":"red","product_number":3899} => 3899