[SPARK-47992] Support recursive descent path in get_json_object function

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Qian Sun
• Created: 25/Apr/24 11:36
• Updated: 25/Apr/24 11:36

Description

JSONPath borrows recursive descent syntax from E4X. We could use it to collect json object from json map string.

// json data
{"key1": {"b": {"c": "c1", "d": "d1", "e": "e1"}}}
{"key2": {"b": {"c": "c2", "d": "d2", "e": "e2"}}}

select get_json_object(data, '$..c'); -- [c1, c2]

ref: https://goessner.net/articles/JsonPath/index.html#e2