[ASTERIXDB-3274] Nested values should be skipped when replaced with an external embedded value

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.9
• Fix Version/s: 0.9.9
• Component/s: RT - Runtime
• Labels: triaged
• Assignee: Wail Y. Alkowaileet
• Reporter: Wail Y. Alkowaileet
• Created: 02/Oct/23 19:46
• Updated: 06/Oct/23 17:04
• Resolved: 03/Oct/23 15:47

Description

DDL:

CREATE TYPE TestType AS {
};

CREATE EXTERNAL DATASET Name(TestType) USING %adapter% (
    %template%,
    ("container"="playground"),
    ("definition"="external-filter/embed/name/{name:string}"),
    ("embed-filter-values" = "true"),
    ("format"="json")
);

 

Sample data in external-filter/embed/name/Jones:

{"id": 1, "name": {"first": "Mike", "last": "Jones"}, "department": "accounting"}
{"id": 2, "name": {"first": "Alice"},"department": "engineering"}
{"id": 3, "name": null, "department": "hr"} 

 

We can see that the filter value {name:string} will replace the nested values such as "name": {"first": "Mike", "last": "Jones"}. Thus, the JSON parser should skip those nested values as it will be replaced by the filter value (i.e., "Jones" as in the example above)