[DRILL-1964] Missing key elements in returned array of maps

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 0.8.0
• Fix Version/s: 0.9.0
• Component/s: Execution - Data Types
• Assignee: Hanifi Gunes
• Reporter: Chun Chang
• Created: 08/Jan/15 22:50
• Updated: 15/Apr/15 19:02
• Resolved: 15/Apr/15 19:02

Description

#Wed Jan 07 18:54:07 EST 2015
git.commit.id.abbrev=35a350f

For an array of maps, if the schema for each map is not identical, with today's implementation, we suppose to display each map with all elements (keys) from all maps. This is not happening. For example, I have the following data:

{
    "id": 2,
    "oooa": {
        "oa": {
            "oab": {
                "oabc": [
                    {
                        "rowId": 2
                    },
                    {
                        "rowValue1": [{"rv1":1, "rv2":2}, {"rva1":3, "rva2":4}],
                        "rowValue2": [{"rw1":1, "rw2":2}, {"rwa1":3, "rwa2":4}]
                    }
                ]
            }
        }
    }
}

The following query gives:

0: jdbc:drill:schema=dfs.drillTestDirComplexJ> select t.oooa.oa.oab.oabc from `jira2file/jira1.json` t;
+------------+
|   EXPR$0   |
+------------+
| [{"rowId":2,"rowValue1":[],"rowValue2":[]},{"rowValue1":[{"rv1":1,"rv2":2},{"rva1":3,"rva2":4}],"rowValue2":[{"rw1":1,"rw2":2},{"rwa1":3,"rwa2":4}]}] |
+------------+

The returned result in a nicely formatted json form:

[
    {
        "rowId": 2,
        "rowValue1": [],
        "rowValue2": []
    },
    {
        "rowValue1": [
            {
                "rv1": 1,
                "rv2": 2
            },
            {
                "rva1": 3,
                "rva2": 4
            }
        ],
        "rowValue2": [
            {
                "rw1": 1,
                "rw2": 2
            },
            {
                "rwa1": 3,
                "rwa2": 4
            }
        ]
    }
]

Notice the first map includes all keys from all maps. But the second map is missing the "rowId" key.