[DRILL-1151] JSON nested data returns empty for all rows except the first when using selections

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Component/s: Storage - JSON
• Assignee: Jacques Nadeau
• Reporter: Norris Lee
• Created: 16/Jul/14 23:29
• Updated: 07/May/15 21:26
• Resolved: 31/Jul/14 06:19

Description

Without the limit clause, everything gets returned:

0: jdbc:drill:zk=localhost:5181> SELECT * FROM `dfs`.`optdrill`.`./raw-files/donuts/moredonuts.json`;
+------------+------------+------------+------------+------------+------------+------------+------------+
|     id     |    type    |    name    |    ppu     |   sales    |  batters   |  topping   |  filling   |
+------------+------------+------------+------------+------------+------------+------------+------------+
| 0001       | donut      | Cake       | 0.55       | 35         | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"},{"id":"100 |
| 0002       | donut      | Raised     | 0.69       | 145        | {"batter":[{"id":"1001","type":"Regular"}]} | [{"id":"5001","type":"None"},{"id":"500 |
| 0003       | donut      | Old Fashioned | 0.55       | 300        | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"}]} | [{" |
| 0004       | donut      | Filled     | 0.69       | 14         | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"},{"id":"100 |
| 0005       | donut      | Apple Fritter | 1.0        | 700        | {"batter":[{"id":"1001","type":"Regular"}]} | [{"id":"5002","type":"Glazed"}] | [] |
+------------+------------+------------+------------+------------+------------+------------+------------+
5 rows selected (0.785 seconds)

Using the limit clause, the batters column returns [] for rows 2-5:

dbc:drill:zk=localhost:5181> SELECT * FROM `dfs`.`optdrill`.`./raw-files/donuts/moredonuts.json` LIMIT 100;
+------------+------------+------------+------------+------------+------------+------------+------------+
|     id     |    type    |    name    |    ppu     |   sales    |  batters   |  topping   |  filling   |
+------------+------------+------------+------------+------------+------------+------------+------------+
| 0001       | donut      | Cake       | 0.55       | 35         | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"},{"id":"100 |
| 0002       | donut      | Raised     | 0.69       | 145        | {"batter":[]} | []         | []         |
| 0003       | donut      | Old Fashioned | 0.55       | 300        | {"batter":[]} | []         | []         |
| 0004       | donut      | Filled     | 0.69       | 14         | {"batter":[]} | []         | []         |
| 0005       | donut      | Apple Fritter | 1.0        | 700        | {"batter":[]} | []         | []         |
+------------+------------+------------+------------+------------+------------+------------+------------+
5 rows selected (0.543 seconds)