Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-1151

JSON nested data returns empty for all rows except the first when using selections

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: Storage - JSON
    • Labels:
      None

      Description

      Without the limit clause, everything gets returned:

      0: jdbc:drill:zk=localhost:5181> SELECT * FROM `dfs`.`optdrill`.`./raw-files/donuts/moredonuts.json`;
      +------------+------------+------------+------------+------------+------------+------------+------------+
      |     id     |    type    |    name    |    ppu     |   sales    |  batters   |  topping   |  filling   |
      +------------+------------+------------+------------+------------+------------+------------+------------+
      | 0001       | donut      | Cake       | 0.55       | 35         | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"},{"id":"100 |
      | 0002       | donut      | Raised     | 0.69       | 145        | {"batter":[{"id":"1001","type":"Regular"}]} | [{"id":"5001","type":"None"},{"id":"500 |
      | 0003       | donut      | Old Fashioned | 0.55       | 300        | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"}]} | [{" |
      | 0004       | donut      | Filled     | 0.69       | 14         | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"},{"id":"100 |
      | 0005       | donut      | Apple Fritter | 1.0        | 700        | {"batter":[{"id":"1001","type":"Regular"}]} | [{"id":"5002","type":"Glazed"}] | [] |
      +------------+------------+------------+------------+------------+------------+------------+------------+
      5 rows selected (0.785 seconds)
      
      

      Using the limit clause, the batters column returns [] for rows 2-5:

      dbc:drill:zk=localhost:5181> SELECT * FROM `dfs`.`optdrill`.`./raw-files/donuts/moredonuts.json` LIMIT 100;
      +------------+------------+------------+------------+------------+------------+------------+------------+
      |     id     |    type    |    name    |    ppu     |   sales    |  batters   |  topping   |  filling   |
      +------------+------------+------------+------------+------------+------------+------------+------------+
      | 0001       | donut      | Cake       | 0.55       | 35         | {"batter":[{"id":"1001","type":"Regular"},{"id":"1002","type":"Chocolate"},{"id":"100 |
      | 0002       | donut      | Raised     | 0.69       | 145        | {"batter":[]} | []         | []         |
      | 0003       | donut      | Old Fashioned | 0.55       | 300        | {"batter":[]} | []         | []         |
      | 0004       | donut      | Filled     | 0.69       | 14         | {"batter":[]} | []         | []         |
      | 0005       | donut      | Apple Fritter | 1.0        | 700        | {"batter":[]} | []         | []         |
      +------------+------------+------------+------------+------------+------------+------------+------------+
      5 rows selected (0.543 seconds)
      
      

        Attachments

        1. DRILL-1151.patch
          1 kB
          Mehant Baid

          Activity

            People

            • Assignee:
              jnadeau Jacques Nadeau
              Reporter:
              norrisl Norris Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: