Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4664

ScanBatch.isNewSchema() returns wrong result for map datatype

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.8.0
    • Component/s: Execution - Flow
    • Labels:
      None

      Description

      isNewSchema() method checks if top-level schema or any of the deeper map schemas has changed. The last one doesn't work properly with count function.
      "deeperSchemaChanged" equals true even when two map strings have the same children fields.

      Discovered while trying to fix DRILL-2385.

      Dataset test.json for reproducing (MAP<REQUIRED> datatype object):

      {"oooi":{"oa":{"oab":{"oabc":1}}}}

      Example of query:

      select count(t.oooi) from dfs.tmp.`test.json` t

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vitalii Vitalii Diravka
                Reporter:
                vitalii Vitalii Diravka
                Reviewer:
                Chun Chang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: