Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-645

DictionaryFilter incorrectly handles null

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.9.0
    • Fix Version/s: 1.9.0, 1.8.2
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      DictionaryFilter checks whether a column can match a query and filters out row groups that can't match. Equality checks don't currently handle null correctly, which is never in the dictionary and is encoded by the definition level. This is causing row groups to be filtered when they should not be because "col is null" is always true.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rdblue Ryan Blue
                Reporter:
                rdblue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: