Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-744 LazyIO of non-filter columns
  3. ORC-741

Schema Evolution missing column is not handled in the presence of filters

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.7.0
    • 1.7.0
    • evolution, Reader
    • None

    Description

      ORC-577 introduced the ability to specify filters to allow row filtering.

      Schema evolution of a missing column is not handled leading to

       java.lang.IllegalArgumentException: Filter could not find column with name:

      It is triggered in the following scenario:

      • Read schema is supplied
      • File schema is missing a column
      • Provide a filter that uses that column during read

      The expectation is that the column is read as null and the filter applied on the read column.

      Attachments

        Issue Links

          Activity

            People

              planka Pavan Lanka
              planka Pavan Lanka
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: