Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10882

Push down Min-Max predicates of CHAR/VARCHAR to ORC reader

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • Backend
    • None

    Description

      This is a follow-up work of IMPALA-6505. Due to padding/truncation issues of CHAR/VARCHAR types when comparing to string literals, we might get wrong results if we simply push down CHAR/VARCHAR predicates into the ORC reader, especially when the file schema differs from the table schema.

      See more discussion in the Gerrit review: https://gerrit.cloudera.org/c/15403/1/be/src/exec/hdfs-orc-scanner.cc#889

      Attachments

        Issue Links

          requires

          Improvement - An improvement or enhancement to an existing feature or task. ORC-612 Improve CHAR(N)/VARCHAR(N) support in predicate push down

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: