Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7813

Non-deterministic partition expression may be redundantly evaluated

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 2.11.0, Impala 3.0
    • None
    • Frontend
    • None
    • ghx-label-8

    Description

      Following on from IMPALA-402, I believe there is another issue where the partition value evaluated in the exchange, the sort and the table sink may all turn out to be different values. This would break various clustering optimisations and result in small files.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-402 Add test for dynamic partition expr involving rand()

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: