Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13658

BooleanSimplification rule is slow with large boolean expressions

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      When run TPCDS Q3 [1] with lots predicates to filter out the partitions, the optimizer rule BooleanSimplification take about 2 seconds (it use lots of sematicsEqual, which require copy the whole tree).

      It will great if we could speedup it.

      [1] https://github.com/cloudera/impala-tpcds-kit/blob/master/queries/q3.sql

      cc marmbrus

      Attachments

        Activity

          People

            viirya L. C. Hsieh
            davies Davies Liu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: