Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21975 Histogram support in cost-based optimizer
  3. SPARK-21322

support histogram in filter cardinality estimation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • SQL
    • None

    Description

      Histogram is effective in dealing with skewed distribution. After we generate histogram information for column statistics, we need to adjust filter estimation based on histogram data structure.

      Attachments

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue SPARK-17074 generate equi-height histogram for column

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #19783 [Github] Pull Request #19783 (ron8hu)

          Pull request #19952 [Github] Pull Request #19952 (cloud-fan)

          Activity

            People

              ron8hu Ron Hu
              ron8hu Ron Hu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: