Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-39678

Improve stats estimation for v2 tables

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Minor
    • Resolution: Unresolved
    • 3.3.0
    • None
    • Optimizer
    • None

    Description

      In case of v2 tables, connectors can bubble up both sizeInBytes and rowCount .

      Presently, SizeInBytesOnlyStatsPlanVisitor, ommits propagating / estimating rowCount stats, some places like :

      For the non-cbo flow, as per my understanding, this can improve the stats estimation, since rowcount is indirectly used in places to estimate the size as well.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            singhpk234 Prashant Singh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: