Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5369 Annotate hive operator tree with statistics from metastore
  3. HIVE-6798

Update column stats based on filter expression in stats annotation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.14.0
    • None
    • Query Processor, Statistics
    • None
    • Hide
      During stats annotation column stats are updated based on ratio of change in number of rows. This heuristics can be improved by analyzing the filter expression and updating the column stats accordingly. For example: When filter expression is an equality to literal then NDV can be set to 1 directly. If the expression is an equality to column projection then min NDVs of the columns participating in expression can be taken.
      Show
      During stats annotation column stats are updated based on ratio of change in number of rows. This heuristics can be improved by analyzing the filter expression and updating the column stats accordingly. For example: When filter expression is an equality to literal then NDV can be set to 1 directly. If the expression is an equality to column projection then min NDVs of the columns participating in expression can be taken.

    Attachments

      Activity

        People

          prasanth_j Prasanth Jayachandran
          prasanth_j Prasanth Jayachandran
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

          Dates

            Created:
            Updated: