Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5369 Annotate hive operator tree with statistics from metastore
  3. HIVE-6798

Update column stats based on filter expression in stats annotation

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.14.0
    • None
    • Query Processor, Statistics
    • None
    • Hide
      During stats annotation column stats are updated based on ratio of change in number of rows. This heuristics can be improved by analyzing the filter expression and updating the column stats accordingly. For example: When filter expression is an equality to literal then NDV can be set to 1 directly. If the expression is an equality to column projection then min NDVs of the columns participating in expression can be taken.
      Show
      During stats annotation column stats are updated based on ratio of change in number of rows. This heuristics can be improved by analyzing the filter expression and updating the column stats accordingly. For example: When filter expression is an equality to literal then NDV can be set to 1 directly. If the expression is an equality to column projection then min NDVs of the columns participating in expression can be taken.

    Description

      Click to add description

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            prasanth_j Prasanth Jayachandran Assign to me
            prasanth_j Prasanth Jayachandran

            Dates

              Created:
              Updated:

              Slack

                Issue deployment