Major Description
Currently when estimating predicates like col > literal or col = literal, we will update min or max in column stats based on literal value. However, literal value is of Catalyst type (internal type), while min/max is of external type. This causes unnecessary conversion when comparing them and updating column stats.
To solve this, we can use Catalyst type for min/max in ColumnStat for ease of estimation. Note that the persistent form in metastore is still of external type, so there's no inconsistency for statistics in metastore.
Attachments
Issue Links
- links to
