[FLINK-11711] Add table and column stats

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: Table SQL / Planner
• Labels: pull-request-available
• Assignee: godfrey he
• Reporter: godfrey he
• Created: 21/Feb/19 09:01
• Updated: 21/Nov/19 02:37
• Resolved: 21/Nov/19 02:37

Description

We define two structure mode to hold statistics

1. TableStats: statistics for table level, contains 2 elements:

rowCount: Long // the number of row count of table

colStats: Map[String, ColumnStats] // map each column to its ColumnStats

2. ColumnStats: statistics for column level, contains 6 elements:

ndv: Long // number of distinct values

nullCount: Long // number of null values

avgLen: Double // average length of column values

maxLen: Integer // max length of column values

max: Any // max value of column values

min: Any // min value of column values

Issue Links

• is a child of: FLINK-11488 Add a basic Blink planner framework
• is duplicated by: FLINK-11516 Port and move some Descriptor classes to flink-table-common
• links to: GitHub Pull Request #7838