[FLINK-28939] Release Testing: Verify FLIP-241 ANALYZE TABLE

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 1.16.0
• Fix Version/s: 1.16.0
• Component/s: Table SQL / API, Table SQL / Planner
• Labels: release-testing
• Assignee: Yunhong Zheng
• Reporter: godfrey he
• Created: 12/Aug/22 03:08
• Updated: 30/Aug/22 02:04
• Resolved: 30/Aug/22 02:04

Description

This issue aims to verify FLIP-240: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=217386481

We can verify it in SQL client after we build the flink-dist package.

1. create a partition table and a non-partition table (with/without compute column/metadata column, with different columns), and then insert some data
2. verify the different statements, please refer to the FLIP doc examples
3. verify the result in catalog. Currently, describe extended statement does not support show the statistics in catalog, we should write some code to get the statistics from catalog, or we can use hive cli if the catalog is hive catalog
4. verify the unsupported cases,
4.1 analyze non-existed table
4.2 analyze view
4.3 analyze a partition table with non-existed partition
4.4. analyze a non-partition table with a partition
4.5. analyze a non-existed column
4.6. analyze a computed column
4.6. analyze a metadata column

Issue Links

• Blocked: HIVE-26492 orc.apache.orc.impl.writer.StructTreeWriter write wrong column stats when encounter decimal type value
• is fixed by: FLINK-29059 The existing column stats are deleted incorrectly when analyze table for partial columns