[HIVE-13822] TestPerfCliDriver throws warning in StatsSetupConst that JsonParser cannot parse COLUMN_STATS - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.3.0
Component/s: None
Labels:
None

Target Version/s:

2.2.0

Description

Thanks to [~jcamachorodriguez] for uncovering this issue as part of ~~HIVE-13269~~. StatsSetupConst.areColumnStatsUptoDate() is used to check whether stats are up-to-date. In case of PerfCliDriver, ‘false’ (thus, not up-to-date) is returned and the following debug message in the logs:

In StatsSetupConst, JsonParser can not parse COLUMN_STATS. (line 190 in StatsSetupConst)

Looks like the issue started happening after ~~HIVE-12261~~ went in.

The fix would be to replace
COLUMN_STATS_ACCURATE,true
with
COLUMN_STATS_ACCURATE,{"COLUMN_STATS":{"key":"true","value":"true"},"BASIC_STATS":"true"}
where key, value are the column names.
in data/files/tpcds-perf/metastore_export/csv/TABLE_PARAMS.txt