[HIVE-13822] TestPerfCliDriver throws warning in StatsSetupConst that JsonParser cannot parse COLUMN_STATS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Target Version/s: 2.2.0
• Assignee: Hari Sankar Sivarama Subramaniyan
• Reporter: Hari Sankar Sivarama Subramaniyan
• Created: 23/May/16 18:36
• Updated: 27/Feb/24 22:23
• Resolved: 05/Aug/16 20:33

Description

Thanks to jcamachorodriguez for uncovering this issue as part of HIVE-13269. StatsSetupConst.areColumnStatsUptoDate() is used to check whether stats are up-to-date. In case of PerfCliDriver, ‘false’ (thus, not up-to-date) is returned and the following debug message in the logs:

In StatsSetupConst, JsonParser can not parse COLUMN_STATS. (line 190 in StatsSetupConst)

Looks like the issue started happening after HIVE-12261 went in.

The fix would be to replace
COLUMN_STATS_ACCURATE,true
with
COLUMN_STATS_ACCURATE,{"COLUMN_STATS":{"key":"true","value":"true"},"BASIC_STATS":"true"}
where key, value are the column names.
in data/files/tpcds-perf/metastore_export/csv/TABLE_PARAMS.txt

Issue Links

• blocks: HIVE-13269 Simplify comparison expressions using column stats