Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13822

TestPerfCliDriver throws warning in StatsSetupConst that JsonParser cannot parse COLUMN_STATS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      Thanks to jcamachorodriguez for uncovering this issue as part of HIVE-13269. StatsSetupConst.areColumnStatsUptoDate() is used to check whether stats are up-to-date. In case of PerfCliDriver, ‘false’ (thus, not up-to-date) is returned and the following debug message in the logs:

      In StatsSetupConst, JsonParser can not parse COLUMN_STATS. (line 190 in StatsSetupConst)
      

      Looks like the issue started happening after HIVE-12261 went in.

      The fix would be to replace
      COLUMN_STATS_ACCURATE,true
      with
      COLUMN_STATS_ACCURATE,{"COLUMN_STATS":{"key":"true","value":"true"},"BASIC_STATS":"true"}
      where key, value are the column names.
      in data/files/tpcds-perf/metastore_export/csv/TABLE_PARAMS.txt

      Attachments

        1. HIVE-13822.1.patch
          16 kB
          Hari Sankar Sivarama Subramaniyan
        2. HIVE-13822.2.patch
          116 kB
          Hari Sankar Sivarama Subramaniyan
        3. HIVE-13822.3.patch
          145 kB
          Hari Sankar Sivarama Subramaniyan
        4. HIVE-13822.4.patch
          140 kB
          Hari Sankar Sivarama Subramaniyan

        Issue Links

          Activity

            People

              hsubramaniyan Hari Sankar Sivarama Subramaniyan
              hsubramaniyan Hari Sankar Sivarama Subramaniyan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: