Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19416 Create single version transactional table metastore statistics for aggregation queries
  3. HIVE-20219

verify that analyze and analyze for columns manage txn stats state correctly

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • None
    • None

    Description

      Discovered while adding tests in HIVE-20029

      Step 1. Have a table with fully correct txn stats.
      Step 2. Run some query that sets stats to invalid (e.g. parallel inserts).
      Step 3. Run analyze without for columns...

      Result is that while only basic stats are updated, the flag is set to true with old column stats values.
      I blame json; if stats state was stored in proper places this kind of bug would be very unlikely.
      Not sure if this would affect master, I'll add a test; ACID stats invalidation definitely needs to invalidate all the stats, not just basic stats flag, when invalidating.

      Attachments

        Activity

          People

            sershe Sergey Shelukhin
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: