Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24928

In case of non-native tables use basic statistics from HiveStorageHandler

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 4.0.0
    • Component/s: Hive

      Description

      When we are running `ANALYZE TABLE ... COMPUTE STATISTICS` or `ANALYZE TABLE ... COMPUTE STATISTICS FOR COLUMNS` all the basic statistics are collected by the BasicStatsTask class. This class tries to estimate the statistics by scanning the directory of the table. 

      In the case of non-native tables (iceberg, hbase), the table directory might contain metadata files as well, which would be counted by the BasicStatsTask when calculating basic stats. 

      Instead of having this logic, the HiveStorageHandler implementation should provide basic statistics.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                lpinter László Pintér
                Reporter:
                lpinter László Pintér
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 6h 20m
                  6h 20m