Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8875

TestHmsIntegration.test_drop_column_maintains_stats seems flaky

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Epic Color:
      ghx-label-9

      Description

      The test of TestHmsIntegration.test_drop_column_maintains_stats seems flaky. The related test file was updated recently due to https://issues.apache.org/jira/browse/IMPALA-8823. Create this JIRA to track this failed test. Maybe Gabor Kaszab you could take a brief look at this? Thanks!

      The error messages are provided in the following.

      Error Message 
      assert {'avg_col_len...ializer', ...} == {'COLUMN_STATS...me': 'x', ...} Common items: {'avg_col_len': '', 'bitVector': '', 'col_name': 'x', 'comment': 'from deserializer', 'data_type': 'int', 'distinct_count': '0', 'max': '0', 'max_col_len': '', 'min': '0', 'num_falses': '', 'num_nulls': '0', 'num_trues': ''} Right contains more items: {'COLUMN_STATS_ACCURATE': '{}'} Full diff: + {'COLUMN_STATS_ACCURATE': '{}', - {'avg_col_len': '', ? ^ + 'avg_col_len': '', ? ^ 'bitVector': '', 'col_name': 'x', 'comment': 'from deserializer', 'data_type': 'int', 'distinct_count': '0', 'max': '0', 'max_col_len': '', 'min': '0', 'num_falses': '', 'num_nulls': '0', 'num_trues': ''}
      

      The stack trace is given as follows.

      Stacktrace
      
      metadata/test_hms_integration.py:390: in test_drop_column_maintains_stats
          assert hive_x_stats == self.hive_column_stats(table_name, 'x')
      E   assert {'avg_col_len...ializer', ...} == {'COLUMN_STATS...me': 'x', ...}
      E     Common items:
      E     {'avg_col_len': '',
      E      'bitVector': '',
      E      'col_name': 'x',
      E      'comment': 'from deserializer',
      E      'data_type': 'int',
      E      'distinct_count': '0',
      E      'max': '0',
      E      'max_col_len': '',
      E      'min': '0',
      E      'num_falses': '',
      E      'num_nulls': '0',
      E      'num_trues': ''}
      E     Right contains more items:
      E     {'COLUMN_STATS_ACCURATE': '{}'}
      E     Full diff:
      E     + {'COLUMN_STATS_ACCURATE': '{}',
      E     - {'avg_col_len': '',
      E     ? ^
      E     +  'avg_col_len': '',
      E     ? ^
      E     'bitVector': '',
      E     'col_name': 'x',
      E     'comment': 'from deserializer',
      E     'data_type': 'int',
      E     'distinct_count': '0',
      E     'max': '0',
      E     'max_col_len': '',
      E     'min': '0',
      E     'num_falses': '',
      E     'num_nulls': '0',
      E     'num_trues': ''}
      

        Attachments

          Activity

            People

            • Assignee:
              csringhofer Csaba Ringhofer
              Reporter:
              fangyurao Fang-Yu Rao
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: