Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7335

Assertion Failure - test_corrupt_files

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 3.1.0
    • Impala 3.1.0
    • None

    Description

      test_corrupt_files fails 

       

      query_test.test_scanners.TestParquet.test_corrupt_files[exec_option:

      {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 0}

      | table_format: parquet/none] (from pytest)

       

      Error Message
      
      query_test/test_scanners.py:300: in test_corrupt_files     self.run_test_case('QueryTest/parquet-abort-on-error', vector) common/impala_test_suite.py:420: in run_test_case     assert False, "Expected exception: %s" % expected_str E   AssertionError: Expected exception: Column metadata states there are 11 values, but read 10 values from column id.
      
      STACKTRACE
      
      query_test/test_scanners.py:300: in test_corrupt_files
          self.run_test_case('QueryTest/parquet-abort-on-error', vector)
      common/impala_test_suite.py:420: in run_test_case
          assert False, "Expected exception: %s" % expected_str
      E   AssertionError: Expected exception: Column metadata states there are 11 values, but read 10 values from column id.
      
      
      Standard Error
      
      -- executing against localhost:21000
      use functional_parquet;
      
      SET batch_size=0;
      SET num_nodes=0;
      SET disable_codegen_rows_threshold=0;
      SET disable_codegen=False;
      SET abort_on_error=0;
      SET exec_single_node_rows_threshold=0;
      -- executing against localhost:21000
      set num_nodes=1;
      
      -- executing against localhost:21000
      
      set num_scanner_threads=1;
      
      -- executing against localhost:21000
      
      select id, cnt from bad_column_metadata t, (select count(*) cnt from t.int_array) v;
      
      -- executing against localhost:21000
      SET NUM_NODES="0";
      
      -- executing against localhost:21000
      SET NUM_SCANNER_THREADS="0";
      
      -- executing against localhost:21000
      set num_nodes=1;
      
      -- executing against localhost:21000
      
      set num_scanner_threads=1;
      
      -- executing against localhost:21000
      
      select id from bad_column_metadata;
      
      -- executing against localhost:21000
      SET NUM_NODES="0";
      
      -- executing against localhost:21000
      SET NUM_SCANNER_THREADS="0";
      
      -- executing against localhost:21000
      SELECT * from bad_parquet_strings_negative_len;
      
      -- executing against localhost:21000
      SELECT * from bad_parquet_strings_out_of_bounds;
      
      -- executing against localhost:21000
      use functional_parquet;
      
      SET batch_size=0;
      SET num_nodes=0;
      SET disable_codegen_rows_threshold=0;
      SET disable_codegen=False;
      SET abort_on_error=1;
      SET exec_single_node_rows_threshold=0;
      -- executing against localhost:21000
      set num_nodes=1;
      
      -- executing against localhost:21000
      
      set num_scanner_threads=1;
      
      -- executing against localhost:21000
      
      select id, cnt from bad_column_metadata t, (select count(*) cnt from t.int_array) v;
      
      -- executing against localhost:21000
      SET NUM_NODES="0";
      
      -- executing against localhost:21000
      SET NUM_SCANNER_THREADS="0";
      
      -- executing against localhost:21000
      set num_nodes=1;
      
      -- executing against localhost:21000
      
      set num_scanner_threads=1;
      
      -- executing against localhost:21000
      
      select id from bad_column_metadata;
      
      -- executing against localhost:21000
      SET NUM_NODES="0";
      
      -- executing against localhost:21000
      SET NUM_SCANNER_THREADS="0";
      
      

       

       

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            poojanilangekar Pooja Nilangekar
            njanarthanan nithya
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment