[IMPALA-5231] S3 build fails because memory estimates changes

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.9.0
• Component/s: Infrastructure
• Labels: broken-build
• Epic Color: ghx-label-4
• Assignee: Tim Armstrong
• Reporter: Taras Bobrovytsky
• Created: 20/Apr/17 01:04
• Updated: 15/Jun/17 06:05
• Resolved: 20/Apr/17 23:18

Description

The S3 build started to fail due to changed memory estimates.

 TestExplain.test_explain_level0[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: text/none] 
[gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/bin/../infra/python/env/bin/python
metadata/test_explain.py:54: in test_explain_level0
    self.run_test_case('QueryTest/explain-level0', vector)
common/impala_test_suite.py:388: in run_test_case
    self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:273: in __verify_results_and_errors
    replace_filenames_with_placeholder)
common/test_result_verifier.py:404: in verify_raw_results
    VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:231: in verify_query_result_is_equal
    assert expected_results == actual_results
E   assert Comparing QueryTestResults (expected vs actual):
E     'Per-Host Resource Reservation: Memory=136.00MB' == 'Per-Host Resource Reservation: Memory=136.00MB'
E     'Per-Host Resource Estimates: Memory=388.41MB' != 'Per-Host Resource Estimates: Memory=340.41MB'
E     '' == ''
E     'PLAN-ROOT SINK' == 'PLAN-ROOT SINK'
E     '04:EXCHANGE [UNPARTITIONED]' == '04:EXCHANGE [UNPARTITIONED]'
E     '02:HASH JOIN [INNER JOIN, BROADCAST]' == '02:HASH JOIN [INNER JOIN, BROADCAST]'
E     '|--03:EXCHANGE [BROADCAST]' == '|--03:EXCHANGE [BROADCAST]'
E     '|  01:SCAN HDFS [tpch.orders]' == '|  01:SCAN HDFS [tpch.orders]'
E     '00:SCAN HDFS [tpch.lineitem]' == '00:SCAN HDFS [tpch.lineitem]'

Issue Links

• is broken by: IMPALA-3748 Compute memory reservation in planner and claim atomically in Prepare()