[IMPALA-8907] TestResultSpooling.test_slow_query is flaky

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.4.0
• Epic Color: ghx-label-2
• Assignee: Sahil Takiar
• Reporter: Sahil Takiar
• Created: 29/Aug/19 00:26
• Updated: 05/Sep/19 16:10
• Resolved: 05/Sep/19 16:10

Description

Recently failed in an ubuntu-16.04-dockerised-tests job: https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/1102/testReport/junit/query_test.test_result_spooling/TestResultSpooling/test_slow_query_protocol__beeswax___exec_option____batch_size___0___num_nodes___0___disable_codegen_rows_threshold___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__parquet_none_/

Error Message:

query_test/test_result_spooling.py:172: in test_slow_query     assert re.search(get_wait_time_regex, self.client.get_runtime_profile(handle)) \ E   assert None is not None E    +  where None = <function search at 0x7f0da4115c08>('RowBatchGetWaitTime: [1-9]', 'Query (id=7f47e1d6a1a1c804:492214eb00000000):\n  DEBUG MODE WARNING: Query profile created while running a DEBUG buil...  - OptimizationTime: 331.998ms\n           - PeakMemoryUsage: 1.09 MB (1144320)\n           - PrepareTime: 31.999ms\n') E    +    where <function search at 0x7f0da4115c08> = re.search E    +    and   'Query (id=7f47e1d6a1a1c804:492214eb00000000):\n  DEBUG MODE WARNING: Query profile created while running a DEBUG buil...  - OptimizationTime: 331.998ms\n           - PeakMemoryUsage: 1.09 MB (1144320)\n           - PrepareTime: 31.999ms\n' = <bound method BeeswaxConnection.get_runtime_profile of <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0>>(<tests.common.impala_connection.OperationHandle object at 0x7f0d94afffd0>) E    +      where <bound method BeeswaxConnection.get_runtime_profile of <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0>> = <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0>.get_runtime_profile E    +        where <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0> = <test_result_spooling.TestResultSpooling object at 0x7f0d94af3d50>.client 

Stacktrace:

query_test/test_result_spooling.py:172: in test_slow_query
    assert re.search(get_wait_time_regex, self.client.get_runtime_profile(handle)) \
E   assert None is not None
E    +  where None = <function search at 0x7f0da4115c08>('RowBatchGetWaitTime: [1-9]', 'Query (id=7f47e1d6a1a1c804:492214eb00000000):\n  DEBUG MODE WARNING: Query profile created while running a DEBUG buil...  - OptimizationTime: 331.998ms\n           - PeakMemoryUsage: 1.09 MB (1144320)\n           - PrepareTime: 31.999ms\n')
E    +    where <function search at 0x7f0da4115c08> = re.search
E    +    and   'Query (id=7f47e1d6a1a1c804:492214eb00000000):\n  DEBUG MODE WARNING: Query profile created while running a DEBUG buil...  - OptimizationTime: 331.998ms\n           - PeakMemoryUsage: 1.09 MB (1144320)\n           - PrepareTime: 31.999ms\n' = <bound method BeeswaxConnection.get_runtime_profile of <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0>>(<tests.common.impala_connection.OperationHandle object at 0x7f0d94afffd0>)
E    +      where <bound method BeeswaxConnection.get_runtime_profile of <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0>> = <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0>.get_runtime_profile
E    +        where <tests.common.impala_connection.BeeswaxConnection object at 0x7f0d94afa7d0> = <test_result_spooling.TestResultSpooling object at 0x7f0d94af3d50>.client 

Issue Links

• relates to: IMPALA-8818 Replace deque queue with spillable queue in BufferedPlanRootSink