[IMPALA-8141] ASAN build failure in query_test/test_mem_usage_scaling.py

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 3.1.0
• Component/s: Backend
• Labels: asan build-failure
• Epic Color: ghx-label-1
• Assignee: Lenisha Gandhi
• Reporter: Paul Rogers
• Created: 29/Jan/19 22:23
• Updated: 29/Jan/19 22:57
• Resolved: 29/Jan/19 22:57

Description

From the build log:

23:18:34 query_test/test_mem_usage_scaling.py:202: in test_low_mem_limit_q16
23:18:34     self.low_memory_limit_test(vector, 'tpch-q16', self.MIN_MEM_FOR_TPCH['Q16'])
23:18:34 query_test/test_mem_usage_scaling.py:116: in low_memory_limit_test
23:18:34     self.run_test_case(tpch_query, new_vector)
23:18:34 common/impala_test_suite.py:472: in run_test_case
23:18:34     result = self.__execute_query(target_impalad_client, query, user=user)
23:18:34 common/impala_test_suite.py:699: in __execute_query
23:18:34     return impalad_client.execute(query, user=user)
23:18:34 common/impala_connection.py:174: in execute
23:18:34     return self.__beeswax_client.execute(sql_stmt, user=user)
23:18:34 beeswax/impala_beeswax.py:182: in execute
23:18:34     handle = self.__execute_query(query_string.strip(), user=user)
23:18:34 beeswax/impala_beeswax.py:359: in __execute_query
23:18:34     self.wait_for_finished(handle)
23:18:34 beeswax/impala_beeswax.py:372: in wait_for_finished
23:18:34     query_state = self.get_state(query_handle)
23:18:34 beeswax/impala_beeswax.py:427: in get_state
23:18:34     return self.__do_rpc(lambda: self.imp_service.get_state(query_handle))
23:18:34 beeswax/impala_beeswax.py:516: in __do_rpc
23:18:34     raise ImpalaBeeswaxException(self.__build_error_message(u), u)
23:18:34 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
23:18:34 E    INNER EXCEPTION: <class 'socket.error'>
23:18:34 E    MESSAGE: [Errno 104] Connection reset by peer

From impalad.ERROR:

==119152==ERROR: AddressSanitizer: use-after-poison on address 0x63100b771168 at pc 0x000002013e2c bp 0x7f1f7865b640 sp 0x7f1f7865b638
READ of size 1 at 0x63100b771168 thread T59694
    #0 0x2013e2b in impala::Tuple::IsNull(impala::NullIndicatorOffset const&) const /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/runtime/tuple.h:241:13
    #1 0x2809df1 in impala::AggFnEvaluator::SerializeOrFinalize(impala::Tuple*, impala::SlotDescriptor const&, impala::Tuple*, void*) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exprs/agg-fn-evaluator.cc:393:29
    #2 0x27755e8 in impala::AggFnEvaluator::Finalize(std::vector<impala::AggFnEvaluator*, std::allocator<impala::AggFnEvaluator*> > const&, impala::Tuple*, impala::Tuple*) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exprs/agg-fn-evaluator.h:307:15
    #3 0x27ab7b6 in impala::GroupingAggregator::CleanupHashTbl(std::vector<impala::AggFnEvaluator*, std::allocator<impala::AggFnEvaluator*> > const&, impala::HashTable::Iterator) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/grouping-aggregator.cc:351:7
    #4 0x27abcd2 in impala::GroupingAggregator::ClosePartitions() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/grouping-aggregator.cc:930:5
    #5 0x27ac014 in impala::GroupingAggregator::Close(impala::RuntimeState*) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/grouping-aggregator.cc:383:3
    #6 0x2761217 in impala::AggregationNode::Close(impala::RuntimeState*) /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/aggregation-node.cc:139:32
    #7 0x2069249 in impala::FragmentInstanceState::Close() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/runtime/fragment-instance-state.cc:368:42
    #8 0x206457a in impala::FragmentInstanceState::Exec() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/runtime/fragment-instance-state.cc:99:3

Issue Links

• duplicates: IMPALA-8140 Grouping aggregation with limit breaks asan build