[IMPALA-2948] Crash: impala::UnionNode::Prepare (when optimize_partition_key_scans set to true)

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.5.0
• Component/s: Frontend
• Labels: crash query_generator
• Environment: DB: functional
• Target Version: Impala 2.5.0
• Assignee: Michael Ho
• Reporter: Taras Bobrovytsky
• Created: 04/Feb/16 19:43
• Updated: 06/Feb/16 21:44
• Resolved: 06/Feb/16 21:44

Description

This crash can be triggered by starting impala cluster with the following command:

start-impala-cluster.py --impalad_args="--default_query_options=optimize_partition_key_scans=1"

Query:

SELECT
COALESCE(a4.int_col_1, a4.bigint_col, a4.bigint_col) AS int_col
FROM (
SELECT
(a3.int_col) + (a3.int_col) AS int_col_1,
a1.bigint_col,
a3.int_col,
(a1.month) + (a1.year) AS int_col_2
FROM alltypestiny a1
INNER JOIN (
SELECT
(697) != (COUNT(COALESCE(a2.day, a2.int_col, a2.tinyint_col))) AS boolean_col,
COALESCE(MIN(a2.year), 972, -416) AS int_col
FROM alltypesagg a2
) a3 ON ((a3.int_col) = (a1.month)) AND ((a3.int_col) = (a1.int_col))
GROUP BY
(a3.int_col) + (a3.int_col),
a1.bigint_col,
a3.int_col,
(a1.month) + (a1.year)
HAVING
(a3.int_col) IS DISTINCT FROM (SUM(a3.int_col))
) a4
WHERE
(a4.int_col_1) IN (a4.int_col, a4.int_col_1)

Stack Trace:

google::DumpStackTraceAndExit() ()
google::LogMessage::Fail() ()
google::LogMessage::SendToLog() ()
google::LogMessage::Flush() ()
google::LogMessageFatal::~LogMessageFatal() ()
impala::UnionNode::Prepare (this=0x13e10d00, state=0x23f7cd00) at /home/dev/Impala/be/src/exec/union-node.cc:70
impala::ExecNode::Prepare (this=0xe73c900, state=0x23f7cd00) at /home/dev/Impala/be/src/exec/exec-node.cc:153
impala::PartitionedAggregationNode::Prepare (this=0xe73c900, state=0x23f7cd00) at /home/dev/Impala/be/src/exec/partitioned-aggregation-node.cc:107
impala::PlanFragmentExecutor::Prepare (this=0x13806030, request=...) at /home/dev/Impala/be/src/runtime/plan-fragment-executor.cc:245
impala::FragmentMgr::FragmentExecState::Prepare (this=0x13805e00) at /home/dev/Impala/be/src/service/fragment-exec-state.cc:44
impala::FragmentMgr::FragmentThread (this=0xe985d40, fragment_instance_id=...) at /home/dev/Impala/be/src/service/fragment-mgr.cc:85
boost::_mfi::mf1::operator() (this=0xf8d6750, p=0xe985d40, a1=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/mem_fn_template.hpp:165
boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0xf8d6760, f=..., a=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind.hpp:313
boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0xf8d6750) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:20
boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/function/function_template.hpp:153
boost::function0::operator() (this=0x7f4e36d30de0) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/function/function_template.hpp:767
impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function, impala::Promise*) (name=..., category=..., functor=..., thread_started=0x7f4e3c63ab90) at /home/dev/Impala/be/src/util/thread.cc:316
boost::_bi::list4, boost::_bi::value, boost::_bi::value >, boost::_bi::value*> >::operator(), impala::Promise*), boost::_bi::list0>(boost::_bi::type, void (*&)(std::string const&, std::string const&, boost::function, impala::Promise*), boost::_bi::list0&, int) (this=0x1baa47c0, f=@0x1baa47b8: 0x15672a2 , impala::Promise*)>, a=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind.hpp:457
boost::_bi::bind_t, impala::Promise*), boost::_bi::list4, boost::_bi::value, boost::_bi::value >, boost::_bi::value*> > >::operator()() (this=0x1baa47b8) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:20
boost::detail::thread_data, impala::Promise*), boost::_bi::list4, boost::_bi::value, boost::_bi::value >, boost::_bi::value*> > > >::run() (this=0x1baa4600) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/thread/detail/thread.hpp:116
thread_proxy ()
start_thread (arg=0x7f4e36d31700) at pthread_create.c:312
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111