[IMPALA-4662] with Kudu tables, ClassCastException with NULL literal in IN list

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.7.0
• Fix Version/s: Impala 2.8.0
• Component/s: Frontend
• Labels: correctness query_generator
• Target Version: Impala 2.8.0
• Assignee: Alexander Behm
• Reporter: Michael Brown
• Created: 14/Dec/16 23:22
• Updated: 24/Jan/17 04:16
• Resolved: 16/Dec/16 01:10

Description

This seems to be a Kudu-specific bug, since the error is about initializing the Kudu scan node, and the equivalent query works fine in functional.

explain select id from functional_kudu.alltypestiny where id in (null);

This query is OK:

explain select id from functional_kudu.alltypestiny where id = null;

The backtrace is:

I1214 15:12:41.465106 25897 jni-util.cc:169] org.apache.impala.common.ImpalaRuntimeException: Unable to initialize the Kudu scan node
        at org.apache.impala.planner.KuduScanNode.init(KuduScanNode.java:135)
        at org.apache.impala.planner.SingleNodePlanner.createScanNode(SingleNodePlanner.java:1285)
        at org.apache.impala.planner.SingleNodePlanner.createTableRefNode(SingleNodePlanner.java:1498)
        at org.apache.impala.planner.SingleNodePlanner.createTableRefsPlan(SingleNodePlanner.java:773)
        at org.apache.impala.planner.SingleNodePlanner.createSelectPlan(SingleNodePlanner.java:613)
        at org.apache.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:254)
        at org.apache.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:147)
        at org.apache.impala.planner.Planner.createPlan(Planner.java:87)
        at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:998)
        at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1090)
        at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:160)
Caused by: java.lang.ClassCastException: org.apache.impala.analysis.NullLiteral cannot be cast to org.apache.impala.analysis.NumericLiteral
        at org.apache.impala.planner.KuduScanNode.getKuduInListValue(KuduScanNode.java:404)
        at org.apache.impala.planner.KuduScanNode.tryConvertInListKuduPredicate(KuduScanNode.java:382)
        at org.apache.impala.planner.KuduScanNode.extractKuduConjuncts(KuduScanNode.java:287)
        at org.apache.impala.planner.KuduScanNode.init(KuduScanNode.java:123)
        ... 10 more
I1214 15:12:41.512305 25897 status.cc:114] ImpalaRuntimeException: Unable to initialize the Kudu scan node
CAUSED BY: ClassCastException: org.apache.impala.analysis.NullLiteral cannot be cast to org.apache.impala.analysis.NumericLiteral
    @          0x11c8de5  impala::Status::Status()
    @          0x15a0dfe  impala::JniUtil::GetJniExceptionMsg()
    @          0x1462fbe  impala::JniUtil::CallJniMethod<>()
    @          0x145f6a9  impala::Frontend::GetExecRequest()
    @          0x147ccc9  impala::ImpalaServer::ExecuteInternal()
    @          0x147c870  impala::ImpalaServer::Execute()
    @          0x14e547e  impala::ImpalaServer::query()
    @          0x1943d96  beeswax::BeeswaxServiceProcessor::process_query()
    @          0x1943ae4  beeswax::BeeswaxServiceProcessor::dispatchCall()
    @          0x192c4ef  impala::ImpalaServiceProcessor::dispatchCall()
    @          0x116fcac  apache::thrift::TDispatchProcessor::process()
    @          0x27d058b  apache::thrift::server::TThreadPoolServer::Task::run()
    @          0x27b8df9  apache::thrift::concurrency::ThreadManager::Worker::run()
    @          0x1336995  impala::ThriftThread::RunRunnable()
    @          0x13380c1  boost::_mfi::mf2<>::operator()()
    @          0x1337f57  boost::_bi::list3<>::operator()<>()
    @          0x1337ca3  boost::_bi::bind_t<>::operator()()
    @          0x1337bb6  boost::detail::function::void_function_obj_invoker0<>::invoke()
    @          0x1345534  boost::function0<>::operator()()
    @          0x15f21b5  impala::Thread::SuperviseThread()
    @          0x15f918e  boost::_bi::list4<>::operator()<>()
    @          0x15f90d1  boost::_bi::bind_t<>::operator()()
    @          0x15f902c  boost::detail::thread_data<>::run()
    @          0x1a4ecca  thread_proxy
    @     0x7f7619a75184  start_thread
    @     0x7f76197a237d  (unknown)