[IMPALA-4332] DCHECK in scheduler when querying Kudu or HBase table with MT_DOP > 0.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.8.0
• Component/s: Backend
• Labels: multithreading
• Target Version: Impala 2.8.0
• Assignee: Marcel Kinard
• Reporter: Alexander Behm
• Created: 21/Oct/16 00:29
• Updated: 07/Nov/16 21:10
• Resolved: 07/Nov/16 21:10

Description

Repro:

select count(*) from functional_kudu.alltypes
OR
select count(*) from functional_hbase.alltypes

DCHECK:

F1020 17:24:07.600431 23910 simple-scheduler.cc:481] Check failed: params.scan_range.__isset.hdfs_file_split

Stack:

#7  0x0000000001403f70 in impala::SimpleScheduler::MtCreateScanInstances (this=0xc1ecf80, leftmost_scan_id=0, 
    fragment_params=0xc57b9c0, schedule=0x7cceee0) at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:481
#8  0x0000000001403c7f in impala::SimpleScheduler::MtComputeFragmentExecParams (this=0xc1ecf80, plan_exec_info=..., 
    fragment_params=0xc57b9c0, schedule=0x7cceee0) at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:456
#9  0x0000000001403973 in impala::SimpleScheduler::MtComputeFragmentExecParams (this=0xc1ecf80, plan_exec_info=..., 
    fragment_params=0xc57b900, schedule=0x7cceee0) at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:428
#10 0x00000000014032ef in impala::SimpleScheduler::MtComputeFragmentExecParams (this=0xc1ecf80, schedule=0x7cceee0)
    at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:378
#11 0x00000000014069a9 in impala::SimpleScheduler::Schedule (this=0xc1ecf80, schedule=0x7cceee0)
    at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:884
#12 0x00000000014db666 in impala::ImpalaServer::QueryExecState::ExecQueryOrDmlRequest (this=0xbe7a000, query_exec_request=...)
    at /home/abehm/impala/be/src/service/query-exec-state.cc:444
#13 0x00000000014d85b5 in impala::ImpalaServer::QueryExecState::Exec (this=0xbe7a000, exec_request=0x7f46a9f328a0)
    at /home/abehm/impala/be/src/service/query-exec-state.cc:154
#14 0x00000000014665c8 in impala::ImpalaServer::ExecuteInternal (this=0xcb98400, query_ctx=..., 
    session_state=std::shared_ptr (count 6, weak 0) 0xcae38c0, registered_exec_state=0x7f46a9f33f2f, exec_state=0x7f46a9f342c0)
    at /home/abehm/impala/be/src/service/impala-server.cc:817
#15 0x0000000001465df4 in impala::ImpalaServer::Execute (this=0xcb98400, query_ctx=0x7f46a9f33fc0, 
    session_state=std::shared_ptr (count 6, weak 0) 0xcae38c0, exec_state=0x7f46a9f342c0)
    at /home/abehm/impala/be/src/service/impala-server.cc:764
#16 0x00000000014cd3d3 in impala::ImpalaServer::query (this=0xcb98400, query_handle=..., query=...)
    at /home/abehm/impala/be/src/service/impala-beeswax-server.cc:66
...