Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4332

DCHECK in scheduler when querying Kudu or HBase table with MT_DOP > 0.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: Impala 2.8.0
    • Component/s: Backend
    • Labels:

      Description

      Repro:

      select count(*) from functional_kudu.alltypes
      OR
      select count(*) from functional_hbase.alltypes
      

      DCHECK:

      F1020 17:24:07.600431 23910 simple-scheduler.cc:481] Check failed: params.scan_range.__isset.hdfs_file_split
      

      Stack:

      #7  0x0000000001403f70 in impala::SimpleScheduler::MtCreateScanInstances (this=0xc1ecf80, leftmost_scan_id=0, 
          fragment_params=0xc57b9c0, schedule=0x7cceee0) at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:481
      #8  0x0000000001403c7f in impala::SimpleScheduler::MtComputeFragmentExecParams (this=0xc1ecf80, plan_exec_info=..., 
          fragment_params=0xc57b9c0, schedule=0x7cceee0) at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:456
      #9  0x0000000001403973 in impala::SimpleScheduler::MtComputeFragmentExecParams (this=0xc1ecf80, plan_exec_info=..., 
          fragment_params=0xc57b900, schedule=0x7cceee0) at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:428
      #10 0x00000000014032ef in impala::SimpleScheduler::MtComputeFragmentExecParams (this=0xc1ecf80, schedule=0x7cceee0)
          at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:378
      #11 0x00000000014069a9 in impala::SimpleScheduler::Schedule (this=0xc1ecf80, schedule=0x7cceee0)
          at /home/abehm/impala/be/src/scheduling/simple-scheduler.cc:884
      #12 0x00000000014db666 in impala::ImpalaServer::QueryExecState::ExecQueryOrDmlRequest (this=0xbe7a000, query_exec_request=...)
          at /home/abehm/impala/be/src/service/query-exec-state.cc:444
      #13 0x00000000014d85b5 in impala::ImpalaServer::QueryExecState::Exec (this=0xbe7a000, exec_request=0x7f46a9f328a0)
          at /home/abehm/impala/be/src/service/query-exec-state.cc:154
      #14 0x00000000014665c8 in impala::ImpalaServer::ExecuteInternal (this=0xcb98400, query_ctx=..., 
          session_state=std::shared_ptr (count 6, weak 0) 0xcae38c0, registered_exec_state=0x7f46a9f33f2f, exec_state=0x7f46a9f342c0)
          at /home/abehm/impala/be/src/service/impala-server.cc:817
      #15 0x0000000001465df4 in impala::ImpalaServer::Execute (this=0xcb98400, query_ctx=0x7f46a9f33fc0, 
          session_state=std::shared_ptr (count 6, weak 0) 0xcae38c0, exec_state=0x7f46a9f342c0)
          at /home/abehm/impala/be/src/service/impala-server.cc:764
      #16 0x00000000014cd3d3 in impala::ImpalaServer::query (this=0xcb98400, query_handle=..., query=...)
          at /home/abehm/impala/be/src/service/impala-beeswax-server.cc:66
      ...
      

        Activity

        Hide
        alex.behm Alexander Behm added a comment -

        commit 0d857237a8d5231caf9af4c30d4134b151cd1e0d
        Author: Marcel Kornacker <marcel@cloudera.com>
        Date: Tue Oct 4 20:40:18 2016 -0400

        IMPALA-4314: Standardize on MT-related data structures

        This removes the data structures that were "superceded" in
        IMPALA-3903 and changes all control flow to utilize the
        new data structures. The new data structures are renamed
        to remove the "Mt" prefix.

        Change-Id: I465d0e15e2cf17cafe4c747d34c8f595d3645151
        Reviewed-on: http://gerrit.cloudera.org:8080/4853
        Reviewed-by: Marcel Kornacker <marcel@cloudera.com>
        Tested-by: Tim Armstrong <tarmstrong@cloudera.com>

        Show
        alex.behm Alexander Behm added a comment - commit 0d857237a8d5231caf9af4c30d4134b151cd1e0d Author: Marcel Kornacker <marcel@cloudera.com> Date: Tue Oct 4 20:40:18 2016 -0400 IMPALA-4314 : Standardize on MT-related data structures This removes the data structures that were "superceded" in IMPALA-3903 and changes all control flow to utilize the new data structures. The new data structures are renamed to remove the "Mt" prefix. Change-Id: I465d0e15e2cf17cafe4c747d34c8f595d3645151 Reviewed-on: http://gerrit.cloudera.org:8080/4853 Reviewed-by: Marcel Kornacker <marcel@cloudera.com> Tested-by: Tim Armstrong <tarmstrong@cloudera.com>

          People

          • Assignee:
            marcelk Marcel Kornacker
            Reporter:
            alex.behm Alexander Behm
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development