Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6568

Jenkins Regression: TPCDS query 68 fails with IllegalStateException: Unexpected EMIT outcome received in buildSchema phase

    XMLWordPrintableJSON

Details

    Description

      This is TPCDS Query 68.

      Query: /root/drillAutomation/framework-master/framework/resources/Advanced/tpcds/tpcds_sf1/original/maprdb/json/query68.sql

      SELECT c_last_name,
      c_first_name,
      ca_city,
      bought_city,
      ss_ticket_number,
      extended_price,
      extended_tax,
      list_price
      FROM (SELECT ss_ticket_number,
      ss_customer_sk,
      ca_city bought_city,
      Sum(ss_ext_sales_price) extended_price,
      Sum(ss_ext_list_price) list_price,
      Sum(ss_ext_tax) extended_tax
      FROM store_sales,
      date_dim,
      store,
      household_demographics,
      customer_address
      WHERE store_sales.ss_sold_date_sk = date_dim.d_date_sk
      AND store_sales.ss_store_sk = store.s_store_sk
      AND store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk
      AND store_sales.ss_addr_sk = customer_address.ca_address_sk
      AND date_dim.d_dom BETWEEN 1 AND 2
      AND ( household_demographics.hd_dep_count = 8
      OR household_demographics.hd_vehicle_count = 3 )
      AND date_dim.d_year IN ( 1998, 1998 + 1, 1998 + 2 )
      AND store.s_city IN ( 'Fairview', 'Midway' )
      GROUP BY ss_ticket_number,
      ss_customer_sk,
      ss_addr_sk,
      ca_city) dn,
      customer,
      customer_address current_addr
      WHERE ss_customer_sk = c_customer_sk
      AND customer.c_current_addr_sk = current_addr.ca_address_sk
      AND current_addr.ca_city <> bought_city
      ORDER BY c_last_name,
      ss_ticket_number
      LIMIT 100;

      Here is the stack trace:
      2018-06-29 07:00:32 INFO DrillTestLogger:348 -
      Exception:

      java.sql.SQLException: SYSTEM ERROR: IllegalStateException: Unexpected EMIT outcome received in buildSchema phase

      Fragment 0:0

      [Error Id: edbe3477-805e-4f1f-8405-d5c194dc28c2 on atsqa6c87.qa.lab:31010]

      (java.lang.IllegalStateException) Unexpected EMIT outcome received in buildSchema phase
      org.apache.drill.exec.physical.impl.TopN.TopNBatch.buildSchema():178
      org.apache.drill.exec.record.AbstractRecordBatch.next():152
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.innerNext():87
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():147
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.physical.impl.BaseRootExec.next():103
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():83
      org.apache.drill.exec.physical.impl.BaseRootExec.next():93
      org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():294
      org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():281
      java.security.AccessController.doPrivileged():-2
      javax.security.auth.Subject.doAs():422
      org.apache.hadoop.security.UserGroupInformation.doAs():1595
      org.apache.drill.exec.work.fragment.FragmentExecutor.run():281
      org.apache.drill.common.SelfCleaningRunnable.run():38
      java.util.concurrent.ThreadPoolExecutor.runWorker():1149
      java.util.concurrent.ThreadPoolExecutor$Worker.run():624
      java.lang.Thread.run():748

      at org.apache.drill.jdbc.impl.DrillCursor.nextRowInternally(DrillCursor.java:528)
      at org.apache.drill.jdbc.impl.DrillCursor.loadInitialSchema(DrillCursor.java:600)
      at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:1904)
      at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:64)
      at oadd.org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:630)
      at org.apache.drill.jdbc.impl.DrillMetaImpl.prepareAndExecute(DrillMetaImpl.java:1109)
      at org.apache.drill.jdbc.impl.DrillMetaImpl.prepareAndExecute(DrillMetaImpl.java:1120)
      at oadd.org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:638)
      at org.apache.drill.jdbc.impl.DrillConnectionImpl.prepareAndExecuteInternal(DrillConnectionImpl.java:200)
      at oadd.org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:149)
      at oadd.org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
      at org.apache.drill.jdbc.impl.DrillStatementImpl.executeQuery(DrillStatementImpl.java:110)
      at org.apache.drill.test.framework.DrillTestJdbc.executeQuery(DrillTestJdbc.java:210)
      at org.apache.drill.test.framework.DrillTestJdbc.run(DrillTestJdbc.java:115)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: oadd.org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IllegalStateException: Unexpected EMIT outcome received in buildSchema phase

      Fragment 0:0

      [Error Id: edbe3477-805e-4f1f-8405-d5c194dc28c2 on atsqa6c87.qa.lab:31010]

      (java.lang.IllegalStateException) Unexpected EMIT outcome received in buildSchema phase
      org.apache.drill.exec.physical.impl.TopN.TopNBatch.buildSchema():178
      org.apache.drill.exec.record.AbstractRecordBatch.next():152
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.innerNext():87
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.record.AbstractRecordBatch.next():119
      org.apache.drill.exec.record.AbstractRecordBatch.next():109
      org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():147
      org.apache.drill.exec.record.AbstractRecordBatch.next():172
      org.apache.drill.exec.physical.impl.BaseRootExec.next():103
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():83
      org.apache.drill.exec.physical.impl.BaseRootExec.next():93
      org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():294
      org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():281
      java.security.AccessController.doPrivileged():-2
      javax.security.auth.Subject.doAs():422
      org.apache.hadoop.security.UserGroupInformation.doAs():1595
      org.apache.drill.exec.work.fragment.FragmentExecutor.run():281
      org.apache.drill.common.SelfCleaningRunnable.run():38
      java.util.concurrent.ThreadPoolExecutor.runWorker():1149
      java.util.concurrent.ThreadPoolExecutor$Worker.run():624
      java.lang.Thread.run():748

      at oadd.org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:123)
      at oadd.org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:422)
      at oadd.org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:96)
      at oadd.org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:274)
      at oadd.org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:244)
      at oadd.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
      at oadd.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
      at oadd.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
      at oadd.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
      at oadd.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
      at oadd.io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
      at oadd.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
      at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
      at oadd.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911)
      at oadd.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
      at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645)
      at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
      at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
      at oadd.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
      at oadd.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
      ... 1 more

      The commit id is:
      1.14.0-SNAPSHOT 140d09e69b65ac2cb1bed09a37fa5861d39a99b3 DRILL-6539: Record count not set for this vector container error 28.06.2018 @ 16:13:20 PDT Unknown 28.06.2018 @ 16:21:42 PDT

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. DRILL-6548 IllegalStateException: Unexpected EMIT outcome received in buildSchema phase

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              khfaraaz Khurram Faraaz
              rhou Robert Hou
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: