Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
Impala 2.9.0
-
None
-
ghx-label-1
Description
Exception
I0531 14:04:50.219782 80661 jni-util.cc:176] java.lang.OutOfMemoryError: Requested array size exceeds VM limit
at java.util.Arrays.copyOf(Arrays.java:2271)
at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:113)
at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:140)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
at org.apache.thrift.protocol.TBinaryProtocol.writeByte(TBinaryProtocol.java:147)
at org.apache.thrift.protocol.TBinaryProtocol.writeFieldStop(TBinaryProtocol.java:115)
at org.apache.impala.thrift.TScanRangeLocationList$TScanRangeLocationListStandardScheme.write(TScanRangeLocationList.java:495)
at org.apache.impala.thrift.TScanRangeLocationList$TScanRangeLocationListStandardScheme.write(TScanRangeLocationList.java:423)
at org.apache.impala.thrift.TScanRangeLocationList.write(TScanRangeLocationList.java:363)
at org.apache.impala.thrift.TPlanExecInfo$TPlanExecInfoStandardScheme.write(TPlanExecInfo.java:551)
at org.apache.impala.thrift.TPlanExecInfo$TPlanExecInfoStandardScheme.write(TPlanExecInfo.java:450)
at org.apache.impala.thrift.TPlanExecInfo.write(TPlanExecInfo.java:391)
at org.apache.impala.thrift.TQueryExecRequest$TQueryExecRequestStandardScheme.write(TQueryExecRequest.java:1366)
at org.apache.impala.thrift.TQueryExecRequest$TQueryExecRequestStandardScheme.write(TQueryExecRequest.java:1210)
at org.apache.impala.thrift.TQueryExecRequest.write(TQueryExecRequest.java:1050)
at org.apache.impala.thrift.TExecRequest$TExecRequestStandardScheme.write(TExecRequest.java:1382)
at org.apache.impala.thrift.TExecRequest$TExecRequestStandardScheme.write(TExecRequest.java:1225)
at org.apache.impala.thrift.TExecRequest.write(TExecRequest.java:1050)
at org.apache.thrift.TSerializer.serialize(TSerializer.java:79)
at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:163)
I0531 14:04:50.225301 80661 status.cc:122] OutOfMemoryError: Requested array size exceeds VM limit
@ 0x83c119 impala::Status::Status()
@ 0xb959b0 impala::JniUtil::GetJniExceptionMsg()
@ 0xaa6a4b impala::Frontend::GetExecRequest()
@ 0xac1785 impala::ImpalaServer::ExecuteInternal()
@ 0xac76f8 impala::ImpalaServer::Execute()
@ 0xb04176 impala::ImpalaServer::query()
@ 0xd6a1f5 beeswax::BeeswaxServiceProcessor::process_query()
@ 0xd6d4f4 beeswax::BeeswaxServiceProcessor::dispatchCall()
@ 0x80c36c apache::thrift::TDispatchProcessor::process()
@ 0x1b4937b apache::thrift::server::TThreadPoolServer::Task::run()
@ 0x1b30f39 apache::thrift::concurrency::ThreadManager::Worker::run()
@ 0x9fb759 impala::ThriftThread::RunRunnable()
@ 0x9fc1b2 boost::detail::function::void_function_obj_invoker0<>::invoke()
@ 0xbec7d9 impala::Thread::SuperviseThread()
@ 0xbed194 boost::detail::thread_data<>::run()
@ 0xe540ea (unknown)
@ 0x3ce2a07aa1 (unknown)
@ 0x3ce26e893d (unknown)
Query
select * from (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a1, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a2, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a3, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a4, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a5, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a6, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a7, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a8, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a9, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a10, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a11, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a12, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a13, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a14, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a15, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a16, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a17, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a18, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a19, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a20, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a21, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a22, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a23, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a24, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a25, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a26, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a27, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a28, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a29, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a30, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a31, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a32, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a33, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a34, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a35, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a36, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a37, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a38, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a39, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a40, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a41, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a42, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a43, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a44, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a45, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a46, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a47, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a48, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a49, (select /* +straight_join */ count(*) from lineitem a join /* +shuffle */ orders b on a.l_orderkey = b.o_orderkey where a.l_orderkey = b.o_orderkey and l_shipdate between "1992-01-01" and "1994-01-01" and o_orderdate between "1992-01-01" and "1994-01-01" group by a.l_orderkey having count(*) > 9999999999) a50;
Plan
+-------------------------------------------------------+ | Explain String | +-------------------------------------------------------+ | Per-Host Resource Reservation: Memory=12.63GB | | Per-Host Resource Estimates: Memory=116.24GB | | | | PLAN-ROOT SINK | | | | | 398:EXCHANGE [UNPARTITIONED] | | | | | 248:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--397:EXCHANGE [BROADCAST] | | | | | | | 199:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 198:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--396:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 197:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 395:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 196:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 247:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--394:EXCHANGE [BROADCAST] | | | | | | | 195:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 194:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--393:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 193:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 392:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 192:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 246:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--391:EXCHANGE [BROADCAST] | | | | | | | 191:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 190:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--390:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 189:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 389:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 188:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 245:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--388:EXCHANGE [BROADCAST] | | | | | | | 187:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 186:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--387:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 185:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 386:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 184:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 244:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--385:EXCHANGE [BROADCAST] | | | | | | | 183:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 182:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--384:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 181:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 383:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 180:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 243:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--382:EXCHANGE [BROADCAST] | | | | | | | 179:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 178:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--381:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 177:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 380:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 176:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 242:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--379:EXCHANGE [BROADCAST] | | | | | | | 175:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 174:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--378:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 173:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 377:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 172:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 241:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--376:EXCHANGE [BROADCAST] | | | | | | | 171:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 170:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--375:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 169:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 374:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 168:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 240:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--373:EXCHANGE [BROADCAST] | | | | | | | 167:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 166:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--372:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 165:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 371:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 164:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 239:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--370:EXCHANGE [BROADCAST] | | | | | | | 163:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 162:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--369:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 161:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 368:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 160:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 238:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--367:EXCHANGE [BROADCAST] | | | | | | | 159:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 158:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--366:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 157:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 365:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 156:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 237:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--364:EXCHANGE [BROADCAST] | | | | | | | 155:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 154:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--363:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 153:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 362:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 152:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 236:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--361:EXCHANGE [BROADCAST] | | | | | | | 151:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 150:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--360:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 149:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 359:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 148:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 235:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--358:EXCHANGE [BROADCAST] | | | | | | | 147:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 146:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--357:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 145:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 356:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 144:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 234:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--355:EXCHANGE [BROADCAST] | | | | | | | 143:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 142:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--354:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 141:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 353:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 140:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 233:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--352:EXCHANGE [BROADCAST] | | | | | | | 139:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 138:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--351:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 137:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 350:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 136:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 232:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--349:EXCHANGE [BROADCAST] | | | | | | | 135:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 134:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--348:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 133:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 347:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 132:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 231:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--346:EXCHANGE [BROADCAST] | | | | | | | 131:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 130:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--345:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 129:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 344:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 128:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 230:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--343:EXCHANGE [BROADCAST] | | | | | | | 127:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 126:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--342:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 125:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 341:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 124:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 229:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--340:EXCHANGE [BROADCAST] | | | | | | | 123:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 122:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--339:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 121:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 338:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 120:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 228:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--337:EXCHANGE [BROADCAST] | | | | | | | 119:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 118:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--336:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 117:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 335:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 116:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 227:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--334:EXCHANGE [BROADCAST] | | | | | | | 115:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 114:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--333:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 113:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 332:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 112:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 226:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--331:EXCHANGE [BROADCAST] | | | | | | | 111:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 110:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--330:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 109:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 329:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 108:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 225:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--328:EXCHANGE [BROADCAST] | | | | | | | 107:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 106:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--327:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 105:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 326:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 104:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 224:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--325:EXCHANGE [BROADCAST] | | | | | | | 103:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 102:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--324:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 101:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 323:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 100:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 223:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--322:EXCHANGE [BROADCAST] | | | | | | | 99:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 98:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--321:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 97:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 320:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 96:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 222:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--319:EXCHANGE [BROADCAST] | | | | | | | 95:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 94:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--318:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 93:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 317:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 92:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 221:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--316:EXCHANGE [BROADCAST] | | | | | | | 91:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 90:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--315:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 89:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 314:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 88:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 220:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--313:EXCHANGE [BROADCAST] | | | | | | | 87:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 86:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--312:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 85:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 311:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 84:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 219:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--310:EXCHANGE [BROADCAST] | | | | | | | 83:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 82:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--309:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 81:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 308:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 80:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 218:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--307:EXCHANGE [BROADCAST] | | | | | | | 79:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 78:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--306:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 77:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 305:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 76:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 217:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--304:EXCHANGE [BROADCAST] | | | | | | | 75:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 74:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--303:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 73:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 302:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 72:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 216:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--301:EXCHANGE [BROADCAST] | | | | | | | 71:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 70:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--300:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 69:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 299:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 68:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 215:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--298:EXCHANGE [BROADCAST] | | | | | | | 67:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 66:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--297:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 65:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 296:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 64:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 214:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--295:EXCHANGE [BROADCAST] | | | | | | | 63:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 62:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--294:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 61:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 293:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 60:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 213:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--292:EXCHANGE [BROADCAST] | | | | | | | 59:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 58:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--291:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 57:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 290:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 56:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 212:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--289:EXCHANGE [BROADCAST] | | | | | | | 55:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 54:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--288:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 53:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 287:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 52:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 211:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--286:EXCHANGE [BROADCAST] | | | | | | | 51:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 50:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--285:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 49:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 284:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 48:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 210:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--283:EXCHANGE [BROADCAST] | | | | | | | 47:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 46:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--282:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 45:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 281:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 44:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 209:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--280:EXCHANGE [BROADCAST] | | | | | | | 43:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 42:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | | | | |--279:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 41:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 278:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 40:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | | | 208:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--277:EXCHANGE [BROADCAST] | | | | | | | 39:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 38:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF009 <- b.o_orderkey | | | | | | | |--276:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 37:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 275:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 36:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF009 -> a.l_orderkey | | | | | 207:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--274:EXCHANGE [BROADCAST] | | | | | | | 35:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 34:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF008 <- b.o_orderkey | | | | | | | |--273:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 33:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 272:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 32:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF008 -> a.l_orderkey | | | | | 206:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--271:EXCHANGE [BROADCAST] | | | | | | | 31:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 30:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF007 <- b.o_orderkey | | | | | | | |--270:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 29:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 269:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 28:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF007 -> a.l_orderkey | | | | | 205:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--268:EXCHANGE [BROADCAST] | | | | | | | 27:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 26:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF006 <- b.o_orderkey | | | | | | | |--267:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 25:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 266:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 24:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF006 -> a.l_orderkey | | | | | 204:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--265:EXCHANGE [BROADCAST] | | | | | | | 23:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 22:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF005 <- b.o_orderkey | | | | | | | |--264:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 21:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 263:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 20:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF005 -> a.l_orderkey | | | | | 203:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--262:EXCHANGE [BROADCAST] | | | | | | | 19:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 18:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF004 <- b.o_orderkey | | | | | | | |--261:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 17:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | +-------------------------------------------------------+ +-------------------------------------------------------+ | Explain String | +-------------------------------------------------------+ | | | | | | 260:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 16:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF004 -> a.l_orderkey | | | | | 202:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--259:EXCHANGE [BROADCAST] | | | | | | | 15:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 14:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF003 <- b.o_orderkey | | | | | | | |--258:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 13:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 257:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 12:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF003 -> a.l_orderkey | | | | | 201:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--256:EXCHANGE [BROADCAST] | | | | | | | 11:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 10:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF002 <- b.o_orderkey | | | | | | | |--255:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 09:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 254:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 08:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF002 -> a.l_orderkey | | | | | 200:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | | | | |--253:EXCHANGE [BROADCAST] | | | | | | | 07:AGGREGATE [FINALIZE] | | | | output: count(*) | | | | group by: a.l_orderkey | | | | having: count(*) > 9999999999 | | | | | | | 06:HASH JOIN [INNER JOIN, PARTITIONED] | | | | hash predicates: a.l_orderkey = b.o_orderkey | | | | runtime filters: RF001 <- b.o_orderkey | | | | | | | |--252:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | | | 05:SCAN HDFS [tpch_1000_parquet.orders b] | | | | partitions=732/2406 files=98088 size=22.75GB | | | | | | | 251:EXCHANGE [HASH(a.l_orderkey)] | | | | | | | 04:SCAN HDFS [tpch_1000_parquet.lineitem a] | | | partitions=731/2526 files=97954 size=76.92GB | | | runtime filters: RF001 -> a.l_orderkey | | | | | 03:AGGREGATE [FINALIZE] | | | output: count(*) | | | group by: a.l_orderkey | | | having: count(*) > 9999999999 | | | | | 02:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash predicates: a.l_orderkey = b.o_orderkey | | | runtime filters: RF000 <- b.o_orderkey | | | | | |--250:EXCHANGE [HASH(b.o_orderkey)] | | | | | | | 01:SCAN HDFS [tpch_1000_parquet.orders b] | | | partitions=732/2406 files=98088 size=22.75GB | | | | | 249:EXCHANGE [HASH(a.l_orderkey)] | | | | | 00:SCAN HDFS [tpch_1000_parquet.lineitem a] | | partitions=731/2526 files=97954 size=76.92GB | | runtime filters: RF000 -> a.l_orderkey | +-------------------------------------------------------+
Attachments
Issue Links
- duplicates
-
IMPALA-5225 Queries that reference >6Million files and 500K partitions can fail with java.lang.OutOfMemoryError while serializing PlanFragment
- Open