Query (id=5b46fc38f6b67fb9:10af6fc100000000): Summary: Session ID: 754d1073e0124d48:50da6206ba3efa89 Session Type: BEESWAX Start Time: 2017-08-14 20:39:07.064703000 End Time: 2017-08-14 21:10:25.435940000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (build 986c035fe4c0861fd9b2926ba870e5c0f957cc22) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:57158 Default Db: tpch_60_parquet Sql Statement: select count(*) from (select distinct * from lineitem) v Coordinator: tarmstrong-box2:22000 Query Options (non default): MEM_LIMIT=10737418240,MT_DOP=0 Plan: ---------------- Per-Host Resource Reservation: Memory=34.00MB Per-Host Resource Estimates: Memory=197.50GB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | tuple-ids=3 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=8B cardinality=1 | F01:PLAN FRAGMENT [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] hosts=1 instances=1 Per-Host Resources: mem-estimate=98.40GB mem-reservation=34.00MB 02:AGGREGATE | output: count(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | tuple-ids=3 row-size=8B cardinality=1 | 04:AGGREGATE [FINALIZE] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 03:EXCHANGE [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=267B cardinality=360011594 | F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 Per-Host Resources: mem-estimate=99.08GB mem-reservation=0B 01:AGGREGATE [STREAMING] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=0B spill-buffer=2.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 00:SCAN HDFS [tpch_60_parquet.lineitem, RANDOM] partitions=1/1 files=51 size=12.56GB stats-rows=360011594 extrapolated-rows=disabled table stats: rows=360011594 size=12.56GB column stats: all mem-estimate=704.00MB mem-reservation=0B tuple-ids=0 row-size=267B cardinality=360011594 ---------------- Estimated Per-Host Mem: 212059697970 Per-Host Memory Reservation: 35651584 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 79.192us 79.192us 1 1 20.00 KB 10.00 MB FINALIZE 05:EXCHANGE 1 6.076us 6.076us 1 1 0 0 UNPARTITIONED 02:AGGREGATE 1 184.411ms 184.411ms 1 1 16.00 KB 10.00 MB 04:AGGREGATE 1 22m35s 22m35s 360.01M 360.01M 7.76 GB 98.39 GB FINALIZE 03:EXCHANGE 1 4s368ms 4s368ms 360.01M 360.01M 0 0 HASH(tpch_60_parquet.lineit... 01:AGGREGATE 1 2m 2m 360.01M 360.01M 245.31 MB 98.39 GB STREAMING 00:SCAN HDFS 1 4m32s 4m32s 360.01M 360.01M 1.57 GB 704.00 MB tpch_60_parquet.lineitem Errors: Planner Timeline: 44.102ms - Analysis finished: 14.585ms (14.585ms) - Equivalence classes computed: 19.390ms (4.805ms) - Single node plan created: 26.727ms (7.337ms) - Runtime filters computed: 26.773ms (45.451us) - Distributed plan created: 28.801ms (2.028ms) - Planning finished: 44.102ms (15.300ms) Query Timeline: 31m18s - Query submitted: 21.118us (21.118us) - Planning finished: 46.772ms (46.751ms) - Submit for admission: 46.922ms (150.207us) - Completed admission: 46.951ms (28.613us) - Ready to start on 1 backends: 47.029ms (78.301us) - All 1 execution backends (3 fragment instances) started: 47.596ms (566.767us) - Rows available: 31m17s (31m17s) - First row fetched: 31m18s (809.083ms) - Unregister query: 31m18s (4.287ms) - ComputeScanRangeAssignmentTimer: 58.915us ImpalaServer: - ClientFetchWaitTimer: 811.105ms - RowMaterializationTimer: 2.226ms Execution Profile 5b46fc38f6b67fb9:10af6fc100000000:(Total: 31m17s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, min / max: 0 / 0, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 Per Node Peak Memory Usage: tarmstrong-box2:22000(9.14 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 31m18s, non-child: 810.105ms, % non-child: 0.04%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:31m18s max:31m18s mean: 31m18s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9809093224) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 31m17s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 31m18s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 809.279ms - ExecTreeExecTime: 2.865us - OpenTime: 31m17s - ExecTreeOpenTime: 31m17s - PrepareTime: 16.628ms - ExecTreePrepareTime: 28.815us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 15.798ms, non-child: 15.798ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.405ms AGGREGATION_NODE (id=6):(Total: 31m17s, non-child: 79.192us, % non-child: 0.00%) - BuildTime: 2.188us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 31m17s, non-child: 31m17s, % non-child: 100.00%) - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 902.000ns - DeserializeRowBatchTimer: 3.735us - FirstBatchArrivalWaitTime: 31m17s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F02: Instance 5b46fc38f6b67fb9:10af6fc100000000 (host=tarmstrong-box2:22000):(Total: 31m18s, non-child: 810.105ms, % non-child: 0.04%) MemoryUsage(32s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9809093224) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 31m17s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 31m18s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 809.279ms - ExecTreeExecTime: 2.865us - OpenTime: 31m17s - ExecTreeOpenTime: 31m17s - PrepareTime: 16.628ms - ExecTreePrepareTime: 28.815us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 15.798ms, non-child: 15.798ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.405ms AGGREGATION_NODE (id=6):(Total: 31m17s, non-child: 79.192us, % non-child: 0.00%) - BuildTime: 2.188us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 31m17s, non-child: 6.076us, % non-child: 0.00%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 902.000ns - DeserializeRowBatchTimer: 3.735us - FirstBatchArrivalWaitTime: 31m17s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 31m17s, non-child: 2.526ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:31m17s max:31m17s mean: 31m17s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.79 GB (8361381183) - PeakReservation: 7.76 GB (8336179200) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9809093224) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 8m38s - TotalNetworkSendTime: 250.340us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 29.80K (29803) - TotalThreadsTotalWallClockTime: 31m17s - TotalThreadsSysTime: 42s116ms - TotalThreadsUserTime: 10m23s - TotalThreadsVoluntaryContextSwitches: 397.62K (397619) Fragment Instance Lifecycle Timings: - ExecTime: 319.227us - ExecTreeExecTime: 1.953us - OpenTime: 31m17s - ExecTreeOpenTime: 31m17s - PrepareTime: 13.423ms - ExecTreePrepareTime: 85.312us DataStreamSender (dst_id=5):(Total: 42.724us, non-child: 42.724us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 577.74 KB/sec - OverallThroughput: 365.72 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 5.788us - TransmitDataRPCTime: 27.045us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 174.687ms, non-child: 174.687ms, % non-child: 100.00%) - CodegenTime: 2.127ms - CompileTime: 53.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 109.586ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 11.309ms AGGREGATION_NODE (id=2):(Total: 31m17s, non-child: 184.411ms, % non-child: 0.01%) - BuildTime: 120.448ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 31m17s, non-child: 22m35s, % non-child: 72.20%) - BuildTime: 2m40s - GetResultsTime: 4s721ms - HTResizeTime: 17s024ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.76 GB (8336845610) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 191.79 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 10s100ms - CumulativeAllocationBytes: 277.17 GB (297608937472) - CumulativeAllocations: 131.95K (131947) - PeakReservation: 7.76 GB (8336179200) - PeakUnpinnedBytes: 84.52 GB (90756349952) - PeakUsedReservation: 7.76 GB (8336179200) - ReadIoBytes: 82.52 GB (88606769152) - ReadIoOps: 42.25K (42251) - ReadIoWaitTime: 10m24s - WriteIoBytes: 84.52 GB (90756349952) - WriteIoOps: 43.28K (43276) - WriteIoWaitTime: 1m2s EXCHANGE_NODE (id=3):(Total: 8m41s, non-child: 8m41s, % non-child: 100.00%) - BytesReceived: 39.92 GB (42862240193) - ConvertRowBatchTime: 2s814ms - DeserializeRowBatchTimer: 1m24s - FirstBatchArrivalWaitTime: 532.385ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 689.90 K/sec - SendersBlockedTimer: 57s939ms - SendersBlockedTotalTimer(*): 57s939ms Fragment F01: Instance 5b46fc38f6b67fb9:10af6fc100000002 (host=tarmstrong-box2:22000):(Total: 31m17s, non-child: 2.526ms, % non-child: 0.00%) MemoryUsage(32s000ms): 4.50 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.76 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.79 GB (8361381183) - PeakReservation: 7.76 GB (8336179200) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9809093224) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 8m38s - TotalNetworkSendTime: 250.340us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 29.80K (29803) - TotalThreadsTotalWallClockTime: 31m17s - TotalThreadsSysTime: 42s116ms - TotalThreadsUserTime: 10m23s - TotalThreadsVoluntaryContextSwitches: 397.62K (397619) Fragment Instance Lifecycle Timings: - ExecTime: 319.227us - ExecTreeExecTime: 1.953us - OpenTime: 31m17s - ExecTreeOpenTime: 31m17s - PrepareTime: 13.423ms - ExecTreePrepareTime: 85.312us DataStreamSender (dst_id=5):(Total: 42.724us, non-child: 42.724us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 577.74 KB/sec - OverallThroughput: 365.72 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 5.788us - TransmitDataRPCTime: 27.045us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 174.687ms, non-child: 174.687ms, % non-child: 100.00%) - CodegenTime: 2.127ms - CompileTime: 53.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 109.586ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 11.309ms AGGREGATION_NODE (id=2):(Total: 31m17s, non-child: 184.411ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 120.448ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 31m17s, non-child: 22m35s, % non-child: 72.20%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m40s - GetResultsTime: 4s721ms - HTResizeTime: 17s024ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.76 GB (8336845610) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 191.79 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 10s100ms - CumulativeAllocationBytes: 277.17 GB (297608937472) - CumulativeAllocations: 131.95K (131947) - PeakReservation: 7.76 GB (8336179200) - PeakUnpinnedBytes: 84.52 GB (90756349952) - PeakUsedReservation: 7.76 GB (8336179200) - ReadIoBytes: 82.52 GB (88606769152) - ReadIoOps: 42.25K (42251) - ReadIoWaitTime: 10m24s - WriteIoBytes: 84.52 GB (90756349952) - WriteIoOps: 43.28K (43276) - WriteIoWaitTime: 1m2s EXCHANGE_NODE (id=3):(Total: 8m41s, non-child: 4s368ms, % non-child: 0.84%) BytesReceived(16s000ms): 913.86 MB, 2.77 GB, 4.53 GB, 6.08 GB, 7.73 GB, 9.46 GB, 11.04 GB, 12.16 GB, 13.25 GB, 13.79 GB, 14.87 GB, 15.42 GB, 16.50 GB, 16.95 GB, 17.25 GB, 17.77 GB, 19.08 GB, 20.45 GB, 21.30 GB, 22.45 GB, 23.01 GB, 23.74 GB, 24.81 GB, 25.79 GB, 26.14 GB, 26.49 GB, 27.09 GB, 28.19 GB, 29.05 GB, 29.24 GB, 29.61 GB, 30.82 GB, 32.06 GB, 32.50 GB, 33.25 GB, 33.65 GB, 34.35 GB, 35.85 GB, 37.16 GB, 38.47 GB, 38.78 GB, 38.94 GB - BytesReceived: 39.92 GB (42862240193) - ConvertRowBatchTime: 2s814ms - DeserializeRowBatchTimer: 1m24s - FirstBatchArrivalWaitTime: 532.385ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 689.90 K/sec - SendersBlockedTimer: 57s939ms - SendersBlockedTotalTimer(*): 57s939ms Averaged Fragment F00:(Total: 11m22s, non-child: 59s927ms, % non-child: 8.78%) split sizes: min: 12.56 GB, max: 12.56 GB, avg: 12.56 GB, stddev: 0 completion times: min:11m22s max:11m22s mean: 11m22s stddev:0.000ns execution rates: min:18.84 MB/sec max:18.84 MB/sec mean:18.84 MB/sec stddev:0.06 B/sec num instances: 1 - AverageThreadTokens: 5.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.81 GB (1939323763) - PeakReservation: 242.00 MB (253755392) - PeakUsedReservation: 0 - PerHostPeak96.18 MB, 932.27 MB, 773.00 MB, 839.25 MB, 807.39 MB, 693.57 MB, 651.31 MB ThreadUsage(16s000ms): 8, 8, 7, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4 - AverageThreadTokens: 5.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.81 GB (1939323763) - PeakReservation: 242.00 MB (253755392) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9809093224) - RowsProduced: 360.01M (360011594) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m10s - TotalStorageWaitTime: 20m18s - TotalThreadsInvoluntaryContextSwitches: 10.35K (10354) - TotalThreadsTotalWallClockTime: 58m16s - TotalThreadsSysTime: 2s388ms - TotalThreadsUserTime: 6m59s - TotalThreadsVoluntaryContextSwitches: 349.89K (349894) Fragment Instance Lifecycle Timings: - ExecTime: 11m22s - ExecTreeExecTime: 6m32s - OpenTime: 168.124ms - ExecTreeOpenTime: 106.067us - PrepareTime: 18.802ms - ExecTreePrepareTime: 586.436us DataStreamSender (dst_id=3):(Total: 3m49s, non-child: 3m49s, % non-child: 100.00%) - BytesSent: 39.92 GB (42862240193) - NetworkThroughput(*): 3.45 GB/sec - OverallThroughput: 177.98 MB/sec - PeakMemoryUsage: 672.00 B (672) - RowsReturned: 360.01M (360011594) - SerializeBatchTime: 3m38s - TransmitDataRPCTime: 11s570ms - UncompressedRowBatchSize: 91.46 GB (98207171238) CodeGen:(Total: 184.477ms, non-child: 184.477ms, % non-child: 100.00%) - CodegenTime: 2.264ms - CompileTime: 54.352ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 85 (85) - NumInstructions: 2.45K (2449) - OptimizationTime: 112.995ms - PeakMemoryUsage: 1.20 MB (1253888) - PrepareTime: 16.731ms AGGREGATION_NODE (id=1):(Total: 6m32s, non-child: 2m, % non-child: 30.66%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 10.419ms - HTResizeTime: 9.392ms - HashBuckets: 1.05M (1048576) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 245.31 MB (257224075) - ReductionFactorEstimate: 1.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 359.23M (359225162) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 916.69 K/sec - StreamingTime: 2m Buffer pool: - AllocTime: 123.652us - CumulativeAllocationBytes: 242.00 MB (253755392) - CumulativeAllocations: 121 (121) - PeakReservation: 242.00 MB (253755392) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 242.00 MB (253755392) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:51/12.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 51 out of 51 Hdfs Read Thread Concurrency Bucket: 0:25.02% Query (id=2049e522067fd280:2802010000000000): Summary: Session ID: 5e44d57fe9deccb8:dff330766d1689ae Session Type: BEESWAX Start Time: 2017-08-14 21:50:52.484564000 End Time: 2017-08-14 22:24:29.058819000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (build 986c035fe4c0861fd9b2926ba870e5c0f957cc22) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:60716 Default Db: tpch_60_parquet Sql Statement: select count(*) from (select distinct * from lineitem) v Coordinator: tarmstrong-box2:22000 Query Options (non default): MEM_LIMIT=10737418240,MT_DOP=0 Plan: ---------------- Per-Host Resource Reservation: Memory=34.00MB Per-Host Resource Estimates: Memory=197.50GB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | tuple-ids=3 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=8B cardinality=1 | F01:PLAN FRAGMENT [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] hosts=1 instances=1 Per-Host Resources: mem-estimate=98.40GB mem-reservation=34.00MB 02:AGGREGATE | output: count(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | tuple-ids=3 row-size=8B cardinality=1 | 04:AGGREGATE [FINALIZE] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 03:EXCHANGE [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=267B cardinality=360011594 | F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 Per-Host Resources: mem-estimate=99.08GB mem-reservation=0B 01:AGGREGATE [STREAMING] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=0B spill-buffer=2.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 00:SCAN HDFS [tpch_60_parquet.lineitem, RANDOM] partitions=1/1 files=51 size=12.56GB stats-rows=360011594 extrapolated-rows=disabled table stats: rows=360011594 size=12.56GB column stats: all mem-estimate=704.00MB mem-reservation=0B tuple-ids=0 row-size=267B cardinality=360011594 ---------------- Estimated Per-Host Mem: 212059697970 Per-Host Memory Reservation: 35651584 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 399.899us 399.899us 1 1 20.00 KB 10.00 MB FINALIZE 05:EXCHANGE 1 5.611us 5.611us 1 1 0 0 UNPARTITIONED 02:AGGREGATE 1 184.085ms 184.085ms 1 1 16.00 KB 10.00 MB 04:AGGREGATE 1 23m24s 23m24s 360.01M 360.01M 7.76 GB 98.39 GB FINALIZE 03:EXCHANGE 1 4s800ms 4s800ms 360.01M 360.01M 0 0 HASH(tpch_60_parquet.lineit... 01:AGGREGATE 1 1m59s 1m59s 360.01M 360.01M 245.31 MB 98.39 GB STREAMING 00:SCAN HDFS 1 5m58s 5m58s 360.01M 360.01M 1.56 GB 704.00 MB tpch_60_parquet.lineitem Errors: Planner Timeline: 5s072ms - Metadata load started: 7.274ms (7.274ms) - Metadata load finished: 4s935ms (4s928ms) - Analysis finished: 4s975ms (39.744ms) - Equivalence classes computed: 4s992ms (17.406ms) - Single node plan created: 5s020ms (27.362ms) - Runtime filters computed: 5s022ms (2.117ms) - Distributed plan created: 5s025ms (3.580ms) - Planning finished: 5s072ms (46.258ms) Query Timeline: 33m36s - Query submitted: 23.889us (23.889us) - Planning finished: 5s081ms (5s081ms) - Submit for admission: 5s081ms (119.997us) - Completed admission: 5s081ms (55.294us) - Ready to start on 1 backends: 5s081ms (76.589us) - All 1 execution backends (3 fragment instances) started: 5s082ms (743.159us) - Rows available: 33m36s (33m30s) - First row fetched: 33m36s (546.975ms) - Unregister query: 33m36s (4.844ms) - ComputeScanRangeAssignmentTimer: 36.873us ImpalaServer: - ClientFetchWaitTimer: 549.350ms - RowMaterializationTimer: 2.435ms Execution Profile 2049e522067fd280:2802010000000000:(Total: 33m30s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: tarmstrong-box2:22000(9.14 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 33m31s, non-child: 550.992ms, % non-child: 0.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:33m31s max:33m31s mean: 33m31s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9808713466) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 33m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 33m31s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 550.831ms - ExecTreeExecTime: 2.698us - OpenTime: 33m30s - ExecTreeOpenTime: 33m30s - PrepareTime: 16.179ms - ExecTreePrepareTime: 52.008us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 15.995ms, non-child: 15.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.571ms AGGREGATION_NODE (id=6):(Total: 33m30s, non-child: 399.899us, % non-child: 0.00%) - BuildTime: 320.937us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 33m30s, non-child: 33m30s, % non-child: 100.00%) - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 323.000ns - DeserializeRowBatchTimer: 1.981us - FirstBatchArrivalWaitTime: 33m30s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F02: Instance 2049e522067fd280:2802010000000000 (host=tarmstrong-box2:22000):(Total: 33m31s, non-child: 550.992ms, % non-child: 0.03%) MemoryUsage(32s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9808713466) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 33m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 33m31s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 550.831ms - ExecTreeExecTime: 2.698us - OpenTime: 33m30s - ExecTreeOpenTime: 33m30s - PrepareTime: 16.179ms - ExecTreePrepareTime: 52.008us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 15.995ms, non-child: 15.995ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.571ms AGGREGATION_NODE (id=6):(Total: 33m30s, non-child: 399.899us, % non-child: 0.00%) - BuildTime: 320.937us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 33m30s, non-child: 5.611us, % non-child: 0.00%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 323.000ns - DeserializeRowBatchTimer: 1.981us - FirstBatchArrivalWaitTime: 33m30s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 33m30s, non-child: 3.642ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:33m30s max:33m30s mean: 33m30s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.79 GB (8361380825) - PeakReservation: 7.76 GB (8336179200) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9808713466) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 10m2s - TotalNetworkSendTime: 278.485us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 36.20K (36195) - TotalThreadsTotalWallClockTime: 33m30s - TotalThreadsSysTime: 56s100ms - TotalThreadsUserTime: 10m18s - TotalThreadsVoluntaryContextSwitches: 387.97K (387971) Fragment Instance Lifecycle Timings: - ExecTime: 449.279us - ExecTreeExecTime: 3.901us - OpenTime: 33m30s - ExecTreeOpenTime: 33m30s - PrepareTime: 17.963ms - ExecTreePrepareTime: 93.536us DataStreamSender (dst_id=5):(Total: 49.199us, non-child: 49.199us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 424.70 KB/sec - OverallThroughput: 317.59 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 4.358us - TransmitDataRPCTime: 36.791us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 177.413ms, non-child: 177.413ms, % non-child: 100.00%) - CodegenTime: 1.985ms - CompileTime: 52.640ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 107.999ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 16.332ms AGGREGATION_NODE (id=2):(Total: 33m30s, non-child: 184.085ms, % non-child: 0.01%) - BuildTime: 120.069ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 33m30s, non-child: 23m24s, % non-child: 69.87%) - BuildTime: 3m16s - GetResultsTime: 4s699ms - HTResizeTime: 17s006ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.76 GB (8336900365) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 179.06 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 5s113ms - CumulativeAllocationBytes: 277.19 GB (297625714688) - CumulativeAllocations: 131.96K (131955) - PeakReservation: 7.76 GB (8336179200) - PeakUnpinnedBytes: 84.53 GB (90764738560) - PeakUsedReservation: 7.76 GB (8336179200) - ReadIoBytes: 82.53 GB (88615157760) - ReadIoOps: 42.26K (42255) - ReadIoWaitTime: 10m31s - WriteIoBytes: 84.53 GB (90764738560) - WriteIoOps: 43.28K (43280) - WriteIoWaitTime: 1m44s EXCHANGE_NODE (id=3):(Total: 10m5s, non-child: 10m5s, % non-child: 100.00%) - BytesReceived: 39.92 GB (42862218872) - ConvertRowBatchTime: 2s906ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 649.869ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 594.23 K/sec - SendersBlockedTimer: 1m38s - SendersBlockedTotalTimer(*): 1m38s Fragment F01: Instance 2049e522067fd280:2802010000000002 (host=tarmstrong-box2:22000):(Total: 33m30s, non-child: 3.642ms, % non-child: 0.00%) MemoryUsage(32s000ms): 4.48 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.77 GB, 7.76 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.77 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB, 7.76 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.79 GB (8361380825) - PeakReservation: 7.76 GB (8336179200) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9808713466) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 10m2s - TotalNetworkSendTime: 278.485us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 36.20K (36195) - TotalThreadsTotalWallClockTime: 33m30s - TotalThreadsSysTime: 56s100ms - TotalThreadsUserTime: 10m18s - TotalThreadsVoluntaryContextSwitches: 387.97K (387971) Fragment Instance Lifecycle Timings: - ExecTime: 449.279us - ExecTreeExecTime: 3.901us - OpenTime: 33m30s - ExecTreeOpenTime: 33m30s - PrepareTime: 17.963ms - ExecTreePrepareTime: 93.536us DataStreamSender (dst_id=5):(Total: 49.199us, non-child: 49.199us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 424.70 KB/sec - OverallThroughput: 317.59 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 4.358us - TransmitDataRPCTime: 36.791us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 177.413ms, non-child: 177.413ms, % non-child: 100.00%) - CodegenTime: 1.985ms - CompileTime: 52.640ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 107.999ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 16.332ms AGGREGATION_NODE (id=2):(Total: 33m30s, non-child: 184.085ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 120.069ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 33m30s, non-child: 23m24s, % non-child: 69.87%) ExecOption: Codegen Enabled, Spilled - BuildTime: 3m16s - GetResultsTime: 4s699ms - HTResizeTime: 17s006ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.76 GB (8336900365) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 179.06 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 5s113ms - CumulativeAllocationBytes: 277.19 GB (297625714688) - CumulativeAllocations: 131.96K (131955) - PeakReservation: 7.76 GB (8336179200) - PeakUnpinnedBytes: 84.53 GB (90764738560) - PeakUsedReservation: 7.76 GB (8336179200) - ReadIoBytes: 82.53 GB (88615157760) - ReadIoOps: 42.26K (42255) - ReadIoWaitTime: 10m31s - WriteIoBytes: 84.53 GB (90764738560) - WriteIoOps: 43.28K (43280) - WriteIoWaitTime: 1m44s EXCHANGE_NODE (id=3):(Total: 10m5s, non-child: 4s800ms, % non-child: 0.79%) BytesReceived(16s000ms): 899.72 MB, 2.78 GB, 4.45 GB, 6.12 GB, 7.80 GB, 9.09 GB, 10.61 GB, 11.01 GB, 11.39 GB, 12.62 GB, 13.60 GB, 13.97 GB, 15.16 GB, 16.15 GB, 16.90 GB, 17.83 GB, 18.07 GB, 18.33 GB, 19.51 GB, 20.26 GB, 20.62 GB, 21.13 GB, 22.00 GB, 22.72 GB, 23.01 GB, 23.75 GB, 24.38 GB, 25.36 GB, 25.93 GB, 26.31 GB, 26.83 GB, 27.47 GB, 28.77 GB, 29.26 GB, 29.55 GB, 30.11 GB, 30.73 GB, 31.06 GB, 32.36 GB, 32.92 GB, 33.71 GB, 34.63 GB, 35.66 GB, 35.95 GB, 36.31 GB, 37.33 GB, 38.10 GB, 38.91 GB, 39.09 GB, 39.47 GB - BytesReceived: 39.92 GB (42862218872) - ConvertRowBatchTime: 2s906ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 649.869ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 594.23 K/sec - SendersBlockedTimer: 1m38s - SendersBlockedTotalTimer(*): 1m38s Averaged Fragment F00:(Total: 13m22s, non-child: 1m33s, % non-child: 11.69%) split sizes: min: 12.56 GB, max: 12.56 GB, avg: 12.56 GB, stddev: 0 completion times: min:13m22s max:13m22s mean: 13m22s stddev:0.000ns execution rates: min:16.01 MB/sec max:16.01 MB/annerThreadsInvoluntaryContextSwitches: 6.03K (6026) - ScannerThreadsTotalWallClockTime: 54m2s - MaterializeTupleTime(*): 52s984ms - ScannerThreadsSysTime: 1s264ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 348.42K (348421) - TotalRawHdfsReadTime(*): 50m31s - TotalReadThroughput: 16.17 MB/sec Fragment F00: Instance 2049e522067fd280:2802010000000001 (host=tarmstrong-box2:22000):(Total: 13m22s, non-child: 1m33s, % non-child: 11.69%) Hdfs split stats (:<# splits>/): -1:51/12.56 GB MemoryUsage(16s000ms): 1.54 GB, 1.41 GB, 1005.66 MB, 1001.38 MB, 743.85 MB, 855.93 MB, 835.09 MB, 703.55 MB, 649.56 MB, 1.01 GB, 869.08 MB, 780.04 MB, 867.51 MB, 952.32 MB, 887.46 MB, 472.23 MB, 433.02 MB, 808.80 MB, 952.11 MB, 783.61 MB, 637.37 MB, 329.99 MB, 1.00 GB, 880.29 MB, 867.47 MB, 643.96 MB, 667.34 MB, 929.37 MB, 830.49 MB, 771.91 MB, 687.97 MB, 762.39 MB, 904.20 MB, 803.25 MB, 744.77 MB, 654.02 MB, 617.85 MB, 746.28 MB, 769.69 MB, 742.39 MB, 811.99 MB, 851.38 MB, 682.16 MB, 619.26 MB, 927.17 MB, 658.39 MB, 926.51 MB, 614.24 MB, 555.66 MB, 444.45 MB ThreadUsage(16s000ms): 8, 8, 7, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 3, 2 - AverageThreadTokens: 5.04 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.80 GB (1935131307) - PeakReservation: 242.00 MB (253755392) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.14 GB (9808713466) - RowsProduced: 360.01M (360011594) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m41s - TotalStorageWaitTime: 25m11s - TotalThreadsInvoluntaryContextSwitches: 11.01K (11008) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 2s116ms - TotalThreadsUserTime: 6m57s - TotalThreadsVoluntaryContextSwitches: 349.38K (349380) Fragment Instance Lifecycle Timings: - ExecTime: 13m22s - ExecTreeExecTime: 7m58s - OpenTime: 167.614ms - ExecTreeOpenTime: 193.576us - PrepareTime: 24.860ms - ExecTreePrepareTime: 12.457ms DataStreamSender (dst_id=3):(Total: 3m50s, non-child: 3m50s, % non-child: 100.00%) - BytesSent: 39.92 GB (42862218872) - NetworkThroughput(*): 3.28 GB/sec - OverallThroughput: 176.98 MB/sec - PeakMemoryUsage: 672.00 B (672) - RowsReturned: 360.01M (360011594) - SerializeBatchTime: 3m38s - TransmitDataRPCTime: 12s159ms - UncompressedRowBatchSize: 91.46 GB (98207171226) CodeGen:(Total: 178.086ms, non-child: 178.086ms, % non-child: 100.00%) - CodegenTime: 2.243ms - CompileTime: 54.399ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 85 (85) - NumInstructions: 2.45K (2449) - OptimizationTime: 112.586ms - PeakMemoryUsage: 1.20 MB (1253888) - PrepareTime: 10.804ms AGGREGATION_NODE (id=1):(Total: 7m57s, non-child: 1m59s, % non-child: 25.05%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 9.786ms - HTResizeTime: 9.635ms - HashBuckets: 1.05M (1048576) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - RowBatchQueueGetWaitTime: 5m55s - RowBatchQueuePutWaitTime: 27m20s - RowsRead: 360.01M (360011594) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 1.00 M/sec - ScanRangesComplete: 51 (51) - ScannerThreadsInvoluntaryContextSwitches: 6.03K (6026) - ScannerThreadsTotalWallClockTime: 54m2s - MaterializeTupleTime(*): 52s984ms - ScannerThreadsSysTime: 1s264ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 348.42K (348421) - TotalRawHdfsReadTime(*): 50m31s - TotalReadThroughput: 16.17 MB/sec