Query (id=ff4268d2a1a0f338:34a75c5a00000000): Summary: Session ID: 5e44d57fe9deccb8:dff330766d1689ae Session Type: BEESWAX Start Time: 2017-08-14 22:25:30.694670000 End Time: 2017-08-14 22:54:32.879092000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (build 986c035fe4c0861fd9b2926ba870e5c0f957cc22) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:60716 Default Db: tpch_60_parquet Sql Statement: select count(*) from (select distinct * from lineitem) v Coordinator: tarmstrong-box2:22000 Query Options (non default): MEM_LIMIT=10737418240,MT_DOP=0,DEFAULT_SPILLABLE_BUFFER_SIZE=8388608 Plan: ---------------- Per-Host Resource Reservation: Memory=136.00MB Per-Host Resource Estimates: Memory=197.50GB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=8.00MB | tuple-ids=3 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=8B cardinality=1 | F01:PLAN FRAGMENT [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] hosts=1 instances=1 Per-Host Resources: mem-estimate=98.40GB mem-reservation=136.00MB 02:AGGREGATE | output: count(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=8.00MB | tuple-ids=3 row-size=8B cardinality=1 | 04:AGGREGATE [FINALIZE] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=136.00MB spill-buffer=8.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 03:EXCHANGE [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=267B cardinality=360011594 | F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 Per-Host Resources: mem-estimate=99.08GB mem-reservation=0B 01:AGGREGATE [STREAMING] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=0B spill-buffer=8.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 00:SCAN HDFS [tpch_60_parquet.lineitem, RANDOM] partitions=1/1 files=51 size=12.56GB stats-rows=360011594 extrapolated-rows=disabled table stats: rows=360011594 size=12.56GB column stats: all mem-estimate=704.00MB mem-reservation=0B tuple-ids=0 row-size=267B cardinality=360011594 ---------------- Estimated Per-Host Mem: 212059697970 Per-Host Memory Reservation: 142606336 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 45.185us 45.185us 1 1 20.00 KB 10.00 MB FINALIZE 05:EXCHANGE 1 5.254us 5.254us 1 1 0 0 UNPARTITIONED 02:AGGREGATE 1 181.796ms 181.796ms 1 1 16.00 KB 10.00 MB 04:AGGREGATE 1 17m59s 17m59s 360.01M 360.01M 7.73 GB 98.39 GB FINALIZE 03:EXCHANGE 1 4s081ms 4s081ms 360.01M 360.01M 0 0 HASH(tpch_60_parquet.lineit... 01:AGGREGATE 1 1m57s 1m57s 360.01M 360.01M 283.31 MB 98.39 GB STREAMING 00:SCAN HDFS 1 6m44s 6m44s 360.01M 360.01M 1.57 GB 704.00 MB tpch_60_parquet.lineitem Errors: Planner Timeline: 59.198ms - Analysis finished: 14.109ms (14.109ms) - Equivalence classes computed: 27.877ms (13.768ms) - Single node plan created: 38.349ms (10.471ms) - Runtime filters computed: 38.411ms (62.375us) - Distributed plan created: 41.453ms (3.041ms) - Planning finished: 59.198ms (17.744ms) Query Timeline: 29m2s - Query submitted: 73.369us (73.369us) - Planning finished: 61.319ms (61.246ms) - Submit for admission: 62.031ms (711.341us) - Completed admission: 62.061ms (30.079us) - Ready to start on 1 backends: 62.142ms (81.738us) - All 1 execution backends (3 fragment instances) started: 62.833ms (690.441us) - Rows available: 29m1s (29m1s) - First row fetched: 29m2s (695.947ms) - Unregister query: 29m2s (3.891ms) - ComputeScanRangeAssignmentTimer: 628.289us ImpalaServer: - ClientFetchWaitTimer: 697.942ms - RowMaterializationTimer: 1.859ms Execution Profile ff4268d2a1a0f338:34a75c5a00000000:(Total: 29m1s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, min / max: 0 / 0, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 Per Node Peak Memory Usage: tarmstrong-box2:22000(9.13 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 29m2s, non-child: 696.831ms, % non-child: 0.04%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:29m2s max:29m2s mean: 29m2s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9807723913) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 29m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 29m2s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 696.038ms - ExecTreeExecTime: 1.136us - OpenTime: 29m1s - ExecTreeOpenTime: 29m1s - PrepareTime: 15.560ms - ExecTreePrepareTime: 24.180us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 14.767ms, non-child: 14.767ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 14.380ms AGGREGATION_NODE (id=6):(Total: 29m1s, non-child: 45.185us, % non-child: 0.00%) - BuildTime: 1.899us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 29m1s, non-child: 29m1s, % non-child: 100.00%) - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 246.000ns - DeserializeRowBatchTimer: 1.674us - FirstBatchArrivalWaitTime: 29m1s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F02: Instance ff4268d2a1a0f338:34a75c5a00000000 (host=tarmstrong-box2:22000):(Total: 29m2s, non-child: 696.831ms, % non-child: 0.04%) MemoryUsage(32s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9807723913) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 29m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 29m2s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 696.038ms - ExecTreeExecTime: 1.136us - OpenTime: 29m1s - ExecTreeOpenTime: 29m1s - PrepareTime: 15.560ms - ExecTreePrepareTime: 24.180us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 14.767ms, non-child: 14.767ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 14.380ms AGGREGATION_NODE (id=6):(Total: 29m1s, non-child: 45.185us, % non-child: 0.00%) - BuildTime: 1.899us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 29m1s, non-child: 5.254us, % non-child: 0.00%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 246.000ns - DeserializeRowBatchTimer: 1.674us - FirstBatchArrivalWaitTime: 29m1s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 29m1s, non-child: 2.669ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:29m1s max:29m1s mean: 29m1s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.75 GB (8321535262) - PeakReservation: 7.73 GB (8296333312) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9807723913) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 10m58s - TotalNetworkSendTime: 176.732us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19.15K (19147) - TotalThreadsTotalWallClockTime: 29m1s - TotalThreadsSysTime: 34s408ms - TotalThreadsUserTime: 7m44s - TotalThreadsVoluntaryContextSwitches: 361.37K (361367) Fragment Instance Lifecycle Timings: - ExecTime: 272.249us - ExecTreeExecTime: 1.058us - OpenTime: 29m1s - ExecTreeOpenTime: 29m1s - PrepareTime: 18.071ms - ExecTreePrepareTime: 77.900us DataStreamSender (dst_id=5):(Total: 31.419us, non-child: 31.419us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 1.15 MB/sec - OverallThroughput: 497.31 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 3.675us - TransmitDataRPCTime: 13.325us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 196.054ms, non-child: 196.054ms, % non-child: 100.00%) - CodegenTime: 3.035ms - CompileTime: 68.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 111.342ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 14.674ms AGGREGATION_NODE (id=2):(Total: 29m1s, non-child: 181.796ms, % non-child: 0.01%) - BuildTime: 119.931ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 29m1s, non-child: 17m59s, % non-child: 62.00%) - BuildTime: 2m9s - GetResultsTime: 4s746ms - HTResizeTime: 13s568ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.73 GB (8297035179) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 206.78 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 3s288ms - CumulativeAllocationBytes: 277.37 GB (297820749824) - CumulativeAllocations: 33.16K (33157) - PeakReservation: 7.73 GB (8296333312) - PeakUnpinnedBytes: 84.63 GB (90873790464) - PeakUsedReservation: 7.73 GB (8296333312) - ReadIoBytes: 82.63 GB (88726306816) - ReadIoOps: 10.58K (10577) - ReadIoWaitTime: 9m2s - WriteIoBytes: 84.63 GB (90873790464) - WriteIoOps: 10.83K (10833) - WriteIoWaitTime: 38s901ms EXCHANGE_NODE (id=3):(Total: 11m1s, non-child: 11m1s, % non-child: 100.00%) - BytesReceived: 39.92 GB (42862208769) - ConvertRowBatchTime: 2s831ms - DeserializeRowBatchTimer: 1m24s - FirstBatchArrivalWaitTime: 573.418ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 544.16 K/sec - SendersBlockedTimer: 38s693ms - SendersBlockedTotalTimer(*): 38s693ms Fragment F01: Instance ff4268d2a1a0f338:34a75c5a00000002 (host=tarmstrong-box2:22000):(Total: 29m1s, non-child: 2.669ms, % non-child: 0.00%) MemoryUsage(32s000ms): 4.45 GB, 7.73 GB, 7.73 GB, 7.74 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.75 GB (8321535262) - PeakReservation: 7.73 GB (8296333312) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9807723913) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 10m58s - TotalNetworkSendTime: 176.732us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19.15K (19147) - TotalThreadsTotalWallClockTime: 29m1s - TotalThreadsSysTime: 34s408ms - TotalThreadsUserTime: 7m44s - TotalThreadsVoluntaryContextSwitches: 361.37K (361367) Fragment Instance Lifecycle Timings: - ExecTime: 272.249us - ExecTreeExecTime: 1.058us - OpenTime: 29m1s - ExecTreeOpenTime: 29m1s - PrepareTime: 18.071ms - ExecTreePrepareTime: 77.900us DataStreamSender (dst_id=5):(Total: 31.419us, non-child: 31.419us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 1.15 MB/sec - OverallThroughput: 497.31 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 3.675us - TransmitDataRPCTime: 13.325us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 196.054ms, non-child: 196.054ms, % non-child: 100.00%) - CodegenTime: 3.035ms - CompileTime: 68.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 111.342ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 14.674ms AGGREGATION_NODE (id=2):(Total: 29m1s, non-child: 181.796ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 119.931ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 29m1s, non-child: 17m59s, % non-child: 62.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m9s - GetResultsTime: 4s746ms - HTResizeTime: 13s568ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.73 GB (8297035179) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 206.78 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 3s288ms - CumulativeAllocationBytes: 277.37 GB (297820749824) - CumulativeAllocations: 33.16K (33157) - PeakReservation: 7.73 GB (8296333312) - PeakUnpinnedBytes: 84.63 GB (90873790464) - PeakUsedReservation: 7.73 GB (8296333312) - ReadIoBytes: 82.63 GB (88726306816) - ReadIoOps: 10.58K (10577) - ReadIoWaitTime: 9m2s - WriteIoBytes: 84.63 GB (90873790464) - WriteIoOps: 10.83K (10833) - WriteIoWaitTime: 38s901ms EXCHANGE_NODE (id=3):(Total: 11m1s, non-child: 4s081ms, % non-child: 0.62%) BytesReceived(16s000ms): 871.56 MB, 2.74 GB, 4.51 GB, 6.05 GB, 7.51 GB, 8.46 GB, 9.05 GB, 10.06 GB, 10.44 GB, 10.69 GB, 11.38 GB, 12.00 GB, 13.16 GB, 13.60 GB, 14.75 GB, 15.79 GB, 16.52 GB, 16.76 GB, 17.09 GB, 17.81 GB, 17.96 GB, 18.62 GB, 19.78 GB, 20.44 GB, 20.99 GB, 21.19 GB, 22.20 GB, 22.99 GB, 23.80 GB, 24.16 GB, 24.66 GB, 25.47 GB, 25.84 GB, 26.09 GB, 26.36 GB, 26.93 GB, 27.24 GB, 28.03 GB, 29.48 GB, 29.91 GB, 30.38 GB, 30.46 GB, 31.68 GB, 32.79 GB, 33.54 GB, 34.30 GB, 35.53 GB, 37.13 GB, 38.26 GB - BytesReceived: 39.92 GB (42862208769) - ConvertRowBatchTime: 2s831ms - DeserializeRowBatchTimer: 1m24s - FirstBatchArrivalWaitTime: 573.418ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 544.16 K/sec - SendersBlockedTimer: 38s693ms - SendersBlockedTotalTimer(*): 38s693ms Averaged Fragment F00:(Total: 13m12s, non-child: 41s014ms, % non-child: 5.18%) split sizes: min: 12.56 GB, max: 12.56 GB, avg: 12.56 GB, stddev: 0 completion times: min:13m12s max:13m12s mean: 13m12s stddev:0.000ns execution rates: min:16.23 MB/sec max:16.23 MB/sec mean:16.23 MB/sec stddev:0.57 B/sec num instances: 1 - AverageThreadTokens: 5.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.84 GB (1978125077) - PeakReservation: 280.00 MB (293601280) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9807723913) - TotalReadThroughput: 16.25 MB/sec Fragment F00: Instance ff4268d2a1a0f338:34a75c5a00000001 (host=tarmstrong-box2:22000):(Total: 13m12s, non-child: 41s014ms, % non-child: 5.18%) Hdfs split stats (:<# splits>/): -1:51/12.56 GB MemoryUsage(16s000ms): 1.56 GB, 1.45 GB, 1.00 GB, 1016.90 MB, 860.13 MB, 615.98 MB, 1.07 GB, 947.79 MB, 900.16 MB, 862.34 MB, 558.81 MB, 817.85 MB, 949.72 MB, 909.73 MB, 419.90 MB, 1004.17 MB, 859.45 MB, 853.37 MB, 774.22 MB, 341.17 MB, 628.00 MB, 1.00 GB, 877.12 MB, 637.75 MB, 397.43 MB, 756.71 MB, 1.00 GB, 861.21 MB, 518.03 MB, 459.86 MB, 945.36 MB, 951.40 MB, 902.57 MB, 888.64 MB, 815.26 MB, 541.85 MB, 367.81 MB, 1011.74 MB, 814.15 MB, 678.73 MB, 332.19 MB, 556.38 MB, 981.45 MB, 756.65 MB, 383.09 MB, 987.31 MB, 877.50 MB, 881.02 MB, 963.43 MB ThreadUsage(16s000ms): 7, 8, 7, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.84 GB (1978125077) - PeakReservation: 280.00 MB (293601280) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9807723913) - RowsProduced: 360.01M (360011594) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 51s926ms - TotalStorageWaitTime: 29m24s - TotalThreadsInvoluntaryContextSwitches: 9.93K (9925) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 2s304ms - TotalThreadsUserTime: 6m54s - TotalThreadsVoluntaryContextSwitches: 349.05K (349045) Fragment Instance Lifecycle Timings: - ExecTime: 13m11s - ExecTreeExecTime: 8m42s - OpenTime: 184.913ms - ExecTreeOpenTime: 187.933us - PrepareTime: 18.096ms - ExecTreePrepareTime: 138.358us DataStreamSender (dst_id=3):(Total: 3m49s, non-child: 3m49s, % non-child: 100.00%) - BytesSent: 39.92 GB (42862208769) - NetworkThroughput(*): 3.27 GB/sec - OverallThroughput: 178.48 MB/sec - PeakMemoryUsage: 672.00 B (672) - RowsReturned: 360.01M (360011594) - SerializeBatchTime: 3m36s - TransmitDataRPCTime: 12s208ms - UncompressedRowBatchSize: 91.46 GB (98207171246) CodeGen:(Total: 200.648ms, non-child: 200.648ms, % non-child: 100.00%) - CodegenTime: 2.592ms - CompileTime: 69.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 85 (85) - NumInstructions: 2.45K (2449) - OptimizationTime: 114.881ms - PeakMemoryUsage: 1.20 MB (1253888) - PrepareTime: 16.227ms AGGREGATION_NODE (id=1):(Total: 8m41s, non-child: 1m57s, % non-child: 22.49%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 9.077ms - HTResizeTime: 9.601ms - HashBuckets: 1.05M (1048576) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 283.31 MB (297069963) - ReductionFactorEstimate: 1.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 359.23M (359225162) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 689.74 K/sec - StreamingTime: 1m57s Buffer pool: - nedRate: 889.90 K/sec - ScanRangesComplete: 51 (51) - ScannerThreadsInvoluntaryContextSwitches: 4.79K (4787) - ScannerThreadsTotalWallClockTime: 55m7s - MaterializeTupleTime(*): 52s891ms - ScannerThreadsSysTime: 1s468ms - ScannerThreadsUserTime: 1m19s - ScannerThreadsVoluntaryContextSwitches: 348.33K (348329) - TotalRawHdfsReadTime(*): 53m18s - TotalReadThroughput: 16.25 MB/sec Query (id=5d40b3f3b981e088:fca093df00000000): Summary: Session ID: 5e44d57fe9deccb8:dff330766d1689ae Session Type: BEESWAX Start Time: 2017-08-14 22:55:36.999018000 End Time: 2017-08-14 23:18:57.750319000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (build 986c035fe4c0861fd9b2926ba870e5c0f957cc22) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:60716 Default Db: tpch_60_parquet Sql Statement: select count(*) from (select distinct * from lineitem) v Coordinator: tarmstrong-box2:22000 Query Options (non default): MEM_LIMIT=10737418240,MT_DOP=0,DEFAULT_SPILLABLE_BUFFER_SIZE=8388608 Plan: ---------------- Per-Host Resource Reservation: Memory=136.00MB Per-Host Resource Estimates: Memory=197.50GB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=8.00MB | tuple-ids=3 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=8B cardinality=1 | F01:PLAN FRAGMENT [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] hosts=1 instances=1 Per-Host Resources: mem-estimate=98.40GB mem-reservation=136.00MB 02:AGGREGATE | output: count(*) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=8.00MB | tuple-ids=3 row-size=8B cardinality=1 | 04:AGGREGATE [FINALIZE] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=136.00MB spill-buffer=8.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 03:EXCHANGE [HASH(tpch_60_parquet.lineitem.l_orderkey,tpch_60_parquet.lineitem.l_partkey,tpch_60_parquet.lineitem.l_suppkey,tpch_60_parquet.lineitem.l_linenumber,tpch_60_parquet.lineitem.l_quantity,tpch_60_parquet.lineitem.l_extendedprice,tpch_60_parquet.lineitem.l_discount,tpch_60_parquet.lineitem.l_tax,tpch_60_parquet.lineitem.l_returnflag,tpch_60_parquet.lineitem.l_linestatus,tpch_60_parquet.lineitem.l_shipdate,tpch_60_parquet.lineitem.l_commitdate,tpch_60_parquet.lineitem.l_receiptdate,tpch_60_parquet.lineitem.l_shipinstruct,tpch_60_parquet.lineitem.l_shipmode,tpch_60_parquet.lineitem.l_comment)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=267B cardinality=360011594 | F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 Per-Host Resources: mem-estimate=99.08GB mem-reservation=0B 01:AGGREGATE [STREAMING] | group by: tpch_60_parquet.lineitem.l_orderkey, tpch_60_parquet.lineitem.l_partkey, tpch_60_parquet.lineitem.l_suppkey, tpch_60_parquet.lineitem.l_linenumber, tpch_60_parquet.lineitem.l_quantity, tpch_60_parquet.lineitem.l_extendedprice, tpch_60_parquet.lineitem.l_discount, tpch_60_parquet.lineitem.l_tax, tpch_60_parquet.lineitem.l_returnflag, tpch_60_parquet.lineitem.l_linestatus, tpch_60_parquet.lineitem.l_shipdate, tpch_60_parquet.lineitem.l_commitdate, tpch_60_parquet.lineitem.l_receiptdate, tpch_60_parquet.lineitem.l_shipinstruct, tpch_60_parquet.lineitem.l_shipmode, tpch_60_parquet.lineitem.l_comment | mem-estimate=98.39GB mem-reservation=0B spill-buffer=8.00MB | tuple-ids=1 row-size=267B cardinality=360011594 | 00:SCAN HDFS [tpch_60_parquet.lineitem, RANDOM] partitions=1/1 files=51 size=12.56GB stats-rows=360011594 extrapolated-rows=disabled table stats: rows=360011594 size=12.56GB column stats: all mem-estimate=704.00MB mem-reservation=0B tuple-ids=0 row-size=267B cardinality=360011594 ---------------- Estimated Per-Host Mem: 212059697970 Per-Host Memory Reservation: 142606336 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 124.141us 124.141us 1 1 20.00 KB 10.00 MB FINALIZE 05:EXCHANGE 1 4.130us 4.130us 1 1 0 0 UNPARTITIONED 02:AGGREGATE 1 187.260ms 187.260ms 1 1 16.00 KB 10.00 MB 04:AGGREGATE 1 19m15s 19m15s 360.01M 360.01M 7.73 GB 98.39 GB FINALIZE 03:EXCHANGE 1 5s057ms 5s057ms 360.01M 360.01M 0 0 HASH(tpch_60_parquet.lineit... 01:AGGREGATE 1 2m1s 2m1s 360.01M 360.01M 283.31 MB 98.39 GB STREAMING 00:SCAN HDFS 1 1s057ms 1s057ms 360.01M 360.01M 1.57 GB 704.00 MB tpch_60_parquet.lineitem Errors: Planner Timeline: 54.061ms - Analysis finished: 12.952ms (12.952ms) - Equivalence classes computed: 26.824ms (13.871ms) - Single node plan created: 38.546ms (11.722ms) - Runtime filters computed: 38.610ms (63.089us) - Distributed plan created: 41.553ms (2.943ms) - Planning finished: 54.061ms (12.507ms) Query Timeline: 23m20s - Query submitted: 73.957us (73.957us) - Planning finished: 56.309ms (56.235ms) - Submit for admission: 56.437ms (127.799us) - Completed admission: 56.468ms (31.495us) - Ready to start on 1 backends: 56.551ms (82.636us) - All 1 execution backends (3 fragment instances) started: 57.184ms (632.786us) - Rows available: 23m20s (23m20s) - First row fetched: 23m20s (28.964ms) - Unregister query: 23m20s (1.460ms) - ComputeScanRangeAssignmentTimer: 37.853us ImpalaServer: - ClientFetchWaitTimer: 29.583ms - RowMaterializationTimer: 829.153us Execution Profile 5d40b3f3b981e088:fca093df00000000:(Total: 23m20s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: tarmstrong-box2:22000(9.13 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 23m20s, non-child: 29.252ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:23m20s max:23m20s mean: 23m20s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9808564071) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 23m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 29.090ms - ExecTreeExecTime: 1.031us - OpenTime: 23m20s - ExecTreeOpenTime: 23m20s - PrepareTime: 11.627ms - ExecTreePrepareTime: 26.987us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 11.465ms, non-child: 11.465ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 10.484ms AGGREGATION_NODE (id=6):(Total: 23m20s, non-child: 124.141us, % non-child: 0.00%) - BuildTime: 1.552us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 23m20s, non-child: 23m20s, % non-child: 100.00%) - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 241.000ns - DeserializeRowBatchTimer: 1.996us - FirstBatchArrivalWaitTime: 23m20s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F02: Instance 5d40b3f3b981e088:fca093df00000000 (host=tarmstrong-box2:22000):(Total: 23m20s, non-child: 29.252ms, % non-child: 0.00%) MemoryUsage(32s000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9808564071) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 23m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 29.090ms - ExecTreeExecTime: 1.031us - OpenTime: 23m20s - ExecTreeOpenTime: 23m20s - PrepareTime: 11.627ms - ExecTreePrepareTime: 26.987us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 11.465ms, non-child: 11.465ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 10.484ms AGGREGATION_NODE (id=6):(Total: 23m20s, non-child: 124.141us, % non-child: 0.00%) - BuildTime: 1.552us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 23m20s, non-child: 4.130us, % non-child: 0.00%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 241.000ns - DeserializeRowBatchTimer: 1.996us - FirstBatchArrivalWaitTime: 23m20s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 23m20s, non-child: 2.421ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:23m20s max:23m20s mean: 23m20s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.75 GB (8321534537) - PeakReservation: 7.73 GB (8296333312) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9808564071) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 4m1s - TotalNetworkSendTime: 101.075us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22.13K (22132) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 28s696ms - TotalThreadsUserTime: 7m49s - TotalThreadsVoluntaryContextSwitches: 350.25K (350245) Fragment Instance Lifecycle Timings: - ExecTime: 290.209us - ExecTreeExecTime: 1.108us - OpenTime: 23m20s - ExecTreeOpenTime: 23m20s - PrepareTime: 19.358ms - ExecTreePrepareTime: 106.976us DataStreamSender (dst_id=5):(Total: 25.001us, non-child: 25.001us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 1.40 MB/sec - OverallThroughput: 624.97 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 3.832us - TransmitDataRPCTime: 10.902us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 213.954ms, non-child: 213.954ms, % non-child: 100.00%) - CodegenTime: 2.892ms - CompileTime: 51.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 144.086ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 17.709ms AGGREGATION_NODE (id=2):(Total: 23m20s, non-child: 187.260ms, % non-child: 0.01%) - BuildTime: 122.215ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 23m20s, non-child: 19m15s, % non-child: 82.53%) - BuildTime: 3m12s - GetResultsTime: 4s820ms - HTResizeTime: 17s246ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.73 GB (8297053756) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 257.10 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 3s540ms - CumulativeAllocationBytes: 277.37 GB (297820749824) - CumulativeAllocations: 33.16K (33157) - PeakReservation: 7.73 GB (8296333312) - PeakUnpinnedBytes: 84.63 GB (90873790464) - PeakUsedReservation: 7.73 GB (8296333312) - ReadIoBytes: 82.63 GB (88726306816) - ReadIoOps: 10.58K (10577) - ReadIoWaitTime: 9m20s - WriteIoBytes: 84.63 GB (90873790464) - WriteIoOps: 10.83K (10833) - WriteIoWaitTime: 1m43s EXCHANGE_NODE (id=3):(Total: 4m4s, non-child: 4m4s, % non-child: 100.00%) - BytesReceived: 39.92 GB (42862329325) - ConvertRowBatchTime: 2s926ms - DeserializeRowBatchTimer: 1m16s - FirstBatchArrivalWaitTime: 529.804ms - PeakMemoryUsage: 0 - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 1.47 M/sec - SendersBlockedTimer: 1m31s - SendersBlockedTotalTimer(*): 1m31s Fragment F01: Instance 5d40b3f3b981e088:fca093df00000002 (host=tarmstrong-box2:22000):(Total: 23m20s, non-child: 2.421ms, % non-child: 0.00%) MemoryUsage(32s000ms): 4.46 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB, 7.73 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.75 GB (8321534537) - PeakReservation: 7.73 GB (8296333312) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 9.13 GB (9808564071) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 4m1s - TotalNetworkSendTime: 101.075us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22.13K (22132) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 28s696ms - TotalThreadsUserTime: 7m49s - TotalThreadsVoluntaryContextSwitches: 350.25K (350245) Fragment Instance Lifecycle Timings: - ExecTime: 290.209us - ExecTreeExecTime: 1.108us - OpenTime: 23m20s - ExecTreeOpenTime: 23m20s - PrepareTime: 19.358ms - ExecTreePrepareTime: 106.976us DataStreamSender (dst_id=5):(Total: 25.001us, non-child: 25.001us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 1.40 MB/sec - OverallThroughput: 624.97 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 3.832us - TransmitDataRPCTime: 10.902us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 213.954ms, non-child: 213.954ms, % non-child: 100.00%) - CodegenTime: 2.892ms - CompileTime: 51.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2046800) - NumFunctions: 65 (65) - NumInstructions: 1.92K (1921) - OptimizationTime: 144.086ms - PeakMemoryUsage: 960.50 KB (983552) - PrepareTime: 17.709ms AGGREGATION_NODE (id=2):(Total: 23m20s, non-child: 187.260ms, % non-child: 0.01%) ExecOption: Codegen Enabled - BuildTime: 122.215ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=4):(Total: 23m20s, non-child: 19m15s, % non-child: 82.53%) ExecOption: Codegen Enabled, Spilled - BuildTime: 3m12s - GetResultsTime: 4s820ms - HTResizeTime: 17s246ms - HashBuckets: 536.87M (536870912) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 31 (31) - PeakMemoryUsage: 7.73 GB (8297053756) - RowsRepartitioned: 0 (0) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 257.10 K/sec - SpilledPartitions: 15 (15) Buffer pool: - AllocTime: 3s540ms - CumulativeAllocationBytes: 277.37 GB (297820749824) - CumulativeAllocations: 33.16K (33157) - PeakReservation: 7.73 GB (8296333312) - PeakUnpinnedBytes: 84.63 GB (90873790464) - PeakUsedReservation: 7.73 GB (8296333312) - ReadIoBytes: 82.63 GB (88726306816) - ReadIoOps: 10.58K (10577) - ReadIoWaitTime: 9m20s - WriteIoBytes: 84.63 GB (90873790464) - WriteIoOps: 10.83K (10833) - WriteIoWaitTime: 1m43s EXCHANGE_NODE (id=3):(Total: 4m4s, non-child: 5s057ms, % non-child: 2.07%) BytesReceived(8s000ms): 392.82 MB, 1.33 GB, 2.29 GB, 3.20 GB, 4.11 GB, 4.91 GB, 5.78 GB, 6.58 GB, 7.39 GB, 8.16 GB, 8.93 GB, 9.43 GB, 10.13 GB, 11.00 GB, 11.46 GB, 12.32 GB, 13.06 GB, 13.78 GB, 14.37 GB, 15.11 GB, 1s, non-child: 2m1s, % non-child: 99.14%) - GetResultsTime: 9.134ms - HTResizeTime: 9.794ms - HashBuckets: 1.05M (1048576) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 283.31 MB (297069963) - ReductionFactorEstimate: 1.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 359.23M (359225162) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 2.93 M/sec - StreamingTime: 2m1s Buffer pool: - AllocTime: 252.402us - CumulativeAllocationBytes: 280.00 MB (293601280) - CumulativeAllocations: 35 (35) - PeakReservation: 280.00 MB (293601280) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 280.00 MB (293601280) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s057ms, non-child: 1s057ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 4.29 - BytesRead: 12.56 GB (13487696004) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.56 GB (13487696004) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.56 GB (13487696004) - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 867 (867) - DecompressionTime: 18s914ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.57 GB (1682522931) - PerReadThreadRawHdfsThroughput: 61.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 269.462ms - RowBatchQueuePutWaitTime: 29m25s - RowsRead: 360.01M (360011594) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 340.32 M/sec - ScanRangesComplete: 51 (51) - ScannerThreadsInvoluntaryContextSwitches: 17.59K (17595) - ScannerThreadsTotalWallClockTime: 31m15s - MaterializeTupleTime(*): 55s341ms - ScannerThreadsSysTime: 1s316ms - ScannerThreadsUserTime: 1m23s - ScannerThreadsVoluntaryContextSwitches: 352.31K (352308) - TotalRawHdfsReadTime(*): 3m29s - TotalReadThroughput: 29.43 MB/sec Fragment F00: Instance 5d40b3f3b981e088:fca093df00000001 (host=tarmstrong-box2:22000):(Total: 7m17s, non-child: 1m23s, % non-child: 19.02%) Hdfs split stats (:<# splits>/): -1:51/12.56 GB MemoryUsage(8s000ms): 1.48 GB, 1.66 GB, 1.51 GB, 1.39 GB, 1.15 GB, 850.74 MB, 1.07 GB, 1.00 GB, 909.01 MB, 677.25 MB, 1.10 GB, 1.04 GB, 977.48 MB, 780.17 MB, 712.03 MB, 1.10 GB, 1001.82 MB, 907.68 MB, 706.22 MB, 1.02 GB, 1.01 GB, 927.64 MB, 707.32 MB, 1.00 GB, 1.05 GB, 983.53 MB, 821.17 MB, 758.97 MB, 1.09 GB, 1021.89 MB, 951.64 MB, 734.75 MB, 1.05 GB, 1.04 GB, 949.01 MB, 780.01 MB, 826.05 MB, 1.09 GB, 1003.88 MB, 912.46 MB, 672.25 MB, 1005.49 MB, 1.04 GB, 960.80 MB, 819.71 MB, 794.03 MB, 1.12 GB, 1.01 GB, 925.90 MB, 721.62 MB, 955.75 MB, 1.02 GB, 929.17 MB, 786.56 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 7, 5, 5, 5, 5, 5, 5, Hdfs Read Thread Concurrency Bucket: 0:82.61% 1:7.895% 2:2.174% 3:1.259% 4:3.318% 5:0.3432% 6:2.403% File Formats: PARQUET/SNAPPY:816 BytesRead(8s000ms): 1.10 GB, 1.48 GB, 1.54 GB, 1.63 GB, 1.72 GB, 1.73 GB, 2.46 GB, 2.59 GB, 2.67 GB, 2.74 GB, 3.48 GB, 3.56 GB, 3.62 GB, 3.70 GB, 3.82 GB, 4.53 GB, 4.59 GB, 4.67 GB, 4.71 GB, 5.33 GB, 5.56 GB, 5.63 GB, 5.73 GB, 6.34 GB, 6.53 GB, 6.59 GB, 6.66 GB, 6.90 GB, 7.49 GB, 7.54 GB, 7.60 GB, 7.67 GB, 8.35 GB, 8.51 GB, 8.58 GB, 8.65 GB, 9.00 GB, 9.49 GB, 9.54 GB, 9.61 GB, 9.65 GB, 10.25 GB, 10.49 GB, 10.55 GB, 10.62 GB, 10.88 GB, 11.46 GB, 11.50 GB, 11.58 GB, 11.63 GB, 12.16 GB, 12.42 GB, 12.48 GB, 12.53 GB - FooterProcessingTime: (Avg: 193.927ms ; Min: 1.598ms ; Max: 1s564ms ; Number of samples: 51) - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 4.29 - BytesRead: 12.56 GB (13487696004) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.56 GB (13487696004) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.56 GB (13487696004) - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 867 (867) - DecompressionTime: 18s914ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 51 (51) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.57 GB (1682522931) - PerReadThreadRawHdfsThroughput: 61.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 269.462ms - RowBatchQueuePutWaitTime: 29m25s - RowsRead: 360.01M (360011594) - RowsReturned: 360.01M (360011594) - RowsReturnedRate: 340.32 M/sec - ScanRangesComplete: 51 (51) - ScannerThreadsInvoluntaryContextSwitches: 17.59K (17595) - ScannerThreadsTotalWallClockTime: 31m15s - MaterializeTupleTime(*): 55s341ms - ScannerThreadsSysTime: 1s316ms - ScannerThreadsUserTime: 1m23s - ScannerThreadsVoluntaryContextSwitches: 352.31K (352308) - TotalRawHdfsReadTime(*): 3m29s - TotalReadThroughput: 29.43 MB/sec