13000000 +--------------+--------+----------+----------+--------+------------+-----------+---------------+-----------------------+ | Operator | #Hosts | Avg Time | Max Time | #Rows | Est. #Rows | Peak Mem | Est. Peak Mem | Detail | +--------------+--------+----------+----------+--------+------------+-----------+---------------+-----------------------+ | 09:AGGREGATE | 1 | 140.76ms | 140.76ms | 1 | 1 | 20.00 KB | -1 B | FINALIZE | | 08:EXCHANGE | 1 | 51.99us | 51.99us | 3 | 1 | 0 B | -1 B | UNPARTITIONED | | 03:AGGREGATE | 3 | 159.12ms | 159.96ms | 3 | 1 | 12.00 KB | 10.00 MB | | | 07:AGGREGATE | 3 | 3.25s | 3.31s | 13.00M | -1 | 271.02 MB | 128.00 MB | | | 06:EXCHANGE | 3 | 543.00ms | 559.22ms | 13.00M | -1 | 0 B | 0 B | HASH((i)) | | 02:AGGREGATE | 3 | 3.41s | 3.43s | 13.00M | -1 | 271.01 MB | 128.00 MB | | | 05:AGGREGATE | 3 | 2.50s | 2.55s | 13.00M | -1 | 271.02 MB | 128.00 MB | FINALIZE | | 04:EXCHANGE | 3 | 540.28ms | 553.36ms | 13.00M | -1 | 0 B | 0 B | HASH(i) | | 01:AGGREGATE | 3 | 3.06s | 3.27s | 13.00M | -1 | 271.02 MB | 128.00 MB | | | 00:SCAN HDFS | 3 | 42.02ms | 44.50ms | 13.00M | -1 | 18.27 MB | 32.00 MB | jbappletest.counter13 | +--------------+--------+----------+----------+--------+------------+-----------+---------------+-----------------------+ Query Runtime Profile: Query (id=7042e548f32e6c6e:d629d67540154cad): Summary: Session ID: a74d7a9345a63b27:194cfed125c5a6ad Session Type: BEESWAX Start Time: 2015-10-06 14:42:51.031745000 End Time: 2015-10-06 14:43:05.394669000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.3.0-cdh5-INTERNAL DEBUG (build b68c8f93dd21fbcc0687effbff15d6663f20350a) User: jbapple Connected User: jbapple Delegated User: Network Address: ::ffff:127.0.0.1:55259 Default Db: default Sql Statement: select count(distinct(i)) as ndv from (select i from jbappletest.counter13 where i < 13000000 group by i) a Coordinator: jbapple-optiplex:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=256.00MB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. jbappletest.counter13 F03:PLAN FRAGMENT [UNPARTITIONED] 09:AGGREGATE [FINALIZE] | output: count:merge((i)) | hosts=3 per-host-mem=unavailable | tuple-ids=4 row-size=8B cardinality=1 | 08:EXCHANGE [UNPARTITIONED] hosts=3 per-host-mem=unavailable tuple-ids=4 row-size=8B cardinality=1 F02:PLAN FRAGMENT [HASH((i))] DATASTREAM SINK [FRAGMENT=F03, EXCHANGE=08, UNPARTITIONED] 03:AGGREGATE | output: count((i)) | hosts=3 per-host-mem=10.00MB | tuple-ids=4 row-size=8B cardinality=1 | 07:AGGREGATE | group by: (i) | hosts=3 per-host-mem=128.00MB | tuple-ids=3 row-size=4B cardinality=unavailable | 06:EXCHANGE [HASH((i))] hosts=3 per-host-mem=0B tuple-ids=3 row-size=4B cardinality=unavailable F01:PLAN FRAGMENT [HASH(i)] DATASTREAM SINK [FRAGMENT=F02, EXCHANGE=06, HASH((i))] 02:AGGREGATE | group by: i | hosts=3 per-host-mem=128.00MB | tuple-ids=3 row-size=4B cardinality=unavailable | 05:AGGREGATE [FINALIZE] | group by: i | hosts=3 per-host-mem=128.00MB | tuple-ids=1 row-size=4B cardinality=unavailable | 04:EXCHANGE [HASH(i)] hosts=3 per-host-mem=0B tuple-ids=1 row-size=4B cardinality=unavailable F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=04, HASH(i)] 01:AGGREGATE | group by: i | hosts=3 per-host-mem=128.00MB | tuple-ids=1 row-size=4B cardinality=unavailable | 00:SCAN HDFS [jbappletest.counter13, RANDOM] partitions=1/1 files=3 size=49.85MB predicates: i < 13000000 table stats: unavailable column stats: unavailable hosts=3 per-host-mem=32.00MB tuple-ids=0 row-size=4B cardinality=unavailable ---------------- Estimated Per-Host Mem: 268435456 Estimated Per-Host VCores: 2 Tables Missing Stats: jbappletest.counter13 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------- 09:AGGREGATE 1 140.764ms 140.764ms 1 1 20.00 KB -1.00 B FINALIZE 08:EXCHANGE 1 51.994us 51.994us 3 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 3 159.119ms 159.958ms 3 1 12.00 KB 10.00 MB 07:AGGREGATE 3 3s250ms 3s307ms 13.00M -1 271.02 MB 128.00 MB 06:EXCHANGE 3 543.1ms 559.216ms 13.00M -1 0 0 HASH((i)) 02:AGGREGATE 3 3s414ms 3s425ms 13.00M -1 271.01 MB 128.00 MB 05:AGGREGATE 3 2s503ms 2s547ms 13.00M -1 271.02 MB 128.00 MB FINALIZE 04:EXCHANGE 3 540.282ms 553.358ms 13.00M -1 0 0 HASH(i) 01:AGGREGATE 3 3s057ms 3s270ms 13.00M -1 271.02 MB 128.00 MB 00:SCAN HDFS 3 42.17ms 44.502ms 13.00M -1 18.27 MB 32.00 MB jbappletest.counter13 Planner Timeline: 7.491ms - Analysis finished: 3.350ms (3.350ms) - Equivalence classes computed: 3.617ms (266.636us) - Single node plan created: 4.954ms (1.337ms) - Distributed plan created: 5.615ms (660.834us) - Planning finished: 7.491ms (1.875ms) Query Timeline: 14s367ms - Start execution: 43.937us (43.937us) - Planning finished: 8.852ms (8.808ms) - Ready to start remote fragments: 149.944ms (141.91ms) - Remote fragments started: 822.852ms (672.908ms) - Rows available: 14s138ms (13s316ms) - First row fetched: 14s361ms (222.257ms) - Unregister query: 14s362ms (1.683ms) ImpalaServer: - ClientFetchWaitTimer: 222.698ms - RowMaterializationTimer: 5.924us Execution Profile 7042e548f32e6c6e:d629d67540154cad:(Total: 14s130ms, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 9, last: 0.257768ns, min: 0.144973ns, max: 0.257768ns, mean: 0.206955ns, stddev: 0.048644ns Per Node Peak Memory Usage: jbapple-optiplex:22002(305.70 MB) jbapple-optiplex:22001(302.31 MB) jbapple-optiplex:22000(370.42 MB) - FinalizationTimer: 0ns Coordinator Fragment F03:(Total: 13s224ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.0ms): 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 32.02 KB (32784) - PerHostPeakMemUsage: 0 - PrepareTime: 140.427ms - RowsProduced: 1 (1) - TotalCpuTime: 1s268ms - TotalNetworkReceiveTime: 13s083ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 232 (232) - BlocksRecycled: 88 (88) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.05 GB (21531490304) - PeakMemoryUsage: 348.59 MB (365527040) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 371.617ms, non-child: 371.617ms, % non-child: 100.00%) - CodegenTime: 486.984us - CompileTime: 334.225us - LoadTime: 23.873us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 231.368ms - PrepareTime: 139.44ms AGGREGATION_NODE (id=9):(Total: 13s224ms, non-child: 140.764ms, % non-child: 1.06%) ExecOption: Codegen Enabled - BuildTime: 3.492us - GetResultsTime: 0ns - HTResizeTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=8):(Total: 13s083ms, non-child: 51.994us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 48.00 B (48) - ConvertRowBatchTime: 5.379us - DeserializeRowBatchTimer: 22.29us - FirstBatchArrivalWaitTime: 13s078ms - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F02:(Total: 13s678ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:13s839ms max:13s843ms mean: 13s841ms stddev:1.803343.803.342897ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 272.11 MB (285326832) - PerHostPeakMemUsage: 326.14 MB (341985962) - PrepareTime: 144.377ms - RowsProduced: 1 (1) - TotalCpuTime: 4s249ms - TotalNetworkReceiveTime: 9s735ms - TotalNetworkSendTime: 159.131us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 225 (225) - BlocksRecycled: 95 (95) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.05 GB (21531490304) - PeakMemoryUsage: 284.83 MB (298663936) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 445.443ms, non-child: 445.443ms, % non-child: 100.00%) - CodegenTime: 5.451ms - CompileTime: 13.351ms - LoadTime: 17.92us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 293.488ms - PrepareTime: 137.826ms DataStreamSender (dst_id=8):(Total: 44.19us, non-child: 44.19us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 146.25 KB/sec - OverallThroughput: 376.36 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 10.75us - ThriftTransmitTime(*): 108.837us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 13s677ms, non-child: 159.119ms, % non-child: 1.16%) - BuildTime: 17.994ms - GetResultsTime: 0ns - HTResizeTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 12.00 KB (12288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=7):(Total: 13s518ms, non-child: 3s250ms, % non-child: 24.05%) - BuildTime: 2s741ms - GetNewBlockTime: 471.819us - GetResultsTime: 495.791ms - HTResizeTime: 362.6ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284183210) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 320.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.682us EXCHANGE_NODE (id=6):(Total: 10s267ms, non-child: 10s267ms, % non-child: 100.00%) - BytesReceived: 37.85 MB (39689237) - ConvertRowBatchTime: 524.93ms - DeserializeRowBatchTimer: 127.988ms - FirstBatchArrivalWaitTime: 9s247ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 422.04 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F01:(Total: 12s872ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:12s933ms max:13s042ms mean: 13s001ms stddev:48.709572.709.571836ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 291.03 MB (305168384) - PerHostPeakMemUsage: 326.14 MB (341985962) - PrepareTime: 248.124ms - RowsProduced: 4.33M (4333333) - TotalCpuTime: 9s703ms - TotalNetworkReceiveTime: 3s518ms - TotalNetworkSendTime: 27.199ms - TotalStorageWaitTime: 0ns CodeGen:(Total: 604.915ms, non-child: 604.915ms, % non-child: 100.00%) - CodegenTime: 13.201ms - CompileTime: 16.218ms - LoadTime: 21.583us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 354.535ms - PrepareTime: 233.80ms DataStreamSender (dst_id=6):(Total: 2s904ms, non-child: 2s904ms, % non-child: 100.00%) - BytesSent: 37.85 MB (39689237) - NetworkThroughput(*): 50.36 MB/sec - OverallThroughput: 13.04 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s257ms - ThriftTransmitTime(*): 752.145ms - UncompressedRowBatchSize: 49.60 MB (52008465) AGGREGATION_NODE (id=2):(Total: 9s963ms, non-child: 3s414ms, % non-child: 34.27%) - BuildTime: 2s386ms - GetNewBlockTime: 389.972us - GetResultsTime: 779.910ms - HTResizeTime: 265.955ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 434.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.986us AGGREGATION_NODE (id=5):(Total: 6s548ms, non-child: 2s503ms, % non-child: 38.23%) - BuildTime: 2s028ms - GetNewBlockTime: 448.964us - GetResultsTime: 459.140ms - HTResizeTime: 354.926ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284177749) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 661.73 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.201us EXCHANGE_NODE (id=4):(Total: 4s045ms, non-child: 4s045ms, % non-child: 100.00%) - BytesReceived: 37.85 MB (39689521) - ConvertRowBatchTime: 518.406ms - DeserializeRowBatchTimer: 119.606ms - FirstBatchArrivalWaitTime: 2s356ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 1.07 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F00:(Total: 5s798ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 16.61 MB, max: 16.62 MB, avg: 16.62 MB, stddev: 2.25 KB completion times: min:5s436ms max:6s174ms mean: 5s909ms stddev:335.522620.522.619552ms execution rates: min:2.69 MB/sec max:3.06 MB/sec mean:2.82 MB/sec stddev:170.44 KB/sec num instances: 3 - AverageThreadTokens: 1.35 - PeakMemoryUsage: 273.35 MB (286626562) - PerHostPeakMemUsage: 319.77 MB (335300181) - PrepareTime: 225.599ms - RowsProduced: 4.33M (4333333) - TotalCpuTime: 8s247ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 31.175ms - TotalStorageWaitTime: 10.417ms CodeGen:(Total: 547.921ms, non-child: 547.921ms, % non-child: 100.00%) - CodegenTime: 6.667ms - CompileTime: 9.820ms - LoadTime: 26.245us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 320.87ms - PrepareTime: 217.4ms DataStreamSender (dst_id=4):(Total: 2s695ms, non-child: 2s695ms, % non-child: 100.00%) - BytesSent: 37.85 MB (39689521) - NetworkThroughput(*): 54.42 MB/sec - OverallThroughput: 14.10 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s162ms - ThriftTransmitTime(*): 698.407ms - UncompressedRowBatchSize: 49.60 MB (52008465) AGGREGATION_NODE (id=1):(Total: 3s099ms, non-child: 3s057ms, % non-child: 98.64%) - BuildTime: 2s113ms - GetNewBlockTime: 449.479us - GetResultsTime: 709.820ms - HTResizeTime: 339.84ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284180480) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 1.40 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.263us HDFS_SCAN_NODE (id=0):(Total: 42.17ms, non-child: 42.17ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.71 MB (17526707) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.71 MB (17526707) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.71 MB (17526707) - DecompressionTime: 4.23ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.27 MB (19154557) - PerReadThreadRawHdfsThroughput: 3.81 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.33M (4333333) - RowsReturned: 4.33M (4333333) - RowsReturnedRate: 103.40 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 380 (380) - ScannerThreadsTotalWallClockTime: 2s153ms - MaterializeTupleTime(*): 2s133ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 1s381ms - ScannerThreadsVoluntaryContextSwitches: 1.17K (1168) - TotalRawHdfsReadTime(*): 4.292ms - TotalReadThroughput: 6.31 MB/sec Fragment F02: Instance 7042e548f32e6c6e:d629d67540154cb0 (host=jbapple-optiplex:22002):(Total: 13s711ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 37.22 MB, 81.07 MB, 114.88 MB, 147.79 MB, 180.72 MB, 213.72 MB, 248.39 MB, 183.60 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 272.19 MB (285407440) - PerHostPeakMemUsage: 305.70 MB (320552960) - PrepareTime: 144.43ms - RowsProduced: 1 (1) - TotalCpuTime: 4s153ms - TotalNetworkReceiveTime: 9s831ms - TotalNetworkSendTime: 150.936us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 226 (226) - BlocksRecycled: 94 (94) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.05 GB (21531490304) - PeakMemoryUsage: 284.94 MB (298778624) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 411.460ms, non-child: 411.460ms, % non-child: 100.00%) - CodegenTime: 5.548ms - CompileTime: 11.302ms - LoadTime: 20.626us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 262.6ms - PrepareTime: 137.315ms DataStreamSender (dst_id=8):(Total: 59.955us, non-child: 59.955us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 171.55 KB/sec - OverallThroughput: 260.61 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 7.974us - ThriftTransmitTime(*): 91.80us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 13s711ms, non-child: 159.269ms, % non-child: 1.16%) ExecOption: Codegen Enabled - BuildTime: 18.445ms - GetResultsTime: 0ns - HTResizeTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 12.00 KB (12288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=7):(Total: 13s551ms, non-child: 3s217ms, % non-child: 23.74%) ExecOption: Codegen Enabled - BuildTime: 2s680ms - GetNewBlockTime: 396.862us - GetResultsTime: 522.921ms - HTResizeTime: 352.519ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 319.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.873us EXCHANGE_NODE (id=6):(Total: 10s334ms, non-child: 514.727ms, % non-child: 4.98%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.04 MB, 10.98 MB, 15.24 MB, 20.05 MB, 24.74 MB, 29.91 MB, 35.81 MB - BytesReceived: 37.85 MB (39688291) - ConvertRowBatchTime: 495.639ms - DeserializeRowBatchTimer: 129.975ms - FirstBatchArrivalWaitTime: 9s300ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 419.28 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 7042e548f32e6c6e:d629d67540154cb1 (host=jbapple-optiplex:22000):(Total: 13s666ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 33.10 MB, 65.61 MB, 98.58 MB, 137.63 MB, 172.83 MB, 213.91 MB, 247.80 MB, 183.60 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 271.96 MB (285167616) - PerHostPeakMemUsage: 370.42 MB (388411392) - PrepareTime: 144.985ms - RowsProduced: 1 (1) - TotalCpuTime: 4s335ms - TotalNetworkReceiveTime: 9s652ms - TotalNetworkSendTime: 189.576us - TotalStorageWaitTime: 0ns CodeGen:(Total: 460.710ms, non-child: 460.710ms, % non-child: 100.00%) - CodegenTime: 5.566ms - CompileTime: 11.203ms - LoadTime: 12.290us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 310.388ms - PrepareTime: 138.413ms DataStreamSender (dst_id=8):(Total: 34.479us, non-child: 34.479us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 122.88 KB/sec - OverallThroughput: 453.17 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.455us - ThriftTransmitTime(*): 127.154us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 13s665ms, non-child: 159.958ms, % non-child: 1.17%) ExecOption: Codegen Enabled - BuildTime: 18.297ms - GetResultsTime: 0ns - HTResizeTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 12.00 KB (12288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=7):(Total: 13s505ms, non-child: 3s307ms, % non-child: 24.49%) ExecOption: Codegen Enabled - BuildTime: 2s780ms - GetNewBlockTime: 614.986us - GetResultsTime: 512.971ms - HTResizeTime: 366.546ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284188672) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 320.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.593us EXCHANGE_NODE (id=6):(Total: 10s198ms, non-child: 555.59ms, % non-child: 5.44%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.36 MB, 8.75 MB, 13.52 MB, 19.61 MB, 24.70 MB, 29.82 MB, 35.47 MB - BytesReceived: 37.85 MB (39683420) - ConvertRowBatchTime: 536.776ms - DeserializeRowBatchTimer: 123.536ms - FirstBatchArrivalWaitTime: 9s231ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 424.86 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 7042e548f32e6c6e:d629d67540154caf (host=jbapple-optiplex:22001):(Total: 13s657ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 3.28 MB, 36.88 MB, 70.41 MB, 102.49 MB, 136.30 MB, 180.72 MB, 211.66 MB, 245.07 MB, 200.29 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 272.18 MB (285405440) - PerHostPeakMemUsage: 302.31 MB (316993536) - PrepareTime: 144.103ms - RowsProduced: 1 (1) - TotalCpuTime: 4s260ms - TotalNetworkReceiveTime: 9s722ms - TotalNetworkSendTime: 136.883us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 224 (224) - BlocksRecycled: 96 (96) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 20.05 GB (21531490304) - PeakMemoryUsage: 284.72 MB (298549248) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 464.160ms, non-child: 464.160ms, % non-child: 100.00%) - CodegenTime: 5.239ms - CompileTime: 17.548ms - LoadTime: 18.361us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 308.70ms - PrepareTime: 137.750ms DataStreamSender (dst_id=8):(Total: 37.625us, non-child: 37.625us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 144.30 KB/sec - OverallThroughput: 415.28 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 12.797us - ThriftTransmitTime(*): 108.278us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=3):(Total: 13s656ms, non-child: 158.130ms, % non-child: 1.16%) ExecOption: Codegen Enabled - BuildTime: 17.239ms - GetResultsTime: 0ns - HTResizeTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 12.00 KB (12288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) AGGREGATION_NODE (id=7):(Total: 13s498ms, non-child: 3s227ms, % non-child: 23.91%) ExecOption: Codegen Enabled - BuildTime: 2s762ms - GetNewBlockTime: 403.609us - GetResultsTime: 451.480ms - HTResizeTime: 366.953ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284188672) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 321.08 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.582us EXCHANGE_NODE (id=6):(Total: 10s270ms, non-child: 559.216ms, % non-child: 5.44%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.85 MB, 9.59 MB, 14.24 MB, 19.05 MB, 24.76 MB, 29.14 MB, 34.13 MB - BytesReceived: 37.86 MB (39696000) - ConvertRowBatchTime: 539.863ms - DeserializeRowBatchTimer: 130.452ms - FirstBatchArrivalWaitTime: 9s209ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 421.99 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F01: Instance 7042e548f32e6c6e:d629d67540154cb4 (host=jbapple-optiplex:22000):(Total: 12s979ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 38.00 MB, 72.72 MB, 118.33 MB, 157.55 MB, 200.47 MB, 238.39 MB, 270.33 MB, 270.33 MB, 282.81 MB, 282.16 MB, 281.50 MB, 278.84 MB, 268.69 MB, 279.75 MB, 250.39 MB, 217.00 MB, 183.63 MB, 133.56 MB, 100.19 MB, 66.83 MB, 16.75 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 291.03 MB (305168384) - PerHostPeakMemUsage: 370.42 MB (388411392) - PrepareTime: 251.450ms - RowsProduced: 4.33M (4332707) - TotalCpuTime: 9s741ms - TotalNetworkReceiveTime: 3s521ms - TotalNetworkSendTime: 31.338ms - TotalStorageWaitTime: 0ns CodeGen:(Total: 547.34ms, non-child: 547.34ms, % non-child: 100.00%) - CodegenTime: 11.604ms - CompileTime: 16.323ms - LoadTime: 12.823us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 291.601ms - PrepareTime: 238.27ms DataStreamSender (dst_id=6):(Total: 2s943ms, non-child: 2s943ms, % non-child: 100.00%) - BytesSent: 37.85 MB (39683420) - NetworkThroughput(*): 49.11 MB/sec - OverallThroughput: 12.86 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s289ms - ThriftTransmitTime(*): 770.635ms - UncompressedRowBatchSize: 49.59 MB (52000948) AGGREGATION_NODE (id=2):(Total: 10s031ms, non-child: 3s425ms, % non-child: 34.15%) ExecOption: Codegen Enabled - BuildTime: 2s388ms - GetNewBlockTime: 406.723us - GetResultsTime: 785.587ms - HTResizeTime: 264.475ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 431.92 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.706us AGGREGATION_NODE (id=5):(Total: 6s605ms, non-child: 2s547ms, % non-child: 38.56%) ExecOption: Codegen Enabled - BuildTime: 2s074ms - GetNewBlockTime: 490.353us - GetResultsTime: 457.190ms - HTResizeTime: 358.114ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 655.89 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.831us EXCHANGE_NODE (id=4):(Total: 4s058ms, non-child: 550.151ms, % non-child: 13.56%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 3.36 MB, 9.39 MB, 15.80 MB, 21.79 MB, 27.30 MB, 33.26 MB, 37.85 MB, 37.85 MB - BytesReceived: 37.85 MB (39683823) - ConvertRowBatchTime: 529.64ms - DeserializeRowBatchTimer: 118.483ms - FirstBatchArrivalWaitTime: 2s211ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 1.07 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 7042e548f32e6c6e:d629d67540154cb2 (host=jbapple-optiplex:22001):(Total: 12s838ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 23.31 MB, 66.75 MB, 101.80 MB, 139.83 MB, 175.25 MB, 206.94 MB, 253.88 MB, 282.81 MB, 282.16 MB, 279.50 MB, 270.84 MB, 269.19 MB, 287.75 MB, 233.71 MB, 200.33 MB, 166.96 MB, 133.57 MB, 100.21 MB, 66.83 MB, 33.46 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 291.03 MB (305168384) - PerHostPeakMemUsage: 302.31 MB (316993536) - PrepareTime: 245.45ms - RowsProduced: 4.33M (4334096) - TotalCpuTime: 9s832ms - TotalNetworkReceiveTime: 3s422ms - TotalNetworkSendTime: 19.583ms - TotalStorageWaitTime: 0ns CodeGen:(Total: 659.792ms, non-child: 659.792ms, % non-child: 100.00%) - CodegenTime: 13.751ms - CompileTime: 16.386ms - LoadTime: 25.659us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 412.879ms - PrepareTime: 229.511ms DataStreamSender (dst_id=6):(Total: 2s934ms, non-child: 2s934ms, % non-child: 100.00%) - BytesSent: 37.86 MB (39696000) - NetworkThroughput(*): 52.31 MB/sec - OverallThroughput: 12.90 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s280ms - ThriftTransmitTime(*): 723.646ms - UncompressedRowBatchSize: 49.61 MB (52017620) AGGREGATION_NODE (id=2):(Total: 9s899ms, non-child: 3s405ms, % non-child: 34.40%) ExecOption: Codegen Enabled - BuildTime: 2s367ms - GetNewBlockTime: 379.945us - GetResultsTime: 793.136ms - HTResizeTime: 264.909ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 437.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.820us AGGREGATION_NODE (id=5):(Total: 6s493ms, non-child: 2s531ms, % non-child: 38.99%) ExecOption: Codegen Enabled - BuildTime: 2s056ms - GetNewBlockTime: 404.820us - GetResultsTime: 459.579ms - HTResizeTime: 358.649ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 667.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.836us EXCHANGE_NODE (id=4):(Total: 3s962ms, non-child: 553.358ms, % non-child: 13.97%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 2.36 MB, 7.84 MB, 13.40 MB, 19.05 MB, 24.24 MB, 29.03 MB, 35.19 MB - BytesReceived: 37.86 MB (39696004) - ConvertRowBatchTime: 531.895ms - DeserializeRowBatchTimer: 118.388ms - FirstBatchArrivalWaitTime: 2s577ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 1.09 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 7042e548f32e6c6e:d629d67540154cb3 (host=jbapple-optiplex:22002):(Total: 12s799ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 6.55 MB, 19.33 MB, 56.33 MB, 89.19 MB, 123.61 MB, 167.53 MB, 200.47 MB, 241.64 MB, 270.34 MB, 282.81 MB, 282.16 MB, 279.50 MB, 269.09 MB, 280.41 MB, 279.75 MB, 233.71 MB, 200.31 MB, 166.94 MB, 133.58 MB, 100.21 MB, 66.83 MB, 16.75 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 291.03 MB (305168384) - PerHostPeakMemUsage: 305.70 MB (320552960) - PrepareTime: 247.875ms - RowsProduced: 4.33M (4333197) - TotalCpuTime: 9s537ms - TotalNetworkReceiveTime: 3s613ms - TotalNetworkSendTime: 30.677ms - TotalStorageWaitTime: 0ns CodeGen:(Total: 607.920ms, non-child: 607.920ms, % non-child: 100.00%) - CodegenTime: 14.248ms - CompileTime: 15.945ms - LoadTime: 26.269us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 359.125ms - PrepareTime: 231.701ms DataStreamSender (dst_id=6):(Total: 2s835ms, non-child: 2s835ms, % non-child: 100.00%) - BytesSent: 37.85 MB (39688291) - NetworkThroughput(*): 49.66 MB/sec - OverallThroughput: 13.35 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s201ms - ThriftTransmitTime(*): 762.156ms - UncompressedRowBatchSize: 49.60 MB (52006828) AGGREGATION_NODE (id=2):(Total: 9s959ms, non-child: 3s413ms, % non-child: 34.27%) ExecOption: Codegen Enabled - BuildTime: 2s404ms - GetNewBlockTime: 383.250us - GetResultsTime: 761.8ms - HTResizeTime: 268.480ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.01 MB (284172288) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 435.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 5.432us AGGREGATION_NODE (id=5):(Total: 6s546ms, non-child: 2s431ms, % non-child: 37.14%) ExecOption: Codegen Enabled - BuildTime: 1s953ms - GetNewBlockTime: 451.719us - GetResultsTime: 460.650ms - HTResizeTime: 348.14ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284188672) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 661.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.937us EXCHANGE_NODE (id=4):(Total: 4s115ms, non-child: 517.338ms, % non-child: 12.57%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 1.20 MB, 6.89 MB, 11.68 MB, 16.94 MB, 22.38 MB, 27.21 MB, 32.59 MB, 37.51 MB - BytesReceived: 37.85 MB (39688738) - ConvertRowBatchTime: 494.258ms - DeserializeRowBatchTimer: 121.946ms - FirstBatchArrivalWaitTime: 2s281ms - PeakMemoryUsage: 0 - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 1.05 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F00: Instance 7042e548f32e6c6e:d629d67540154cb7 (host=jbapple-optiplex:22000):(Total: 6s033ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/16.62 MB MemoryUsage(500.0ms): 3.25 MB, 34.24 MB, 83.64 MB, 150.94 MB, 195.80 MB, 256.75 MB, 250.39 MB, 217.02 MB, 183.62 MB, 133.58 MB, 100.21 MB, 66.82 MB, 33.46 MB ThreadUsage(500.0ms): 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.38 - PeakMemoryUsage: 273.35 MB (286626560) - PerHostPeakMemUsage: 370.42 MB (388411392) - PrepareTime: 256.587ms - RowsProduced: 4.33M (4334096) - TotalCpuTime: 8s736ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 10.68ms - TotalStorageWaitTime: 11.779ms CodeGen:(Total: 637.497ms, non-child: 637.497ms, % non-child: 100.00%) - CodegenTime: 7.672ms - CompileTime: 10.10ms - LoadTime: 31.126us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 379.574ms - PrepareTime: 246.788ms DataStreamSender (dst_id=4):(Total: 2s714ms, non-child: 2s714ms, % non-child: 100.00%) - BytesSent: 37.86 MB (39696004) - NetworkThroughput(*): 58.92 MB/sec - OverallThroughput: 13.95 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s184ms - ThriftTransmitTime(*): 642.469ms - UncompressedRowBatchSize: 49.61 MB (52017620) AGGREGATION_NODE (id=1):(Total: 3s315ms, non-child: 3s270ms, % non-child: 98.66%) ExecOption: Codegen Enabled - BuildTime: 2s284ms - GetNewBlockTime: 484.580us - GetResultsTime: 720.214ms - HTResizeTime: 358.735ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284180480) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 1.31 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 5.141us HDFS_SCAN_NODE (id=0):(Total: 44.502ms, non-child: 44.502ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/16.62 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 16.72 MB, 16.72 MB, 16.72 MB, 16.72 MB, 16.72 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.72 MB (17529764) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.72 MB (17529764) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.72 MB (17529764) - DecompressionTime: 4.234ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.27 MB (19157288) - PerReadThreadRawHdfsThroughput: 3.97 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.33M (4334096) - RowsReturned: 4.33M (4334096) - RowsReturnedRate: 97.39 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 487 (487) - ScannerThreadsTotalWallClockTime: 2s327ms - MaterializeTupleTime(*): 2s305ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 1s468ms - ScannerThreadsVoluntaryContextSwitches: 1.33K (1331) - TotalRawHdfsReadTime(*): 4.110ms - TotalReadThroughput: 5.57 MB/sec Instance 7042e548f32e6c6e:d629d67540154cb6 (host=jbapple-optiplex:22002):(Total: 5s963ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/16.62 MB MemoryUsage(500.0ms): 3.30 MB, 50.60 MB, 100.11 MB, 161.94 MB, 238.41 MB, 267.07 MB, 233.71 MB, 200.32 MB, 150.27 MB, 116.88 MB, 83.52 MB, 50.14 MB, 16.75 MB ThreadUsage(500.0ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.31 - PeakMemoryUsage: 273.35 MB (286626568) - PerHostPeakMemUsage: 305.70 MB (320552960) - PrepareTime: 179.193ms - RowsProduced: 4.33M (4333197) - TotalCpuTime: 8s366ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 55.847ms - TotalStorageWaitTime: 9.299ms CodeGen:(Total: 500.363ms, non-child: 500.363ms, % non-child: 100.00%) - CodegenTime: 5.108ms - CompileTime: 11.367ms - LoadTime: 23.81us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 315.667ms - PrepareTime: 172.479ms DataStreamSender (dst_id=4):(Total: 2s882ms, non-child: 2s882ms, % non-child: 100.00%) - BytesSent: 37.85 MB (39688738) - NetworkThroughput(*): 53.91 MB/sec - OverallThroughput: 13.13 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s233ms - ThriftTransmitTime(*): 702.94ms - UncompressedRowBatchSize: 49.60 MB (52006828) AGGREGATION_NODE (id=1):(Total: 3s076ms, non-child: 3s037ms, % non-child: 98.72%) ExecOption: Codegen Enabled - BuildTime: 2s099ms - GetNewBlockTime: 407.768us - GetResultsTime: 750.663ms - HTResizeTime: 342.777ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284180480) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 1.41 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.846us HDFS_SCAN_NODE (id=0):(Total: 39.316ms, non-child: 39.316ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/16.62 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 16.71 MB, 16.71 MB, 16.71 MB, 16.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.71 MB (17526158) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.71 MB (17526158) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.71 MB (17526158) - DecompressionTime: 3.955ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.26 MB (19149096) - PerReadThreadRawHdfsThroughput: 3.68 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.33M (4333197) - RowsReturned: 4.33M (4333197) - RowsReturnedRate: 110.21 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 303 (303) - ScannerThreadsTotalWallClockTime: 2s134ms - MaterializeTupleTime(*): 2s115ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 1s364ms - ScannerThreadsVoluntaryContextSwitches: 1.09K (1091) - TotalRawHdfsReadTime(*): 4.433ms - TotalReadThroughput: 6.69 MB/sec Instance 7042e548f32e6c6e:d629d67540154cb5 (host=jbapple-optiplex:22001):(Total: 5s398ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/16.61 MB MemoryUsage(500.0ms): 3.30 MB, 50.77 MB, 124.58 MB, 178.60 MB, 239.86 MB, 250.39 MB, 217.02 MB, 166.96 MB, 116.89 MB, 83.50 MB, 33.46 MB ThreadUsage(500.0ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.36 - PeakMemoryUsage: 273.35 MB (286626560) - PerHostPeakMemUsage: 283.18 MB (296936192) - PrepareTime: 241.16ms - RowsProduced: 4.33M (4332707) - TotalCpuTime: 7s637ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 27.609ms - TotalStorageWaitTime: 10.174ms CodeGen:(Total: 505.903ms, non-child: 505.903ms, % non-child: 100.00%) - CodegenTime: 7.221ms - CompileTime: 8.84ms - LoadTime: 24.530us - ModuleFileSize: 2.64 MB (2772812) - OptimizationTime: 265.20ms - PrepareTime: 231.744ms DataStreamSender (dst_id=4):(Total: 2s488ms, non-child: 2s488ms, % non-child: 100.00%) - BytesSent: 37.85 MB (39683823) - NetworkThroughput(*): 50.42 MB/sec - OverallThroughput: 15.21 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 1s069ms - ThriftTransmitTime(*): 750.657ms - UncompressedRowBatchSize: 49.59 MB (52000948) AGGREGATION_NODE (id=1):(Total: 2s905ms, non-child: 2s862ms, % non-child: 98.55%) ExecOption: Codegen Enabled - BuildTime: 1s956ms - GetNewBlockTime: 456.91us - GetResultsTime: 658.582ms - HTResizeTime: 315.739ms - HashBuckets: 8.39M (8388608) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.02 MB (284180480) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 1.49 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 4.802us HDFS_SCAN_NODE (id=0):(Total: 42.233ms, non-child: 42.233ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/16.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 16.71 MB, 16.71 MB, 16.71 MB, 16.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 16.71 MB (17524200) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.71 MB (17524200) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.71 MB (17524200) - DecompressionTime: 3.881ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 18.27 MB (19157288) - PerReadThreadRawHdfsThroughput: 3.77 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.33M (4332707) - RowsReturned: 4.33M (4332707) - RowsReturnedRate: 102.59 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 351 (351) - ScannerThreadsTotalWallClockTime: 1s998ms - MaterializeTupleTime(*): 1s978ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 1s312ms - ScannerThreadsVoluntaryContextSwitches: 1.08K (1084) - TotalRawHdfsReadTime(*): 4.332ms - TotalReadThroughput: 6.68 MB/sec