impalad / /backends /catalog /hadoop-varz /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query (id=bc4f82f61a2b9b6e:23378c97dac23295): Summary: Session ID: b7435381649b4bb5:a8156fb048f456af Session Type: BEESWAX Start Time: 2015-04-14 12:15:16.793432000 End Time: Query Type: DML Query State: CREATED Query Status: OK Impala Version: impalad version 2.0.1-cdh5 RELEASE (build cc09df07d93c79351052eef2f4e5baf52373dc33) User: rex Connected User: rex Delegated User: Network Address: ::ffff:10.21.161.93:36509 Default Db: impala2 Sql Statement: insert overwrite table test2 select cable_modem_mac_address_txt, count(distinct(cmts_nm)) as n from hic_medium group by cable_modem_mac_address_txt having n > 10 Coordinator: atlas-ch2-01.sys.comcast.net:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.20TB VCores=2 F01:PLAN FRAGMENT [HASH(cable_modem_mac_address_txt)] WRITE TO HDFS [impala2.test2, OVERWRITE=true] | partitions=1 | hosts=60 per-host-mem=100.00KB | 02:AGGREGATE [FINALIZE] | output: count((cmts_nm)) | group by: cable_modem_mac_address_txt | having: count((cmts_nm)) > 10 | hosts=60 per-host-mem=26.91MB | tuple-ids=2 row-size=41B cardinality=3754631 | 04:AGGREGATE | group by: cable_modem_mac_address_txt, (cmts_nm) | hosts=60 per-host-mem=188.94GB | tuple-ids=1 row-size=85B cardinality=11869695950 | 03:EXCHANGE [HASH(cable_modem_mac_address_txt)] hosts=60 per-host-mem=0B tuple-ids=1 row-size=85B cardinality=11869695950 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=03, HASH(cable_modem_mac_address_txt)] 01:AGGREGATE | group by: cable_modem_mac_address_txt, (cmts_nm) | hosts=60 per-host-mem=1.01TB | tuple-ids=1 row-size=85B cardinality=11869695950 | 00:SCAN HDFS [impala2.hic_medium, RANDOM] partitions=187/187 size=490.70GB table stats: 11869695950 rows total column stats: all hosts=60 per-host-mem=128.00MB tuple-ids=0 row-size=85B cardinality=11869695950 ---------------- Estimated Per-Host Mem: 1316026700594 Estimated Per-Host VCores: 2 Admission result: Admitted immediately Request Pool: root.rex Query Timeline: 3m33s - Start execution: 96.523us (96.523us) - Planning finished: 69.677ms (69.580ms) - Submit for admission: 104.188ms (34.511ms) - Completed admission: 104.368ms (179.676us) - Ready to start remote fragments: 127.558ms (23.190ms) - Remote fragments started: 937.885ms (810.327ms) ImpalaServer: - ClientFetchWaitTimer: 0ns - RowMaterializationTimer: 0ns Execution Profile bc4f82f61a2b9b6e:23378c97dac23295:(Total: 810.611ms, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 112, last: 0.348327, min: 0.203904, max: 0.404565, mean: 0.290941, stddev: 0.0399568 - FinalizationTimer: 0ns Averaged Fragment F01:(Total: 304.992ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.80 MB (853335905) - PerHostPeakMemUsage: 5.68 GB (6095868696) - PrepareTime: 266.60ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.10K (1098) - BlocksRecycled: 152 - BufferedPins: 1 - BytesWritten: 598.27 MB (627328577) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.38 GB (5778888118) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 616.403ms CodeGen:(Total: 631.569ms, non-child: 631.569ms, % non-child: 100.00%) - CodegenTime: 5.258ms - CompileTime: 372.633ms - LoadTime: 257.414ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.804us, non-child: 58.804us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 266.58ms, non-child: 262.413ms, % non-child: 98.63%) - BuildTime: 0ns - GetNewBlockTime: 313.259us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.396us AGGREGATION_NODE (id=4):(Total: 3.644ms, non-child: 0ns, % non-child: 0.00%) - BuildTime: 17s655ms - GetNewBlockTime: 1.763ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.48 MB (846704623) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.860us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 3m12s, % non-child: 100.00%) - BytesReceived: 1.50 GB (1614666785) - ConvertRowBatchTime: 1s125ms - DeserializeRowBatchTimer: 9s572ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.28M (37282916) - RowsReturnedRate: 193.52 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F00:(Total: 2m51s, non-child: 0ns, % non-child: 0.00%) split sizes: min: 8.69 GB, max: 8.92 GB, avg: 8.76 GB, stddev: 53.26 MB - AverageThreadTokens: 26.16 - PeakMemoryUsage: 5.43 GB (5828712545) - PerHostPeakMemUsage: 5.68 GB (6095868696) - PrepareTime: 260.542ms - RowsProduced: 37.32M (37323113) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 56.489ms - TotalStorageWaitTime: 6s337ms CodeGen:(Total: 565.158ms, non-child: 565.158ms, % non-child: 100.00%) - CodegenTime: 3.55ms - CompileTime: 309.673ms - LoadTime: 254.11ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 28s302ms, non-child: 28s302ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1616388350) - NetworkThroughput(*): 29.42 MB/sec - OverallThroughput: 54.66 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s805ms - ThriftTransmitTime(*): 52s692ms - UncompressedRowBatchSize: 3.38 GB (3631428229) AGGREGATION_NODE (id=1):(Total: 2m22s, non-child: 2m21s, % non-child: 98.97%) - BuildTime: 2m11s - GetNewBlockTime: 34.311ms - GetResultsTime: 3s896ms - HashBuckets: 33.35M (33348461) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 62 - PeakMemoryUsage: 4.77 GB (5121582418) - PinTime: 616.850ms - RowsRepartitioned: 6.39M (6386092) - RowsReturned: 37.32M (37323113) - RowsReturnedRate: 263.20 K/sec - SpilledPartitions: 1 - UnpinTime: 75.579us HDFS_SCAN_NODE (id=0):(Total: 1s463ms, non-child: 1s463ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.32 - BytesRead: 2.40 GB (2581553482) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2581553482) - BytesReadShortCircuit: 2.40 GB (2581553482) - DecompressionTime: 12s439ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 827.41 MB (867599036) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RowsRead: 211.96M (211958856) - RowsReturned: 211.96M (211958856) - RowsReturnedRate: 145.57 M/sec - ScanRangesComplete: 170 - ScannerThreadsInvoluntaryContextSwitches: 3.87K (3869) - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s714ms - ScannerThreadsUserTime: 47s720ms - ScannerThreadsVoluntaryContextSwitches: 207.58K (207579) - TotalRawHdfsReadTime(*): 1s845ms - TotalReadThroughput: 18.49 MB/sec Fragment F01: Instance bc4f82f61a2b9b6e:23378c97dac232a3 (host=atlas-ch2-13.sys.comcast.net:22000):(Total: 306.358ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.94 MB, 349.95 MB, 548.11 MB, 552.46 MB, 553.49 MB, 554.33 MB, 560.40 MB, 614.39 MB, 717.32 MB, 765.83 MB, 806.07 MB, 806.04 MB, 806.03 MB, 806.03 MB, 806.03 MB, 806.04 MB, 806.02 MB, 806.06 MB, 806.03 MB, 806.02 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.07 MB (853618568) - PerHostPeakMemUsage: 5.68 GB (6094394992) - PrepareTime: 266.645ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1125) - BlocksRecycled: 147 - BufferedPins: 0 - BytesWritten: 599.24 MB (628350869) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.54 GB (5949267968) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 610.761ms CodeGen:(Total: 604.318ms, non-child: 604.318ms, % non-child: 100.00%) - CodegenTime: 4.965ms - CompileTime: 344.403ms - LoadTime: 258.410ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 74.262us, non-child: 74.262us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 266.641ms, non-child: 263.205ms, % non-child: 98.71%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 301.661us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.284us AGGREGATION_NODE (id=4):(Total: 3.436ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s678ms - GetNewBlockTime: 1.663ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.78 MB (847014456) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.408us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 4s129ms, % non-child: 2.15%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 384.51 KB, 34.03 MB, 147.27 MB, 302.81 MB, 473.43 MB, 650.38 MB, 827.94 MB, 1005.49 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613131944) - ConvertRowBatchTime: 1s095ms - DeserializeRowBatchTimer: 10s573ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.25M (37248581) - RowsReturnedRate: 194.08 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac2329d (host=atlas-ch2-50.sys.comcast.net:22000):(Total: 307.345ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.66 MB, 285.42 MB, 547.83 MB, 552.10 MB, 553.74 MB, 554.46 MB, 560.06 MB, 614.31 MB, 716.48 MB, 763.79 MB, 806.06 MB, 806.02 MB, 806.05 MB, 806.02 MB, 806.03 MB, 806.06 MB, 806.04 MB, 806.02 MB, 806.03 MB, 806.03 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.11 MB (853660768) - PerHostPeakMemUsage: 5.62 GB (6036307120) - PrepareTime: 267.998ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1084) - BlocksRecycled: 157 - BufferedPins: 2 - BytesWritten: 584.00 MB (612365301) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697044480) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 638.801ms CodeGen:(Total: 603.707ms, non-child: 603.707ms, % non-child: 100.00%) - CodegenTime: 4.938ms - CompileTime: 342.484ms - LoadTime: 259.828ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 51.328us, non-child: 51.328us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 267.996ms, non-child: 264.523ms, % non-child: 98.70%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 308.724us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.613us AGGREGATION_NODE (id=4):(Total: 3.473ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 15s726ms - GetNewBlockTime: 1.321ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056752) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.161us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 3s896ms, % non-child: 2.01%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 246.65 KB, 30.71 MB, 141.03 MB, 295.15 MB, 465.69 MB, 643.10 MB, 820.95 MB, 998.47 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1614007674) - ConvertRowBatchTime: 966.670ms - DeserializeRowBatchTimer: 10s574ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.27M (37269150) - RowsReturnedRate: 192.22 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232bb (host=atlas-ch2-27.sys.comcast.net:22000):(Total: 302.52ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.04 MB, 284.52 MB, 546.98 MB, 551.50 MB, 552.88 MB, 553.72 MB, 557.52 MB, 603.73 MB, 720.81 MB, 754.26 MB, 805.58 MB, 805.54 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.69 MB (853221016) - PerHostPeakMemUsage: 5.65 GB (6069157800) - PrepareTime: 260.661ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1094) - BlocksRecycled: 145 - BufferedPins: 2 - BytesWritten: 592.00 MB (620753960) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697904640) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 581.723ms CodeGen:(Total: 596.439ms, non-child: 596.439ms, % non-child: 100.00%) - CodegenTime: 5.214ms - CompileTime: 342.780ms - LoadTime: 252.316ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.63us, non-child: 53.63us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 260.659ms, non-child: 257.243ms, % non-child: 98.69%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 293.602us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.657us AGGREGATION_NODE (id=4):(Total: 3.415ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s914ms - GetNewBlockTime: 1.432ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532448) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.409us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 3s324ms, % non-child: 1.74%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 432.78 KB, 35.33 MB, 149.74 MB, 305.18 MB, 475.77 MB, 652.37 MB, 829.19 MB, 1006.34 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB - BytesReceived: 1.50 GB (1610440879) - ConvertRowBatchTime: 1s270ms - DeserializeRowBatchTimer: 8s425ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.19M (37186333) - RowsReturnedRate: 195.03 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232be (host=atlas-ch2-10.sys.comcast.net:22000):(Total: 313.130ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 285.35 MB, 547.36 MB, 551.61 MB, 552.99 MB, 554.19 MB, 558.92 MB, 607.89 MB, 723.84 MB, 763.27 MB, 805.54 MB, 805.53 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.55 MB, 805.53 MB, 805.54 MB, 805.52 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.65 MB (853178544) - PerHostPeakMemUsage: 5.63 GB (6042609544) - PrepareTime: 273.238ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.10K (1101) - BlocksRecycled: 152 - BufferedPins: 1 - BytesWritten: 592.00 MB (620753807) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.40 GB (5798027264) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 619.433ms CodeGen:(Total: 616.43ms, non-child: 616.43ms, % non-child: 100.00%) - CodegenTime: 4.909ms - CompileTime: 349.522ms - LoadTime: 265.81ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 55.358us, non-child: 55.358us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 273.235ms, non-child: 269.802ms, % non-child: 98.74%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 302.659us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.332us AGGREGATION_NODE (id=4):(Total: 3.433ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s624ms - GetNewBlockTime: 1.596ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490040) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.680us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 4s015ms, % non-child: 2.09%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 265.92 KB, 31.41 MB, 142.49 MB, 296.65 MB, 466.88 MB, 643.82 MB, 821.48 MB, 998.74 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612435048) - ConvertRowBatchTime: 1s084ms - DeserializeRowBatchTimer: 10s530ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.22M (37224659) - RowsReturnedRate: 193.91 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232cd (host=atlas-ch2-14.sys.comcast.net:22000):(Total: 313.451ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.87 MB, 349.56 MB, 547.46 MB, 551.84 MB, 552.93 MB, 554.35 MB, 558.71 MB, 618.02 MB, 720.94 MB, 765.34 MB, 805.56 MB, 805.55 MB, 805.53 MB, 805.55 MB, 805.55 MB, 805.56 MB, 805.54 MB, 805.52 MB, 805.54 MB, 805.55 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136344) - PerHostPeakMemUsage: 5.65 GB (6063793592) - PrepareTime: 274.591ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.04K (1036) - BlocksRecycled: 204 - BufferedPins: 1 - BytesWritten: 589.61 MB (618248108) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.00 GB (5369692160) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 609.300ms CodeGen:(Total: 614.574ms, non-child: 614.574ms, % non-child: 100.00%) - CodegenTime: 4.968ms - CompileTime: 346.750ms - LoadTime: 266.385ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 54.581us, non-child: 54.581us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 274.589ms, non-child: 271.171ms, % non-child: 98.76%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 316.10us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.150us AGGREGATION_NODE (id=4):(Total: 3.417ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s852ms - GetNewBlockTime: 1.66ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532336) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.503us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s119ms, % non-child: 2.14%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 363.66 KB, 33.69 MB, 146.73 MB, 302.19 MB, 473.54 MB, 650.94 MB, 828.21 MB, 1005.21 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612584355) - ConvertRowBatchTime: 1s074ms - DeserializeRowBatchTimer: 10s642ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.23M (37232375) - RowsReturnedRate: 193.20 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac2329b (host=atlas-ch2-31.sys.comcast.net:22000):(Total: 330.597ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.87 MB, 349.65 MB, 547.51 MB, 551.84 MB, 552.92 MB, 553.84 MB, 560.64 MB, 616.91 MB, 720.85 MB, 762.32 MB, 805.56 MB, 805.52 MB, 805.53 MB, 805.55 MB, 805.53 MB, 805.55 MB, 805.55 MB, 805.55 MB, 805.54 MB, 805.52 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136248) - PerHostPeakMemUsage: 6.12 GB (6576422056) - PrepareTime: 290.696ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.14K (1139) - BlocksRecycled: 4 - BufferedPins: 0 - BytesWritten: 672.00 MB (704639065) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5964300288) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 644.64ms, non-child: 644.64ms, % non-child: 100.00%) - CodegenTime: 4.898ms - CompileTime: 360.100ms - LoadTime: 282.365ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.882us, non-child: 53.882us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 290.693ms, non-child: 287.235ms, % non-child: 98.81%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 297.241us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.330us AGGREGATION_NODE (id=4):(Total: 3.458ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s679ms - GetNewBlockTime: 2.428ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532168) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.408us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 2s476ms, % non-child: 1.29%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 376.32 KB, 33.85 MB, 146.88 MB, 302.12 MB, 473.01 MB, 649.92 MB, 827.29 MB, 1004.52 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB - BytesReceived: 1.50 GB (1611516134) - ConvertRowBatchTime: 1s183ms - DeserializeRowBatchTimer: 6s445ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.21M (37208530) - RowsReturnedRate: 193.89 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b3 (host=atlas-ch2-24.sys.comcast.net:22000):(Total: 324.263ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.46 MB, 285.13 MB, 547.68 MB, 552.00 MB, 553.35 MB, 554.34 MB, 560.17 MB, 612.24 MB, 715.33 MB, 755.79 MB, 806.08 MB, 806.04 MB, 806.03 MB, 806.03 MB, 806.04 MB, 806.03 MB, 806.03 MB, 806.03 MB, 806.03 MB, 806.04 MB, 806.04 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.07 MB (853618648) - PerHostPeakMemUsage: 5.62 GB (6035276584) - PrepareTime: 283.798ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.04K (1042) - BlocksRecycled: 230 - BufferedPins: 0 - BytesWritten: 590.91 MB (619611717) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.06 GB (5436907520) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 624.304ms CodeGen:(Total: 632.972ms, non-child: 632.972ms, % non-child: 100.00%) - CodegenTime: 4.840ms - CompileTime: 355.816ms - LoadTime: 275.710ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.594us, non-child: 58.594us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 283.796ms, non-child: 280.387ms, % non-child: 98.80%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 282.592us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.180us AGGREGATION_NODE (id=4):(Total: 3.408ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s030ms - GetNewBlockTime: 849.404us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.78 MB (847014568) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.614us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 3s285ms, % non-child: 1.72%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 512.36 KB, 36.78 MB, 152.31 MB, 308.32 MB, 479.59 MB, 657.41 MB, 835.15 MB, 1012.81 MB, 1.16 GB, 1.28 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1614931182) - ConvertRowBatchTime: 1s155ms - DeserializeRowBatchTimer: 8s659ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.29M (37286368) - RowsReturnedRate: 194.66 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a7 (host=atlas-ch2-46.sys.comcast.net:22000):(Total: 327.145ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.36 MB, 285.02 MB, 547.76 MB, 552.09 MB, 553.37 MB, 554.44 MB, 559.23 MB, 604.37 MB, 725.55 MB, 768.83 MB, 806.07 MB, 806.03 MB, 806.03 MB, 806.05 MB, 806.03 MB, 806.05 MB, 806.06 MB, 806.04 MB, 806.03 MB, 806.02 MB, 806.02 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.11 MB (853660968) - PerHostPeakMemUsage: 5.65 GB (6063535352) - PrepareTime: 285.79ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1089) - BlocksRecycled: 152 - BufferedPins: 2 - BytesWritten: 592.00 MB (620753493) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697396736) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 587.370ms CodeGen:(Total: 634.516ms, non-child: 634.516ms, % non-child: 100.00%) - CodegenTime: 5.6ms - CompileTime: 356.176ms - LoadTime: 276.920ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.803us, non-child: 57.803us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 285.77ms, non-child: 281.579ms, % non-child: 98.77%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 283.662us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.499us AGGREGATION_NODE (id=4):(Total: 3.497ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s843ms - GetNewBlockTime: 1.419ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056920) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.375us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 4s295ms, % non-child: 2.25%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 501.97 KB, 36.66 MB, 152.29 MB, 308.56 MB, 479.64 MB, 656.94 MB, 834.61 MB, 1012.45 MB, 1.16 GB, 1.28 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1615875136) - ConvertRowBatchTime: 1s192ms - DeserializeRowBatchTimer: 10s803ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.31M (37313766) - RowsReturnedRate: 195.64 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a1 (host=atlas-ch2-32.sys.comcast.net:22000):(Total: 331.236ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.04 MB, 284.21 MB, 546.97 MB, 551.47 MB, 552.75 MB, 553.74 MB, 557.56 MB, 606.65 MB, 721.81 MB, 755.23 MB, 805.56 MB, 805.52 MB, 805.52 MB, 805.53 MB, 805.54 MB, 805.52 MB, 805.55 MB, 805.51 MB, 805.55 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.65 MB (853178648) - PerHostPeakMemUsage: 6.04 GB (6489468016) - PrepareTime: 290.431ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.15K (1149) - BlocksRecycled: 122 - BufferedPins: 0 - BytesWritten: 646.57 MB (677979205) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.64 GB (6055526400) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 631.861ms CodeGen:(Total: 673.297ms, non-child: 673.297ms, % non-child: 100.00%) - CodegenTime: 4.997ms - CompileTime: 389.625ms - LoadTime: 282.177ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.768us, non-child: 57.768us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 290.429ms, non-child: 286.906ms, % non-child: 98.79%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 293.610us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 1.896us AGGREGATION_NODE (id=4):(Total: 3.523ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s254ms - GetNewBlockTime: 1.913ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490112) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 2.990us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 2s416ms, % non-child: 1.26%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 406.87 KB, 34.75 MB, 148.83 MB, 304.12 MB, 474.97 MB, 652.54 MB, 830.60 MB, 1008.55 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1615655226) - ConvertRowBatchTime: 1s154ms - DeserializeRowBatchTimer: 6s475ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.30M (37302685) - RowsReturnedRate: 193.99 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac2329c (host=atlas-ch2-45.sys.comcast.net:22000):(Total: 345.19ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.40 MB, 285.16 MB, 547.74 MB, 551.99 MB, 553.34 MB, 554.26 MB, 557.04 MB, 600.22 MB, 707.32 MB, 756.74 MB, 806.07 MB, 806.03 MB, 806.02 MB, 806.05 MB, 806.03 MB, 806.02 MB, 806.04 MB, 806.03 MB, 806.03 MB, 806.04 MB, 806.01 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.15 MB (853703128) - PerHostPeakMemUsage: 5.73 GB (6150832432) - PrepareTime: 301.927ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.13K (1133) - BlocksRecycled: 139 - BufferedPins: 2 - BytesWritten: 616.00 MB (645919070) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5958860800) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 624.519ms CodeGen:(Total: 753.459ms, non-child: 753.459ms, % non-child: 100.00%) - CodegenTime: 5.52ms - CompileTime: 458.331ms - LoadTime: 293.664ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 65.718us, non-child: 65.718us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 301.925ms, non-child: 298.414ms, % non-child: 98.84%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 285.730us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.55us AGGREGATION_NODE (id=4):(Total: 3.510ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s567ms - GetNewBlockTime: 1.751ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.78 MB (847014448) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.559us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 2s826ms, % non-child: 1.47%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 507.52 KB, 36.65 MB, 151.86 MB, 307.77 MB, 478.96 MB, 656.12 MB, 833.41 MB, 1010.65 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB - BytesReceived: 1.50 GB (1611281876) - ConvertRowBatchTime: 1s233ms - DeserializeRowBatchTimer: 6s733ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.20M (37201061) - RowsReturnedRate: 193.84 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b1 (host=atlas-ch2-26.sys.comcast.net:22000):(Total: 394.700ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.80 MB, 349.50 MB, 547.52 MB, 551.80 MB, 552.90 MB, 553.71 MB, 559.67 MB, 616.84 MB, 715.81 MB, 760.32 MB, 805.59 MB, 805.54 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.55 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094160) - PerHostPeakMemUsage: 5.63 GB (6047432640) - PrepareTime: 355.33ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1082) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 586.50 MB (614993347) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688565760) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 604.204ms CodeGen:(Total: 865.829ms, non-child: 865.829ms, % non-child: 100.00%) - CodegenTime: 8.823ms - CompileTime: 522.415ms - LoadTime: 341.22ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 86.417us, non-child: 86.417us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 355.31ms, non-child: 349.112ms, % non-child: 98.33%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 483.682us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 3.442us AGGREGATION_NODE (id=4):(Total: 5.918ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s137ms - GetNewBlockTime: 1.608ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490192) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.947us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 2s861ms, % non-child: 1.49%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 341.47 KB, 33.05 MB, 145.38 MB, 300.55 MB, 471.81 MB, 649.52 MB, 827.70 MB, 1005.53 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1615670282) - ConvertRowBatchTime: 1s311ms - DeserializeRowBatchTimer: 6s953ms - FirstBatchArrivalWaitTime: 2m5s - PeakMemoryUsage: 0 - RowsReturned: 37.31M (37305311) - RowsReturnedRate: 194.02 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c0 (host=atlas-ch2-57.sys.comcast.net:22000):(Total: 394.476ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.18 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 349.30 MB, 547.37 MB, 551.69 MB, 552.96 MB, 553.94 MB, 558.64 MB, 610.82 MB, 721.85 MB, 764.29 MB, 805.57 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.52 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136200) - PerHostPeakMemUsage: 5.65 GB (6063957720) - PrepareTime: 357.295ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1082) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 585.24 MB (613665085) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688467456) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 614.14ms CodeGen:(Total: 870.889ms, non-child: 870.889ms, % non-child: 100.00%) - CodegenTime: 8.805ms - CompileTime: 525.166ms - LoadTime: 343.456ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 79.408us, non-child: 79.408us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 357.292ms, non-child: 351.356ms, % non-child: 98.34%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 446.919us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 4.367us AGGREGATION_NODE (id=4):(Total: 5.936ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s727ms - GetNewBlockTime: 2.261ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490088) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 5.549us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 3s199ms, % non-child: 1.68%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 274.27 KB, 31.48 MB, 142.05 MB, 296.11 MB, 466.65 MB, 644.28 MB, 822.33 MB, 1000.08 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1615275407) - ConvertRowBatchTime: 1s219ms - DeserializeRowBatchTimer: 8s368ms - FirstBatchArrivalWaitTime: 2m5s - PeakMemoryUsage: 0 - RowsReturned: 37.29M (37294010) - RowsReturnedRate: 195.62 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac23298 (host=atlas-ch2-62.sys.comcast.net:22000):(Total: 237.602ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.61 MB, 284.87 MB, 547.29 MB, 551.58 MB, 552.78 MB, 553.76 MB, 558.54 MB, 609.95 MB, 721.88 MB, 756.30 MB, 805.57 MB, 805.54 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.70 MB (853221168) - PerHostPeakMemUsage: 5.68 GB (6096399808) - PrepareTime: 207.39ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1122) - BlocksRecycled: 150 - BufferedPins: 2 - BytesWritten: 595.69 MB (624624611) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.56 GB (5965955072) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 687.617ms CodeGen:(Total: 501.639ms, non-child: 501.639ms, % non-child: 100.00%) - CodegenTime: 4.989ms - CompileTime: 301.366ms - LoadTime: 198.849ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 55.707us, non-child: 55.707us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 207.37ms, non-child: 203.576ms, % non-child: 98.33%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 293.515us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.294us AGGREGATION_NODE (id=4):(Total: 3.460ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s741ms - GetNewBlockTime: 1.600ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532504) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.463us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s090ms, % non-child: 2.12%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 196.84 KB, 29.14 MB, 137.61 MB, 290.74 MB, 460.66 MB, 637.49 MB, 815.35 MB, 992.76 MB, 1.14 GB, 1.26 GB, 1.34 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB - BytesReceived: 1.50 GB (1612487091) - ConvertRowBatchTime: 1s108ms - DeserializeRowBatchTimer: 10s500ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.22M (37224712) - RowsReturnedRate: 192.97 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac2329f (host=atlas-ch2-33.sys.comcast.net:22000):(Total: 289.630ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 349.01 MB, 547.39 MB, 551.63 MB, 553.02 MB, 554.01 MB, 559.61 MB, 606.89 MB, 714.86 MB, 757.28 MB, 805.56 MB, 805.56 MB, 805.53 MB, 805.54 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.55 MB, 805.55 MB, 805.54 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136328) - PerHostPeakMemUsage: 5.65 GB (6069741672) - PrepareTime: 251.531ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1088) - BlocksRecycled: 152 - BufferedPins: 1 - BytesWritten: 591.10 MB (619810588) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697331200) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 612.158ms CodeGen:(Total: 632.837ms, non-child: 632.837ms, % non-child: 100.00%) - CodegenTime: 4.909ms - CompileTime: 388.23ms - LoadTime: 243.414ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.56us, non-child: 57.56us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 251.530ms, non-child: 248.101ms, % non-child: 98.64%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 297.123us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.369us AGGREGATION_NODE (id=4):(Total: 3.428ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 19s015ms - GetNewBlockTime: 1.436ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490104) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.605us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 4s257ms, % non-child: 2.22%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255.29 KB, 31.04 MB, 141.45 MB, 295.65 MB, 466.27 MB, 643.76 MB, 821.32 MB, 998.47 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613705366) - ConvertRowBatchTime: 1s203ms - DeserializeRowBatchTimer: 10s639ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.26M (37259382) - RowsReturnedRate: 194.54 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b5 (host=atlas-ch2-20.sys.comcast.net:22000):(Total: 285.540ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 349.20 MB, 547.42 MB, 551.69 MB, 553.13 MB, 553.88 MB, 558.65 MB, 613.81 MB, 722.85 MB, 763.31 MB, 805.57 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.55 MB, 805.51 MB, 805.56 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.65 MB (853178672) - PerHostPeakMemUsage: 5.66 GB (6076323792) - PrepareTime: 245.451ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.10K (1096) - BlocksRecycled: 144 - BufferedPins: 1 - BytesWritten: 607.20 MB (636693600) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697896448) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 588.136ms CodeGen:(Total: 623.79ms, non-child: 623.79ms, % non-child: 100.00%) - CodegenTime: 4.990ms - CompileTime: 384.455ms - LoadTime: 237.165ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.910us, non-child: 58.910us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 245.449ms, non-child: 241.974ms, % non-child: 98.58%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 295.866us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.407us AGGREGATION_NODE (id=4):(Total: 3.474ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s228ms - GetNewBlockTime: 1.420ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490056) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.584us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s138ms, % non-child: 2.15%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 274.65 KB, 31.48 MB, 142.59 MB, 297.16 MB, 467.52 MB, 643.90 MB, 821.02 MB, 998.19 MB, 1.14 GB, 1.26 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB - BytesReceived: 1.50 GB (1612117969) - ConvertRowBatchTime: 1s127ms - DeserializeRowBatchTimer: 10s477ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.22M (37223142) - RowsReturnedRate: 193.56 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a8 (host=atlas-ch2-09.sys.comcast.net:22000):(Total: 289.257ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.29 MB, 284.45 MB, 547.08 MB, 551.69 MB, 552.98 MB, 554.03 MB, 558.56 MB, 608.72 MB, 723.48 MB, 759.26 MB, 805.55 MB, 805.54 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.54 MB, 805.54 MB, 805.52 MB, 805.52 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136456) - PerHostPeakMemUsage: 5.65 GB (6064976224) - PrepareTime: 251.701ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1089) - BlocksRecycled: 182 - BufferedPins: 1 - BytesWritten: 585.02 MB (613434991) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.38 GB (5780832256) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 644.248ms CodeGen:(Total: 633.743ms, non-child: 633.743ms, % non-child: 100.00%) - CodegenTime: 4.914ms - CompileTime: 388.717ms - LoadTime: 243.555ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 55.869us, non-child: 55.869us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 251.699ms, non-child: 248.268ms, % non-child: 98.64%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 284.457us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.346us AGGREGATION_NODE (id=4):(Total: 3.431ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s807ms - GetNewBlockTime: 1.725ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532440) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.796us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s080ms, % non-child: 2.12%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 458.49 KB, 35.67 MB, 150.46 MB, 306.81 MB, 478.75 MB, 656.81 MB, 834.71 MB, 1012.59 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.51 GB (1617445382) - ConvertRowBatchTime: 1s145ms - DeserializeRowBatchTimer: 10s587ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.35M (37348960) - RowsReturnedRate: 193.78 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c9 (host=atlas-ch2-16.sys.comcast.net:22000):(Total: 283.415ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.83 MB, 349.58 MB, 547.52 MB, 551.83 MB, 552.91 MB, 553.81 MB, 559.61 MB, 613.86 MB, 721.87 MB, 763.31 MB, 805.56 MB, 805.54 MB, 805.52 MB, 805.54 MB, 805.55 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136472) - PerHostPeakMemUsage: 5.61 GB (6022812096) - PrepareTime: 242.856ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1117) - BlocksRecycled: 148 - BufferedPins: 0 - BytesWritten: 601.68 MB (630905006) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.49 GB (5890564096) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 703.854ms CodeGen:(Total: 622.710ms, non-child: 622.710ms, % non-child: 100.00%) - CodegenTime: 4.919ms - CompileTime: 386.541ms - LoadTime: 234.801ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 51.341us, non-child: 51.341us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 242.855ms, non-child: 239.437ms, % non-child: 98.59%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 295.568us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.378us AGGREGATION_NODE (id=4):(Total: 3.417ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s814ms - GetNewBlockTime: 2.238ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532384) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.960us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 3s598ms, % non-child: 1.88%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 335.44 KB, 32.95 MB, 145.16 MB, 299.91 MB, 470.42 MB, 647.60 MB, 825.47 MB, 1003.37 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1615260871) - ConvertRowBatchTime: 1s300ms - DeserializeRowBatchTimer: 9s115ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.29M (37292965) - RowsReturnedRate: 194.51 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac2329e (host=atlas-ch2-35.sys.comcast.net:22000):(Total: 297.71ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 285.15 MB, 547.31 MB, 551.68 MB, 552.88 MB, 553.75 MB, 563.58 MB, 612.85 MB, 716.25 MB, 761.30 MB, 805.57 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.54 MB, 805.54 MB, 805.54 MB, 805.51 MB, 805.53 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094200) - PerHostPeakMemUsage: 5.63 GB (6042477584) - PrepareTime: 255.674ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1089) - BlocksRecycled: 182 - BufferedPins: 0 - BytesWritten: 589.23 MB (617853676) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.38 GB (5772361728) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 649.815ms CodeGen:(Total: 633.510ms, non-child: 633.510ms, % non-child: 100.00%) - CodegenTime: 5.873ms - CompileTime: 385.564ms - LoadTime: 246.409ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 56.279us, non-child: 56.279us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 255.672ms, non-child: 251.415ms, % non-child: 98.33%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 305.180us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.201us AGGREGATION_NODE (id=4):(Total: 4.257ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s841ms - GetNewBlockTime: 1.813ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490120) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.878us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 4s177ms, % non-child: 2.16%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 244.34 KB, 30.69 MB, 140.92 MB, 294.77 MB, 465.11 MB, 642.55 MB, 820.74 MB, 998.79 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.51 GB (1617368886) - ConvertRowBatchTime: 1s041ms - DeserializeRowBatchTimer: 10s820ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.35M (37348816) - RowsReturnedRate: 192.80 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c6 (host=atlas-ch2-18.sys.comcast.net:22000):(Total: 292.450ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.05 MB, 284.25 MB, 546.96 MB, 551.50 MB, 552.80 MB, 554.04 MB, 557.61 MB, 595.79 MB, 709.86 MB, 749.22 MB, 804.56 MB, 805.54 MB, 805.52 MB, 805.52 MB, 805.54 MB, 805.53 MB, 805.51 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094192) - PerHostPeakMemUsage: 5.59 GB (6004325560) - PrepareTime: 254.363ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1082) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 588.28 MB (616855239) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688459264) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 645.472ms CodeGen:(Total: 638.446ms, non-child: 638.446ms, % non-child: 100.00%) - CodegenTime: 4.933ms - CompileTime: 390.752ms - LoadTime: 246.305ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 52.702us, non-child: 52.702us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 254.361ms, non-child: 250.978ms, % non-child: 98.67%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 287.979us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.62us AGGREGATION_NODE (id=4):(Total: 3.382ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s375ms - GetNewBlockTime: 1.372ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490072) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.227us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s230ms, % non-child: 2.20%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 413.46 KB, 34.72 MB, 148.66 MB, 304.15 MB, 474.85 MB, 651.53 MB, 828.81 MB, 1006.16 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613266690) - ConvertRowBatchTime: 1s174ms - DeserializeRowBatchTimer: 10s663ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.26M (37255371) - RowsReturnedRate: 193.87 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac23297 (host=atlas-ch2-41.sys.comcast.net:22000):(Total: 302.846ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.04 MB, 284.21 MB, 546.89 MB, 551.52 MB, 552.95 MB, 553.75 MB, 558.75 MB, 599.66 MB, 714.83 MB, 755.25 MB, 805.57 MB, 805.55 MB, 805.56 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.65 MB (853178688) - PerHostPeakMemUsage: 5.60 GB (6016479680) - PrepareTime: 260.820ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1087) - BlocksRecycled: 153 - BufferedPins: 1 - BytesWritten: 591.65 MB (620393414) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697110016) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 601.808ms CodeGen:(Total: 637.578ms, non-child: 637.578ms, % non-child: 100.00%) - CodegenTime: 4.985ms - CompileTime: 383.574ms - LoadTime: 252.545ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.191us, non-child: 57.191us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 260.818ms, non-child: 257.331ms, % non-child: 98.66%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 310.727us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.408us AGGREGATION_NODE (id=4):(Total: 3.487ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 15s550ms - GetNewBlockTime: 1.454ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532456) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.313us EXCHANGE_NODE (id=3):(Total: 3m15s, non-child: 3s991ms, % non-child: 2.05%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 406.72 KB, 34.56 MB, 148.06 MB, 303.19 MB, 474.10 MB, 651.83 MB, 830.19 MB, 1008.25 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.51 GB (1617390906) - ConvertRowBatchTime: 948.878ms - DeserializeRowBatchTimer: 10s728ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.35M (37346612) - RowsReturnedRate: 191.50 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a0 (host=atlas-ch2-42.sys.comcast.net:22000):(Total: 311.146ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.69 MB, 349.27 MB, 547.40 MB, 551.78 MB, 552.99 MB, 554.04 MB, 559.76 MB, 614.84 MB, 722.99 MB, 766.33 MB, 805.56 MB, 805.54 MB, 805.54 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.52 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136488) - PerHostPeakMemUsage: 5.56 GB (5975254424) - PrepareTime: 270.370ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1082) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 587.25 MB (615772227) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688467456) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 588.104ms CodeGen:(Total: 612.395ms, non-child: 612.395ms, % non-child: 100.00%) - CodegenTime: 5.99ms - CompileTime: 348.918ms - LoadTime: 262.86ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 52.22us, non-child: 52.22us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 270.368ms, non-child: 266.925ms, % non-child: 98.73%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 287.159us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.292us AGGREGATION_NODE (id=4):(Total: 3.443ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s557ms - GetNewBlockTime: 1.514ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532424) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.603us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s392ms, % non-child: 2.29%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 298.39 KB, 32.16 MB, 143.60 MB, 298.14 MB, 468.68 MB, 646.01 MB, 823.59 MB, 1000.81 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1614555392) - ConvertRowBatchTime: 1s203ms - DeserializeRowBatchTimer: 10s839ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.28M (37280033) - RowsReturnedRate: 194.15 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232ab (host=atlas-ch2-55.sys.comcast.net:22000):(Total: 324.20ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.80 MB, 350.02 MB, 548.02 MB, 552.31 MB, 553.45 MB, 554.34 MB, 560.09 MB, 619.65 MB, 725.54 MB, 763.83 MB, 806.05 MB, 806.03 MB, 806.04 MB, 806.04 MB, 806.05 MB, 806.02 MB, 806.03 MB, 806.03 MB, 806.02 MB, 806.04 MB, 806.02 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.19 MB (853745288) - PerHostPeakMemUsage: 5.59 GB (6003840648) - PrepareTime: 285.366ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1083) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 587.39 MB (615922993) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688459264) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 650.81ms CodeGen:(Total: 632.988ms, non-child: 632.988ms, % non-child: 100.00%) - CodegenTime: 4.920ms - CompileTime: 354.293ms - LoadTime: 277.331ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 54.362us, non-child: 54.362us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 285.365ms, non-child: 281.936ms, % non-child: 98.80%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 289.973us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.557us AGGREGATION_NODE (id=4):(Total: 3.428ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s564ms - GetNewBlockTime: 1.459ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056712) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.700us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 4s223ms, % non-child: 2.19%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 359.21 KB, 33.65 MB, 146.88 MB, 302.13 MB, 472.91 MB, 650.09 MB, 827.76 MB, 1005.37 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1615885281) - ConvertRowBatchTime: 1s107ms - DeserializeRowBatchTimer: 10s742ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.31M (37311524) - RowsReturnedRate: 193.29 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232bd (host=atlas-ch2-49.sys.comcast.net:22000):(Total: 333.772ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.29 MB, 284.74 MB, 547.09 MB, 551.51 MB, 552.82 MB, 553.82 MB, 558.59 MB, 602.69 MB, 722.79 MB, 761.28 MB, 805.56 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136464) - PerHostPeakMemUsage: 5.64 GB (6057018448) - PrepareTime: 293.81ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1116) - BlocksRecycled: 153 - BufferedPins: 0 - BytesWritten: 583.32 MB (611654821) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.53 GB (5940379648) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 590.461ms CodeGen:(Total: 637.805ms, non-child: 637.805ms, % non-child: 100.00%) - CodegenTime: 5.267ms - CompileTime: 351.814ms - LoadTime: 284.510ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 49.924us, non-child: 49.924us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 293.78ms, non-child: 289.609ms, % non-child: 98.82%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 315.969us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.130us AGGREGATION_NODE (id=4):(Total: 3.468ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s070ms - GetNewBlockTime: 1.628ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532432) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.553us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 3s425ms, % non-child: 1.78%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 493.12 KB, 36.36 MB, 151.33 MB, 307.35 MB, 478.97 MB, 656.73 MB, 834.72 MB, 1012.47 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.51 GB (1617799573) - ConvertRowBatchTime: 1s151ms - DeserializeRowBatchTimer: 9s215ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.36M (37356347) - RowsReturnedRate: 194.05 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a4 (host=atlas-ch2-47.sys.comcast.net:22000):(Total: 339.610ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.22 MB, 284.59 MB, 547.11 MB, 551.52 MB, 552.94 MB, 553.71 MB, 559.00 MB, 604.12 MB, 719.05 MB, 757.28 MB, 805.55 MB, 805.54 MB, 805.55 MB, 805.54 MB, 805.54 MB, 805.54 MB, 805.54 MB, 805.52 MB, 805.54 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.65 MB (853178904) - PerHostPeakMemUsage: 5.63 GB (6047811952) - PrepareTime: 296.8ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1082) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 587.32 MB (615848005) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688532992) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 672.108ms CodeGen:(Total: 653.26ms, non-child: 653.26ms, % non-child: 100.00%) - CodegenTime: 4.901ms - CompileTime: 363.656ms - LoadTime: 287.991ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.376us, non-child: 53.376us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 296.5ms, non-child: 292.631ms, % non-child: 98.86%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 284.338us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.333us AGGREGATION_NODE (id=4):(Total: 3.374ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s092ms - GetNewBlockTime: 1.439ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532536) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.637us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s121ms, % non-child: 2.14%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 456.31 KB, 35.75 MB, 150.63 MB, 306.45 MB, 477.78 MB, 654.92 MB, 832.19 MB, 1009.55 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613627377) - ConvertRowBatchTime: 1s149ms - DeserializeRowBatchTimer: 10s481ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.26M (37261499) - RowsReturnedRate: 193.60 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232cc (host=atlas-ch2-01.sys.comcast.net:22000):(Total: 240.373ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.81 MB, 349.56 MB, 547.53 MB, 551.77 MB, 552.94 MB, 553.92 MB, 567.68 MB, 624.07 MB, 723.87 MB, 767.31 MB, 805.55 MB, 805.57 MB, 805.52 MB, 805.52 MB, 805.54 MB, 805.54 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.73 MB (853262936) - PerHostPeakMemUsage: 5.70 GB (6118113176) - PrepareTime: 206.572ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1121) - BlocksRecycled: 150 - BufferedPins: 1 - BytesWritten: 596.64 MB (625623623) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5957632000) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 780.441ms CodeGen:(Total: 495.317ms, non-child: 495.317ms, % non-child: 100.00%) - CodegenTime: 4.963ms - CompileTime: 295.432ms - LoadTime: 198.418ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 54.47us, non-child: 54.47us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 206.571ms, non-child: 203.131ms, % non-child: 98.33%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 280.678us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 1.992us AGGREGATION_NODE (id=4):(Total: 3.439ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s819ms - GetNewBlockTime: 2.116ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532256) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.770us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 4s077ms, % non-child: 2.10%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 350.14 KB, 33.53 MB, 146.77 MB, 302.12 MB, 473.07 MB, 650.63 MB, 828.68 MB, 1006.68 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB, 1.51 GB - BytesReceived: 1.51 GB (1620371962) - ConvertRowBatchTime: 1s123ms - DeserializeRowBatchTimer: 10s109ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.42M (37417981) - RowsReturnedRate: 193.05 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a5 (host=atlas-ch2-37.sys.comcast.net:22000):(Total: 279.365ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.29 MB, 284.59 MB, 547.12 MB, 551.50 MB, 552.86 MB, 553.83 MB, 556.54 MB, 604.65 MB, 717.84 MB, 755.25 MB, 805.57 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.54 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.70 MB (853225152) - PerHostPeakMemUsage: 5.59 GB (6005574600) - PrepareTime: 240.890ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.06K (1063) - BlocksRecycled: 181 - BufferedPins: 0 - BytesWritten: 586.92 MB (615434994) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.17 GB (5554348032) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 594.455ms CodeGen:(Total: 619.485ms, non-child: 619.485ms, % non-child: 100.00%) - CodegenTime: 4.964ms - CompileTime: 385.370ms - LoadTime: 232.613ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 69.812us, non-child: 69.812us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 240.888ms, non-child: 237.369ms, % non-child: 98.54%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 306.82us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.284us AGGREGATION_NODE (id=4):(Total: 3.519ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s591ms - GetNewBlockTime: 1.697ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532440) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.419us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 4s095ms, % non-child: 2.10%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 454.43 KB, 35.62 MB, 150.31 MB, 306.22 MB, 477.10 MB, 654.14 MB, 831.61 MB, 1009.00 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1614105481) - ConvertRowBatchTime: 1s030ms - DeserializeRowBatchTimer: 10s782ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.26M (37263151) - RowsReturnedRate: 191.12 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c8 (host=atlas-ch2-25.sys.comcast.net:22000):(Total: 278.501ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.75 MB, 349.26 MB, 547.38 MB, 551.75 MB, 553.07 MB, 553.72 MB, 559.66 MB, 618.02 MB, 724.92 MB, 753.27 MB, 803.58 MB, 805.53 MB, 805.54 MB, 805.54 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.54 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136344) - PerHostPeakMemUsage: 5.68 GB (6095276856) - PrepareTime: 239.789ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1082) - BlocksRecycled: 157 - BufferedPins: 1 - BytesWritten: 576.00 MB (603976247) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688582144) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 625.65ms CodeGen:(Total: 613.305ms, non-child: 613.305ms, % non-child: 100.00%) - CodegenTime: 4.943ms - CompileTime: 380.198ms - LoadTime: 231.702ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 52.91us, non-child: 52.91us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 239.787ms, non-child: 236.306ms, % non-child: 98.55%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 276.517us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 1.946us AGGREGATION_NODE (id=4):(Total: 3.480ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s557ms - GetNewBlockTime: 1.387ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532320) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.414us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 4s291ms, % non-child: 2.21%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 298.36 KB, 32.17 MB, 143.64 MB, 298.20 MB, 468.87 MB, 646.09 MB, 823.89 MB, 1001.25 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1614261394) - ConvertRowBatchTime: 1s096ms - DeserializeRowBatchTimer: 10s880ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.28M (37278364) - RowsReturnedRate: 192.16 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b8 (host=atlas-ch2-23.sys.comcast.net:22000):(Total: 296.304ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.04 MB, 284.21 MB, 546.92 MB, 551.54 MB, 552.76 MB, 554.04 MB, 558.65 MB, 602.68 MB, 714.99 MB, 753.24 MB, 805.58 MB, 805.50 MB, 805.56 MB, 805.52 MB, 805.56 MB, 805.54 MB, 805.53 MB, 805.55 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094120) - PerHostPeakMemUsage: 5.69 GB (6109148640) - PrepareTime: 254.924ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.13K (1132) - BlocksRecycled: 139 - BufferedPins: 2 - BytesWritten: 616.00 MB (645919291) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5958860800) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 593.563ms CodeGen:(Total: 639.309ms, non-child: 639.309ms, % non-child: 100.00%) - CodegenTime: 4.863ms - CompileTime: 391.63ms - LoadTime: 246.757ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.150us, non-child: 58.150us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 254.922ms, non-child: 251.480ms, % non-child: 98.65%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 303.569us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.2us AGGREGATION_NODE (id=4):(Total: 3.442ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s288ms - GetNewBlockTime: 2.404ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490144) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.147us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 4s269ms, % non-child: 2.21%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 409.15 KB, 34.80 MB, 148.72 MB, 304.56 MB, 475.72 MB, 653.18 MB, 831.09 MB, 1008.78 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1618718215) - ConvertRowBatchTime: 1s136ms - DeserializeRowBatchTimer: 10s665ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.38M (37375519) - RowsReturnedRate: 193.40 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232bf (host=atlas-ch2-02.sys.comcast.net:22000):(Total: 294.987ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.81 MB, 350.29 MB, 548.49 MB, 552.78 MB, 553.88 MB, 554.81 MB, 556.74 MB, 611.09 MB, 721.97 MB, 762.30 MB, 806.54 MB, 806.54 MB, 806.52 MB, 806.53 MB, 806.54 MB, 806.53 MB, 806.54 MB, 806.54 MB, 806.54 MB, 806.54 MB, 806.52 MB, 806.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.57 MB (854142776) - PerHostPeakMemUsage: 5.65 GB (6061971928) - PrepareTime: 255.603ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.11K (1108) - BlocksRecycled: 140 - BufferedPins: 1 - BytesWritten: 608.00 MB (637530869) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.35 GB (5740068864) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 581.958ms CodeGen:(Total: 642.708ms, non-child: 642.708ms, % non-child: 100.00%) - CodegenTime: 5.2ms - CompileTime: 393.936ms - LoadTime: 247.248ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 64.909us, non-child: 64.909us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 255.601ms, non-child: 252.85ms, % non-child: 98.62%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 294.657us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.429us AGGREGATION_NODE (id=4):(Total: 3.515ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s687ms - GetNewBlockTime: 1.810ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 808.28 MB (847538712) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.857us EXCHANGE_NODE (id=3):(Total: 3m13s, non-child: 4s061ms, % non-child: 2.10%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 341.33 KB, 32.97 MB, 144.83 MB, 298.96 MB, 469.39 MB, 646.40 MB, 823.55 MB, 1000.24 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1611123552) - ConvertRowBatchTime: 1s092ms - DeserializeRowBatchTimer: 10s580ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.20M (37202459) - RowsReturnedRate: 191.90 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac23299 (host=atlas-ch2-29.sys.comcast.net:22000):(Total: 315.859ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.60 MB, 285.55 MB, 548.26 MB, 552.55 MB, 553.85 MB, 554.74 MB, 558.49 MB, 617.76 MB, 723.81 MB, 759.29 MB, 806.55 MB, 806.53 MB, 806.53 MB, 806.53 MB, 806.52 MB, 806.54 MB, 806.53 MB, 806.54 MB, 806.54 MB, 806.53 MB, 806.52 MB, 806.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.61 MB (854184936) - PerHostPeakMemUsage: 6.16 GB (6616084984) - PrepareTime: 275.53ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m15s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.14K (1142) - BlocksRecycled: 101 - BufferedPins: 2 - BytesWritten: 680.00 MB (713028095) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5964300288) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 586.401ms CodeGen:(Total: 611.213ms, non-child: 611.213ms, % non-child: 100.00%) - CodegenTime: 4.895ms - CompileTime: 342.695ms - LoadTime: 267.195ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 51.7us, non-child: 51.7us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 275.51ms, non-child: 271.683ms, % non-child: 98.78%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 276.82us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.153us AGGREGATION_NODE (id=4):(Total: 3.367ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 14s972ms - GetNewBlockTime: 2.393ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 808.32 MB (847580960) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.369us EXCHANGE_NODE (id=3):(Total: 3m16s, non-child: 1s802ms, % non-child: 0.92%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 613.80 KB, 38.77 MB, 156.08 MB, 313.03 MB, 484.73 MB, 662.31 MB, 840.27 MB, 1017.95 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1618344794) - ConvertRowBatchTime: 813.968ms - DeserializeRowBatchTimer: 5s450ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.37M (37369766) - RowsReturnedRate: 190.04 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac23296 (host=atlas-ch2-39.sys.comcast.net:22000):(Total: 318.933ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.41 MB, 284.73 MB, 547.20 MB, 551.56 MB, 552.83 MB, 553.72 MB, 558.63 MB, 602.00 MB, 711.82 MB, 755.25 MB, 805.56 MB, 805.54 MB, 805.52 MB, 805.52 MB, 805.52 MB, 805.53 MB, 805.53 MB, 805.56 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136360) - PerHostPeakMemUsage: 5.66 GB (6078801216) - PrepareTime: 278.333ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m15s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.11K (1113) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 587.96 MB (616522817) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.54 GB (5948579840) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 634.134ms CodeGen:(Total: 621.190ms, non-child: 621.190ms, % non-child: 100.00%) - CodegenTime: 4.973ms - CompileTime: 349.623ms - LoadTime: 270.136ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.160us, non-child: 57.160us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 278.330ms, non-child: 274.842ms, % non-child: 98.75%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 286.294us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.366us AGGREGATION_NODE (id=4):(Total: 3.488ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 14s784ms - GetNewBlockTime: 1.569ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532384) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.411us EXCHANGE_NODE (id=3):(Total: 3m16s, non-child: 4s019ms, % non-child: 2.04%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 519.12 KB, 36.72 MB, 151.99 MB, 307.94 MB, 479.16 MB, 656.34 MB, 833.78 MB, 1011.29 MB, 1.16 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.50 GB (1614672515) - ConvertRowBatchTime: 912.685ms - DeserializeRowBatchTimer: 10s929ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.27M (37269912) - RowsReturnedRate: 189.37 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c1 (host=atlas-ch2-19.sys.comcast.net:22000):(Total: 317.639ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.04 MB, 284.26 MB, 546.93 MB, 551.47 MB, 552.80 MB, 553.70 MB, 555.47 MB, 597.13 MB, 711.85 MB, 750.20 MB, 805.55 MB, 805.57 MB, 805.52 MB, 805.52 MB, 805.52 MB, 805.54 MB, 805.53 MB, 805.55 MB, 805.53 MB, 805.54 MB, 805.52 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094016) - PerHostPeakMemUsage: 5.60 GB (6018153528) - PrepareTime: 279.300ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m14s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.11K (1111) - BlocksRecycled: 150 - BufferedPins: 0 - BytesWritten: 594.22 MB (623086923) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.46 GB (5865373696) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 597.845ms CodeGen:(Total: 569.482ms, non-child: 569.482ms, % non-child: 100.00%) - CodegenTime: 4.909ms - CompileTime: 296.775ms - LoadTime: 271.346ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 51.799us, non-child: 51.799us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 279.297ms, non-child: 275.897ms, % non-child: 98.78%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 271.642us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.372us AGGREGATION_NODE (id=4):(Total: 3.400ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s315ms - GetNewBlockTime: 4.602ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490024) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.658us EXCHANGE_NODE (id=3):(Total: 3m15s, non-child: 2s669ms, % non-child: 1.37%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 406.86 KB, 34.54 MB, 148.08 MB, 302.98 MB, 473.58 MB, 650.65 MB, 828.00 MB, 1004.95 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612158009) - ConvertRowBatchTime: 958.176ms - DeserializeRowBatchTimer: 7s691ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.23M (37226809) - RowsReturnedRate: 190.58 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232aa (host=atlas-ch2-07.sys.comcast.net:22000):(Total: 324.626ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 284.96 MB, 547.32 MB, 551.57 MB, 552.95 MB, 553.77 MB, 557.60 MB, 609.08 MB, 721.82 MB, 765.30 MB, 805.55 MB, 805.55 MB, 805.55 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.56 MB, 805.54 MB, 805.53 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136624) - PerHostPeakMemUsage: 5.63 GB (6043266744) - PrepareTime: 285.235ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1088) - BlocksRecycled: 152 - BufferedPins: 1 - BytesWritten: 589.85 MB (618497771) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697290240) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 597.147ms CodeGen:(Total: 633.135ms, non-child: 633.135ms, % non-child: 100.00%) - CodegenTime: 4.902ms - CompileTime: 354.532ms - LoadTime: 277.150ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 56.330us, non-child: 56.330us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 285.232ms, non-child: 281.821ms, % non-child: 98.80%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 288.289us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.77us AGGREGATION_NODE (id=4):(Total: 3.411ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s115ms - GetNewBlockTime: 1.388ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532536) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.388us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 3s997ms, % non-child: 2.06%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 654.39 KB, 39.30 MB, 156.74 MB, 313.66 MB, 485.28 MB, 662.58 MB, 840.11 MB, 1017.49 MB, 1.16 GB, 1.28 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.50 GB (1615613799) - ConvertRowBatchTime: 1s072ms - DeserializeRowBatchTimer: 10s584ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.31M (37306648) - RowsReturnedRate: 191.85 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a2 (host=atlas-ch2-30.sys.comcast.net:22000):(Total: 242.429ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.61 MB, 284.93 MB, 547.26 MB, 551.64 MB, 552.82 MB, 553.73 MB, 558.64 MB, 612.79 MB, 721.94 MB, 759.27 MB, 805.53 MB, 805.52 MB, 805.52 MB, 805.52 MB, 805.55 MB, 805.54 MB, 805.52 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136464) - PerHostPeakMemUsage: 5.66 GB (6077739216) - PrepareTime: 208.637ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.06K (1065) - BlocksRecycled: 206 - BufferedPins: 0 - BytesWritten: 586.74 MB (615238029) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.22 GB (5604679680) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 704.250ms CodeGen:(Total: 501.915ms, non-child: 501.915ms, % non-child: 100.00%) - CodegenTime: 4.948ms - CompileTime: 300.85ms - LoadTime: 200.381ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 52.699us, non-child: 52.699us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 208.635ms, non-child: 205.216ms, % non-child: 98.36%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 304.267us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.158us AGGREGATION_NODE (id=4):(Total: 3.419ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s285ms - GetNewBlockTime: 1.67ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532368) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.500us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 4s169ms, % non-child: 2.15%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 207.89 KB, 29.66 MB, 138.83 MB, 292.56 MB, 462.86 MB, 640.25 MB, 818.27 MB, 995.81 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1618301459) - ConvertRowBatchTime: 1s162ms - DeserializeRowBatchTimer: 10s587ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.37M (37365971) - RowsReturnedRate: 192.28 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232ca (host=atlas-ch2-40.sys.comcast.net:22000):(Total: 238.267ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.99 MB, 349.97 MB, 548.06 MB, 552.37 MB, 553.48 MB, 554.39 MB, 560.30 MB, 615.39 MB, 718.41 MB, 765.83 MB, 806.06 MB, 806.03 MB, 806.02 MB, 806.02 MB, 806.04 MB, 806.05 MB, 806.02 MB, 806.03 MB, 806.02 MB, 806.02 MB, 806.01 MB, 806.04 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.19 MB (853745272) - PerHostPeakMemUsage: 5.63 GB (6043865616) - PrepareTime: 206.963ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.07K (1066) - BlocksRecycled: 206 - BufferedPins: 0 - BytesWritten: 584.19 MB (612563003) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.22 GB (5604646912) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 715.238ms CodeGen:(Total: 500.462ms, non-child: 500.462ms, % non-child: 100.00%) - CodegenTime: 4.956ms - CompileTime: 300.235ms - LoadTime: 198.767ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.996us, non-child: 53.996us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 206.961ms, non-child: 203.472ms, % non-child: 98.31%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 301.85us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.373us AGGREGATION_NODE (id=4):(Total: 3.488ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s593ms - GetNewBlockTime: 1.499ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056752) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.951us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 4s299ms, % non-child: 2.22%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 395.85 KB, 34.37 MB, 148.09 MB, 303.78 MB, 475.04 MB, 652.48 MB, 829.98 MB, 1007.14 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1618921950) - ConvertRowBatchTime: 1s175ms - DeserializeRowBatchTimer: 10s629ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.39M (37385505) - RowsReturnedRate: 192.67 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac2329a (host=atlas-ch2-08.sys.comcast.net:22000):(Total: 286.268ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.61 MB, 284.80 MB, 547.26 MB, 551.53 MB, 552.86 MB, 553.78 MB, 558.69 MB, 612.87 MB, 721.83 MB, 763.27 MB, 805.56 MB, 805.53 MB, 805.55 MB, 805.55 MB, 805.53 MB, 805.54 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.54 MB, 805.54 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136496) - PerHostPeakMemUsage: 5.69 GB (6112639416) - PrepareTime: 246.789ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.13K (1130) - BlocksRecycled: 141 - BufferedPins: 2 - BytesWritten: 608.00 MB (637530685) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5958090752) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 694.514ms CodeGen:(Total: 625.114ms, non-child: 625.114ms, % non-child: 100.00%) - CodegenTime: 5.0ms - CompileTime: 385.176ms - LoadTime: 238.465ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.843us, non-child: 57.843us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 246.787ms, non-child: 243.281ms, % non-child: 98.58%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 306.715us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.261us AGGREGATION_NODE (id=4):(Total: 3.506ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s818ms - GetNewBlockTime: 2.409ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532416) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 5.702us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 3s455ms, % non-child: 1.77%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 594.90 KB, 38.30 MB, 155.17 MB, 311.76 MB, 483.61 MB, 661.51 MB, 839.07 MB, 1016.39 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1619713119) - ConvertRowBatchTime: 1s200ms - DeserializeRowBatchTimer: 8s678ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.40M (37396447) - RowsReturnedRate: 192.04 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b9 (host=atlas-ch2-54.sys.comcast.net:22000):(Total: 282.241ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.22 MB, 284.90 MB, 547.63 MB, 552.02 MB, 553.31 MB, 554.20 MB, 558.07 MB, 604.21 MB, 713.34 MB, 750.77 MB, 798.04 MB, 800.04 MB, 806.05 MB, 806.06 MB, 806.04 MB, 806.02 MB, 806.02 MB, 806.04 MB, 806.04 MB, 806.05 MB, 806.03 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.11 MB (853660864) - PerHostPeakMemUsage: 5.67 GB (6088659920) - PrepareTime: 241.475ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m12s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.13K (1126) - BlocksRecycled: 146 - BufferedPins: 1 - BytesWritten: 600.00 MB (629142420) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.54 GB (5949374464) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 712.489ms CodeGen:(Total: 718.208ms, non-child: 718.208ms, % non-child: 100.00%) - CodegenTime: 5.16ms - CompileTime: 483.513ms - LoadTime: 233.229ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.610us, non-child: 57.610us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 241.473ms, non-child: 237.998ms, % non-child: 98.56%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 279.522us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 1.973us AGGREGATION_NODE (id=4):(Total: 3.475ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s025ms - GetNewBlockTime: 1.560ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056824) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 2.991us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 3s076ms, % non-child: 1.58%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 454.51 KB, 35.61 MB, 150.06 MB, 305.65 MB, 477.11 MB, 654.76 MB, 832.43 MB, 1009.60 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1616728745) - ConvertRowBatchTime: 1s200ms - DeserializeRowBatchTimer: 7s993ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.33M (37328413) - RowsReturnedRate: 192.00 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b2 (host=atlas-ch2-58.sys.comcast.net:22000):(Total: 304.498ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 285.26 MB, 547.34 MB, 551.61 MB, 552.96 MB, 553.81 MB, 558.56 MB, 605.86 MB, 713.84 MB, 751.30 MB, 805.54 MB, 805.53 MB, 805.54 MB, 805.55 MB, 805.53 MB, 805.54 MB, 805.53 MB, 805.54 MB, 805.55 MB, 805.55 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136368) - PerHostPeakMemUsage: 5.61 GB (6021105384) - PrepareTime: 264.15ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1089) - BlocksRecycled: 182 - BufferedPins: 1 - BytesWritten: 590.47 MB (619150836) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.38 GB (5780742144) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 614.193ms CodeGen:(Total: 596.521ms, non-child: 596.521ms, % non-child: 100.00%) - CodegenTime: 5.334ms - CompileTime: 339.657ms - LoadTime: 255.369ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 54.940us, non-child: 54.940us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 264.13ms, non-child: 260.533ms, % non-child: 98.68%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 304.561us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.309us AGGREGATION_NODE (id=4):(Total: 3.479ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s329ms - GetNewBlockTime: 1.217ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532352) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.447us EXCHANGE_NODE (id=3):(Total: 3m15s, non-child: 3s315ms, % non-child: 1.70%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 257.58 KB, 31.08 MB, 141.60 MB, 296.00 MB, 466.34 MB, 642.71 MB, 819.61 MB, 996.49 MB, 1.14 GB, 1.26 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613874760) - ConvertRowBatchTime: 1s088ms - DeserializeRowBatchTimer: 8s826ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.26M (37258191) - RowsReturnedRate: 190.81 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b4 (host=atlas-ch2-63.sys.comcast.net:22000):(Total: 313.749ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.22 MB, 284.91 MB, 547.58 MB, 551.98 MB, 553.33 MB, 554.30 MB, 557.01 MB, 604.18 MB, 716.31 MB, 758.77 MB, 806.05 MB, 806.02 MB, 806.03 MB, 806.05 MB, 806.05 MB, 806.04 MB, 806.03 MB, 806.04 MB, 806.03 MB, 806.04 MB, 806.02 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.11 MB (853660808) - PerHostPeakMemUsage: 5.66 GB (6075675648) - PrepareTime: 292.331ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m14s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.10K (1101) - BlocksRecycled: 140 - BufferedPins: 2 - BytesWritten: 608.00 MB (637530620) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5698224128) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 593.319ms CodeGen:(Total: 677.296ms, non-child: 677.296ms, % non-child: 100.00%) - CodegenTime: 4.931ms - CompileTime: 391.586ms - LoadTime: 283.696ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.915us, non-child: 53.915us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 292.330ms, non-child: 288.986ms, % non-child: 98.86%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 279.380us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.368us AGGREGATION_NODE (id=4):(Total: 3.343ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s973ms - GetNewBlockTime: 1.422ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056672) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.94us EXCHANGE_NODE (id=3):(Total: 3m15s, non-child: 3s398ms, % non-child: 1.74%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 451.58 KB, 35.52 MB, 149.67 MB, 305.15 MB, 476.17 MB, 653.58 MB, 831.03 MB, 1008.15 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1616252625) - ConvertRowBatchTime: 1s030ms - DeserializeRowBatchTimer: 9s367ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.32M (37317935) - RowsReturnedRate: 190.81 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232ae (host=atlas-ch2-38.sys.comcast.net:22000):(Total: 316.389ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.68 MB, 349.63 MB, 547.95 MB, 552.20 MB, 553.57 MB, 554.40 MB, 560.15 MB, 618.56 MB, 725.34 MB, 765.85 MB, 806.07 MB, 806.04 MB, 806.06 MB, 806.01 MB, 806.02 MB, 806.05 MB, 806.03 MB, 806.05 MB, 806.03 MB, 806.04 MB, 806.04 MB, 806.05 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.32 MB (853872160) - PerHostPeakMemUsage: 5.67 GB (6088211104) - PrepareTime: 275.796ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1117) - BlocksRecycled: 157 - BufferedPins: 2 - BytesWritten: 600.00 MB (629142277) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5957001216) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 654.155ms CodeGen:(Total: 617.462ms, non-child: 617.462ms, % non-child: 100.00%) - CodegenTime: 4.876ms - CompileTime: 348.674ms - LoadTime: 267.440ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.924us, non-child: 53.924us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 275.794ms, non-child: 272.192ms, % non-child: 98.69%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 286.246us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 1.928us AGGREGATION_NODE (id=4):(Total: 3.602ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s972ms - GetNewBlockTime: 1.341ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056704) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.321us EXCHANGE_NODE (id=3):(Total: 3m14s, non-child: 4s234ms, % non-child: 2.18%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 296.29 KB, 32.06 MB, 143.64 MB, 298.73 MB, 470.30 MB, 648.55 MB, 826.69 MB, 1004.49 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB, 1.51 GB - BytesReceived: 1.51 GB (1623799008) - ConvertRowBatchTime: 1s138ms - DeserializeRowBatchTimer: 10s749ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.49M (37493218) - RowsReturnedRate: 192.66 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232ba (host=atlas-ch2-17.sys.comcast.net:22000):(Total: 316.473ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.60 MB, 284.93 MB, 547.30 MB, 551.55 MB, 552.88 MB, 553.92 MB, 559.58 MB, 613.83 MB, 722.87 MB, 752.30 MB, 804.55 MB, 805.55 MB, 805.55 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.56 MB, 805.53 MB, 805.55 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094264) - PerHostPeakMemUsage: 5.59 GB (5997491960) - PrepareTime: 277.209ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.07K (1066) - BlocksRecycled: 174 - BufferedPins: 1 - BytesWritten: 587.71 MB (616253645) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.18 GB (5562638336) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 643.324ms CodeGen:(Total: 623.188ms, non-child: 623.188ms, % non-child: 100.00%) - CodegenTime: 4.961ms - CompileTime: 352.787ms - LoadTime: 268.970ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 55.979us, non-child: 55.979us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 277.207ms, non-child: 273.722ms, % non-child: 98.74%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 311.646us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.578us AGGREGATION_NODE (id=4):(Total: 3.484ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 20s266ms - GetNewBlockTime: 2.255ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490168) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.418us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 3s738ms, % non-child: 1.94%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 650.42 KB, 39.10 MB, 156.20 MB, 312.69 MB, 484.55 MB, 662.33 MB, 840.06 MB, 1017.74 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1618468313) - ConvertRowBatchTime: 1s374ms - DeserializeRowBatchTimer: 9s161ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.37M (37370363) - RowsReturnedRate: 194.34 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232ad (host=atlas-ch2-34.sys.comcast.net:22000):(Total: 331.901ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.28 MB, 284.55 MB, 547.14 MB, 551.56 MB, 552.82 MB, 553.85 MB, 557.51 MB, 604.86 MB, 723.05 MB, 755.22 MB, 805.54 MB, 805.55 MB, 805.53 MB, 805.51 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.50 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.55 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136416) - PerHostPeakMemUsage: 5.69 GB (6114835384) - PrepareTime: 289.775ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.11K (1115) - BlocksRecycled: 156 - BufferedPins: 2 - BytesWritten: 584.00 MB (612364846) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5957148672) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 644.172ms CodeGen:(Total: 634.927ms, non-child: 634.927ms, % non-child: 100.00%) - CodegenTime: 4.947ms - CompileTime: 351.933ms - LoadTime: 281.500ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.400us, non-child: 58.400us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 289.773ms, non-child: 286.285ms, % non-child: 98.80%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 293.753us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.448us AGGREGATION_NODE (id=4):(Total: 3.487ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s514ms - GetNewBlockTime: 1.547ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532368) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.116us EXCHANGE_NODE (id=3):(Total: 3m15s, non-child: 4s185ms, % non-child: 2.15%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 445.29 KB, 35.57 MB, 150.22 MB, 305.96 MB, 477.39 MB, 654.72 MB, 832.05 MB, 1009.59 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1617913737) - ConvertRowBatchTime: 1s109ms - DeserializeRowBatchTimer: 10s611ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.36M (37358045) - RowsReturnedRate: 191.52 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a6 (host=atlas-ch2-60.sys.comcast.net:22000):(Total: 236.413ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.03 MB, 284.45 MB, 547.10 MB, 551.54 MB, 552.81 MB, 553.79 MB, 561.55 MB, 615.70 MB, 722.97 MB, 753.24 MB, 805.55 MB, 805.52 MB, 805.54 MB, 805.52 MB, 805.52 MB, 805.54 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.54 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136568) - PerHostPeakMemUsage: 5.59 GB (6007196744) - PrepareTime: 206.583ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1083) - BlocksRecycled: 157 - BufferedPins: 2 - BytesWritten: 584.00 MB (612365193) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697085440) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 677.283ms CodeGen:(Total: 473.437ms, non-child: 473.437ms, % non-child: 100.00%) - CodegenTime: 4.976ms - CompileTime: 273.572ms - LoadTime: 198.451ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 68.830us, non-child: 68.830us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 206.581ms, non-child: 203.131ms, % non-child: 98.33%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 295.235us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.314us AGGREGATION_NODE (id=4):(Total: 3.450ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s664ms - GetNewBlockTime: 1.294ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532432) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.735us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 4s032ms, % non-child: 2.10%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 440.70 KB, 35.41 MB, 149.76 MB, 305.53 MB, 476.77 MB, 654.12 MB, 831.90 MB, 1009.61 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613322166) - ConvertRowBatchTime: 1s008ms - DeserializeRowBatchTimer: 10s666ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.25M (37250635) - RowsReturnedRate: 194.03 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232ac (host=atlas-ch2-61.sys.comcast.net:22000):(Total: 236.963ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.68 MB, 285.13 MB, 547.29 MB, 551.60 MB, 552.90 MB, 553.82 MB, 559.65 MB, 612.87 MB, 716.90 MB, 753.30 MB, 805.56 MB, 805.53 MB, 805.55 MB, 805.52 MB, 805.52 MB, 805.56 MB, 805.52 MB, 805.52 MB, 805.52 MB, 805.54 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136360) - PerHostPeakMemUsage: 5.75 GB (6175744040) - PrepareTime: 208.447ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.13K (1132) - BlocksRecycled: 139 - BufferedPins: 2 - BytesWritten: 616.00 MB (645919330) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5959581696) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 763.155ms CodeGen:(Total: 500.36ms, non-child: 500.36ms, % non-child: 100.00%) - CodegenTime: 4.925ms - CompileTime: 298.294ms - LoadTime: 200.244ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.59us, non-child: 57.59us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 208.439ms, non-child: 204.960ms, % non-child: 98.33%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 291.552us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.444us AGGREGATION_NODE (id=4):(Total: 3.478ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s323ms - GetNewBlockTime: 2.211ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532320) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.358us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 3s688ms, % non-child: 1.93%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 235.63 KB, 30.46 MB, 140.36 MB, 294.41 MB, 465.30 MB, 642.76 MB, 820.73 MB, 998.43 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612916449) - ConvertRowBatchTime: 1s102ms - DeserializeRowBatchTimer: 9s316ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.25M (37245361) - RowsReturnedRate: 194.68 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b7 (host=atlas-ch2-12.sys.comcast.net:22000):(Total: 237.734ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.22 MB, 284.52 MB, 547.04 MB, 551.50 MB, 552.78 MB, 553.70 MB, 556.63 MB, 602.86 MB, 714.79 MB, 748.24 MB, 805.56 MB, 805.55 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.53 MB, 805.56 MB, 805.54 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136376) - PerHostPeakMemUsage: 5.66 GB (6074895392) - PrepareTime: 207.288ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1083) - BlocksRecycled: 157 - BufferedPins: 1 - BytesWritten: 584.00 MB (612365168) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688614912) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 689.479ms CodeGen:(Total: 499.382ms, non-child: 499.382ms, % non-child: 100.00%) - CodegenTime: 5.31ms - CompileTime: 298.878ms - LoadTime: 199.6ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.233us, non-child: 58.233us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 207.287ms, non-child: 203.776ms, % non-child: 98.31%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 291.90us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.364us AGGREGATION_NODE (id=4):(Total: 3.511ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s525ms - GetNewBlockTime: 1.326ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532336) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.322us EXCHANGE_NODE (id=3):(Total: 3m11s, non-child: 4s051ms, % non-child: 2.12%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 453.75 KB, 35.62 MB, 149.74 MB, 305.20 MB, 475.97 MB, 653.08 MB, 830.60 MB, 1008.26 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB - BytesReceived: 1.50 GB (1608489466) - ConvertRowBatchTime: 1s104ms - DeserializeRowBatchTimer: 10s609ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37142651) - RowsReturnedRate: 194.37 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c2 (host=atlas-ch2-56.sys.comcast.net:22000):(Total: 277.123ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 285.14 MB, 547.30 MB, 551.59 MB, 552.84 MB, 553.95 MB, 561.68 MB, 617.78 MB, 720.88 MB, 760.30 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.54 MB, 805.52 MB, 805.52 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.54 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.69 MB (853220936) - PerHostPeakMemUsage: 5.63 GB (6043483048) - PrepareTime: 238.917ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m8s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.10K (1096) - BlocksRecycled: 145 - BufferedPins: 2 - BytesWritten: 608.00 MB (637530599) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697896448) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 589.937ms CodeGen:(Total: 613.724ms, non-child: 613.724ms, % non-child: 100.00%) - CodegenTime: 4.952ms - CompileTime: 381.575ms - LoadTime: 230.628ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 57.658us, non-child: 57.658us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 238.914ms, non-child: 235.447ms, % non-child: 98.55%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 294.101us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 1.943us AGGREGATION_NODE (id=4):(Total: 3.467ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s305ms - GetNewBlockTime: 1.608ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532448) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.796us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 4s237ms, % non-child: 2.23%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 233.51 KB, 30.33 MB, 140.35 MB, 294.31 MB, 464.42 MB, 641.19 MB, 818.79 MB, 996.33 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612438569) - ConvertRowBatchTime: 1s156ms - DeserializeRowBatchTimer: 10s708ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.24M (37235517) - RowsReturnedRate: 195.72 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c4 (host=atlas-ch2-53.sys.comcast.net:22000):(Total: 276.626ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.69 MB, 349.65 MB, 547.93 MB, 552.21 MB, 553.48 MB, 554.25 MB, 560.24 MB, 611.33 MB, 721.53 MB, 761.83 MB, 806.06 MB, 806.06 MB, 806.05 MB, 806.03 MB, 806.04 MB, 806.03 MB, 806.02 MB, 806.05 MB, 806.03 MB, 806.04 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.08 MB (853622640) - PerHostPeakMemUsage: 5.64 GB (6057477744) - PrepareTime: 235.504ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m8s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.11K (1115) - BlocksRecycled: 156 - BufferedPins: 1 - BytesWritten: 576.00 MB (603976753) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.54 GB (5948760064) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 623.412ms CodeGen:(Total: 611.345ms, non-child: 611.345ms, % non-child: 100.00%) - CodegenTime: 4.931ms - CompileTime: 382.512ms - LoadTime: 227.429ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 60.832us, non-child: 60.832us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 235.502ms, non-child: 232.62ms, % non-child: 98.54%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 291.74us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.230us AGGREGATION_NODE (id=4):(Total: 3.440ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s540ms - GetNewBlockTime: 1.537ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.78 MB (847018576) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.543us EXCHANGE_NODE (id=3):(Total: 3m9s, non-child: 4s303ms, % non-child: 2.27%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 283.07 KB, 31.67 MB, 142.49 MB, 296.46 MB, 466.88 MB, 644.32 MB, 822.36 MB, 999.92 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1611249570) - ConvertRowBatchTime: 1s182ms - DeserializeRowBatchTimer: 10s692ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.20M (37203897) - RowsReturnedRate: 195.81 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232bc (host=atlas-ch2-22.sys.comcast.net:22000):(Total: 279.186ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.77 MB, 349.39 MB, 547.50 MB, 551.71 MB, 552.89 MB, 553.82 MB, 559.54 MB, 616.82 MB, 718.88 MB, 764.31 MB, 805.55 MB, 805.52 MB, 805.53 MB, 805.52 MB, 805.55 MB, 805.55 MB, 805.55 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094104) - PerHostPeakMemUsage: 5.62 GB (6031849800) - PrepareTime: 239.208ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.11K (1113) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 585.48 MB (613925355) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.54 GB (5948506112) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 640.664ms CodeGen:(Total: 617.431ms, non-child: 617.431ms, % non-child: 100.00%) - CodegenTime: 4.985ms - CompileTime: 385.21ms - LoadTime: 231.23ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 56.705us, non-child: 56.705us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 239.205ms, non-child: 235.684ms, % non-child: 98.53%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 299.5us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.112us AGGREGATION_NODE (id=4):(Total: 3.520ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s572ms - GetNewBlockTime: 2.272ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490072) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.478us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 2s425ms, % non-child: 1.27%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 337.36 KB, 32.85 MB, 145.15 MB, 299.92 MB, 470.49 MB, 647.37 MB, 825.03 MB, 1002.78 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612485457) - ConvertRowBatchTime: 1s175ms - DeserializeRowBatchTimer: 6s496ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.24M (37235530) - RowsReturnedRate: 194.99 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b0 (host=atlas-ch2-51.sys.comcast.net:22000):(Total: 281.962ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 285.16 MB, 547.38 MB, 551.67 MB, 552.84 MB, 553.79 MB, 557.64 MB, 615.82 MB, 718.85 MB, 762.34 MB, 805.57 MB, 805.54 MB, 805.52 MB, 805.55 MB, 805.52 MB, 805.51 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.52 MB, 805.53 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136232) - PerHostPeakMemUsage: 5.59 GB (6004387736) - PrepareTime: 242.267ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m8s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.09K (1091) - BlocksRecycled: 149 - BufferedPins: 1 - BytesWritten: 592.03 MB (620789848) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5697626112) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 726.948ms CodeGen:(Total: 643.219ms, non-child: 643.219ms, % non-child: 100.00%) - CodegenTime: 5.34ms - CompileTime: 407.760ms - LoadTime: 234.14ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 56.45us, non-child: 56.45us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 242.264ms, non-child: 238.787ms, % non-child: 98.56%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 301.611us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.416us AGGREGATION_NODE (id=4):(Total: 3.477ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s248ms - GetNewBlockTime: 2.143ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532232) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.32us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 3s473ms, % non-child: 1.83%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 254.86 KB, 30.86 MB, 141.49 MB, 295.86 MB, 466.41 MB, 643.29 MB, 820.67 MB, 998.07 MB, 1.14 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1611647675) - ConvertRowBatchTime: 1s224ms - DeserializeRowBatchTimer: 8s971ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.22M (37218532) - RowsReturnedRate: 195.61 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232cb (host=atlas-ch2-43.sys.comcast.net:22000):(Total: 295.582ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.81 MB, 349.71 MB, 547.93 MB, 552.41 MB, 553.36 MB, 554.88 MB, 560.66 MB, 610.40 MB, 725.37 MB, 763.83 MB, 806.07 MB, 806.03 MB, 806.05 MB, 806.05 MB, 806.04 MB, 806.03 MB, 806.04 MB, 806.05 MB, 806.02 MB, 806.05 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.15 MB (853702960) - PerHostPeakMemUsage: 5.66 GB (6072780512) - PrepareTime: 254.37ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m8s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.06K (1059) - BlocksRecycled: 181 - BufferedPins: 1 - BytesWritten: 582.77 MB (611073460) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.15 GB (5529083904) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 629.200ms CodeGen:(Total: 642.718ms, non-child: 642.718ms, % non-child: 100.00%) - CodegenTime: 4.916ms - CompileTime: 395.376ms - LoadTime: 245.825ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 60.1us, non-child: 60.1us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 254.34ms, non-child: 250.617ms, % non-child: 98.65%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 303.360us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.86us AGGREGATION_NODE (id=4):(Total: 3.417ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s407ms - GetNewBlockTime: 1.277ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056672) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.473us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 4s302ms, % non-child: 2.26%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 317.85 KB, 32.55 MB, 144.35 MB, 298.73 MB, 469.14 MB, 646.46 MB, 824.21 MB, 1001.59 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1610647983) - ConvertRowBatchTime: 1s171ms - DeserializeRowBatchTimer: 10s724ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.20M (37197187) - RowsReturnedRate: 195.64 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232b6 (host=atlas-ch2-44.sys.comcast.net:22000):(Total: 301.831ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 349.63 MB, 547.85 MB, 552.39 MB, 553.69 MB, 554.28 MB, 559.05 MB, 618.34 MB, 723.43 MB, 762.78 MB, 806.04 MB, 806.06 MB, 806.04 MB, 806.05 MB, 806.05 MB, 806.05 MB, 806.03 MB, 806.05 MB, 806.05 MB, 806.03 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.11 MB (853660552) - PerHostPeakMemUsage: 5.68 GB (6098527040) - PrepareTime: 246.351ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.12K (1122) - BlocksRecycled: 151 - BufferedPins: 1 - BytesWritten: 600.00 MB (629142189) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.54 GB (5949145088) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 632.777ms CodeGen:(Total: 626.277ms, non-child: 626.277ms, % non-child: 100.00%) - CodegenTime: 4.890ms - CompileTime: 386.613ms - LoadTime: 238.251ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 56.688us, non-child: 56.688us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 246.349ms, non-child: 242.923ms, % non-child: 98.61%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 311.400us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.72us AGGREGATION_NODE (id=4):(Total: 3.426ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s976ms - GetNewBlockTime: 2.400ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056560) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.781us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 4s068ms, % non-child: 2.14%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 257.35 KB, 31.28 MB, 142.15 MB, 296.44 MB, 466.90 MB, 644.01 MB, 821.50 MB, 998.80 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1613324086) - ConvertRowBatchTime: 1s104ms - DeserializeRowBatchTimer: 10s444ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.26M (37256807) - RowsReturnedRate: 195.49 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232a9 (host=atlas-ch2-52.sys.comcast.net:22000):(Total: 320.289ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.03 MB, 284.39 MB, 546.92 MB, 551.48 MB, 552.83 MB, 553.69 MB, 557.55 MB, 604.65 MB, 722.85 MB, 756.23 MB, 805.56 MB, 805.56 MB, 805.56 MB, 805.54 MB, 805.52 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.54 MB, 805.55 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.61 MB (853136496) - PerHostPeakMemUsage: 6.17 GB (6627933704) - PrepareTime: 282.657ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.14K (1139) - BlocksRecycled: 4 - BufferedPins: 0 - BytesWritten: 672.00 MB (704639016) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5964300288) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 632.187ms, non-child: 632.187ms, % non-child: 100.00%) - CodegenTime: 4.950ms - CompileTime: 356.212ms - LoadTime: 274.510ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 58.4us, non-child: 58.4us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 282.655ms, non-child: 279.215ms, % non-child: 98.78%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 285.826us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.239us AGGREGATION_NODE (id=4):(Total: 3.440ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s219ms - GetNewBlockTime: 3.507ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.32 MB (846532392) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.941us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 2s186ms, % non-child: 1.14%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 417.52 KB, 34.80 MB, 148.62 MB, 303.97 MB, 474.91 MB, 652.23 MB, 830.12 MB, 1007.84 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1612509207) - ConvertRowBatchTime: 940.357ms - DeserializeRowBatchTimer: 6s480ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.23M (37233012) - RowsReturnedRate: 193.54 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c7 (host=atlas-ch2-28.sys.comcast.net:22000):(Total: 322.991ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 14.00 MB, 349.96 MB, 548.00 MB, 552.35 MB, 553.43 MB, 554.33 MB, 561.26 MB, 615.41 MB, 725.34 MB, 762.78 MB, 806.06 MB, 806.07 MB, 806.02 MB, 806.03 MB, 806.02 MB, 806.03 MB, 806.04 MB, 806.04 MB, 806.01 MB, 806.04 MB, 806.04 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.07 MB (853618448) - PerHostPeakMemUsage: 5.62 GB (6033162256) - PrepareTime: 281.687ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m9s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.08K (1083) - BlocksRecycled: 158 - BufferedPins: 1 - BytesWritten: 586.44 MB (614926459) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.30 GB (5688459264) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 734.599ms CodeGen:(Total: 627.1ms, non-child: 627.1ms, % non-child: 100.00%) - CodegenTime: 4.940ms - CompileTime: 352.47ms - LoadTime: 273.522ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 64.820us, non-child: 64.820us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 281.685ms, non-child: 278.239ms, % non-child: 98.78%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 291.391us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.269us AGGREGATION_NODE (id=4):(Total: 3.446ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 17s725ms - GetNewBlockTime: 1.382ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.78 MB (847014464) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 3.402us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 3s474ms, % non-child: 1.82%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 389.33 KB, 34.20 MB, 147.51 MB, 302.49 MB, 473.01 MB, 649.79 MB, 827.29 MB, 1004.89 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1610254136) - ConvertRowBatchTime: 1s128ms - DeserializeRowBatchTimer: 9s402ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.18M (37180925) - RowsReturnedRate: 194.81 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232af (host=atlas-ch2-11.sys.comcast.net:22000):(Total: 338.120ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.67 MB, 349.44 MB, 547.87 MB, 552.11 MB, 553.42 MB, 554.27 MB, 560.13 MB, 610.40 MB, 717.51 MB, 764.76 MB, 806.07 MB, 806.05 MB, 806.05 MB, 806.02 MB, 806.02 MB, 806.02 MB, 806.04 MB, 806.04 MB, 806.05 MB, 806.02 MB, 806.04 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.19 MB (853745160) - PerHostPeakMemUsage: 5.60 GB (6015475176) - PrepareTime: 297.726ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m10s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.06K (1062) - BlocksRecycled: 181 - BufferedPins: 0 - BytesWritten: 582.44 MB (610734675) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.16 GB (5545861120) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 619.165ms CodeGen:(Total: 630.188ms, non-child: 630.188ms, % non-child: 100.00%) - CodegenTime: 4.924ms - CompileTime: 339.529ms - LoadTime: 289.261ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 53.575us, non-child: 53.575us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 297.724ms, non-child: 294.255ms, % non-child: 98.83%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 635.740us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 2.312us AGGREGATION_NODE (id=4):(Total: 3.468ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 16s602ms - GetNewBlockTime: 1.197ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.78 MB (847014392) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 4.335us EXCHANGE_NODE (id=3):(Total: 3m12s, non-child: 4s180ms, % non-child: 2.18%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255.28 KB, 31.29 MB, 142.43 MB, 297.19 MB, 467.81 MB, 645.08 MB, 822.91 MB, 1000.76 MB, 1.15 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.51 GB (1616076663) - ConvertRowBatchTime: 1s053ms - DeserializeRowBatchTimer: 10s887ms - FirstBatchArrivalWaitTime: 2m6s - PeakMemoryUsage: 0 - RowsReturned: 37.32M (37315122) - RowsReturnedRate: 194.35 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c3 (host=atlas-ch2-15.sys.comcast.net:22000):(Total: 398.905ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.66 MB, 285.00 MB, 547.31 MB, 551.57 MB, 552.85 MB, 553.84 MB, 559.68 MB, 608.81 MB, 717.87 MB, 762.25 MB, 805.55 MB, 805.54 MB, 805.54 MB, 805.52 MB, 805.54 MB, 805.53 MB, 805.55 MB, 805.54 MB, 805.53 MB, 805.53 MB, 805.52 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 813.57 MB (853094184) - PerHostPeakMemUsage: 5.71 GB (6134935776) - PrepareTime: 357.870ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m8s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.13K (1131) - BlocksRecycled: 140 - BufferedPins: 2 - BytesWritten: 608.00 MB (637530839) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.55 GB (5958434816) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 594.878ms CodeGen:(Total: 868.234ms, non-child: 868.234ms, % non-child: 100.00%) - CodegenTime: 8.707ms - CompileTime: 521.934ms - LoadTime: 343.793ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 83.181us, non-child: 83.181us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 357.867ms, non-child: 351.985ms, % non-child: 98.36%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 476.111us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 4.434us AGGREGATION_NODE (id=4):(Total: 5.881ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s104ms - GetNewBlockTime: 2.770ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.28 MB (846490192) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 6.21us EXCHANGE_NODE (id=3):(Total: 3m10s, non-child: 3s086ms, % non-child: 1.62%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 672.54 KB, 39.64 MB, 157.56 MB, 314.48 MB, 485.81 MB, 662.97 MB, 840.42 MB, 1017.99 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.43 GB, 1.44 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.48 GB, 1.49 GB, 1.50 GB - BytesReceived: 1.50 GB (1611973600) - ConvertRowBatchTime: 1s179ms - DeserializeRowBatchTimer: 8s018ms - FirstBatchArrivalWaitTime: 2m5s - PeakMemoryUsage: 0 - RowsReturned: 37.22M (37221593) - RowsReturnedRate: 195.60 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance bc4f82f61a2b9b6e:23378c97dac232c5 (host=atlas-ch2-48.sys.comcast.net:22000):(Total: 400.883ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4s000ms): 10.94 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 12.51 MB, 13.03 MB, 284.75 MB, 547.47 MB, 552.04 MB, 553.39 MB, 554.38 MB, 559.02 MB, 612.17 MB, 723.32 MB, 757.72 MB, 806.06 MB, 806.03 MB, 806.05 MB, 806.05 MB, 806.04 MB, 806.04 MB, 806.03 MB, 806.04 MB, 806.05 MB, 806.02 MB, 806.03 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 814.11 MB (853660736) - PerHostPeakMemUsage: 5.60 GB (6013532992) - PrepareTime: 360.497ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 3m8s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 1.10K (1100) - BlocksRecycled: 140 - BufferedPins: 2 - BytesWritten: 600.00 MB (629142271) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 76.80 GB (82463375360) - PeakMemoryUsage: 5.31 GB (5698486272) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 650.266ms CodeGen:(Total: 872.578ms, non-child: 872.578ms, % non-child: 100.00%) - CodegenTime: 8.813ms - CompileTime: 523.637ms - LoadTime: 346.536ms - ModuleFileSize: 1.94 MB (2033316) HdfsTableSink:(Total: 83.913us, non-child: 83.913us, % non-child: 100.00%) - BytesWritten: 0 - CompressTimer: 0ns - EncodeTimer: 0ns - HdfsWriteTimer: 0ns - PeakMemoryUsage: 0 - RowsInserted: 0 AGGREGATION_NODE (id=2):(Total: 360.494ms, non-child: 354.650ms, % non-child: 98.38%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 480.114us - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 6.25 MB (6553600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - UnpinTime: 4.344us AGGREGATION_NODE (id=4):(Total: 5.843ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 18s893ms - GetNewBlockTime: 1.721ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 807.82 MB (847056632) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 1 - UnpinTime: 5.97us EXCHANGE_NODE (id=3):(Total: 3m9s, non-child: 3s212ms, % non-child: 1.70%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 440.86 KB, 35.41 MB, 149.82 MB, 305.42 MB, 476.56 MB, 654.24 MB, 832.59 MB, 1010.95 MB, 1.16 GB, 1.28 GB, 1.36 GB, 1.40 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.49 GB, 1.50 GB, 1.50 GB - BytesReceived: 1.51 GB (1616945604) - ConvertRowBatchTime: 1s192ms - DeserializeRowBatchTimer: 8s351ms - FirstBatchArrivalWaitTime: 2m5s - PeakMemoryUsage: 0 - RowsReturned: 37.34M (37339681) - RowsReturnedRate: 197.04 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F00: Instance bc4f82f61a2b9b6e:23378c97dac232de (host=atlas-ch2-60.sys.comcast.net:22000):(Total: 2m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:6/203.24 MB 1:11/445.00 MB 10:12/564.50 MB 0:19/853.29 MB 5:13/678.54 MB 9:15/863.81 MB 2:19/938.02 MB 11:14/593.97 MB 3:20/1.06 GB 4:20/1.03 GB 6:14/896.44 MB 7:14/741.70 MB MemoryUsage(4s000ms): 1.40 GB, 2.07 GB, 2.66 GB, 3.12 GB, 3.25 GB, 3.51 GB, 3.69 GB, 4.16 GB, 4.14 GB, 4.32 GB, 4.36 GB, 4.39 GB, 4.56 GB, 4.70 GB, 4.71 GB, 4.70 GB, 4.66 GB, 4.84 GB, 4.87 GB, 4.90 GB, 4.89 GB, 4.83 GB, 4.81 GB, 5.00 GB, 5.25 GB, 5.34 GB, 5.38 GB, 5.37 GB, 5.30 GB, 5.18 GB, 5.05 GB, 4.91 GB, 4.68 GB, 4.19 GB, 3.52 GB, 2.92 GB, 2.27 GB, 1.65 GB, 1.05 GB, 385.64 MB, 786.10 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 27, 21, 14, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.89 - PeakMemoryUsage: 5.40 GB (5800581128) - PerHostPeakMemUsage: 5.59 GB (6007196744) - PrepareTime: 191.630ms - RowsProduced: 37.45M (37448783) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 56.874ms - TotalStorageWaitTime: 3s276ms CodeGen:(Total: 413.283ms, non-child: 413.283ms, % non-child: 100.00%) - CodegenTime: 2.753ms - CompileTime: 226.272ms - LoadTime: 185.618ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s526ms, non-child: 26s526ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1621616284) - NetworkThroughput(*): 27.89 MB/sec - OverallThroughput: 58.30 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s121ms - ThriftTransmitTime(*): 55s455ms - UncompressedRowBatchSize: 3.39 GB (3643583361) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m17s, % non-child: 99.05%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m8s - GetNewBlockTime: 29.99ms - GetResultsTime: 3s540ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 677.700ms - RowsRepartitioned: 6.58M (6581641) - RowsReturned: 37.45M (37448783) - RowsReturnedRate: 270.41 K/sec - SpilledPartitions: 1 - UnpinTime: 26.267us HDFS_SCAN_NODE (id=0):(Total: 1s313ms, non-child: 1s313ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:6/203.24 MB 1:11/445.00 MB 10:12/564.50 MB 0:19/853.29 MB 5:13/678.54 MB 9:15/863.81 MB 2:19/938.02 MB 11:14/593.97 MB 3:20/1.06 GB 4:20/1.03 GB 6:14/896.44 MB 7:14/741.70 MB Hdfs Read Thread Concurrency Bucket: 0:98.08% 1:1.923% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 177 BytesRead(4s000ms): 532.03 MB, 553.89 MB, 593.61 MB, 668.83 MB, 711.81 MB, 812.41 MB, 864.55 MB, 897.24 MB, 1004.54 MB, 1.03 GB, 1.07 GB, 1.20 GB, 1.32 GB, 1.41 GB, 1.49 GB, 1.53 GB, 1.58 GB, 1.65 GB, 1.70 GB, 1.79 GB, 1.86 GB, 1.90 GB, 1.93 GB, 2.02 GB, 2.11 GB, 2.23 GB, 2.32 GB, 2.36 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.96 - BytesRead: 2.39 GB (2569459152) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2569459152) - BytesReadShortCircuit: 2.39 GB (2569459152) - DecompressionTime: 10s563ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 861.52 MB (903369640) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RowsRead: 210.75M (210745930) - RowsReturned: 210.75M (210745930) - RowsReturnedRate: 160.48 M/sec - ScanRangesComplete: 177 - ScannerThreadsInvoluntaryContextSwitches: 27.10K (27098) - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s602ms - ScannerThreadsUserTime: 42s847ms - ScannerThreadsVoluntaryContextSwitches: 206.48K (206482) - TotalRawHdfsReadTime(*): 2s107ms - TotalReadThroughput: 18.85 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e4 (host=atlas-ch2-61.sys.comcast.net:22000):(Total: 3m2s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:12/429.40 MB 7:12/619.37 MB 1:10/403.96 MB 10:11/635.80 MB 9:11/644.46 MB 4:14/897.20 MB 6:16/836.81 MB 8:20/1.17 GB 0:20/963.93 MB 5:14/823.25 MB 11:15/921.56 MB 2:13/577.52 MB MemoryUsage(4s000ms): 1.34 GB, 1.99 GB, 2.42 GB, 2.98 GB, 3.09 GB, 3.35 GB, 3.53 GB, 3.99 GB, 4.11 GB, 4.15 GB, 4.30 GB, 4.33 GB, 4.37 GB, 4.57 GB, 4.66 GB, 4.67 GB, 4.64 GB, 4.71 GB, 4.89 GB, 4.91 GB, 4.94 GB, 4.93 GB, 4.91 GB, 5.07 GB, 5.28 GB, 5.36 GB, 5.37 GB, 5.40 GB, 5.39 GB, 5.36 GB, 5.29 GB, 5.15 GB, 5.02 GB, 4.88 GB, 4.74 GB, 4.79 GB, 4.27 GB, 3.72 GB, 3.19 GB, 2.64 GB, 2.09 GB, 1.54 GB, 989.81 MB, 405.63 MB, 707.33 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 25, 20, 11, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.81 - PeakMemoryUsage: 5.43 GB (5827879576) - PerHostPeakMemUsage: 5.75 GB (6175744040) - PrepareTime: 197.756ms - RowsProduced: 37.72M (37721513) - TotalCpuTime: 1h18m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 53.279ms - TotalStorageWaitTime: 3s664ms CodeGen:(Total: 461.805ms, non-child: 461.805ms, % non-child: 100.00%) - CodegenTime: 2.844ms - CompileTime: 268.849ms - LoadTime: 191.562ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 30s663ms, non-child: 30s663ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1633482653) - NetworkThroughput(*): 29.69 MB/sec - OverallThroughput: 50.80 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s081ms - ThriftTransmitTime(*): 52s476ms - UncompressedRowBatchSize: 3.42 GB (3670241525) AGGREGATION_NODE (id=1):(Total: 2m32s, non-child: 2m30s, % non-child: 99.08%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m18s - GetNewBlockTime: 38.658ms - GetResultsTime: 5s380ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 763.589ms - RowsRepartitioned: 6.59M (6587723) - RowsReturned: 37.72M (37721513) - RowsReturnedRate: 248.00 K/sec - SpilledPartitions: 1 - UnpinTime: 26.397us HDFS_SCAN_NODE (id=0):(Total: 1s406ms, non-child: 1s406ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:12/429.40 MB 7:12/619.37 MB 1:10/403.96 MB 10:11/635.80 MB 9:11/644.46 MB 4:14/897.20 MB 6:16/836.81 MB 8:20/1.17 GB 0:20/963.93 MB 5:14/823.25 MB 11:15/921.56 MB 2:13/577.52 MB Hdfs Read Thread Concurrency Bucket: 0:99.29% 1:0.7117% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:7 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 168 BytesRead(4s000ms): 407.58 MB, 465.80 MB, 486.69 MB, 580.62 MB, 630.54 MB, 747.04 MB, 851.52 MB, 861.25 MB, 926.62 MB, 989.44 MB, 1.03 GB, 1.11 GB, 1.22 GB, 1.32 GB, 1.42 GB, 1.47 GB, 1.51 GB, 1.58 GB, 1.70 GB, 1.78 GB, 1.85 GB, 1.91 GB, 1.94 GB, 2.00 GB, 2.06 GB, 2.12 GB, 2.17 GB, 2.29 GB, 2.34 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.32 - BytesRead: 2.40 GB (2573062706) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2573062706) - BytesReadShortCircuit: 2.40 GB (2573062706) - DecompressionTime: 10s169ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 804.87 MB (843963688) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RowsRead: 210.92M (210917746) - RowsReturned: 210.92M (210917746) - RowsReturnedRate: 149.95 M/sec - ScanRangesComplete: 168 - ScannerThreadsInvoluntaryContextSwitches: 26.75K (26748) - ScannerThreadsTotalWallClockTime: 1h15m - MaterializeTupleTime(*): 1h15m - ScannerThreadsSysTime: 1s785ms - ScannerThreadsUserTime: 40s964ms - ScannerThreadsVoluntaryContextSwitches: 206.67K (206668) - TotalRawHdfsReadTime(*): 2s105ms - TotalReadThroughput: 17.40 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac23302 (host=atlas-ch2-40.sys.comcast.net:22000):(Total: 2m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:14/780.01 MB 1:9/550.25 MB 7:19/813.57 MB 8:11/648.16 MB 2:15/742.92 MB 11:9/668.83 MB 3:12/578.27 MB 4:15/713.14 MB 5:14/798.44 MB 0:22/1.30 GB 9:12/690.52 MB 10:14/587.04 MB MemoryUsage(4s000ms): 1.25 GB, 2.01 GB, 2.53 GB, 3.04 GB, 3.17 GB, 3.42 GB, 3.55 GB, 4.06 GB, 4.13 GB, 4.19 GB, 4.34 GB, 4.35 GB, 4.42 GB, 4.61 GB, 4.71 GB, 4.71 GB, 4.73 GB, 4.94 GB, 4.91 GB, 4.95 GB, 4.94 GB, 4.91 GB, 5.10 GB, 5.33 GB, 5.37 GB, 5.41 GB, 5.37 GB, 5.29 GB, 5.17 GB, 5.05 GB, 4.91 GB, 4.83 GB, 4.53 GB, 3.86 GB, 3.19 GB, 2.52 GB, 1.89 GB, 1.20 GB, 627.30 MB, 571.85 MB, 677.91 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 24, 21, 13, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.11 - PeakMemoryUsage: 5.43 GB (5833288944) - PerHostPeakMemUsage: 5.63 GB (6043865616) - PrepareTime: 198.492ms - RowsProduced: 37.75M (37754050) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 59.610ms - TotalStorageWaitTime: 3s528ms CodeGen:(Total: 467.619ms, non-child: 467.619ms, % non-child: 100.00%) - CodegenTime: 2.921ms - CompileTime: 273.917ms - LoadTime: 192.329ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s432ms, non-child: 27s432ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1635158757) - NetworkThroughput(*): 28.37 MB/sec - OverallThroughput: 56.85 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s704ms - ThriftTransmitTime(*): 54s964ms - UncompressedRowBatchSize: 3.42 GB (3673437133) AGGREGATION_NODE (id=1):(Total: 2m15s, non-child: 2m14s, % non-child: 99.01%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 32.982ms - GetResultsTime: 3s630ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 715.736ms - RowsRepartitioned: 6.58M (6575085) - RowsReturned: 37.75M (37754050) - RowsReturnedRate: 277.80 K/sec - SpilledPartitions: 1 - UnpinTime: 29.980us HDFS_SCAN_NODE (id=0):(Total: 1s340ms, non-child: 1s340ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:14/780.01 MB 1:9/550.25 MB 7:19/813.57 MB 8:11/648.16 MB 2:15/742.92 MB 11:9/668.83 MB 3:12/578.27 MB 4:15/713.14 MB 5:14/798.44 MB 0:22/1.30 GB 9:12/690.52 MB 10:14/587.04 MB Hdfs Read Thread Concurrency Bucket: 0:98.03% 1:1.575% 2:0% 3:0% 4:0.3937% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:10 PARQUET/SNAPPY:312 ExecOption: Codegen enabled: 0 out of 166 BytesRead(2s000ms): 447.65 MB, 492.88 MB, 492.88 MB, 511.15 MB, 511.15 MB, 594.21 MB, 637.26 MB, 638.80 MB, 665.99 MB, 673.50 MB, 743.36 MB, 853.30 MB, 877.21 MB, 891.36 MB, 896.08 MB, 896.08 MB, 991.05 MB, 1.03 GB, 1.05 GB, 1.08 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.18 GB, 1.27 GB, 1.27 GB, 1.29 GB, 1.48 GB, 1.52 GB, 1.55 GB, 1.58 GB, 1.59 GB, 1.64 GB, 1.69 GB, 1.71 GB, 1.76 GB, 1.80 GB, 1.80 GB, 1.87 GB, 1.90 GB, 1.95 GB, 1.96 GB, 1.97 GB, 2.01 GB, 2.05 GB, 2.08 GB, 2.11 GB, 2.12 GB, 2.16 GB, 2.21 GB, 2.30 GB, 2.31 GB, 2.35 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 32.43 - BytesRead: 2.39 GB (2561556721) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2561556721) - BytesReadShortCircuit: 2.39 GB (2561556721) - DecompressionTime: 11s911ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 826.21 MB (866342256) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RowsRead: 210.53M (210525008) - RowsReturned: 210.53M (210525008) - RowsReturnedRate: 157.07 M/sec - ScanRangesComplete: 166 - ScannerThreadsInvoluntaryContextSwitches: 26.08K (26082) - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s795ms - ScannerThreadsUserTime: 46s106ms - ScannerThreadsVoluntaryContextSwitches: 206.25K (206245) - TotalRawHdfsReadTime(*): 1s748ms - TotalReadThroughput: 19.24 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ea (host=atlas-ch2-58.sys.comcast.net:22000):(Total: 2m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:11/483.14 MB 7:11/587.65 MB 8:12/623.62 MB 4:12/744.39 MB 6:21/1.14 GB 5:15/735.83 MB 0:13/797.65 MB 3:14/684.81 MB 9:12/560.92 MB 10:17/939.92 MB 2:10/537.49 MB 11:16/1.08 GB MemoryUsage(4s000ms): 1.36 GB, 2.07 GB, 2.59 GB, 3.04 GB, 3.17 GB, 3.38 GB, 3.47 GB, 3.78 GB, 4.09 GB, 4.08 GB, 4.33 GB, 4.40 GB, 4.33 GB, 4.60 GB, 4.65 GB, 4.63 GB, 4.66 GB, 4.89 GB, 4.89 GB, 4.88 GB, 4.90 GB, 4.95 GB, 5.13 GB, 5.39 GB, 5.39 GB, 5.34 GB, 5.37 GB, 5.27 GB, 5.12 GB, 4.97 GB, 4.85 GB, 4.91 GB, 4.57 GB, 3.90 GB, 3.35 GB, 2.76 GB, 2.13 GB, 1.48 GB, 808.60 MB, 476.74 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 29, 20, 14, 7, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.74 - PeakMemoryUsage: 5.41 GB (5806663400) - PerHostPeakMemUsage: 5.61 GB (6021105384) - PrepareTime: 241.109ms - RowsProduced: 37.85M (37854466) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 56.699ms - TotalStorageWaitTime: 6s441ms CodeGen:(Total: 520.430ms, non-child: 520.430ms, % non-child: 100.00%) - CodegenTime: 2.971ms - CompileTime: 284.163ms - LoadTime: 234.906ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s900ms, non-child: 27s900ms, % non-child: 100.00%) - BytesSent: 1.53 GB (1639465534) - NetworkThroughput(*): 30.17 MB/sec - OverallThroughput: 56.04 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s904ms - ThriftTransmitTime(*): 51s827ms - UncompressedRowBatchSize: 3.43 GB (3683277965) AGGREGATION_NODE (id=1):(Total: 2m15s, non-child: 2m14s, % non-child: 99.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 29.577ms - GetResultsTime: 3s677ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 614.630ms - RowsRepartitioned: 6.64M (6644118) - RowsReturned: 37.85M (37854466) - RowsReturnedRate: 279.26 K/sec - SpilledPartitions: 1 - UnpinTime: 30.587us HDFS_SCAN_NODE (id=0):(Total: 1s362ms, non-child: 1s362ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/483.14 MB 7:11/587.65 MB 8:12/623.62 MB 4:12/744.39 MB 6:21/1.14 GB 5:15/735.83 MB 0:13/797.65 MB 3:14/684.81 MB 9:12/560.92 MB 10:17/939.92 MB 2:10/537.49 MB 11:16/1.08 GB Hdfs Read Thread Concurrency Bucket: 0:98.82% 1:1.181% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:8 PARQUET/SNAPPY:312 ExecOption: Codegen enabled: 0 out of 164 BytesRead(2s000ms): 363.45 MB, 484.60 MB, 484.60 MB, 484.60 MB, 490.79 MB, 584.12 MB, 634.02 MB, 635.28 MB, 670.89 MB, 678.86 MB, 726.98 MB, 767.13 MB, 770.27 MB, 785.03 MB, 822.12 MB, 858.70 MB, 943.03 MB, 1019.38 MB, 1019.38 MB, 1020.72 MB, 1.06 GB, 1.12 GB, 1.20 GB, 1.23 GB, 1.25 GB, 1.26 GB, 1.27 GB, 1.39 GB, 1.43 GB, 1.45 GB, 1.52 GB, 1.55 GB, 1.59 GB, 1.64 GB, 1.68 GB, 1.69 GB, 1.73 GB, 1.78 GB, 1.81 GB, 1.83 GB, 1.87 GB, 1.96 GB, 2.02 GB, 2.08 GB, 2.10 GB, 2.10 GB, 2.12 GB, 2.16 GB, 2.18 GB, 2.21 GB, 2.23 GB, 2.26 GB, 2.34 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.85 - BytesRead: 2.41 GB (2582376414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2582376414) - BytesReadShortCircuit: 2.41 GB (2582376414) - DecompressionTime: 12s327ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 827.89 MB (868110472) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RowsRead: 212.66M (212664668) - RowsReturned: 212.66M (212664668) - RowsReturnedRate: 156.14 M/sec - ScanRangesComplete: 164 - ScannerThreadsInvoluntaryContextSwitches: 560 - ScannerThreadsTotalWallClockTime: 1h7m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s646ms - ScannerThreadsUserTime: 47s664ms - ScannerThreadsVoluntaryContextSwitches: 208.22K (208216) - TotalRawHdfsReadTime(*): 1s636ms - TotalReadThroughput: 19.32 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f6 (host=atlas-ch2-10.sys.comcast.net:22000):(Total: 2m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:13/652.10 MB 1:12/494.42 MB 10:10/454.24 MB 7:16/703.63 MB 8:12/657.69 MB 5:12/520.67 MB 0:16/917.47 MB 2:21/1.24 GB 11:18/1.14 GB 6:8/419.75 MB 3:16/1.15 GB 4:10/575.90 MB MemoryUsage(4s000ms): 1.41 GB, 2.12 GB, 2.67 GB, 3.09 GB, 3.16 GB, 3.41 GB, 3.56 GB, 4.10 GB, 4.12 GB, 4.28 GB, 4.35 GB, 4.37 GB, 4.43 GB, 4.59 GB, 4.62 GB, 4.63 GB, 4.67 GB, 4.83 GB, 4.94 GB, 4.93 GB, 4.93 GB, 4.88 GB, 4.89 GB, 5.08 GB, 5.32 GB, 5.40 GB, 5.40 GB, 5.37 GB, 5.27 GB, 5.12 GB, 4.97 GB, 4.85 GB, 4.73 GB, 4.44 GB, 3.76 GB, 3.14 GB, 2.47 GB, 1.85 GB, 1.15 GB, 554.81 MB, 706.61 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 29, 23, 14, 8, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.18 - PeakMemoryUsage: 5.43 GB (5828167560) - PerHostPeakMemUsage: 5.63 GB (6042609544) - PrepareTime: 251.569ms - RowsProduced: 37.59M (37592896) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 58.64ms - TotalStorageWaitTime: 6s135ms CodeGen:(Total: 528.778ms, non-child: 528.778ms, % non-child: 100.00%) - CodegenTime: 2.896ms - CompileTime: 282.11ms - LoadTime: 245.377ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s506ms, non-child: 26s506ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1628190197) - NetworkThroughput(*): 27.63 MB/sec - OverallThroughput: 58.58 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s175ms - ThriftTransmitTime(*): 56s193ms - UncompressedRowBatchSize: 3.41 GB (3657627149) AGGREGATION_NODE (id=1):(Total: 2m19s, non-child: 2m18s, % non-child: 99.01%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m9s - GetNewBlockTime: 35.18ms - GetResultsTime: 3s537ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.76 GB (5110265200) - PinTime: 619.833ms - RowsRepartitioned: 6.66M (6655433) - RowsReturned: 37.59M (37592896) - RowsReturnedRate: 268.65 K/sec - SpilledPartitions: 1 - UnpinTime: 155.407us HDFS_SCAN_NODE (id=0):(Total: 1s392ms, non-child: 1s392ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:13/652.10 MB 1:12/494.42 MB 10:10/454.24 MB 7:16/703.63 MB 8:12/657.69 MB 5:12/520.67 MB 0:16/917.47 MB 2:21/1.24 GB 11:18/1.14 GB 6:8/419.75 MB 3:16/1.15 GB 4:10/575.90 MB Hdfs Read Thread Concurrency Bucket: 0:98.47% 1:1.527% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:8 PARQUET/SNAPPY:312 ExecOption: Codegen enabled: 0 out of 164 BytesRead(4s000ms): 460.99 MB, 556.76 MB, 591.57 MB, 632.37 MB, 633.15 MB, 740.41 MB, 834.43 MB, 878.04 MB, 1005.99 MB, 1.05 GB, 1.10 GB, 1.19 GB, 1.22 GB, 1.33 GB, 1.44 GB, 1.51 GB, 1.60 GB, 1.74 GB, 1.80 GB, 1.84 GB, 1.89 GB, 1.93 GB, 2.02 GB, 2.10 GB, 2.16 GB, 2.27 GB, 2.32 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.00 - BytesRead: 2.41 GB (2592831547) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2592831547) - BytesReadShortCircuit: 2.41 GB (2592831547) - DecompressionTime: 12s971ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 840.48 MB (881311288) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RowsRead: 213.25M (213250308) - RowsReturned: 213.25M (213250308) - RowsReturnedRate: 153.19 M/sec - ScanRangesComplete: 164 - ScannerThreadsInvoluntaryContextSwitches: 434 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s569ms - ScannerThreadsUserTime: 47s930ms - ScannerThreadsVoluntaryContextSwitches: 208.78K (208778) - TotalRawHdfsReadTime(*): 1s886ms - TotalReadThroughput: 18.80 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac23305 (host=atlas-ch2-14.sys.comcast.net:22000):(Total: 2m41s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:16/1.00 GB 6:9/421.55 MB 3:12/702.95 MB 1:12/708.01 MB 4:12/708.54 MB 5:18/1.07 GB 0:9/461.44 MB 7:16/932.07 MB 11:13/723.49 MB 2:13/682.34 MB 8:15/771.57 MB 10:15/736.03 MB MemoryUsage(4s000ms): 1.19 GB, 2.06 GB, 2.56 GB, 3.06 GB, 3.13 GB, 3.44 GB, 3.59 GB, 4.15 GB, 4.18 GB, 4.28 GB, 4.38 GB, 4.40 GB, 4.33 GB, 4.55 GB, 4.59 GB, 4.63 GB, 4.66 GB, 4.77 GB, 4.94 GB, 4.93 GB, 4.90 GB, 4.88 GB, 4.89 GB, 5.06 GB, 5.40 GB, 5.41 GB, 5.38 GB, 5.29 GB, 5.14 GB, 5.03 GB, 4.87 GB, 4.72 GB, 4.27 GB, 3.59 GB, 2.99 GB, 2.32 GB, 1.72 GB, 1.07 GB, 462.25 MB, 709.20 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 29, 23, 20, 10, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.22 - PeakMemoryUsage: 5.45 GB (5849351608) - PerHostPeakMemUsage: 5.65 GB (6063793592) - PrepareTime: 245.486ms - RowsProduced: 37.26M (37255950) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 55.933ms - TotalStorageWaitTime: 6s658ms CodeGen:(Total: 522.34ms, non-child: 522.34ms, % non-child: 100.00%) - CodegenTime: 2.823ms - CompileTime: 281.229ms - LoadTime: 239.337ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s454ms, non-child: 26s454ms, % non-child: 100.00%) - BytesSent: 1.50 GB (1613626602) - NetworkThroughput(*): 28.37 MB/sec - OverallThroughput: 58.17 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s125ms - ThriftTransmitTime(*): 54s249ms - UncompressedRowBatchSize: 3.38 GB (3624856193) AGGREGATION_NODE (id=1):(Total: 2m14s, non-child: 2m13s, % non-child: 99.02%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m4s - GetNewBlockTime: 35.152ms - GetResultsTime: 3s494ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 609.667ms - RowsRepartitioned: 6.64M (6635809) - RowsReturned: 37.26M (37255950) - RowsReturnedRate: 276.24 K/sec - SpilledPartitions: 1 - UnpinTime: 27.920us HDFS_SCAN_NODE (id=0):(Total: 1s320ms, non-child: 1s320ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:16/1.00 GB 6:9/421.55 MB 3:12/702.95 MB 1:12/708.01 MB 4:12/708.54 MB 5:18/1.07 GB 0:9/461.44 MB 7:16/932.07 MB 11:13/723.49 MB 2:13/682.34 MB 8:15/771.57 MB 10:15/736.03 MB Hdfs Read Thread Concurrency Bucket: 0:99.6% 1:0.3953% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:8 PARQUET/SNAPPY:304 ExecOption: Codegen enabled: 0 out of 160 BytesRead(2s000ms): 407.63 MB, 542.92 MB, 542.92 MB, 547.57 MB, 552.22 MB, 585.99 MB, 624.26 MB, 624.26 MB, 624.26 MB, 649.44 MB, 755.91 MB, 890.68 MB, 897.86 MB, 906.16 MB, 917.59 MB, 927.00 MB, 1002.81 MB, 1.07 GB, 1.07 GB, 1.07 GB, 1.10 GB, 1.15 GB, 1.18 GB, 1.20 GB, 1.24 GB, 1.25 GB, 1.27 GB, 1.34 GB, 1.38 GB, 1.47 GB, 1.49 GB, 1.52 GB, 1.60 GB, 1.72 GB, 1.75 GB, 1.76 GB, 1.80 GB, 1.84 GB, 1.88 GB, 1.90 GB, 1.92 GB, 1.93 GB, 1.98 GB, 1.99 GB, 2.04 GB, 2.06 GB, 2.09 GB, 2.16 GB, 2.23 GB, 2.28 GB, 2.31 GB, 2.34 GB, 2.35 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.30 - BytesRead: 2.40 GB (2580588695) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2580588695) - BytesReadShortCircuit: 2.40 GB (2580588695) - DecompressionTime: 10s962ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 819.61 MB (859425280) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RowsRead: 212.50M (212495856) - RowsReturned: 212.50M (212495856) - RowsReturnedRate: 160.86 M/sec - ScanRangesComplete: 160 - ScannerThreadsInvoluntaryContextSwitches: 474 - ScannerThreadsTotalWallClockTime: 1h7m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s608ms - ScannerThreadsUserTime: 42s992ms - ScannerThreadsVoluntaryContextSwitches: 208.04K (208043) - TotalRawHdfsReadTime(*): 1s711ms - TotalReadThroughput: 19.45 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232dd (host=atlas-ch2-37.sys.comcast.net:22000):(Total: 2m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:10/308.69 MB 4:8/581.73 MB 10:13/544.30 MB 1:13/551.99 MB 8:16/660.09 MB 5:10/495.87 MB 0:18/886.91 MB 11:19/983.76 MB 2:17/818.42 MB 9:16/856.75 MB 3:18/940.22 MB 7:22/1.32 GB MemoryUsage(4s000ms): 1.16 GB, 2.05 GB, 2.56 GB, 2.99 GB, 3.09 GB, 3.42 GB, 3.58 GB, 4.10 GB, 4.13 GB, 4.26 GB, 4.32 GB, 4.38 GB, 4.54 GB, 4.60 GB, 4.61 GB, 4.60 GB, 4.72 GB, 4.87 GB, 4.87 GB, 4.85 GB, 4.85 GB, 4.80 GB, 4.92 GB, 5.20 GB, 5.36 GB, 5.35 GB, 5.36 GB, 5.32 GB, 5.23 GB, 5.13 GB, 4.95 GB, 4.76 GB, 4.50 GB, 3.86 GB, 3.24 GB, 2.58 GB, 1.96 GB, 1.34 GB, 692.02 MB, 510.38 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 30, 25, 17, 4, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.74 - PeakMemoryUsage: 5.40 GB (5793200768) - PerHostPeakMemUsage: 5.59 GB (6005574600) - PrepareTime: 276.710ms - RowsProduced: 37.57M (37569374) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.437ms - TotalStorageWaitTime: 8s044ms CodeGen:(Total: 582.758ms, non-child: 582.758ms, % non-child: 100.00%) - CodegenTime: 2.832ms - CompileTime: 310.827ms - LoadTime: 270.477ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s377ms, non-child: 26s377ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1627128044) - NetworkThroughput(*): 28.58 MB/sec - OverallThroughput: 58.83 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s213ms - ThriftTransmitTime(*): 54s298ms - UncompressedRowBatchSize: 3.40 GB (3655414469) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m14s, % non-child: 98.90%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 30.611ms - GetResultsTime: 3s517ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.69 GB (5034742688) - PinTime: 594.836ms - RowsRepartitioned: 6.61M (6605427) - RowsReturned: 37.57M (37569374) - RowsReturnedRate: 275.73 K/sec - SpilledPartitions: 1 - UnpinTime: 168.965us HDFS_SCAN_NODE (id=0):(Total: 1s500ms, non-child: 1s500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:10/308.69 MB 4:8/581.73 MB 10:13/544.30 MB 1:13/551.99 MB 8:16/660.09 MB 5:10/495.87 MB 0:18/886.91 MB 11:19/983.76 MB 2:17/818.42 MB 9:16/856.75 MB 3:18/940.22 MB 7:22/1.32 GB Hdfs Read Thread Concurrency Bucket: 0:98.05% 1:1.953% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:342 ExecOption: Codegen enabled: 0 out of 180 BytesRead(4s000ms): 407.90 MB, 465.88 MB, 496.08 MB, 557.51 MB, 584.46 MB, 795.20 MB, 839.87 MB, 869.47 MB, 1007.43 MB, 1.01 GB, 1.09 GB, 1.23 GB, 1.26 GB, 1.35 GB, 1.43 GB, 1.50 GB, 1.60 GB, 1.67 GB, 1.75 GB, 1.82 GB, 1.87 GB, 1.89 GB, 2.03 GB, 2.15 GB, 2.18 GB, 2.25 GB, 2.33 GB, 2.38 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.78 - BytesRead: 2.41 GB (2585563386) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2585563386) - BytesReadShortCircuit: 2.41 GB (2585563386) - DecompressionTime: 13s870ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 770.36 MB (807784144) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RowsRead: 211.50M (211501464) - RowsReturned: 211.50M (211501464) - RowsReturnedRate: 140.95 M/sec - ScanRangesComplete: 180 - ScannerThreadsInvoluntaryContextSwitches: 482 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s723ms - ScannerThreadsUserTime: 50s575ms - ScannerThreadsVoluntaryContextSwitches: 207.11K (207106) - TotalRawHdfsReadTime(*): 1s690ms - TotalReadThroughput: 19.26 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232cf (host=atlas-ch2-41.sys.comcast.net:22000):(Total: 2m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:14/773.60 MB 4:12/771.24 MB 6:16/806.49 MB 7:13/653.27 MB 9:9/466.39 MB 10:16/922.60 MB 8:9/387.29 MB 11:21/1.02 GB 2:16/924.42 MB 1:17/814.50 MB 5:14/725.75 MB 0:18/729.94 MB MemoryUsage(4s000ms): 1.17 GB, 1.99 GB, 2.59 GB, 3.09 GB, 3.20 GB, 3.42 GB, 3.55 GB, 4.04 GB, 4.14 GB, 4.24 GB, 4.37 GB, 4.39 GB, 4.35 GB, 4.56 GB, 4.60 GB, 4.60 GB, 4.61 GB, 4.74 GB, 4.87 GB, 4.88 GB, 4.93 GB, 4.93 GB, 4.92 GB, 5.06 GB, 5.25 GB, 5.39 GB, 5.36 GB, 5.33 GB, 5.28 GB, 5.18 GB, 5.03 GB, 4.89 GB, 4.70 GB, 4.25 GB, 3.59 GB, 2.99 GB, 2.32 GB, 1.72 GB, 1.09 GB, 462.25 MB, 706.06 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 27, 20, 14, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.64 - PeakMemoryUsage: 5.41 GB (5810115456) - PerHostPeakMemUsage: 5.60 GB (6016479680) - PrepareTime: 281.367ms - RowsProduced: 37.43M (37426820) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 58.132ms - TotalStorageWaitTime: 7s931ms CodeGen:(Total: 615.592ms, non-child: 615.592ms, % non-child: 100.00%) - CodegenTime: 2.838ms - CompileTime: 338.997ms - LoadTime: 275.231ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s615ms, non-child: 26s615ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1620964600) - NetworkThroughput(*): 28.00 MB/sec - OverallThroughput: 58.08 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s253ms - ThriftTransmitTime(*): 55s206ms - UncompressedRowBatchSize: 3.39 GB (3641444374) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m17s, % non-child: 98.87%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m8s - GetNewBlockTime: 33.295ms - GetResultsTime: 3s539ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 602.239ms - RowsRepartitioned: 6.66M (6658920) - RowsReturned: 37.43M (37426820) - RowsReturnedRate: 270.01 K/sec - SpilledPartitions: 1 - UnpinTime: 30.330us HDFS_SCAN_NODE (id=0):(Total: 1s560ms, non-child: 1s560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:14/773.60 MB 4:12/771.24 MB 6:16/806.49 MB 7:13/653.27 MB 9:9/466.39 MB 10:16/922.60 MB 8:9/387.29 MB 11:21/1.02 GB 2:16/924.42 MB 1:17/814.50 MB 5:14/725.75 MB 0:18/729.94 MB Hdfs Read Thread Concurrency Bucket: 0:99.23% 1:0.7692% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:326 ExecOption: Codegen enabled: 0 out of 175 BytesRead(4s000ms): 460.91 MB, 547.50 MB, 600.56 MB, 651.94 MB, 673.32 MB, 775.25 MB, 857.85 MB, 888.31 MB, 989.36 MB, 1.05 GB, 1.10 GB, 1.20 GB, 1.23 GB, 1.29 GB, 1.43 GB, 1.49 GB, 1.54 GB, 1.65 GB, 1.75 GB, 1.82 GB, 1.92 GB, 1.99 GB, 2.09 GB, 2.17 GB, 2.20 GB, 2.25 GB, 2.30 GB, 2.35 GB, 2.40 GB, 2.40 GB, 2.40 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.73 - BytesRead: 2.42 GB (2596177977) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.42 GB (2596177977) - BytesReadShortCircuit: 2.42 GB (2596177977) - DecompressionTime: 12s433ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 841.42 MB (882290240) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RowsRead: 213.19M (213185129) - RowsReturned: 213.19M (213185129) - RowsReturnedRate: 136.62 M/sec - ScanRangesComplete: 175 - ScannerThreadsInvoluntaryContextSwitches: 605 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s840ms - ScannerThreadsUserTime: 47s598ms - ScannerThreadsVoluntaryContextSwitches: 208.71K (208713) - TotalRawHdfsReadTime(*): 2s023ms - TotalReadThroughput: 18.97 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232fe (host=atlas-ch2-18.sys.comcast.net:22000):(Total: 2m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:17/1.05 GB 1:10/590.37 MB 2:8/424.88 MB 11:18/1018.39 MB 10:14/687.08 MB 3:19/978.59 MB 4:10/807.93 MB 9:12/687.27 MB 6:15/806.25 MB 0:15/703.00 MB 5:12/495.47 MB 8:17/710.89 MB MemoryUsage(4s000ms): 1.10 GB, 1.89 GB, 2.32 GB, 2.96 GB, 3.08 GB, 3.33 GB, 3.53 GB, 3.82 GB, 4.14 GB, 4.17 GB, 4.39 GB, 4.37 GB, 4.44 GB, 4.64 GB, 4.64 GB, 4.68 GB, 4.68 GB, 4.93 GB, 4.90 GB, 4.88 GB, 4.84 GB, 4.82 GB, 4.90 GB, 5.11 GB, 5.35 GB, 5.38 GB, 5.38 GB, 5.33 GB, 5.21 GB, 5.05 GB, 4.92 GB, 4.78 GB, 4.48 GB, 3.89 GB, 3.22 GB, 2.60 GB, 1.95 GB, 1.33 GB, 692.08 MB, 509.36 MB, 698.22 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 28, 19, 12, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.29 - PeakMemoryUsage: 5.39 GB (5791287880) - PerHostPeakMemUsage: 5.59 GB (6004325560) - PrepareTime: 282.509ms - RowsProduced: 37.48M (37478726) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 58.140ms - TotalStorageWaitTime: 7s702ms CodeGen:(Total: 581.265ms, non-child: 581.265ms, % non-child: 100.00%) - CodegenTime: 2.784ms - CompileTime: 303.395ms - LoadTime: 276.578ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s317ms, non-child: 26s317ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1623111353) - NetworkThroughput(*): 28.16 MB/sec - OverallThroughput: 58.82 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s166ms - ThriftTransmitTime(*): 54s974ms - UncompressedRowBatchSize: 3.40 GB (3646706115) AGGREGATION_NODE (id=1):(Total: 2m17s, non-child: 2m15s, % non-child: 98.97%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 34.619ms - GetResultsTime: 3s515ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 645.975ms - RowsRepartitioned: 6.62M (6619598) - RowsReturned: 37.48M (37478726) - RowsReturnedRate: 273.25 K/sec - SpilledPartitions: 1 - UnpinTime: 29.605us HDFS_SCAN_NODE (id=0):(Total: 1s415ms, non-child: 1s415ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:17/1.05 GB 1:10/590.37 MB 2:8/424.88 MB 11:18/1018.39 MB 10:14/687.08 MB 3:19/978.59 MB 4:10/807.93 MB 9:12/687.27 MB 6:15/806.25 MB 0:15/703.00 MB 5:12/495.47 MB 8:17/710.89 MB Hdfs Read Thread Concurrency Bucket: 0:98.44% 1:1.556% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 167 BytesRead(4s000ms): 365.27 MB, 426.72 MB, 462.26 MB, 593.07 MB, 619.11 MB, 747.26 MB, 840.97 MB, 885.38 MB, 984.36 MB, 1.05 GB, 1.14 GB, 1.20 GB, 1.31 GB, 1.36 GB, 1.46 GB, 1.58 GB, 1.66 GB, 1.72 GB, 1.76 GB, 1.84 GB, 1.87 GB, 1.91 GB, 2.03 GB, 2.12 GB, 2.21 GB, 2.28 GB, 2.35 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.28 - BytesRead: 2.40 GB (2582009570) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2582009570) - BytesReadShortCircuit: 2.40 GB (2582009570) - DecompressionTime: 11s480ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 812.83 MB (852316728) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RowsRead: 211.91M (211910180) - RowsReturned: 211.91M (211910180) - RowsReturnedRate: 149.68 M/sec - ScanRangesComplete: 167 - ScannerThreadsInvoluntaryContextSwitches: 519 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s555ms - ScannerThreadsUserTime: 45s380ms - ScannerThreadsVoluntaryContextSwitches: 207.53K (207531) - TotalRawHdfsReadTime(*): 1s741ms - TotalReadThroughput: 19.16 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232da (host=atlas-ch2-30.sys.comcast.net:22000):(Total: 2m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:11/987.51 MB 8:15/761.96 MB 7:12/519.48 MB 6:12/593.49 MB 9:11/439.99 MB 3:17/890.18 MB 11:13/764.15 MB 2:19/883.61 MB 4:12/505.39 MB 5:13/972.64 MB 0:16/956.54 MB 10:13/657.19 MB MemoryUsage(4s000ms): 1.41 GB, 2.12 GB, 2.59 GB, 3.03 GB, 3.20 GB, 3.43 GB, 3.52 GB, 4.07 GB, 4.10 GB, 4.35 GB, 4.43 GB, 4.45 GB, 4.59 GB, 4.66 GB, 4.67 GB, 4.61 GB, 4.60 GB, 4.86 GB, 4.88 GB, 4.91 GB, 4.89 GB, 4.88 GB, 5.17 GB, 5.41 GB, 5.43 GB, 5.44 GB, 5.38 GB, 5.28 GB, 5.17 GB, 5.01 GB, 4.86 GB, 4.85 GB, 4.49 GB, 3.80 GB, 3.15 GB, 2.52 GB, 1.81 GB, 1.16 GB, 486.28 MB, 709.04 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 30, 25, 16, 8, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.09 - PeakMemoryUsage: 5.46 GB (5863297232) - PerHostPeakMemUsage: 5.66 GB (6077739216) - PrepareTime: 209.247ms - RowsProduced: 37.72M (37721042) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 63.97ms - TotalStorageWaitTime: 3s744ms CodeGen:(Total: 478.147ms, non-child: 478.147ms, % non-child: 100.00%) - CodegenTime: 2.905ms - CompileTime: 273.754ms - LoadTime: 202.978ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s413ms, non-child: 26s413ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1633790518) - NetworkThroughput(*): 28.15 MB/sec - OverallThroughput: 58.99 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s233ms - ThriftTransmitTime(*): 55s353ms - UncompressedRowBatchSize: 3.42 GB (3670233110) AGGREGATION_NODE (id=1):(Total: 2m15s, non-child: 2m14s, % non-child: 99.06%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 37.876ms - GetResultsTime: 3s553ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261273560) - PinTime: 704.711ms - RowsRepartitioned: 6.60M (6602127) - RowsReturned: 37.72M (37721042) - RowsReturnedRate: 277.55 K/sec - SpilledPartitions: 1 - UnpinTime: 156.100us HDFS_SCAN_NODE (id=0):(Total: 1s271ms, non-child: 1s271ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/987.51 MB 8:15/761.96 MB 7:12/519.48 MB 6:12/593.49 MB 9:11/439.99 MB 3:17/890.18 MB 11:13/764.15 MB 2:19/883.61 MB 4:12/505.39 MB 5:13/972.64 MB 0:16/956.54 MB 10:13/657.19 MB Hdfs Read Thread Concurrency Bucket: 0:98.42% 1:1.581% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:310 ExecOption: Codegen enabled: 0 out of 164 BytesRead(2s000ms): 410.35 MB, 547.14 MB, 547.14 MB, 547.14 MB, 547.14 MB, 571.88 MB, 595.32 MB, 629.33 MB, 665.52 MB, 693.28 MB, 742.80 MB, 778.45 MB, 787.80 MB, 803.51 MB, 827.34 MB, 880.80 MB, 985.21 MB, 1.01 GB, 1.09 GB, 1.13 GB, 1.13 GB, 1.20 GB, 1.27 GB, 1.28 GB, 1.34 GB, 1.36 GB, 1.39 GB, 1.45 GB, 1.46 GB, 1.47 GB, 1.48 GB, 1.52 GB, 1.54 GB, 1.57 GB, 1.67 GB, 1.72 GB, 1.75 GB, 1.81 GB, 1.85 GB, 1.87 GB, 1.88 GB, 1.89 GB, 1.94 GB, 2.01 GB, 2.11 GB, 2.15 GB, 2.17 GB, 2.20 GB, 2.23 GB, 2.28 GB, 2.32 GB, 2.35 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.23 - BytesRead: 2.39 GB (2569765983) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2569765983) - BytesReadShortCircuit: 2.39 GB (2569765983) - DecompressionTime: 10s939ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 825.96 MB (866078928) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RowsRead: 211.29M (211286716) - RowsReturned: 211.29M (211286716) - RowsReturnedRate: 166.20 M/sec - ScanRangesComplete: 164 - ScannerThreadsInvoluntaryContextSwitches: 25.46K (25459) - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s550ms - ScannerThreadsUserTime: 42s372ms - ScannerThreadsVoluntaryContextSwitches: 207.01K (207014) - TotalRawHdfsReadTime(*): 1s791ms - TotalReadThroughput: 19.30 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac23304 (host=atlas-ch2-01.sys.comcast.net:22000):(Total: 2m57s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:21/780.81 MB 6:13/295.87 MB 8:19/909.58 MB 5:18/724.89 MB 0:16/732.57 MB 10:20/925.01 MB 9:13/778.76 MB 4:14/467.46 MB 7:24/938.13 MB 11:17/757.40 MB 2:14/738.81 MB 3:18/896.56 MB MemoryUsage(4s000ms): 1.24 GB, 2.09 GB, 2.63 GB, 3.00 GB, 3.13 GB, 3.36 GB, 3.51 GB, 3.99 GB, 4.12 GB, 4.23 GB, 4.34 GB, 4.38 GB, 4.39 GB, 4.59 GB, 4.63 GB, 4.64 GB, 4.67 GB, 4.71 GB, 4.89 GB, 4.88 GB, 4.86 GB, 4.87 GB, 4.88 GB, 5.08 GB, 5.38 GB, 5.43 GB, 5.40 GB, 5.36 GB, 5.32 GB, 5.22 GB, 5.09 GB, 4.96 GB, 4.91 GB, 4.75 GB, 4.25 GB, 3.78 GB, 3.29 GB, 2.80 GB, 2.30 GB, 1.83 GB, 1.32 GB, 788.41 MB, 439.00 MB, 785.44 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 30, 24, 16, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.30 - PeakMemoryUsage: 5.45 GB (5850970000) - PerHostPeakMemUsage: 5.70 GB (6118113176) - PrepareTime: 202.749ms - RowsProduced: 37.92M (37921957) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 47.275ms - TotalStorageWaitTime: 3s895ms CodeGen:(Total: 473.109ms, non-child: 473.109ms, % non-child: 100.00%) - CodegenTime: 2.919ms - CompileTime: 275.461ms - LoadTime: 196.57ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 33s589ms, non-child: 33s589ms, % non-child: 100.00%) - BytesSent: 1.53 GB (1642421789) - NetworkThroughput(*): 28.78 MB/sec - OverallThroughput: 46.63 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s703ms - ThriftTransmitTime(*): 54s416ms - UncompressedRowBatchSize: 3.44 GB (3689667632) AGGREGATION_NODE (id=1):(Total: 2m23s, non-child: 2m22s, % non-child: 99.04%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m10s - GetNewBlockTime: 27.855ms - GetResultsTime: 5s494ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265481720) - PinTime: 780.994ms - RowsRepartitioned: 6.63M (6625542) - RowsReturned: 37.92M (37921957) - RowsReturnedRate: 264.03 K/sec - SpilledPartitions: 1 - UnpinTime: 30.541us HDFS_SCAN_NODE (id=0):(Total: 1s374ms, non-child: 1s374ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:21/780.81 MB 6:13/295.87 MB 8:19/909.58 MB 5:18/724.89 MB 0:16/732.57 MB 10:20/925.01 MB 9:13/778.76 MB 4:14/467.46 MB 7:24/938.13 MB 11:17/757.40 MB 2:14/738.81 MB 3:18/896.56 MB Hdfs Read Thread Concurrency Bucket: 0:99.62% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0.3788% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: PARQUET/NONE:41 PARQUET/SNAPPY:332 ExecOption: Codegen enabled: 0 out of 207 BytesRead(4s000ms): 450.96 MB, 520.69 MB, 550.97 MB, 582.92 MB, 640.47 MB, 786.52 MB, 849.91 MB, 893.38 MB, 1022.97 MB, 1.04 GB, 1.09 GB, 1.21 GB, 1.24 GB, 1.34 GB, 1.44 GB, 1.54 GB, 1.62 GB, 1.68 GB, 1.74 GB, 1.80 GB, 1.84 GB, 1.95 GB, 2.01 GB, 2.10 GB, 2.20 GB, 2.28 GB, 2.31 GB, 2.34 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.77 - BytesRead: 2.40 GB (2579449270) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2579449270) - BytesReadShortCircuit: 2.40 GB (2579449270) - DecompressionTime: 13s349ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 810.39 MB (849752920) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RowsRead: 212.15M (212146204) - RowsReturned: 212.15M (212146204) - RowsReturnedRate: 154.31 M/sec - ScanRangesComplete: 207 - ScannerThreadsInvoluntaryContextSwitches: 29.49K (29489) - ScannerThreadsTotalWallClockTime: 1h12m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s745ms - ScannerThreadsUserTime: 49s884ms - ScannerThreadsVoluntaryContextSwitches: 207.86K (207862) - TotalRawHdfsReadTime(*): 1s958ms - TotalReadThroughput: 18.64 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e8 (host=atlas-ch2-51.sys.comcast.net:22000):(Total: 2m54s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:19/930.05 MB 6:14/689.55 MB 3:21/994.03 MB 4:12/715.53 MB 9:13/766.96 MB 2:9/479.48 MB 11:15/696.12 MB 0:19/847.72 MB 5:12/584.24 MB 8:15/768.73 MB 7:12/485.04 MB 1:17/994.81 MB MemoryUsage(4s000ms): 1.43 GB, 2.10 GB, 2.63 GB, 3.07 GB, 3.20 GB, 3.41 GB, 3.51 GB, 4.03 GB, 4.10 GB, 4.26 GB, 4.38 GB, 4.39 GB, 4.53 GB, 4.64 GB, 4.68 GB, 4.68 GB, 4.65 GB, 4.73 GB, 4.88 GB, 4.90 GB, 4.91 GB, 4.91 GB, 4.92 GB, 4.95 GB, 5.17 GB, 5.37 GB, 5.34 GB, 5.31 GB, 5.32 GB, 5.22 GB, 5.07 GB, 4.92 GB, 4.76 GB, 4.54 GB, 4.00 GB, 3.48 GB, 2.94 GB, 2.41 GB, 1.87 GB, 1.35 GB, 845.22 MB, 367.90 MB, 785.21 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 30, 21, 14, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.74 - PeakMemoryUsage: 5.40 GB (5798334360) - PerHostPeakMemUsage: 5.59 GB (6004387736) - PrepareTime: 224.680ms - RowsProduced: 37.43M (37425826) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 55.631ms - TotalStorageWaitTime: 8s384ms CodeGen:(Total: 570.47ms, non-child: 570.47ms, % non-child: 100.00%) - CodegenTime: 2.916ms - CompileTime: 350.244ms - LoadTime: 218.470ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 30s284ms, non-child: 30s284ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1620897866) - NetworkThroughput(*): 30.20 MB/sec - OverallThroughput: 51.04 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s138ms - ThriftTransmitTime(*): 51s188ms - UncompressedRowBatchSize: 3.39 GB (3641440997) AGGREGATION_NODE (id=1):(Total: 2m24s, non-child: 2m22s, % non-child: 98.95%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m10s - GetNewBlockTime: 32.599ms - GetResultsTime: 5s130ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 727.440ms - RowsRepartitioned: 6.57M (6573274) - RowsReturned: 37.43M (37425826) - RowsReturnedRate: 259.67 K/sec - SpilledPartitions: 1 - UnpinTime: 28.479us HDFS_SCAN_NODE (id=0):(Total: 1s518ms, non-child: 1s518ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:19/930.05 MB 6:14/689.55 MB 3:21/994.03 MB 4:12/715.53 MB 9:13/766.96 MB 2:9/479.48 MB 11:15/696.12 MB 0:19/847.72 MB 5:12/584.24 MB 8:15/768.73 MB 7:12/485.04 MB 1:17/994.81 MB Hdfs Read Thread Concurrency Bucket: 0:98.49% 1:1.509% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:314 ExecOption: Codegen enabled: 0 out of 178 BytesRead(4s000ms): 491.54 MB, 569.49 MB, 594.33 MB, 676.47 MB, 697.81 MB, 760.95 MB, 820.19 MB, 843.39 MB, 997.06 MB, 1.06 GB, 1.11 GB, 1.20 GB, 1.30 GB, 1.38 GB, 1.47 GB, 1.52 GB, 1.58 GB, 1.63 GB, 1.71 GB, 1.79 GB, 1.88 GB, 1.95 GB, 2.02 GB, 2.07 GB, 2.13 GB, 2.20 GB, 2.23 GB, 2.28 GB, 2.36 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.58 - BytesRead: 2.40 GB (2572479798) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2572479798) - BytesReadShortCircuit: 2.40 GB (2572479798) - DecompressionTime: 13s380ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 856.81 MB (898432152) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RowsRead: 210.37M (210373685) - RowsReturned: 210.37M (210373685) - RowsReturnedRate: 138.53 M/sec - ScanRangesComplete: 178 - ScannerThreadsInvoluntaryContextSwitches: 486 - ScannerThreadsTotalWallClockTime: 1h12m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s780ms - ScannerThreadsUserTime: 50s217ms - ScannerThreadsVoluntaryContextSwitches: 205.98K (205983) - TotalRawHdfsReadTime(*): 1s883ms - TotalReadThroughput: 18.45 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d9 (host=atlas-ch2-32.sys.comcast.net:22000):(Total: 3m13s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:19/848.87 MB 8:11/700.49 MB 6:18/828.41 MB 0:10/614.51 MB 5:17/811.49 MB 1:18/901.55 MB 7:17/704.21 MB 9:17/752.29 MB 3:15/835.23 MB 2:13/722.82 MB 11:16/611.98 MB 10:16/669.72 MB MemoryUsage(4s000ms): 1.16 GB, 1.94 GB, 2.37 GB, 2.93 GB, 3.04 GB, 3.13 GB, 3.46 GB, 3.53 GB, 4.14 GB, 4.16 GB, 4.38 GB, 4.41 GB, 4.43 GB, 4.57 GB, 4.67 GB, 4.68 GB, 4.70 GB, 4.62 GB, 4.74 GB, 4.83 GB, 4.81 GB, 4.84 GB, 4.83 GB, 4.83 GB, 4.88 GB, 5.10 GB, 5.29 GB, 5.34 GB, 5.32 GB, 5.33 GB, 5.30 GB, 5.30 GB, 5.32 GB, 5.26 GB, 5.16 GB, 5.04 GB, 4.92 GB, 4.92 GB, 4.89 GB, 4.41 GB, 3.86 GB, 3.27 GB, 2.68 GB, 2.13 GB, 1.54 GB, 989.99 MB, 405.56 MB, 784.32 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 27, 20, 14, 9, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.74 - PeakMemoryUsage: 5.37 GB (5770481192) - PerHostPeakMemUsage: 6.04 GB (6489468016) - PrepareTime: 246.321ms - RowsProduced: 37.76M (37755375) - TotalCpuTime: 1h26m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 52.671ms - TotalStorageWaitTime: 7s941ms CodeGen:(Total: 604.556ms, non-child: 604.556ms, % non-child: 100.00%) - CodegenTime: 2.904ms - CompileTime: 363.94ms - LoadTime: 240.40ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 30s963ms, non-child: 30s963ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1634977386) - NetworkThroughput(*): 34.72 MB/sec - OverallThroughput: 50.36 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s393ms - ThriftTransmitTime(*): 44s915ms - UncompressedRowBatchSize: 3.42 GB (3673478438) AGGREGATION_NODE (id=1):(Total: 2m42s, non-child: 2m41s, % non-child: 98.96%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m31s - GetNewBlockTime: 35.102ms - GetResultsTime: 3s977ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 632.344ms - RowsRepartitioned: 6.65M (6646582) - RowsReturned: 37.76M (37755375) - RowsReturnedRate: 232.07 K/sec - SpilledPartitions: 1 - UnpinTime: 174.954us HDFS_SCAN_NODE (id=0):(Total: 1s688ms, non-child: 1s688ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:19/848.87 MB 8:11/700.49 MB 6:18/828.41 MB 0:10/614.51 MB 5:17/811.49 MB 1:18/901.55 MB 7:17/704.21 MB 9:17/752.29 MB 3:15/835.23 MB 2:13/722.82 MB 11:16/611.98 MB 10:16/669.72 MB Hdfs Read Thread Concurrency Bucket: 0:99.02% 1:0.9772% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:350 ExecOption: Codegen enabled: 0 out of 187 BytesRead(4s000ms): 442.89 MB, 510.48 MB, 514.81 MB, 573.61 MB, 592.60 MB, 625.30 MB, 739.44 MB, 827.74 MB, 909.42 MB, 1.04 GB, 1.11 GB, 1.12 GB, 1.26 GB, 1.33 GB, 1.37 GB, 1.45 GB, 1.50 GB, 1.51 GB, 1.55 GB, 1.59 GB, 1.64 GB, 1.74 GB, 1.80 GB, 1.87 GB, 1.94 GB, 2.02 GB, 2.11 GB, 2.12 GB, 2.18 GB, 2.24 GB, 2.27 GB, 2.36 GB, 2.40 GB, 2.42 GB, 2.42 GB, 2.42 GB, 2.42 GB, 2.42 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.61 - BytesRead: 2.42 GB (2594348361) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.42 GB (2594348361) - BytesReadShortCircuit: 2.42 GB (2594348361) - DecompressionTime: 12s030ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 808.06 MB (847316936) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RowsRead: 212.79M (212794004) - RowsReturned: 212.79M (212794004) - RowsReturnedRate: 126.04 M/sec - ScanRangesComplete: 187 - ScannerThreadsInvoluntaryContextSwitches: 610 - ScannerThreadsTotalWallClockTime: 1h23m - MaterializeTupleTime(*): 1h22m - ScannerThreadsSysTime: 1s667ms - ScannerThreadsUserTime: 46s991ms - ScannerThreadsVoluntaryContextSwitches: 208.62K (208615) - TotalRawHdfsReadTime(*): 1s825ms - TotalReadThroughput: 16.12 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d8 (host=atlas-ch2-42.sys.comcast.net:22000):(Total: 2m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:13/825.22 MB 9:12/483.86 MB 3:11/606.54 MB 7:10/486.12 MB 1:15/603.53 MB 8:17/1.04 GB 2:19/993.27 MB 11:12/443.51 MB 10:14/722.06 MB 6:17/930.88 MB 5:16/831.78 MB 0:18/960.63 MB MemoryUsage(4s000ms): 1.41 GB, 2.10 GB, 2.56 GB, 3.08 GB, 3.14 GB, 3.39 GB, 3.55 GB, 4.08 GB, 4.12 GB, 4.24 GB, 4.36 GB, 4.36 GB, 4.53 GB, 4.64 GB, 4.65 GB, 4.66 GB, 4.75 GB, 4.93 GB, 4.92 GB, 4.92 GB, 4.91 GB, 4.90 GB, 5.04 GB, 5.24 GB, 5.32 GB, 5.32 GB, 5.35 GB, 5.34 GB, 5.24 GB, 5.10 GB, 4.89 GB, 4.74 GB, 4.48 GB, 3.91 GB, 3.37 GB, 2.81 GB, 2.25 GB, 1.72 GB, 1.16 GB, 615.48 MB, 569.19 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 23, 11, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.04 - PeakMemoryUsage: 5.37 GB (5760812440) - PerHostPeakMemUsage: 5.56 GB (5975254424) - PrepareTime: 244.725ms - RowsProduced: 37.47M (37471620) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 59.787ms - TotalStorageWaitTime: 6s251ms CodeGen:(Total: 523.0ms, non-child: 523.0ms, % non-child: 100.00%) - CodegenTime: 2.850ms - CompileTime: 283.104ms - LoadTime: 238.386ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s640ms, non-child: 29s640ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1622932924) - NetworkThroughput(*): 28.51 MB/sec - OverallThroughput: 52.22 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s835ms - ThriftTransmitTime(*): 54s284ms - UncompressedRowBatchSize: 3.40 GB (3645886086) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m15s, % non-child: 98.95%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 33.888ms - GetResultsTime: 3s848ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 588.519ms - RowsRepartitioned: 6.61M (6609382) - RowsReturned: 37.47M (37471620) - RowsReturnedRate: 274.13 K/sec - SpilledPartitions: 1 - UnpinTime: 28.634us HDFS_SCAN_NODE (id=0):(Total: 1s434ms, non-child: 1s434ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:13/825.22 MB 9:12/483.86 MB 3:11/606.54 MB 7:10/486.12 MB 1:15/603.53 MB 8:17/1.04 GB 2:19/993.27 MB 11:12/443.51 MB 10:14/722.06 MB 6:17/930.88 MB 5:16/831.78 MB 0:18/960.63 MB Hdfs Read Thread Concurrency Bucket: 0:99.22% 1:0.7812% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:320 ExecOption: Codegen enabled: 0 out of 174 BytesRead(4s000ms): 466.58 MB, 533.23 MB, 543.48 MB, 631.94 MB, 634.27 MB, 743.71 MB, 866.32 MB, 902.33 MB, 959.28 MB, 1.02 GB, 1.12 GB, 1.18 GB, 1.24 GB, 1.37 GB, 1.46 GB, 1.52 GB, 1.63 GB, 1.70 GB, 1.77 GB, 1.83 GB, 1.89 GB, 1.96 GB, 2.01 GB, 2.05 GB, 2.12 GB, 2.19 GB, 2.29 GB, 2.34 GB, 2.36 GB, 2.36 GB, 2.37 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.57 - BytesRead: 2.40 GB (2573224688) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2573224688) - BytesReadShortCircuit: 2.40 GB (2573224688) - DecompressionTime: 13s363ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 827.66 MB (867862312) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RowsRead: 211.57M (211569208) - RowsReturned: 211.57M (211569208) - RowsReturnedRate: 147.44 M/sec - ScanRangesComplete: 174 - ScannerThreadsInvoluntaryContextSwitches: 714 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s630ms - ScannerThreadsUserTime: 51s558ms - ScannerThreadsVoluntaryContextSwitches: 207.17K (207170) - TotalRawHdfsReadTime(*): 1s864ms - TotalReadThroughput: 19.10 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d1 (host=atlas-ch2-29.sys.comcast.net:22000):(Total: 3m26s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:14/757.87 MB 3:15/1.28 GB 7:12/648.95 MB 10:11/504.27 MB 11:7/382.01 MB 2:15/805.13 MB 0:14/631.86 MB 5:9/508.71 MB 4:20/1.19 GB 1:14/765.46 MB 9:22/1.05 GB 8:12/501.70 MB MemoryUsage(4s000ms): 1.37 GB, 2.02 GB, 2.50 GB, 3.00 GB, 3.06 GB, 3.27 GB, 3.50 GB, 3.75 GB, 4.07 GB, 4.07 GB, 4.13 GB, 4.30 GB, 4.31 GB, 4.33 GB, 4.30 GB, 4.49 GB, 4.57 GB, 4.58 GB, 4.59 GB, 4.59 GB, 4.61 GB, 4.61 GB, 4.87 GB, 4.90 GB, 4.92 GB, 4.92 GB, 4.90 GB, 4.88 GB, 4.89 GB, 5.17 GB, 5.39 GB, 5.41 GB, 5.42 GB, 5.41 GB, 5.37 GB, 5.25 GB, 5.12 GB, 5.03 GB, 4.93 GB, 4.86 GB, 4.81 GB, 4.75 GB, 4.48 GB, 3.89 GB, 3.29 GB, 2.70 GB, 2.10 GB, 1.50 GB, 921.78 MB, 406.14 MB, 787.16 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 27, 20, 15, 10, 7, 5, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.25 - PeakMemoryUsage: 5.44 GB (5841710040) - PerHostPeakMemUsage: 6.16 GB (6616084984) - PrepareTime: 252.131ms - RowsProduced: 37.55M (37549689) - TotalCpuTime: 1h30m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 46.380ms - TotalStorageWaitTime: 5s354ms CodeGen:(Total: 533.394ms, non-child: 533.394ms, % non-child: 100.00%) - CodegenTime: 2.898ms - CompileTime: 286.4ms - LoadTime: 245.990ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s474ms, non-child: 27s474ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1626300250) - NetworkThroughput(*): 36.06 MB/sec - OverallThroughput: 56.45 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 11s684ms - ThriftTransmitTime(*): 43s011ms - UncompressedRowBatchSize: 3.40 GB (3653487083) AGGREGATION_NODE (id=1):(Total: 2m58s, non-child: 2m57s, % non-child: 99.14%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m46s - GetNewBlockTime: 36.925ms - GetResultsTime: 4s459ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 586.820ms - RowsRepartitioned: 6.72M (6719860) - RowsReturned: 37.55M (37549689) - RowsReturnedRate: 210.28 K/sec - SpilledPartitions: 1 - UnpinTime: 40.984us HDFS_SCAN_NODE (id=0):(Total: 1s542ms, non-child: 1s542ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:14/757.87 MB 3:15/1.28 GB 7:12/648.95 MB 10:11/504.27 MB 11:7/382.01 MB 2:15/805.13 MB 0:14/631.86 MB 5:9/508.71 MB 4:20/1.19 GB 1:14/765.46 MB 9:22/1.05 GB 8:12/501.70 MB Hdfs Read Thread Concurrency Bucket: 0:98.81% 1:1.19% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:318 ExecOption: Codegen enabled: 0 out of 165 BytesRead(4s000ms): 441.22 MB, 505.53 MB, 526.21 MB, 600.88 MB, 611.82 MB, 697.84 MB, 792.37 MB, 822.86 MB, 837.58 MB, 958.33 MB, 1009.75 MB, 1.05 GB, 1.08 GB, 1.13 GB, 1.19 GB, 1.27 GB, 1.35 GB, 1.40 GB, 1.44 GB, 1.47 GB, 1.59 GB, 1.63 GB, 1.73 GB, 1.79 GB, 1.86 GB, 1.92 GB, 1.96 GB, 1.99 GB, 2.05 GB, 2.16 GB, 2.22 GB, 2.27 GB, 2.32 GB, 2.34 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.39 GB, 2.40 GB, 2.43 GB, 2.44 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.04 - BytesRead: 2.44 GB (2622154877) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 GB (2622154877) - BytesReadShortCircuit: 2.44 GB (2622154877) - DecompressionTime: 9s707ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 820.44 MB (860294672) - PerReadThreadRawHdfsThroughput: 1.81 GB/sec - RowsRead: 215.02M (215017936) - RowsReturned: 215.02M (215017936) - RowsReturnedRate: 139.42 M/sec - ScanRangesComplete: 165 - ScannerThreadsInvoluntaryContextSwitches: 595 - ScannerThreadsTotalWallClockTime: 1h26m - MaterializeTupleTime(*): 1h26m - ScannerThreadsSysTime: 1s488ms - ScannerThreadsUserTime: 38s762ms - ScannerThreadsVoluntaryContextSwitches: 210.49K (210493) - TotalRawHdfsReadTime(*): 1s349ms - TotalReadThroughput: 14.84 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232eb (host=atlas-ch2-24.sys.comcast.net:22000):(Total: 2m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:16/808.02 MB 11:12/572.96 MB 9:17/1.02 GB 3:14/713.88 MB 1:18/1.06 GB 4:14/554.69 MB 8:22/1.28 GB 6:9/622.09 MB 10:9/475.02 MB 7:9/476.32 MB 5:12/614.31 MB 0:15/686.64 MB MemoryUsage(4s000ms): 1.40 GB, 2.09 GB, 2.63 GB, 3.08 GB, 3.18 GB, 3.45 GB, 3.58 GB, 4.12 GB, 4.16 GB, 4.35 GB, 4.38 GB, 4.37 GB, 4.49 GB, 4.55 GB, 4.60 GB, 4.59 GB, 4.70 GB, 4.88 GB, 4.85 GB, 4.85 GB, 4.83 GB, 4.83 GB, 5.13 GB, 5.39 GB, 5.39 GB, 5.38 GB, 5.36 GB, 5.26 GB, 5.12 GB, 4.94 GB, 4.79 GB, 4.81 GB, 4.41 GB, 3.76 GB, 3.19 GB, 2.62 GB, 2.01 GB, 1.34 GB, 647.39 MB, 571.95 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 30, 22, 13, 5, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.88 - PeakMemoryUsage: 5.42 GB (5820834600) - PerHostPeakMemUsage: 5.62 GB (6035276584) - PrepareTime: 246.711ms - RowsProduced: 37.74M (37737684) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.539ms - TotalStorageWaitTime: 3s519ms CodeGen:(Total: 505.213ms, non-child: 505.213ms, % non-child: 100.00%) - CodegenTime: 3.46ms - CompileTime: 263.435ms - LoadTime: 240.354ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s946ms, non-child: 27s946ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1634476486) - NetworkThroughput(*): 30.67 MB/sec - OverallThroughput: 55.78 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s970ms - ThriftTransmitTime(*): 50s825ms - UncompressedRowBatchSize: 3.42 GB (3671802780) AGGREGATION_NODE (id=1):(Total: 2m14s, non-child: 2m13s, % non-child: 98.99%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m4s - GetNewBlockTime: 34.606ms - GetResultsTime: 3s696ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261215144) - PinTime: 624.734ms - RowsRepartitioned: 6.65M (6649947) - RowsReturned: 37.74M (37737684) - RowsReturnedRate: 280.86 K/sec - SpilledPartitions: 1 - UnpinTime: 170.321us HDFS_SCAN_NODE (id=0):(Total: 1s353ms, non-child: 1s353ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:16/808.02 MB 11:12/572.96 MB 9:17/1.02 GB 3:14/713.88 MB 1:18/1.06 GB 4:14/554.69 MB 8:22/1.28 GB 6:9/622.09 MB 10:9/475.02 MB 7:9/476.32 MB 5:12/614.31 MB 0:15/686.64 MB Hdfs Read Thread Concurrency Bucket: 0:99.21% 1:0.7937% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:10 PARQUET/SNAPPY:314 ExecOption: Codegen enabled: 0 out of 167 BytesRead(2s000ms): 524.27 MB, 524.27 MB, 525.79 MB, 530.38 MB, 535.80 MB, 610.26 MB, 638.17 MB, 642.20 MB, 645.49 MB, 645.49 MB, 743.20 MB, 817.72 MB, 839.73 MB, 843.70 MB, 881.37 MB, 933.75 MB, 1.02 GB, 1.04 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.16 GB, 1.18 GB, 1.20 GB, 1.23 GB, 1.24 GB, 1.27 GB, 1.36 GB, 1.41 GB, 1.46 GB, 1.49 GB, 1.51 GB, 1.56 GB, 1.62 GB, 1.68 GB, 1.71 GB, 1.74 GB, 1.76 GB, 1.79 GB, 1.80 GB, 1.82 GB, 1.85 GB, 1.92 GB, 1.97 GB, 2.06 GB, 2.15 GB, 2.16 GB, 2.18 GB, 2.19 GB, 2.25 GB, 2.27 GB, 2.30 GB, 2.34 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.09 - BytesRead: 2.40 GB (2581023025) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2581023025) - BytesReadShortCircuit: 2.40 GB (2581023025) - DecompressionTime: 12s457ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 815.47 MB (855084888) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RowsRead: 212.83M (212829401) - RowsReturned: 212.83M (212829401) - RowsReturnedRate: 157.25 M/sec - ScanRangesComplete: 167 - ScannerThreadsInvoluntaryContextSwitches: 508 - ScannerThreadsTotalWallClockTime: 1h7m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s581ms - ScannerThreadsUserTime: 47s111ms - ScannerThreadsVoluntaryContextSwitches: 208.43K (208427) - TotalRawHdfsReadTime(*): 1s708ms - TotalReadThroughput: 19.54 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e6 (host=atlas-ch2-38.sys.comcast.net:22000):(Total: 2m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:8/439.53 MB 8:13/859.45 MB 7:15/802.38 MB 6:16/698.48 MB 10:13/649.11 MB 0:12/537.26 MB 5:15/792.20 MB 9:18/1.20 GB 2:9/515.52 MB 11:22/1.21 GB 3:11/465.93 MB 4:15/891.02 MB MemoryUsage(4s000ms): 1.36 GB, 2.07 GB, 2.62 GB, 3.05 GB, 3.14 GB, 3.44 GB, 3.56 GB, 4.11 GB, 4.13 GB, 4.27 GB, 4.31 GB, 4.29 GB, 4.41 GB, 4.61 GB, 4.67 GB, 4.68 GB, 4.82 GB, 4.91 GB, 4.88 GB, 4.87 GB, 4.91 GB, 5.14 GB, 5.34 GB, 5.39 GB, 5.37 GB, 5.46 GB, 5.42 GB, 5.33 GB, 5.15 GB, 5.02 GB, 4.88 GB, 4.92 GB, 4.83 GB, 4.21 GB, 3.54 GB, 2.88 GB, 2.21 GB, 1.56 GB, 889.15 MB, 439.42 MB, 789.24 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 30, 23, 15, 8, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.64 - PeakMemoryUsage: 5.47 GB (5877957288) - PerHostPeakMemUsage: 5.67 GB (6088211104) - PrepareTime: 250.636ms - RowsProduced: 37.79M (37787083) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.169ms - TotalStorageWaitTime: 8s364ms CodeGen:(Total: 529.488ms, non-child: 529.488ms, % non-child: 100.00%) - CodegenTime: 2.927ms - CompileTime: 283.579ms - LoadTime: 244.554ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s645ms, non-child: 26s645ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1636165814) - NetworkThroughput(*): 28.28 MB/sec - OverallThroughput: 58.56 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s208ms - ThriftTransmitTime(*): 55s167ms - UncompressedRowBatchSize: 3.42 GB (3676696707) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m16s, % non-child: 98.81%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m7s - GetNewBlockTime: 39.24ms - GetResultsTime: 3s543ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265481720) - PinTime: 654.719ms - RowsRepartitioned: 6.75M (6754681) - RowsReturned: 37.79M (37787083) - RowsReturnedRate: 273.43 K/sec - SpilledPartitions: 1 - UnpinTime: 32.431us HDFS_SCAN_NODE (id=0):(Total: 1s637ms, non-child: 1s637ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:8/439.53 MB 8:13/859.45 MB 7:15/802.38 MB 6:16/698.48 MB 10:13/649.11 MB 0:12/537.26 MB 5:15/792.20 MB 9:18/1.20 GB 2:9/515.52 MB 11:22/1.21 GB 3:11/465.93 MB 4:15/891.02 MB Hdfs Read Thread Concurrency Bucket: 0:98.84% 1:1.163% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:7 PARQUET/SNAPPY:320 ExecOption: Codegen enabled: 0 out of 167 BytesRead(4s000ms): 429.38 MB, 495.48 MB, 520.90 MB, 571.52 MB, 618.29 MB, 739.78 MB, 830.69 MB, 880.84 MB, 1006.92 MB, 1.02 GB, 1.07 GB, 1.10 GB, 1.22 GB, 1.37 GB, 1.49 GB, 1.57 GB, 1.65 GB, 1.71 GB, 1.74 GB, 1.82 GB, 1.94 GB, 2.01 GB, 2.03 GB, 2.13 GB, 2.22 GB, 2.39 GB, 2.40 GB, 2.40 GB, 2.40 GB, 2.40 GB, 2.41 GB, 2.43 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.52 - BytesRead: 2.44 GB (2621451454) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 GB (2621451454) - BytesReadShortCircuit: 2.44 GB (2621451454) - DecompressionTime: 13s437ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 835.82 MB (876419864) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RowsRead: 216.17M (216169680) - RowsReturned: 216.17M (216169680) - RowsReturnedRate: 131.99 M/sec - ScanRangesComplete: 167 - ScannerThreadsInvoluntaryContextSwitches: 432 - ScannerThreadsTotalWallClockTime: 1h7m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s626ms - ScannerThreadsUserTime: 49s227ms - ScannerThreadsVoluntaryContextSwitches: 211.63K (211628) - TotalRawHdfsReadTime(*): 1s966ms - TotalReadThroughput: 19.31 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232df (host=atlas-ch2-46.sys.comcast.net:22000):(Total: 2m49s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:20/895.67 MB 4:14/969.58 MB 6:12/684.76 MB 10:12/723.07 MB 8:21/1.18 GB 3:11/661.00 MB 1:11/469.08 MB 2:9/378.68 MB 11:14/648.31 MB 0:16/879.70 MB 5:10/473.14 MB 9:20/988.95 MB MemoryUsage(4s000ms): 1.27 GB, 2.03 GB, 2.47 GB, 3.00 GB, 3.09 GB, 3.21 GB, 3.49 GB, 3.56 GB, 4.07 GB, 4.10 GB, 4.26 GB, 4.33 GB, 4.32 GB, 4.47 GB, 4.58 GB, 4.64 GB, 4.67 GB, 4.76 GB, 4.85 GB, 4.87 GB, 4.90 GB, 4.91 GB, 4.91 GB, 5.10 GB, 5.35 GB, 5.42 GB, 5.41 GB, 5.39 GB, 5.30 GB, 5.20 GB, 5.05 GB, 4.89 GB, 4.73 GB, 4.42 GB, 3.82 GB, 3.28 GB, 2.71 GB, 2.17 GB, 1.63 GB, 1.07 GB, 538.88 MB, 629.25 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 28, 20, 11, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.01 - PeakMemoryUsage: 5.45 GB (5849093368) - PerHostPeakMemUsage: 5.65 GB (6063535352) - PrepareTime: 253.177ms - RowsProduced: 37.51M (37513563) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 55.985ms - TotalStorageWaitTime: 5s825ms CodeGen:(Total: 529.852ms, non-child: 529.852ms, % non-child: 100.00%) - CodegenTime: 2.888ms - CompileTime: 281.389ms - LoadTime: 247.69ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 30s024ms, non-child: 30s024ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1624767401) - NetworkThroughput(*): 28.24 MB/sec - OverallThroughput: 51.61 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s955ms - ThriftTransmitTime(*): 54s874ms - UncompressedRowBatchSize: 3.40 GB (3649997376) AGGREGATION_NODE (id=1):(Total: 2m19s, non-child: 2m18s, % non-child: 98.92%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m9s - GetNewBlockTime: 35.763ms - GetResultsTime: 3s873ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 587.770ms - RowsRepartitioned: 6.65M (6653713) - RowsReturned: 37.51M (37513563) - RowsReturnedRate: 268.13 K/sec - SpilledPartitions: 1 - UnpinTime: 31.699us HDFS_SCAN_NODE (id=0):(Total: 1s511ms, non-child: 1s511ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:20/895.67 MB 4:14/969.58 MB 6:12/684.76 MB 10:12/723.07 MB 8:21/1.18 GB 3:11/661.00 MB 1:11/469.08 MB 2:9/378.68 MB 11:14/648.31 MB 0:16/879.70 MB 5:10/473.14 MB 9:20/988.95 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.521% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:316 ExecOption: Codegen enabled: 0 out of 170 BytesRead(4s000ms): 506.36 MB, 553.89 MB, 573.41 MB, 648.93 MB, 653.62 MB, 673.41 MB, 764.04 MB, 801.15 MB, 854.89 MB, 1018.83 MB, 1.04 GB, 1.09 GB, 1.13 GB, 1.22 GB, 1.36 GB, 1.47 GB, 1.55 GB, 1.61 GB, 1.67 GB, 1.76 GB, 1.88 GB, 1.93 GB, 1.99 GB, 2.07 GB, 2.20 GB, 2.26 GB, 2.28 GB, 2.36 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.42 - BytesRead: 2.41 GB (2584398949) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2584398949) - BytesReadShortCircuit: 2.41 GB (2584398949) - DecompressionTime: 13s540ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 829.94 MB (870254168) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RowsRead: 213.08M (213080901) - RowsReturned: 213.08M (213080901) - RowsReturnedRate: 140.94 M/sec - ScanRangesComplete: 170 - ScannerThreadsInvoluntaryContextSwitches: 583 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s671ms - ScannerThreadsUserTime: 52s965ms - ScannerThreadsVoluntaryContextSwitches: 208.63K (208628) - TotalRawHdfsReadTime(*): 1s877ms - TotalReadThroughput: 18.74 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e3 (host=atlas-ch2-55.sys.comcast.net:22000):(Total: 2m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:11/534.24 MB 1:9/500.87 MB 6:15/642.29 MB 8:15/660.13 MB 5:14/763.00 MB 0:16/907.63 MB 4:20/1.18 GB 3:18/1.04 GB 10:16/856.74 MB 2:13/629.03 MB 11:14/517.60 MB 7:16/705.68 MB MemoryUsage(4s000ms): 1.19 GB, 2.05 GB, 2.64 GB, 3.07 GB, 3.16 GB, 3.41 GB, 3.52 GB, 4.07 GB, 4.08 GB, 4.28 GB, 4.33 GB, 4.34 GB, 4.55 GB, 4.63 GB, 4.64 GB, 4.62 GB, 4.57 GB, 4.79 GB, 4.80 GB, 4.84 GB, 4.85 GB, 4.84 GB, 4.84 GB, 5.05 GB, 5.30 GB, 5.33 GB, 5.35 GB, 5.37 GB, 5.27 GB, 5.11 GB, 4.96 GB, 4.80 GB, 4.48 GB, 3.87 GB, 3.22 GB, 2.60 GB, 1.95 GB, 1.35 GB, 768.68 MB, 526.72 MB, 763.87 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 30, 23, 14, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.49 - PeakMemoryUsage: 5.39 GB (5789398664) - PerHostPeakMemUsage: 5.59 GB (6003840648) - PrepareTime: 253.872ms - RowsProduced: 37.24M (37242832) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.239ms - TotalStorageWaitTime: 5s438ms CodeGen:(Total: 521.559ms, non-child: 521.559ms, % non-child: 100.00%) - CodegenTime: 2.885ms - CompileTime: 272.512ms - LoadTime: 247.744ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s633ms, non-child: 26s633ms, % non-child: 100.00%) - BytesSent: 1.50 GB (1612844544) - NetworkThroughput(*): 27.82 MB/sec - OverallThroughput: 57.75 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s272ms - ThriftTransmitTime(*): 55s296ms - UncompressedRowBatchSize: 3.37 GB (3623554302) AGGREGATION_NODE (id=1):(Total: 2m17s, non-child: 2m15s, % non-child: 98.99%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 35.245ms - GetResultsTime: 3s534ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 650.550ms - RowsRepartitioned: 6.61M (6611543) - RowsReturned: 37.24M (37242832) - RowsReturnedRate: 271.30 K/sec - SpilledPartitions: 1 - UnpinTime: 30.332us HDFS_SCAN_NODE (id=0):(Total: 1s393ms, non-child: 1s393ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:11/534.24 MB 1:9/500.87 MB 6:15/642.29 MB 8:15/660.13 MB 5:14/763.00 MB 0:16/907.63 MB 4:20/1.18 GB 3:18/1.04 GB 10:16/856.74 MB 2:13/629.03 MB 11:14/517.60 MB 7:16/705.68 MB Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:1.172% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:330 ExecOption: Codegen enabled: 0 out of 177 BytesRead(4s000ms): 471.89 MB, 543.54 MB, 584.35 MB, 633.17 MB, 671.01 MB, 753.15 MB, 808.79 MB, 852.55 MB, 976.66 MB, 1.01 GB, 1.08 GB, 1.18 GB, 1.27 GB, 1.37 GB, 1.45 GB, 1.47 GB, 1.55 GB, 1.62 GB, 1.68 GB, 1.78 GB, 1.87 GB, 1.94 GB, 2.01 GB, 2.06 GB, 2.12 GB, 2.24 GB, 2.32 GB, 2.39 GB, 2.41 GB, 2.41 GB, 2.41 GB, 2.41 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.75 - BytesRead: 2.41 GB (2586023655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2586023655) - BytesReadShortCircuit: 2.41 GB (2586023655) - DecompressionTime: 12s835ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 812.84 MB (852321680) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RowsRead: 211.68M (211678741) - RowsReturned: 211.68M (211678741) - RowsReturnedRate: 151.93 M/sec - ScanRangesComplete: 177 - ScannerThreadsInvoluntaryContextSwitches: 497 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s692ms - ScannerThreadsUserTime: 48s298ms - ScannerThreadsVoluntaryContextSwitches: 207.24K (207242) - TotalRawHdfsReadTime(*): 1s519ms - TotalReadThroughput: 19.27 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e5 (host=atlas-ch2-34.sys.comcast.net:22000):(Total: 2m47s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:9/474.20 MB 3:10/287.20 MB 1:16/690.29 MB 10:13/740.32 MB 6:13/621.95 MB 9:21/1.12 GB 2:11/494.76 MB 11:13/619.79 MB 8:21/1.15 GB 5:10/454.43 MB 0:16/1.07 GB 4:19/1.11 GB MemoryUsage(4s000ms): 1.27 GB, 2.10 GB, 2.63 GB, 3.06 GB, 3.16 GB, 3.35 GB, 3.44 GB, 3.98 GB, 4.03 GB, 4.15 GB, 4.34 GB, 4.38 GB, 4.33 GB, 4.55 GB, 4.67 GB, 4.65 GB, 4.65 GB, 4.74 GB, 4.85 GB, 4.86 GB, 4.91 GB, 4.92 GB, 4.93 GB, 5.12 GB, 5.43 GB, 5.47 GB, 5.44 GB, 5.38 GB, 5.29 GB, 5.13 GB, 4.95 GB, 4.79 GB, 4.86 GB, 4.41 GB, 3.78 GB, 3.19 GB, 2.60 GB, 1.95 GB, 1.26 GB, 647.51 MB, 628.99 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 34, 30, 22, 13, 5, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.93 - PeakMemoryUsage: 5.50 GB (5900393400) - PerHostPeakMemUsage: 5.69 GB (6114835384) - PrepareTime: 254.693ms - RowsProduced: 37.80M (37802031) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.757ms - TotalStorageWaitTime: 5s395ms CodeGen:(Total: 520.122ms, non-child: 520.122ms, % non-child: 100.00%) - CodegenTime: 2.908ms - CompileTime: 270.232ms - LoadTime: 248.469ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s652ms, non-child: 27s652ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1637125083) - NetworkThroughput(*): 27.99 MB/sec - OverallThroughput: 56.46 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s774ms - ThriftTransmitTime(*): 55s786ms - UncompressedRowBatchSize: 3.43 GB (3678152579) AGGREGATION_NODE (id=1):(Total: 2m19s, non-child: 2m17s, % non-child: 98.92%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m8s - GetNewBlockTime: 38.64ms - GetResultsTime: 3s695ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 644.612ms - RowsRepartitioned: 6.61M (6614474) - RowsReturned: 37.80M (37802031) - RowsReturnedRate: 271.05 K/sec - SpilledPartitions: 1 - UnpinTime: 30.686us HDFS_SCAN_NODE (id=0):(Total: 1s506ms, non-child: 1s506ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:9/474.20 MB 3:10/287.20 MB 1:16/690.29 MB 10:13/740.32 MB 6:13/621.95 MB 9:21/1.12 GB 2:11/494.76 MB 11:13/619.79 MB 8:21/1.15 GB 5:10/454.43 MB 0:16/1.07 GB 4:19/1.11 GB Hdfs Read Thread Concurrency Bucket: 0:97.69% 1:2.308% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:316 ExecOption: Codegen enabled: 0 out of 172 BytesRead(4s000ms): 468.28 MB, 525.70 MB, 577.08 MB, 640.84 MB, 658.60 MB, 708.82 MB, 744.12 MB, 780.28 MB, 947.47 MB, 1.02 GB, 1.10 GB, 1.20 GB, 1.24 GB, 1.35 GB, 1.48 GB, 1.53 GB, 1.58 GB, 1.61 GB, 1.68 GB, 1.79 GB, 1.88 GB, 1.95 GB, 2.05 GB, 2.12 GB, 2.22 GB, 2.31 GB, 2.35 GB, 2.35 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.13 - BytesRead: 2.40 GB (2572255238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2572255238) - BytesReadShortCircuit: 2.40 GB (2572255238) - DecompressionTime: 14s853ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 861.33 MB (903175096) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RowsRead: 211.86M (211859731) - RowsReturned: 211.86M (211859731) - RowsReturnedRate: 140.65 M/sec - ScanRangesComplete: 172 - ScannerThreadsInvoluntaryContextSwitches: 528 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s691ms - ScannerThreadsUserTime: 54s398ms - ScannerThreadsVoluntaryContextSwitches: 207.43K (207431) - TotalRawHdfsReadTime(*): 1s637ms - TotalReadThroughput: 18.87 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d3 (host=atlas-ch2-31.sys.comcast.net:22000):(Total: 3m31s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:10/324.30 MB 4:15/819.65 MB 3:16/1.01 GB 10:14/595.57 MB 6:13/570.14 MB 8:13/727.87 MB 9:11/543.06 MB 11:17/713.80 MB 2:17/742.31 MB 5:20/952.78 MB 0:18/869.86 MB 7:18/1.04 GB MemoryUsage(4s000ms): 1.13 GB, 1.92 GB, 2.49 GB, 2.97 GB, 3.06 GB, 3.32 GB, 3.49 GB, 3.91 GB, 4.12 GB, 4.15 GB, 4.32 GB, 4.34 GB, 4.29 GB, 4.37 GB, 4.53 GB, 4.61 GB, 4.61 GB, 4.59 GB, 4.60 GB, 4.66 GB, 4.78 GB, 4.86 GB, 4.86 GB, 4.88 GB, 4.89 GB, 4.88 GB, 4.86 GB, 4.86 GB, 4.84 GB, 4.88 GB, 5.07 GB, 5.20 GB, 5.35 GB, 5.35 GB, 5.34 GB, 5.32 GB, 5.34 GB, 5.32 GB, 5.29 GB, 5.22 GB, 5.15 GB, 5.07 GB, 4.92 GB, 4.80 GB, 4.71 GB, 4.51 GB, 4.02 GB, 3.54 GB, 3.05 GB, 2.58 GB, 2.06 GB, 1.59 GB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 31, 29, 26, 22, 14, 6, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 28.36 - PeakMemoryUsage: 5.38 GB (5771542000) - PerHostPeakMemUsage: 6.12 GB (6576422056) - PrepareTime: 268.781ms - RowsProduced: 29.80M (29798379) - TotalCpuTime: 1h36m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 19.941ms - TotalStorageWaitTime: 6s965ms CodeGen:(Total: 644.466ms, non-child: 644.466ms, % non-child: 100.00%) - CodegenTime: 3.67ms - CompileTime: 380.752ms - LoadTime: 262.226ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s860ms, non-child: 26s860ms, % non-child: 100.00%) - BytesSent: 1.20 GB (1289924563) - NetworkThroughput(*): 35.87 MB/sec - OverallThroughput: 45.80 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 11s234ms - ThriftTransmitTime(*): 34s297ms - UncompressedRowBatchSize: 2.70 GB (2898000178) AGGREGATION_NODE (id=1):(Total: 3m4s, non-child: 3m2s, % non-child: 99.10%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m57s - GetNewBlockTime: 32.599ms - GetResultsTime: 4s336ms - HashBuckets: 27.26M (27262976) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 29.80M (29798379) - RowsReturnedRate: 161.82 K/sec - SpilledPartitions: 1 - UnpinTime: 31.438us HDFS_SCAN_NODE (id=0):(Total: 1s653ms, non-child: 1s653ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:10/324.30 MB 4:15/819.65 MB 3:16/1.01 GB 10:14/595.57 MB 6:13/570.14 MB 8:13/727.87 MB 9:11/543.06 MB 11:17/713.80 MB 2:17/742.31 MB 5:20/952.78 MB 0:18/869.86 MB 7:18/1.04 GB Hdfs Read Thread Concurrency Bucket: 0:99.44% 1:0.5571% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:340 ExecOption: Codegen enabled: 0 out of 182 BytesRead(4s000ms): 396.22 MB, 455.42 MB, 494.93 MB, 583.08 MB, 624.19 MB, 758.71 MB, 815.39 MB, 878.45 MB, 1021.92 MB, 1.05 GB, 1.08 GB, 1.17 GB, 1.19 GB, 1.24 GB, 1.32 GB, 1.43 GB, 1.44 GB, 1.47 GB, 1.53 GB, 1.65 GB, 1.68 GB, 1.72 GB, 1.76 GB, 1.80 GB, 1.86 GB, 1.88 GB, 1.91 GB, 1.97 GB, 2.01 GB, 2.05 GB, 2.07 GB, 2.15 GB, 2.20 GB, 2.24 GB, 2.26 GB, 2.29 GB, 2.35 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.24 - BytesRead: 2.40 GB (2574624833) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2574624833) - BytesReadShortCircuit: 2.40 GB (2574624833) - DecompressionTime: 12s478ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 777.95 MB (815735912) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RowsRead: 210.25M (210254125) - RowsReturned: 210.25M (210254125) - RowsReturnedRate: 127.17 M/sec - ScanRangesComplete: 182 - ScannerThreadsInvoluntaryContextSwitches: 662 - ScannerThreadsTotalWallClockTime: 1h36m - MaterializeTupleTime(*): 1h36m - ScannerThreadsSysTime: 1s926ms - ScannerThreadsUserTime: 49s525ms - ScannerThreadsVoluntaryContextSwitches: 206.09K (206093) - TotalRawHdfsReadTime(*): 1s906ms - TotalReadThroughput: 13.64 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac23300 (host=atlas-ch2-25.sys.comcast.net:22000):(Total: 2m48s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:11/434.72 MB 6:12/773.06 MB 1:15/709.88 MB 3:15/784.81 MB 10:16/752.53 MB 4:18/735.17 MB 9:10/302.99 MB 0:13/748.06 MB 5:16/1.11 GB 11:13/804.16 MB 2:15/832.11 MB 8:18/928.64 MB MemoryUsage(4s000ms): 1.34 GB, 1.99 GB, 2.42 GB, 2.97 GB, 3.11 GB, 3.35 GB, 3.46 GB, 3.93 GB, 4.07 GB, 4.18 GB, 4.31 GB, 4.37 GB, 4.42 GB, 4.60 GB, 4.70 GB, 4.66 GB, 4.63 GB, 4.78 GB, 4.87 GB, 4.91 GB, 4.99 GB, 5.02 GB, 5.02 GB, 5.23 GB, 5.42 GB, 5.45 GB, 5.43 GB, 5.34 GB, 5.24 GB, 5.13 GB, 4.98 GB, 4.79 GB, 4.59 GB, 4.08 GB, 3.52 GB, 2.98 GB, 2.41 GB, 1.87 GB, 1.31 GB, 768.58 MB, 467.78 MB, 724.44 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 29, 23, 16, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.87 - PeakMemoryUsage: 5.48 GB (5888344048) - PerHostPeakMemUsage: 5.68 GB (6095276856) - PrepareTime: 268.707ms - RowsProduced: 37.26M (37257234) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 62.46ms - TotalStorageWaitTime: 7s985ms CodeGen:(Total: 568.412ms, non-child: 568.412ms, % non-child: 100.00%) - CodegenTime: 2.822ms - CompileTime: 304.373ms - LoadTime: 262.678ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s709ms, non-child: 29s709ms, % non-child: 100.00%) - BytesSent: 1.50 GB (1613613441) - NetworkThroughput(*): 28.30 MB/sec - OverallThroughput: 51.80 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s891ms - ThriftTransmitTime(*): 54s371ms - UncompressedRowBatchSize: 3.38 GB (3624958237) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m16s, % non-child: 98.90%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m7s - GetNewBlockTime: 32.449ms - GetResultsTime: 3s819ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 625.522ms - RowsRepartitioned: 6.57M (6571812) - RowsReturned: 37.26M (37257234) - RowsReturnedRate: 269.50 K/sec - SpilledPartitions: 1 - UnpinTime: 203.454us HDFS_SCAN_NODE (id=0):(Total: 1s515ms, non-child: 1s515ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:11/434.72 MB 6:12/773.06 MB 1:15/709.88 MB 3:15/784.81 MB 10:16/752.53 MB 4:18/735.17 MB 9:10/302.99 MB 0:13/748.06 MB 5:16/1.11 GB 11:13/804.16 MB 2:15/832.11 MB 8:18/928.64 MB Hdfs Read Thread Concurrency Bucket: 0:98.45% 1:1.55% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:316 ExecOption: Codegen enabled: 0 out of 172 BytesRead(4s000ms): 411.51 MB, 470.29 MB, 477.19 MB, 578.81 MB, 629.27 MB, 700.14 MB, 768.34 MB, 794.82 MB, 937.49 MB, 1.01 GB, 1.03 GB, 1.16 GB, 1.26 GB, 1.35 GB, 1.50 GB, 1.53 GB, 1.58 GB, 1.66 GB, 1.73 GB, 1.83 GB, 1.98 GB, 2.08 GB, 2.13 GB, 2.18 GB, 2.27 GB, 2.30 GB, 2.35 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.39 - BytesRead: 2.40 GB (2571660470) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2571660470) - BytesReadShortCircuit: 2.40 GB (2571660470) - DecompressionTime: 13s004ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 893.44 MB (936841936) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RowsRead: 210.19M (210191607) - RowsReturned: 210.19M (210191607) - RowsReturnedRate: 138.72 M/sec - ScanRangesComplete: 172 - ScannerThreadsInvoluntaryContextSwitches: 847 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s612ms - ScannerThreadsUserTime: 51s015ms - ScannerThreadsVoluntaryContextSwitches: 205.78K (205785) - TotalRawHdfsReadTime(*): 1s818ms - TotalReadThroughput: 18.94 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d2 (host=atlas-ch2-08.sys.comcast.net:22000):(Total: 2m59s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:14/711.63 MB 10:8/623.29 MB 11:12/942.61 MB 2:14/862.78 MB 7:18/756.44 MB 6:12/611.17 MB 8:17/947.82 MB 9:10/573.14 MB 3:14/664.38 MB 1:15/653.45 MB 5:18/963.73 MB 0:13/680.18 MB MemoryUsage(4s000ms): 1.21 GB, 1.98 GB, 2.43 GB, 3.00 GB, 3.10 GB, 3.28 GB, 3.52 GB, 3.76 GB, 4.09 GB, 4.11 GB, 4.29 GB, 4.37 GB, 4.39 GB, 4.50 GB, 4.68 GB, 4.69 GB, 4.68 GB, 4.68 GB, 4.88 GB, 4.83 GB, 4.84 GB, 4.88 GB, 4.89 GB, 5.06 GB, 5.26 GB, 5.41 GB, 5.43 GB, 5.41 GB, 5.37 GB, 5.28 GB, 5.16 GB, 5.04 GB, 4.88 GB, 4.85 GB, 4.63 GB, 4.02 GB, 3.49 GB, 2.95 GB, 2.46 GB, 1.99 GB, 1.50 GB, 1.01 GB, 486.20 MB, 629.41 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 24, 19, 10, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.45 - PeakMemoryUsage: 5.45 GB (5853909168) - PerHostPeakMemUsage: 5.69 GB (6112639416) - PrepareTime: 278.307ms - RowsProduced: 37.72M (37718089) - TotalCpuTime: 1h15m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 56.218ms - TotalStorageWaitTime: 7s496ms CodeGen:(Total: 606.277ms, non-child: 606.277ms, % non-child: 100.00%) - CodegenTime: 2.861ms - CompileTime: 332.758ms - LoadTime: 272.218ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 32s793ms, non-child: 32s793ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1633438939) - NetworkThroughput(*): 30.26 MB/sec - OverallThroughput: 47.50 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s014ms - ThriftTransmitTime(*): 51s473ms - UncompressedRowBatchSize: 3.42 GB (3670018588) AGGREGATION_NODE (id=1):(Total: 2m26s, non-child: 2m24s, % non-child: 98.85%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m13s - GetNewBlockTime: 33.540ms - GetResultsTime: 5s039ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261278464) - PinTime: 694.990ms - RowsRepartitioned: 6.64M (6639983) - RowsReturned: 37.72M (37718089) - RowsReturnedRate: 258.08 K/sec - SpilledPartitions: 1 - UnpinTime: 29.501us HDFS_SCAN_NODE (id=0):(Total: 1s679ms, non-child: 1s679ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:14/711.63 MB 10:8/623.29 MB 11:12/942.61 MB 2:14/862.78 MB 7:18/756.44 MB 6:12/611.17 MB 8:17/947.82 MB 9:10/573.14 MB 3:14/664.38 MB 1:15/653.45 MB 5:18/963.73 MB 0:13/680.18 MB Hdfs Read Thread Concurrency Bucket: 0:98.89% 1:0.7407% 2:0.3704% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:318 ExecOption: Codegen enabled: 0 out of 165 BytesRead(4s000ms): 403.22 MB, 514.63 MB, 518.77 MB, 625.98 MB, 637.46 MB, 705.41 MB, 811.07 MB, 851.08 MB, 891.37 MB, 1005.06 MB, 1.02 GB, 1.15 GB, 1.23 GB, 1.30 GB, 1.44 GB, 1.54 GB, 1.58 GB, 1.62 GB, 1.66 GB, 1.70 GB, 1.80 GB, 1.89 GB, 1.94 GB, 2.10 GB, 2.18 GB, 2.23 GB, 2.29 GB, 2.35 GB, 2.37 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.51 - BytesRead: 2.41 GB (2586438542) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2586438542) - BytesReadShortCircuit: 2.41 GB (2586438542) - DecompressionTime: 14s853ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 827.74 MB (867947008) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RowsRead: 212.54M (212542647) - RowsReturned: 212.54M (212542647) - RowsReturnedRate: 126.53 M/sec - ScanRangesComplete: 165 - ScannerThreadsInvoluntaryContextSwitches: 592 - ScannerThreadsTotalWallClockTime: 1h13m - MaterializeTupleTime(*): 1h12m - ScannerThreadsSysTime: 1s410ms - ScannerThreadsUserTime: 52s468ms - ScannerThreadsVoluntaryContextSwitches: 208.11K (208111) - TotalRawHdfsReadTime(*): 1s946ms - TotalReadThroughput: 18.20 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f4 (host=atlas-ch2-22.sys.comcast.net:22000):(Total: 2m49s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:13/948.04 MB 4:10/588.56 MB 5:7/420.25 MB 0:14/727.26 MB 7:12/627.23 MB 6:10/489.00 MB 8:12/718.63 MB 2:19/1.10 GB 11:14/653.19 MB 9:13/773.78 MB 10:21/981.03 MB 3:16/909.86 MB MemoryUsage(4s000ms): 1.20 GB, 2.03 GB, 2.58 GB, 3.06 GB, 3.14 GB, 3.40 GB, 3.55 GB, 4.16 GB, 4.18 GB, 4.32 GB, 4.40 GB, 4.35 GB, 4.50 GB, 4.59 GB, 4.61 GB, 4.66 GB, 4.70 GB, 4.90 GB, 4.89 GB, 4.90 GB, 4.89 GB, 4.89 GB, 5.01 GB, 5.28 GB, 5.40 GB, 5.41 GB, 5.38 GB, 5.33 GB, 5.26 GB, 5.16 GB, 5.02 GB, 4.81 GB, 4.73 GB, 4.10 GB, 3.50 GB, 2.95 GB, 2.42 GB, 1.87 GB, 1.36 GB, 848.90 MB, 362.06 MB, 787.64 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 29, 22, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.98 - PeakMemoryUsage: 5.42 GB (5821168504) - PerHostPeakMemUsage: 5.62 GB (6031849800) - PrepareTime: 270.892ms - RowsProduced: 37.74M (37742579) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 62.472ms - TotalStorageWaitTime: 7s600ms CodeGen:(Total: 571.145ms, non-child: 571.145ms, % non-child: 100.00%) - CodegenTime: 2.810ms - CompileTime: 304.971ms - LoadTime: 264.832ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 31s342ms, non-child: 31s342ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1634651217) - NetworkThroughput(*): 32.32 MB/sec - OverallThroughput: 49.74 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s510ms - ThriftTransmitTime(*): 48s232ms - UncompressedRowBatchSize: 3.42 GB (3672291025) AGGREGATION_NODE (id=1):(Total: 2m17s, non-child: 2m16s, % non-child: 98.91%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 31.693ms - GetResultsTime: 4s016ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 641.75ms - RowsRepartitioned: 6.59M (6589830) - RowsReturned: 37.74M (37742579) - RowsReturnedRate: 273.80 K/sec - SpilledPartitions: 1 - UnpinTime: 29.945us HDFS_SCAN_NODE (id=0):(Total: 1s495ms, non-child: 1s495ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:13/948.04 MB 4:10/588.56 MB 5:7/420.25 MB 0:14/727.26 MB 7:12/627.23 MB 6:10/489.00 MB 8:12/718.63 MB 2:19/1.10 GB 11:14/653.19 MB 9:13/773.78 MB 10:21/981.03 MB 3:16/909.86 MB Hdfs Read Thread Concurrency Bucket: 0:99.22% 1:0.7812% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:314 ExecOption: Codegen enabled: 0 out of 161 BytesRead(4s000ms): 496.86 MB, 567.84 MB, 581.44 MB, 623.60 MB, 644.46 MB, 765.21 MB, 868.74 MB, 967.58 MB, 1.02 GB, 1.07 GB, 1.13 GB, 1.16 GB, 1.22 GB, 1.32 GB, 1.42 GB, 1.55 GB, 1.62 GB, 1.68 GB, 1.75 GB, 1.84 GB, 1.92 GB, 1.95 GB, 2.03 GB, 2.15 GB, 2.25 GB, 2.29 GB, 2.34 GB, 2.38 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 33.18 - BytesRead: 2.40 GB (2578570754) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2578570754) - BytesReadShortCircuit: 2.40 GB (2578570754) - DecompressionTime: 13s247ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 812.16 MB (851610352) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RowsRead: 211.00M (211000031) - RowsReturned: 211.00M (211000031) - RowsReturnedRate: 141.08 M/sec - ScanRangesComplete: 161 - ScannerThreadsInvoluntaryContextSwitches: 768 - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s967ms - ScannerThreadsUserTime: 50s633ms - ScannerThreadsVoluntaryContextSwitches: 206.56K (206562) - TotalRawHdfsReadTime(*): 1s610ms - TotalReadThroughput: 19.14 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ed (host=atlas-ch2-20.sys.comcast.net:22000):(Total: 2m51s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:9/575.56 MB 8:11/635.68 MB 3:13/674.21 MB 4:15/608.69 MB 1:15/820.56 MB 0:14/675.25 MB 5:15/995.04 MB 10:21/1.42 GB 9:10/496.23 MB 7:15/805.30 MB 2:14/793.37 MB 11:8/494.62 MB MemoryUsage(4s000ms): 1.39 GB, 2.03 GB, 2.52 GB, 3.04 GB, 3.12 GB, 3.22 GB, 3.52 GB, 3.51 GB, 4.06 GB, 4.09 GB, 4.25 GB, 4.39 GB, 4.43 GB, 4.52 GB, 4.65 GB, 4.63 GB, 4.59 GB, 4.58 GB, 4.80 GB, 4.81 GB, 4.83 GB, 4.92 GB, 4.92 GB, 5.06 GB, 5.19 GB, 5.35 GB, 5.40 GB, 5.43 GB, 5.40 GB, 5.28 GB, 5.09 GB, 4.95 GB, 4.79 GB, 4.66 GB, 4.15 GB, 3.52 GB, 2.98 GB, 2.43 GB, 1.87 GB, 1.35 GB, 768.62 MB, 468.16 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 29, 20, 13, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.12 - PeakMemoryUsage: 5.46 GB (5861881808) - PerHostPeakMemUsage: 5.66 GB (6076323792) - PrepareTime: 276.226ms - RowsProduced: 37.50M (37496785) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 55.449ms - TotalStorageWaitTime: 8s063ms CodeGen:(Total: 576.622ms, non-child: 576.622ms, % non-child: 100.00%) - CodegenTime: 2.867ms - CompileTime: 305.121ms - LoadTime: 270.133ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 28s738ms, non-child: 28s738ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1623686326) - NetworkThroughput(*): 28.19 MB/sec - OverallThroughput: 53.88 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s381ms - ThriftTransmitTime(*): 54s937ms - UncompressedRowBatchSize: 3.40 GB (3648240881) AGGREGATION_NODE (id=1):(Total: 2m22s, non-child: 2m21s, % non-child: 98.98%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m12s - GetNewBlockTime: 32.180ms - GetResultsTime: 3s757ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 588.594ms - RowsRepartitioned: 6.65M (6653757) - RowsReturned: 37.50M (37496785) - RowsReturnedRate: 263.18 K/sec - SpilledPartitions: 1 - UnpinTime: 28.190us HDFS_SCAN_NODE (id=0):(Total: 1s453ms, non-child: 1s453ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:9/575.56 MB 8:11/635.68 MB 3:13/674.21 MB 4:15/608.69 MB 1:15/820.56 MB 0:14/675.25 MB 5:15/995.04 MB 10:21/1.42 GB 9:10/496.23 MB 7:15/805.30 MB 2:14/793.37 MB 11:8/494.62 MB Hdfs Read Thread Concurrency Bucket: 0:99.63% 1:0.3731% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:314 ExecOption: Codegen enabled: 0 out of 160 BytesRead(4s000ms): 456.74 MB, 544.37 MB, 583.72 MB, 641.13 MB, 661.83 MB, 685.06 MB, 787.19 MB, 811.63 MB, 845.56 MB, 961.05 MB, 1.04 GB, 1.13 GB, 1.24 GB, 1.31 GB, 1.38 GB, 1.42 GB, 1.46 GB, 1.53 GB, 1.61 GB, 1.66 GB, 1.76 GB, 1.92 GB, 2.00 GB, 2.03 GB, 2.07 GB, 2.15 GB, 2.31 GB, 2.39 GB, 2.40 GB, 2.40 GB, 2.40 GB, 2.40 GB, 2.41 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.15 - BytesRead: 2.42 GB (2596739723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.42 GB (2596739723) - BytesReadShortCircuit: 2.42 GB (2596739723) - DecompressionTime: 12s150ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 837.75 MB (878442344) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RowsRead: 213.02M (213024474) - RowsReturned: 213.02M (213024474) - RowsReturnedRate: 146.53 M/sec - ScanRangesComplete: 160 - ScannerThreadsInvoluntaryContextSwitches: 538 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s840ms - ScannerThreadsUserTime: 48s035ms - ScannerThreadsVoluntaryContextSwitches: 208.57K (208573) - TotalRawHdfsReadTime(*): 2s000ms - TotalReadThroughput: 18.41 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e0 (host=atlas-ch2-09.sys.comcast.net:22000):(Total: 2m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:14/790.84 MB 4:14/701.47 MB 10:13/566.91 MB 8:14/802.45 MB 0:17/976.17 MB 5:12/710.84 MB 9:11/541.39 MB 7:16/694.38 MB 2:9/565.52 MB 11:19/1.06 GB 1:18/828.01 MB 6:14/677.26 MB MemoryUsage(4s000ms): 1.14 GB, 2.01 GB, 2.47 GB, 3.03 GB, 3.14 GB, 3.34 GB, 3.47 GB, 3.81 GB, 4.05 GB, 4.09 GB, 4.32 GB, 4.36 GB, 4.32 GB, 4.56 GB, 4.58 GB, 4.59 GB, 4.62 GB, 4.81 GB, 4.86 GB, 4.88 GB, 4.86 GB, 4.83 GB, 4.95 GB, 5.16 GB, 5.43 GB, 5.42 GB, 5.42 GB, 5.34 GB, 5.19 GB, 5.06 GB, 4.90 GB, 4.83 GB, 4.67 GB, 4.02 GB, 3.35 GB, 2.68 GB, 2.05 GB, 1.42 GB, 808.59 MB, 476.79 MB, 769.91 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 26, 19, 11, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.05 - PeakMemoryUsage: 5.45 GB (5855122344) - PerHostPeakMemUsage: 5.65 GB (6064976224) - PrepareTime: 283.343ms - RowsProduced: 37.86M (37862677) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 57.257ms - TotalStorageWaitTime: 8s019ms CodeGen:(Total: 583.161ms, non-child: 583.161ms, % non-child: 100.00%) - CodegenTime: 2.824ms - CompileTime: 304.518ms - LoadTime: 277.280ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s191ms, non-child: 27s191ms, % non-child: 100.00%) - BytesSent: 1.53 GB (1639789798) - NetworkThroughput(*): 28.83 MB/sec - OverallThroughput: 57.51 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s501ms - ThriftTransmitTime(*): 54s243ms - UncompressedRowBatchSize: 3.43 GB (3684017107) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m15s, % non-child: 98.95%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 34.150ms - GetResultsTime: 3s612ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 644.643ms - RowsRepartitioned: 6.58M (6583783) - RowsReturned: 37.86M (37862677) - RowsReturnedRate: 276.64 K/sec - SpilledPartitions: 1 - UnpinTime: 29.634us HDFS_SCAN_NODE (id=0):(Total: 1s433ms, non-child: 1s433ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:14/790.84 MB 4:14/701.47 MB 10:13/566.91 MB 8:14/802.45 MB 0:17/976.17 MB 5:12/710.84 MB 9:11/541.39 MB 7:16/694.38 MB 2:9/565.52 MB 11:19/1.06 GB 1:18/828.01 MB 6:14/677.26 MB Hdfs Read Thread Concurrency Bucket: 0:98.05% 1:1.953% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:330 ExecOption: Codegen enabled: 0 out of 171 BytesRead(4s000ms): 412.26 MB, 481.72 MB, 504.15 MB, 633.61 MB, 656.58 MB, 708.06 MB, 751.49 MB, 774.74 MB, 958.78 MB, 1.02 GB, 1.06 GB, 1.21 GB, 1.26 GB, 1.31 GB, 1.39 GB, 1.49 GB, 1.61 GB, 1.67 GB, 1.74 GB, 1.82 GB, 1.87 GB, 1.90 GB, 2.01 GB, 2.11 GB, 2.25 GB, 2.30 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.20 - BytesRead: 2.40 GB (2572650351) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2572650351) - BytesReadShortCircuit: 2.40 GB (2572650351) - DecompressionTime: 11s688ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 818.16 MB (857904040) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RowsRead: 210.73M (210729772) - RowsReturned: 210.73M (210729772) - RowsReturnedRate: 147.03 M/sec - ScanRangesComplete: 171 - ScannerThreadsInvoluntaryContextSwitches: 545 - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s745ms - ScannerThreadsUserTime: 45s717ms - ScannerThreadsVoluntaryContextSwitches: 206.35K (206355) - TotalRawHdfsReadTime(*): 1s889ms - TotalReadThroughput: 19.17 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ef (host=atlas-ch2-12.sys.comcast.net:22000):(Total: 2m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:13/573.62 MB 4:16/1.08 GB 1:11/501.36 MB 6:12/676.12 MB 2:5/285.55 MB 11:16/884.91 MB 8:15/750.53 MB 5:15/724.91 MB 0:14/732.56 MB 10:18/1.20 GB 7:12/668.79 MB 9:15/881.15 MB MemoryUsage(4s000ms): 1.38 GB, 2.03 GB, 2.53 GB, 3.01 GB, 3.11 GB, 3.40 GB, 3.57 GB, 4.02 GB, 4.20 GB, 4.28 GB, 4.42 GB, 4.48 GB, 4.45 GB, 4.64 GB, 4.67 GB, 4.64 GB, 4.64 GB, 4.78 GB, 4.85 GB, 4.84 GB, 4.82 GB, 4.77 GB, 4.80 GB, 4.94 GB, 5.25 GB, 5.42 GB, 5.40 GB, 5.31 GB, 5.22 GB, 5.08 GB, 4.96 GB, 4.79 GB, 4.63 GB, 4.06 GB, 3.44 GB, 2.81 GB, 2.17 GB, 1.55 GB, 921.81 MB, 484.29 MB, 785.45 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 30, 26, 22, 15, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.13 - PeakMemoryUsage: 5.47 GB (5868463984) - PerHostPeakMemUsage: 5.66 GB (6074895392) - PrepareTime: 198.37ms - RowsProduced: 37.49M (37491024) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.402ms - TotalStorageWaitTime: 3s124ms CodeGen:(Total: 462.679ms, non-child: 462.679ms, % non-child: 100.00%) - CodegenTime: 2.834ms - CompileTime: 269.323ms - LoadTime: 191.979ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s487ms, non-child: 26s487ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1623790686) - NetworkThroughput(*): 27.95 MB/sec - OverallThroughput: 58.46 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s180ms - ThriftTransmitTime(*): 55s401ms - UncompressedRowBatchSize: 3.40 GB (3647733278) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m16s, % non-child: 99.07%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m7s - GetNewBlockTime: 35.348ms - GetResultsTime: 3s529ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 689.950ms - RowsRepartitioned: 6.65M (6647763) - RowsReturned: 37.49M (37491024) - RowsReturnedRate: 271.16 K/sec - SpilledPartitions: 1 - UnpinTime: 166.210us HDFS_SCAN_NODE (id=0):(Total: 1s280ms, non-child: 1s280ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:13/573.62 MB 4:16/1.08 GB 1:11/501.36 MB 6:12/676.12 MB 2:5/285.55 MB 11:16/884.91 MB 8:15/750.53 MB 5:15/724.91 MB 0:14/732.56 MB 10:18/1.20 GB 7:12/668.79 MB 9:15/881.15 MB Hdfs Read Thread Concurrency Bucket: 0:98.84% 1:1.158% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:312 ExecOption: Codegen enabled: 0 out of 162 BytesRead(4s000ms): 525.10 MB, 525.10 MB, 558.76 MB, 626.48 MB, 657.81 MB, 833.56 MB, 903.00 MB, 926.25 MB, 1.08 GB, 1.13 GB, 1.18 GB, 1.29 GB, 1.31 GB, 1.38 GB, 1.48 GB, 1.54 GB, 1.62 GB, 1.69 GB, 1.71 GB, 1.78 GB, 1.81 GB, 1.84 GB, 1.99 GB, 2.06 GB, 2.14 GB, 2.32 GB, 2.38 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.02 - BytesRead: 2.41 GB (2591391114) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2591391114) - BytesReadShortCircuit: 2.41 GB (2591391114) - DecompressionTime: 11s114ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 832.25 MB (872676656) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RowsRead: 213.00M (213004080) - RowsReturned: 213.00M (213004080) - RowsReturnedRate: 166.31 M/sec - ScanRangesComplete: 162 - ScannerThreadsInvoluntaryContextSwitches: 26.92K (26918) - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s726ms - ScannerThreadsUserTime: 44s058ms - ScannerThreadsVoluntaryContextSwitches: 208.82K (208820) - TotalRawHdfsReadTime(*): 2s059ms - TotalReadThroughput: 19.08 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f3 (host=atlas-ch2-27.sys.comcast.net:22000):(Total: 2m50s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:10/544.41 MB 6:13/575.45 MB 7:14/724.37 MB 1:18/649.82 MB 9:16/776.80 MB 3:23/1.12 GB 0:15/832.26 MB 5:18/805.97 MB 10:15/749.70 MB 11:17/787.90 MB 2:24/834.77 MB 4:13/479.90 MB MemoryUsage(4s000ms): 1.23 GB, 2.01 GB, 2.47 GB, 3.02 GB, 3.10 GB, 3.24 GB, 3.54 GB, 3.71 GB, 4.12 GB, 4.10 GB, 4.30 GB, 4.31 GB, 4.46 GB, 4.63 GB, 4.67 GB, 4.68 GB, 4.66 GB, 4.84 GB, 4.90 GB, 4.88 GB, 4.88 GB, 4.88 GB, 4.88 GB, 5.16 GB, 5.36 GB, 5.36 GB, 5.36 GB, 5.32 GB, 5.29 GB, 5.28 GB, 5.24 GB, 5.09 GB, 4.92 GB, 4.68 GB, 4.27 GB, 3.74 GB, 3.14 GB, 2.55 GB, 1.93 GB, 1.27 GB, 653.75 MB, 509.34 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 34, 25, 16, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 27.25 - PeakMemoryUsage: 5.38 GB (5776577984) - PerHostPeakMemUsage: 5.65 GB (6069157800) - PrepareTime: 238.629ms - RowsProduced: 37.53M (37533957) - TotalCpuTime: 1h17m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 57.647ms - TotalStorageWaitTime: 6s664ms CodeGen:(Total: 521.203ms, non-child: 521.203ms, % non-child: 100.00%) - CodegenTime: 2.864ms - CompileTime: 287.473ms - LoadTime: 232.461ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 28s310ms, non-child: 28s310ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1625358128) - NetworkThroughput(*): 30.15 MB/sec - OverallThroughput: 54.75 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s120ms - ThriftTransmitTime(*): 51s417ms - UncompressedRowBatchSize: 3.40 GB (3652009989) AGGREGATION_NODE (id=1):(Total: 2m22s, non-child: 2m20s, % non-child: 98.97%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m12s - GetNewBlockTime: 33.219ms - GetResultsTime: 3s727ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 582.288ms - RowsRepartitioned: 6.56M (6561110) - RowsReturned: 37.53M (37533957) - RowsReturnedRate: 263.78 K/sec - SpilledPartitions: 1 - UnpinTime: 33.465us HDFS_SCAN_NODE (id=0):(Total: 1s466ms, non-child: 1s466ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:10/544.41 MB 6:13/575.45 MB 7:14/724.37 MB 1:18/649.82 MB 9:16/776.80 MB 3:23/1.12 GB 0:15/832.26 MB 5:18/805.97 MB 10:15/749.70 MB 11:17/787.90 MB 2:24/834.77 MB 4:13/479.90 MB Hdfs Read Thread Concurrency Bucket: 0:98.13% 1:1.493% 2:0.3731% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:25 PARQUET/SNAPPY:342 ExecOption: Codegen enabled: 0 out of 196 BytesRead(4s000ms): 449.21 MB, 510.77 MB, 521.69 MB, 596.02 MB, 625.22 MB, 670.72 MB, 831.49 MB, 854.94 MB, 866.98 MB, 975.37 MB, 1019.23 MB, 1.12 GB, 1.26 GB, 1.29 GB, 1.41 GB, 1.52 GB, 1.58 GB, 1.64 GB, 1.67 GB, 1.75 GB, 1.84 GB, 1.88 GB, 1.92 GB, 2.03 GB, 2.10 GB, 2.16 GB, 2.22 GB, 2.24 GB, 2.29 GB, 2.37 GB, 2.39 GB, 2.39 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 33.49 - BytesRead: 2.39 GB (2568096918) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2568096918) - BytesReadShortCircuit: 2.39 GB (2568096918) - DecompressionTime: 13s087ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 800.52 MB (839409632) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RowsRead: 210.04M (210040863) - RowsReturned: 210.04M (210040863) - RowsReturnedRate: 143.23 M/sec - ScanRangesComplete: 196 - ScannerThreadsInvoluntaryContextSwitches: 501 - ScannerThreadsTotalWallClockTime: 1h14m - MaterializeTupleTime(*): 1h14m - ScannerThreadsSysTime: 1s781ms - ScannerThreadsUserTime: 50s412ms - ScannerThreadsVoluntaryContextSwitches: 205.74K (205736) - TotalRawHdfsReadTime(*): 1s857ms - TotalReadThroughput: 18.28 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e1 (host=atlas-ch2-52.sys.comcast.net:22000):(Total: 3m31s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:14/832.29 MB 3:13/723.12 MB 8:11/585.10 MB 11:12/628.13 MB 2:13/749.55 MB 9:8/391.37 MB 10:12/715.22 MB 5:15/802.89 MB 0:19/1.10 GB 6:13/638.45 MB 4:16/774.22 MB 7:14/949.13 MB MemoryUsage(4s000ms): 1.31 GB, 2.09 GB, 2.53 GB, 3.10 GB, 3.18 GB, 3.27 GB, 3.57 GB, 3.53 GB, 3.99 GB, 4.15 GB, 4.29 GB, 4.43 GB, 4.44 GB, 4.39 GB, 4.50 GB, 4.59 GB, 4.62 GB, 4.61 GB, 4.62 GB, 4.64 GB, 4.66 GB, 4.84 GB, 4.87 GB, 4.91 GB, 4.93 GB, 4.95 GB, 4.92 GB, 4.92 GB, 4.92 GB, 5.01 GB, 5.17 GB, 5.27 GB, 5.43 GB, 5.41 GB, 5.40 GB, 5.40 GB, 5.37 GB, 5.33 GB, 5.20 GB, 5.13 GB, 5.08 GB, 4.96 GB, 4.85 GB, 4.75 GB, 4.70 GB, 4.40 GB, 3.93 GB, 3.44 GB, 2.99 GB, 2.51 GB, 2.04 GB, 1.55 GB, 1.09 GB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 26, 23, 21, 15, 8, 4, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 27.69 - PeakMemoryUsage: 5.45 GB (5857110992) - PerHostPeakMemUsage: 6.17 GB (6627933704) - PrepareTime: 249.653ms - RowsProduced: 30.48M (30484902) - TotalCpuTime: 1h34m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 21.955ms - TotalStorageWaitTime: 5s124ms CodeGen:(Total: 518.419ms, non-child: 518.419ms, % non-child: 100.00%) - CodegenTime: 2.934ms - CompileTime: 273.577ms - LoadTime: 243.468ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 28s434ms, non-child: 28s434ms, % non-child: 100.00%) - BytesSent: 1.23 GB (1319777799) - NetworkThroughput(*): 35.93 MB/sec - OverallThroughput: 44.26 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 11s798ms - ThriftTransmitTime(*): 35s030ms - UncompressedRowBatchSize: 2.76 GB (2965044592) AGGREGATION_NODE (id=1):(Total: 3m3s, non-child: 3m1s, % non-child: 99.15%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m56s - GetNewBlockTime: 44.312ms - GetResultsTime: 4s540ms - HashBuckets: 28.31M (28311552) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.67 GB (5009595816) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 30.48M (30484902) - RowsReturnedRate: 166.14 K/sec - SpilledPartitions: 1 - UnpinTime: 31.392us HDFS_SCAN_NODE (id=0):(Total: 1s557ms, non-child: 1s557ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:14/832.29 MB 3:13/723.12 MB 8:11/585.10 MB 11:12/628.13 MB 2:13/749.55 MB 9:8/391.37 MB 10:12/715.22 MB 5:15/802.89 MB 0:19/1.10 GB 6:13/638.45 MB 4:16/774.22 MB 7:14/949.13 MB Hdfs Read Thread Concurrency Bucket: 0:99.16% 1:0.5587% 2:0% 3:0% 4:0.2793% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:296 ExecOption: Codegen enabled: 0 out of 160 BytesRead(4s000ms): 526.14 MB, 574.53 MB, 595.66 MB, 714.64 MB, 728.66 MB, 755.20 MB, 825.21 MB, 844.77 MB, 868.92 MB, 1.05 GB, 1.13 GB, 1.16 GB, 1.23 GB, 1.23 GB, 1.29 GB, 1.34 GB, 1.40 GB, 1.41 GB, 1.47 GB, 1.54 GB, 1.65 GB, 1.68 GB, 1.70 GB, 1.77 GB, 1.84 GB, 1.91 GB, 1.94 GB, 1.99 GB, 2.04 GB, 2.16 GB, 2.17 GB, 2.21 GB, 2.25 GB, 2.28 GB, 2.29 GB, 2.34 GB, 2.34 GB, 2.35 GB, 2.35 GB, 2.35 GB, 2.35 GB, 2.36 GB, 2.36 GB, 2.37 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 31.68 - BytesRead: 2.39 GB (2561936050) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2561936050) - BytesReadShortCircuit: 2.39 GB (2561936050) - DecompressionTime: 12s239ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 893.09 MB (936475560) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RowsRead: 210.25M (210251542) - RowsReturned: 210.25M (210251542) - RowsReturnedRate: 134.99 M/sec - ScanRangesComplete: 160 - ScannerThreadsInvoluntaryContextSwitches: 629 - ScannerThreadsTotalWallClockTime: 1h34m - MaterializeTupleTime(*): 1h34m - ScannerThreadsSysTime: 2s034ms - ScannerThreadsUserTime: 48s663ms - ScannerThreadsVoluntaryContextSwitches: 205.86K (205863) - TotalRawHdfsReadTime(*): 1s855ms - TotalReadThroughput: 13.65 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f5 (host=atlas-ch2-49.sys.comcast.net:22000):(Total: 2m47s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:18/819.63 MB 6:8/595.26 MB 4:17/977.39 MB 3:11/534.03 MB 0:10/502.88 MB 5:16/1006.46 MB 8:12/652.97 MB 1:12/704.02 MB 9:21/945.44 MB 2:13/509.94 MB 11:18/908.03 MB 10:18/780.20 MB MemoryUsage(4s000ms): 1.27 GB, 1.99 GB, 2.42 GB, 3.00 GB, 3.12 GB, 3.33 GB, 3.43 GB, 3.99 GB, 4.07 GB, 4.24 GB, 4.38 GB, 4.40 GB, 4.50 GB, 4.64 GB, 4.63 GB, 4.62 GB, 4.64 GB, 4.87 GB, 4.90 GB, 4.92 GB, 4.91 GB, 4.97 GB, 5.18 GB, 5.39 GB, 5.39 GB, 5.39 GB, 5.36 GB, 5.37 GB, 5.32 GB, 5.21 GB, 5.07 GB, 4.93 GB, 4.81 GB, 4.48 GB, 3.91 GB, 3.38 GB, 2.81 GB, 2.14 GB, 1.47 GB, 803.68 MB, 555.26 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 28, 24, 15, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.74 - PeakMemoryUsage: 5.42 GB (5815443328) - PerHostPeakMemUsage: 5.64 GB (6057018448) - PrepareTime: 253.628ms - RowsProduced: 37.67M (37669528) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.658ms - TotalStorageWaitTime: 6s152ms CodeGen:(Total: 517.399ms, non-child: 517.399ms, % non-child: 100.00%) - CodegenTime: 2.896ms - CompileTime: 268.553ms - LoadTime: 247.480ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 28s304ms, non-child: 28s304ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1631488363) - NetworkThroughput(*): 29.57 MB/sec - OverallThroughput: 54.97 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s056ms - ThriftTransmitTime(*): 52s609ms - UncompressedRowBatchSize: 3.41 GB (3665154881) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m17s, % non-child: 98.95%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m8s - GetNewBlockTime: 36.729ms - GetResultsTime: 3s735ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.89 GB (5252895336) - PinTime: 590.961ms - RowsRepartitioned: 6.56M (6564827) - RowsReturned: 37.67M (37669528) - RowsReturnedRate: 271.65 K/sec - SpilledPartitions: 1 - UnpinTime: 157.423us HDFS_SCAN_NODE (id=0):(Total: 1s450ms, non-child: 1s450ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:18/819.63 MB 6:8/595.26 MB 4:17/977.39 MB 3:11/534.03 MB 0:10/502.88 MB 5:16/1006.46 MB 8:12/652.97 MB 1:12/704.02 MB 9:21/945.44 MB 2:13/509.94 MB 11:18/908.03 MB 10:18/780.20 MB Hdfs Read Thread Concurrency Bucket: 0:99.62% 1:0.3831% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:13 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 174 BytesRead(4s000ms): 478.59 MB, 516.33 MB, 538.76 MB, 611.70 MB, 644.77 MB, 697.39 MB, 740.67 MB, 767.87 MB, 955.75 MB, 1.05 GB, 1.11 GB, 1.22 GB, 1.31 GB, 1.36 GB, 1.42 GB, 1.49 GB, 1.55 GB, 1.65 GB, 1.76 GB, 1.84 GB, 1.89 GB, 1.99 GB, 2.07 GB, 2.10 GB, 2.15 GB, 2.23 GB, 2.32 GB, 2.37 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 33.03 - BytesRead: 2.39 GB (2569270088) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2569270088) - BytesReadShortCircuit: 2.39 GB (2569270088) - DecompressionTime: 13s311ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 798.89 MB (837701080) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RowsRead: 210.12M (210121759) - RowsReturned: 210.12M (210121759) - RowsReturnedRate: 144.84 M/sec - ScanRangesComplete: 174 - ScannerThreadsInvoluntaryContextSwitches: 566 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s558ms - ScannerThreadsUserTime: 50s809ms - ScannerThreadsVoluntaryContextSwitches: 205.76K (205760) - TotalRawHdfsReadTime(*): 1s608ms - TotalReadThroughput: 18.78 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f2 (host=atlas-ch2-17.sys.comcast.net:22000):(Total: 2m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:12/553.55 MB 11:18/1.00 GB 8:15/779.82 MB 0:9/508.31 MB 5:14/818.37 MB 6:12/683.88 MB 3:14/704.29 MB 4:19/1.14 GB 7:17/921.79 MB 10:8/293.78 MB 9:12/695.26 MB 1:18/795.73 MB MemoryUsage(4s000ms): 1.42 GB, 2.05 GB, 2.56 GB, 3.08 GB, 3.15 GB, 3.36 GB, 3.51 GB, 3.84 GB, 4.11 GB, 4.17 GB, 4.38 GB, 4.41 GB, 4.40 GB, 4.63 GB, 4.63 GB, 4.59 GB, 4.56 GB, 4.75 GB, 4.87 GB, 4.86 GB, 4.88 GB, 4.83 GB, 4.88 GB, 5.17 GB, 5.36 GB, 5.34 GB, 5.34 GB, 5.33 GB, 5.17 GB, 5.07 GB, 4.93 GB, 4.75 GB, 4.48 GB, 3.89 GB, 3.29 GB, 2.62 GB, 1.98 GB, 1.35 GB, 711.19 MB, 509.37 MB, 660.00 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 24, 20, 13, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.25 - PeakMemoryUsage: 5.39 GB (5791438584) - PerHostPeakMemUsage: 5.59 GB (5997491960) - PrepareTime: 250.417ms - RowsProduced: 37.43M (37431876) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.40ms - TotalStorageWaitTime: 7s043ms CodeGen:(Total: 522.557ms, non-child: 522.557ms, % non-child: 100.00%) - CodegenTime: 2.934ms - CompileTime: 276.959ms - LoadTime: 244.249ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s812ms, non-child: 26s812ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1620773797) - NetworkThroughput(*): 29.18 MB/sec - OverallThroughput: 57.65 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s311ms - ThriftTransmitTime(*): 52s973ms - UncompressedRowBatchSize: 3.39 GB (3642071359) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m15s, % non-child: 99.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 25.657ms - GetResultsTime: 3s559ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 643.790ms - RowsRepartitioned: 6.61M (6614540) - RowsReturned: 37.43M (37431876) - RowsReturnedRate: 273.73 K/sec - SpilledPartitions: 1 - UnpinTime: 29.869us HDFS_SCAN_NODE (id=0):(Total: 1s365ms, non-child: 1s365ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/553.55 MB 11:18/1.00 GB 8:15/779.82 MB 0:9/508.31 MB 5:14/818.37 MB 6:12/683.88 MB 3:14/704.29 MB 4:19/1.14 GB 7:17/921.79 MB 10:8/293.78 MB 9:12/695.26 MB 1:18/795.73 MB Hdfs Read Thread Concurrency Bucket: 0:98.44% 1:1.172% 2:0.3906% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:11 PARQUET/SNAPPY:314 ExecOption: Codegen enabled: 0 out of 168 BytesRead(4s000ms): 484.09 MB, 563.63 MB, 600.66 MB, 706.14 MB, 706.93 MB, 765.49 MB, 803.77 MB, 839.56 MB, 1007.05 MB, 1.07 GB, 1.12 GB, 1.22 GB, 1.31 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.53 GB, 1.66 GB, 1.72 GB, 1.79 GB, 1.88 GB, 1.92 GB, 1.99 GB, 2.08 GB, 2.18 GB, 2.22 GB, 2.30 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.35 - BytesRead: 2.40 GB (2572136089) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2572136089) - BytesReadShortCircuit: 2.40 GB (2572136089) - DecompressionTime: 12s063ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 872.94 MB (915346792) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RowsRead: 211.68M (211675206) - RowsReturned: 211.68M (211675206) - RowsReturnedRate: 155.02 M/sec - ScanRangesComplete: 168 - ScannerThreadsInvoluntaryContextSwitches: 459 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s663ms - ScannerThreadsUserTime: 45s627ms - ScannerThreadsVoluntaryContextSwitches: 207.28K (207281) - TotalRawHdfsReadTime(*): 1s690ms - TotalReadThroughput: 19.09 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232fc (host=atlas-ch2-53.sys.comcast.net:22000):(Total: 2m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:12/531.74 MB 1:13/875.89 MB 4:17/826.69 MB 7:20/1023.30 MB 2:11/544.69 MB 11:18/755.12 MB 6:23/1009.57 MB 8:12/628.17 MB 5:10/545.09 MB 0:15/644.57 MB 3:13/628.73 MB 9:14/884.97 MB MemoryUsage(4s000ms): 1.27 GB, 1.94 GB, 2.45 GB, 2.91 GB, 3.06 GB, 3.36 GB, 3.53 GB, 3.96 GB, 4.08 GB, 4.13 GB, 4.25 GB, 4.33 GB, 4.45 GB, 4.60 GB, 4.60 GB, 4.56 GB, 4.58 GB, 4.82 GB, 4.85 GB, 4.89 GB, 4.88 GB, 4.88 GB, 4.87 GB, 5.05 GB, 5.27 GB, 5.34 GB, 5.34 GB, 5.35 GB, 5.26 GB, 5.13 GB, 4.99 GB, 4.82 GB, 4.80 GB, 4.35 GB, 3.70 GB, 3.01 GB, 2.36 GB, 1.73 GB, 1.10 GB, 546.73 MB, 630.53 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 30, 23, 17, 7, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.17 - PeakMemoryUsage: 5.39 GB (5786700360) - PerHostPeakMemUsage: 5.64 GB (6057477744) - PrepareTime: 268.120ms - RowsProduced: 37.69M (37688135) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.376ms - TotalStorageWaitTime: 7s737ms CodeGen:(Total: 568.30ms, non-child: 568.30ms, % non-child: 100.00%) - CodegenTime: 2.804ms - CompileTime: 304.624ms - LoadTime: 262.46ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s617ms, non-child: 27s617ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1632222610) - NetworkThroughput(*): 27.47 MB/sec - OverallThroughput: 56.36 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s799ms - ThriftTransmitTime(*): 56s659ms - UncompressedRowBatchSize: 3.42 GB (3667064566) AGGREGATION_NODE (id=1):(Total: 2m19s, non-child: 2m17s, % non-child: 98.85%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m8s - GetNewBlockTime: 38.742ms - GetResultsTime: 3s705ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261273448) - PinTime: 623.921ms - RowsRepartitioned: 6.57M (6565974) - RowsReturned: 37.69M (37688135) - RowsReturnedRate: 270.83 K/sec - SpilledPartitions: 1 - UnpinTime: 188.225us HDFS_SCAN_NODE (id=0):(Total: 1s598ms, non-child: 1s598ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:12/531.74 MB 1:13/875.89 MB 4:17/826.69 MB 7:20/1023.30 MB 2:11/544.69 MB 11:18/755.12 MB 6:23/1009.57 MB 8:12/628.17 MB 5:10/545.09 MB 0:15/644.57 MB 3:13/628.73 MB 9:14/884.97 MB Hdfs Read Thread Concurrency Bucket: 0:98.85% 1:1.154% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:344 ExecOption: Codegen enabled: 0 out of 178 BytesRead(4s000ms): 360.95 MB, 412.51 MB, 443.00 MB, 525.57 MB, 587.88 MB, 754.17 MB, 875.05 MB, 898.49 MB, 918.39 MB, 980.87 MB, 1.03 GB, 1.18 GB, 1.24 GB, 1.34 GB, 1.42 GB, 1.46 GB, 1.53 GB, 1.61 GB, 1.70 GB, 1.80 GB, 1.85 GB, 1.90 GB, 1.95 GB, 2.07 GB, 2.12 GB, 2.17 GB, 2.24 GB, 2.33 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.33 - BytesRead: 2.38 GB (2560273183) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.38 GB (2560273183) - BytesReadShortCircuit: 2.38 GB (2560273183) - DecompressionTime: 14s464ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 759.10 MB (795969832) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RowsRead: 210.24M (210243066) - RowsReturned: 210.24M (210243066) - RowsReturnedRate: 131.50 M/sec - ScanRangesComplete: 178 - ScannerThreadsInvoluntaryContextSwitches: 573 - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s548ms - ScannerThreadsUserTime: 53s115ms - ScannerThreadsVoluntaryContextSwitches: 205.88K (205878) - TotalRawHdfsReadTime(*): 1s660ms - TotalReadThroughput: 18.71 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232fa (host=atlas-ch2-56.sys.comcast.net:22000):(Total: 2m51s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:11/710.84 MB 6:9/482.95 MB 7:16/882.71 MB 3:14/793.34 MB 9:13/640.95 MB 10:14/845.74 MB 4:14/830.16 MB 2:15/855.88 MB 11:9/369.31 MB 1:17/754.23 MB 0:16/889.97 MB 5:17/966.00 MB MemoryUsage(4s000ms): 1.27 GB, 1.94 GB, 2.39 GB, 3.00 GB, 3.12 GB, 3.39 GB, 3.52 GB, 4.00 GB, 4.11 GB, 4.29 GB, 4.48 GB, 4.51 GB, 4.60 GB, 4.72 GB, 4.72 GB, 4.69 GB, 4.66 GB, 4.85 GB, 4.89 GB, 4.86 GB, 4.86 GB, 4.89 GB, 4.89 GB, 5.02 GB, 5.19 GB, 5.39 GB, 5.36 GB, 5.32 GB, 5.31 GB, 5.25 GB, 5.13 GB, 4.99 GB, 4.85 GB, 4.64 GB, 4.17 GB, 3.59 GB, 2.99 GB, 2.47 GB, 1.89 GB, 1.35 GB, 845.29 MB, 467.58 MB, 659.83 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 30, 24, 18, 10, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.38 - PeakMemoryUsage: 5.41 GB (5812261064) - PerHostPeakMemUsage: 5.63 GB (6043483048) - PrepareTime: 267.761ms - RowsProduced: 37.42M (37416174) - TotalCpuTime: 1h15m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.29ms - TotalStorageWaitTime: 8s007ms CodeGen:(Total: 567.653ms, non-child: 567.653ms, % non-child: 100.00%) - CodegenTime: 2.841ms - CompileTime: 304.586ms - LoadTime: 261.725ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s379ms, non-child: 29s379ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1620586035) - NetworkThroughput(*): 28.66 MB/sec - OverallThroughput: 52.61 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s649ms - ThriftTransmitTime(*): 53s918ms - UncompressedRowBatchSize: 3.39 GB (3640485075) AGGREGATION_NODE (id=1):(Total: 2m22s, non-child: 2m20s, % non-child: 98.91%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m11s - GetNewBlockTime: 34.965ms - GetResultsTime: 3s787ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 590.377ms - RowsRepartitioned: 6.66M (6663737) - RowsReturned: 37.42M (37416174) - RowsReturnedRate: 263.28 K/sec - SpilledPartitions: 1 - UnpinTime: 31.395us HDFS_SCAN_NODE (id=0):(Total: 1s552ms, non-child: 1s552ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:11/710.84 MB 6:9/482.95 MB 7:16/882.71 MB 3:14/793.34 MB 9:13/640.95 MB 10:14/845.74 MB 4:14/830.16 MB 2:15/855.88 MB 11:9/369.31 MB 1:17/754.23 MB 0:16/889.97 MB 5:17/966.00 MB Hdfs Read Thread Concurrency Bucket: 0:99.63% 1:0.3745% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:11 PARQUET/SNAPPY:308 ExecOption: Codegen enabled: 0 out of 165 BytesRead(4s000ms): 391.91 MB, 447.89 MB, 447.91 MB, 608.56 MB, 661.02 MB, 757.41 MB, 826.84 MB, 892.91 MB, 971.10 MB, 1.11 GB, 1.20 GB, 1.34 GB, 1.40 GB, 1.44 GB, 1.51 GB, 1.56 GB, 1.61 GB, 1.64 GB, 1.74 GB, 1.79 GB, 1.86 GB, 1.96 GB, 2.07 GB, 2.14 GB, 2.17 GB, 2.25 GB, 2.30 GB, 2.35 GB, 2.39 GB, 2.41 GB, 2.41 GB, 2.41 GB, 2.41 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.70 - BytesRead: 2.41 GB (2593056928) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2593056928) - BytesReadShortCircuit: 2.41 GB (2593056928) - DecompressionTime: 11s921ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 876.45 MB (919022824) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RowsRead: 213.46M (213462901) - RowsReturned: 213.46M (213462901) - RowsReturnedRate: 137.50 M/sec - ScanRangesComplete: 165 - ScannerThreadsInvoluntaryContextSwitches: 555 - ScannerThreadsTotalWallClockTime: 1h12m - MaterializeTupleTime(*): 1h12m - ScannerThreadsSysTime: 1s928ms - ScannerThreadsUserTime: 46s792ms - ScannerThreadsVoluntaryContextSwitches: 209.01K (209008) - TotalRawHdfsReadTime(*): 2s001ms - TotalReadThroughput: 18.45 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232dc (host=atlas-ch2-47.sys.comcast.net:22000):(Total: 2m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:16/674.20 MB 9:11/515.63 MB 1:13/929.20 MB 8:15/797.00 MB 4:7/300.82 MB 3:13/871.19 MB 6:13/758.96 MB 2:18/981.60 MB 11:16/1.00 GB 10:15/683.77 MB 0:12/633.03 MB 5:15/806.84 MB MemoryUsage(4s000ms): 1.21 GB, 2.02 GB, 2.55 GB, 2.99 GB, 3.08 GB, 3.37 GB, 3.50 GB, 4.05 GB, 4.14 GB, 4.30 GB, 4.41 GB, 4.43 GB, 4.47 GB, 4.62 GB, 4.66 GB, 4.66 GB, 4.66 GB, 4.76 GB, 4.87 GB, 4.89 GB, 4.92 GB, 4.91 GB, 4.92 GB, 4.91 GB, 5.07 GB, 5.34 GB, 5.40 GB, 5.33 GB, 5.18 GB, 5.02 GB, 4.90 GB, 4.77 GB, 4.54 GB, 3.93 GB, 3.29 GB, 2.70 GB, 2.04 GB, 1.42 GB, 826.11 MB, 466.78 MB, 786.83 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 23, 16, 11, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.74 - PeakMemoryUsage: 5.44 GB (5841303064) - PerHostPeakMemUsage: 5.63 GB (6047811952) - PrepareTime: 276.807ms - RowsProduced: 37.49M (37485074) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.190ms - TotalStorageWaitTime: 7s247ms CodeGen:(Total: 545.627ms, non-child: 545.627ms, % non-child: 100.00%) - CodegenTime: 2.833ms - CompileTime: 273.476ms - LoadTime: 270.871ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s919ms, non-child: 26s919ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1623352588) - NetworkThroughput(*): 28.21 MB/sec - OverallThroughput: 57.51 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s352ms - ThriftTransmitTime(*): 54s887ms - UncompressedRowBatchSize: 3.40 GB (3647192278) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m16s, % non-child: 98.96%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 34.669ms - GetResultsTime: 3s553ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 672.583ms - RowsRepartitioned: 6.61M (6611162) - RowsReturned: 37.49M (37485074) - RowsReturnedRate: 271.36 K/sec - SpilledPartitions: 1 - UnpinTime: 30.610us HDFS_SCAN_NODE (id=0):(Total: 1s439ms, non-child: 1s439ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:16/674.20 MB 9:11/515.63 MB 1:13/929.20 MB 8:15/797.00 MB 4:7/300.82 MB 3:13/871.19 MB 6:13/758.96 MB 2:18/981.60 MB 11:16/1.00 GB 10:15/683.77 MB 0:12/633.03 MB 5:15/806.84 MB Hdfs Read Thread Concurrency Bucket: 0:98.83% 1:1.167% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:310 ExecOption: Codegen enabled: 0 out of 164 BytesRead(4s000ms): 443.03 MB, 490.08 MB, 514.90 MB, 567.39 MB, 596.62 MB, 757.53 MB, 810.84 MB, 846.97 MB, 1.01 GB, 1.09 GB, 1.18 GB, 1.24 GB, 1.26 GB, 1.36 GB, 1.50 GB, 1.54 GB, 1.60 GB, 1.65 GB, 1.73 GB, 1.84 GB, 1.92 GB, 1.99 GB, 2.08 GB, 2.11 GB, 2.18 GB, 2.31 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.86 - BytesRead: 2.41 GB (2582819321) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2582819321) - BytesReadShortCircuit: 2.41 GB (2582819321) - DecompressionTime: 12s759ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 805.50 MB (844625240) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RowsRead: 211.82M (211823773) - RowsReturned: 211.82M (211823773) - RowsReturnedRate: 147.13 M/sec - ScanRangesComplete: 164 - ScannerThreadsInvoluntaryContextSwitches: 435 - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s638ms - ScannerThreadsUserTime: 48s500ms - ScannerThreadsVoluntaryContextSwitches: 207.43K (207427) - TotalRawHdfsReadTime(*): 1s814ms - TotalReadThroughput: 19.17 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ec (host=atlas-ch2-63.sys.comcast.net:22000):(Total: 2m51s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:15/784.74 MB 6:14/967.97 MB 10:18/950.66 MB 1:20/961.82 MB 5:12/679.44 MB 0:8/455.80 MB 3:19/868.96 MB 8:14/750.17 MB 7:18/830.03 MB 11:12/535.92 MB 2:14/689.45 MB 9:9/456.52 MB MemoryUsage(4s000ms): 1.14 GB, 1.97 GB, 2.42 GB, 2.97 GB, 3.09 GB, 3.29 GB, 3.53 GB, 3.83 GB, 4.10 GB, 4.12 GB, 4.32 GB, 4.34 GB, 4.36 GB, 4.50 GB, 4.62 GB, 4.61 GB, 4.59 GB, 4.59 GB, 4.87 GB, 4.91 GB, 4.92 GB, 4.92 GB, 4.91 GB, 4.91 GB, 5.14 GB, 5.37 GB, 5.33 GB, 5.31 GB, 5.31 GB, 5.29 GB, 5.23 GB, 5.09 GB, 4.93 GB, 4.76 GB, 4.51 GB, 3.97 GB, 3.37 GB, 2.71 GB, 2.10 GB, 1.44 GB, 826.00 MB, 468.56 MB, 650.50 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 24, 16, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 27.05 - PeakMemoryUsage: 5.39 GB (5785215536) - PerHostPeakMemUsage: 5.66 GB (6075675648) - PrepareTime: 288.500ms - RowsProduced: 37.52M (37522079) - TotalCpuTime: 1h17m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 50.970ms - TotalStorageWaitTime: 7s646ms CodeGen:(Total: 620.772ms, non-child: 620.772ms, % non-child: 100.00%) - CodegenTime: 2.755ms - CompileTime: 336.862ms - LoadTime: 282.657ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s911ms, non-child: 26s911ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1624858397) - NetworkThroughput(*): 28.99 MB/sec - OverallThroughput: 57.58 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s433ms - ThriftTransmitTime(*): 53s443ms - UncompressedRowBatchSize: 3.40 GB (3650963042) AGGREGATION_NODE (id=1):(Total: 2m24s, non-child: 2m22s, % non-child: 98.98%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m14s - GetNewBlockTime: 31.11ms - GetResultsTime: 3s602ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 593.793ms - RowsRepartitioned: 6.60M (6601604) - RowsReturned: 37.52M (37522079) - RowsReturnedRate: 260.04 K/sec - SpilledPartitions: 1 - UnpinTime: 32.299us HDFS_SCAN_NODE (id=0):(Total: 1s476ms, non-child: 1s476ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/784.74 MB 6:14/967.97 MB 10:18/950.66 MB 1:20/961.82 MB 5:12/679.44 MB 0:8/455.80 MB 3:19/868.96 MB 8:14/750.17 MB 7:18/830.03 MB 11:12/535.92 MB 2:14/689.45 MB 9:9/456.52 MB Hdfs Read Thread Concurrency Bucket: 0:99.63% 1:0.3676% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:8 PARQUET/SNAPPY:330 ExecOption: Codegen enabled: 0 out of 173 BytesRead(4s000ms): 413.61 MB, 480.34 MB, 505.99 MB, 585.28 MB, 636.78 MB, 744.01 MB, 841.05 MB, 862.75 MB, 943.78 MB, 1.02 GB, 1.04 GB, 1.14 GB, 1.24 GB, 1.30 GB, 1.39 GB, 1.43 GB, 1.49 GB, 1.61 GB, 1.74 GB, 1.78 GB, 1.87 GB, 1.91 GB, 2.01 GB, 2.07 GB, 2.12 GB, 2.15 GB, 2.18 GB, 2.25 GB, 2.31 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.94 - BytesRead: 2.40 GB (2571672956) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2571672956) - BytesReadShortCircuit: 2.40 GB (2571672956) - DecompressionTime: 12s413ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 793.93 MB (832500264) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RowsRead: 211.39M (211390632) - RowsReturned: 211.39M (211390632) - RowsReturnedRate: 143.18 M/sec - ScanRangesComplete: 173 - ScannerThreadsInvoluntaryContextSwitches: 425 - ScannerThreadsTotalWallClockTime: 1h14m - MaterializeTupleTime(*): 1h14m - ScannerThreadsSysTime: 1s770ms - ScannerThreadsUserTime: 47s311ms - ScannerThreadsVoluntaryContextSwitches: 206.98K (206977) - TotalRawHdfsReadTime(*): 1s966ms - TotalReadThroughput: 18.03 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d0 (host=atlas-ch2-62.sys.comcast.net:22000):(Total: 2m47s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:15/998.04 MB 3:15/733.20 MB 4:11/634.12 MB 6:11/368.04 MB 10:15/816.90 MB 0:18/820.43 MB 5:11/751.76 MB 7:14/736.04 MB 11:16/668.87 MB 2:18/934.66 MB 8:16/673.42 MB 9:17/978.09 MB MemoryUsage(4s000ms): 1.35 GB, 2.01 GB, 2.47 GB, 3.01 GB, 3.13 GB, 3.36 GB, 3.47 GB, 3.93 GB, 4.06 GB, 4.25 GB, 4.38 GB, 4.41 GB, 4.52 GB, 4.62 GB, 4.62 GB, 4.58 GB, 4.61 GB, 4.80 GB, 4.87 GB, 4.89 GB, 4.93 GB, 4.91 GB, 4.92 GB, 5.07 GB, 5.37 GB, 5.38 GB, 5.36 GB, 5.37 GB, 5.31 GB, 5.15 GB, 5.00 GB, 4.83 GB, 4.85 GB, 4.71 GB, 4.02 GB, 3.39 GB, 2.74 GB, 2.05 GB, 1.42 GB, 788.42 MB, 515.91 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 24, 15, 7, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.21 - PeakMemoryUsage: 5.41 GB (5806016216) - PerHostPeakMemUsage: 5.68 GB (6096399808) - PrepareTime: 190.565ms - RowsProduced: 37.79M (37786117) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 57.523ms - TotalStorageWaitTime: 3s430ms CodeGen:(Total: 456.345ms, non-child: 456.345ms, % non-child: 100.00%) - CodegenTime: 2.346ms - CompileTime: 269.740ms - LoadTime: 185.225ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s698ms, non-child: 26s698ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1636526390) - NetworkThroughput(*): 27.91 MB/sec - OverallThroughput: 58.46 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s225ms - ThriftTransmitTime(*): 55s910ms - UncompressedRowBatchSize: 3.42 GB (3676571321) AGGREGATION_NODE (id=1):(Total: 2m20s, non-child: 2m19s, % non-child: 99.01%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m10s - GetNewBlockTime: 34.426ms - GetResultsTime: 3s557ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265481720) - PinTime: 688.133ms - RowsRepartitioned: 6.70M (6704896) - RowsReturned: 37.79M (37786117) - RowsReturnedRate: 268.83 K/sec - SpilledPartitions: 1 - UnpinTime: 28.798us HDFS_SCAN_NODE (id=0):(Total: 1s384ms, non-child: 1s384ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:15/998.04 MB 3:15/733.20 MB 4:11/634.12 MB 6:11/368.04 MB 10:15/816.90 MB 0:18/820.43 MB 5:11/751.76 MB 7:14/736.04 MB 11:16/668.87 MB 2:18/934.66 MB 8:16/673.42 MB 9:17/978.09 MB Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:326 ExecOption: Codegen enabled: 0 out of 177 BytesRead(4s000ms): 418.67 MB, 487.85 MB, 503.17 MB, 608.94 MB, 649.60 MB, 712.80 MB, 759.31 MB, 792.43 MB, 915.83 MB, 1.06 GB, 1.10 GB, 1.24 GB, 1.31 GB, 1.36 GB, 1.41 GB, 1.45 GB, 1.55 GB, 1.64 GB, 1.71 GB, 1.79 GB, 1.92 GB, 2.00 GB, 2.05 GB, 2.12 GB, 2.20 GB, 2.25 GB, 2.28 GB, 2.34 GB, 2.39 GB, 2.40 GB, 2.40 GB, 2.41 GB, 2.44 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 31.99 - BytesRead: 2.44 GB (2621071541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 GB (2621071541) - BytesReadShortCircuit: 2.44 GB (2621071541) - DecompressionTime: 10s785ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 806.81 MB (846004120) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RowsRead: 214.76M (214762271) - RowsReturned: 214.76M (214762271) - RowsReturnedRate: 155.07 M/sec - ScanRangesComplete: 177 - ScannerThreadsInvoluntaryContextSwitches: 28.11K (28110) - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s563ms - ScannerThreadsUserTime: 43s093ms - ScannerThreadsVoluntaryContextSwitches: 210.51K (210507) - TotalRawHdfsReadTime(*): 1s998ms - TotalReadThroughput: 18.87 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232db (host=atlas-ch2-13.sys.comcast.net:22000):(Total: 2m47s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:9/644.15 MB 5:10/567.37 MB 4:12/695.78 MB 9:15/841.02 MB 1:15/724.39 MB 10:18/864.33 MB 7:18/817.49 MB 8:17/888.99 MB 2:18/840.33 MB 11:12/773.70 MB 3:12/616.56 MB 6:12/680.52 MB MemoryUsage(4s000ms): 1.19 GB, 2.09 GB, 2.67 GB, 3.11 GB, 3.23 GB, 3.46 GB, 3.54 GB, 4.09 GB, 4.10 GB, 4.26 GB, 4.36 GB, 4.36 GB, 4.49 GB, 4.63 GB, 4.67 GB, 4.64 GB, 4.67 GB, 4.89 GB, 4.93 GB, 4.95 GB, 4.99 GB, 4.96 GB, 4.94 GB, 5.15 GB, 5.35 GB, 5.41 GB, 5.41 GB, 5.41 GB, 5.35 GB, 5.24 GB, 5.04 GB, 4.92 GB, 4.83 GB, 4.81 GB, 4.17 GB, 3.52 GB, 2.84 GB, 2.21 GB, 1.54 GB, 889.19 MB, 439.27 MB, 732.67 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 28, 17, 11, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.45 - PeakMemoryUsage: 5.44 GB (5842199104) - PerHostPeakMemUsage: 5.68 GB (6094394992) - PrepareTime: 243.944ms - RowsProduced: 37.79M (37791815) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 58.673ms - TotalStorageWaitTime: 5s856ms CodeGen:(Total: 523.823ms, non-child: 523.823ms, % non-child: 100.00%) - CodegenTime: 2.906ms - CompileTime: 284.659ms - LoadTime: 237.727ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s682ms, non-child: 26s682ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1636624425) - NetworkThroughput(*): 27.63 MB/sec - OverallThroughput: 58.50 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s298ms - ThriftTransmitTime(*): 56s490ms - UncompressedRowBatchSize: 3.42 GB (3677269985) AGGREGATION_NODE (id=1):(Total: 2m20s, non-child: 2m19s, % non-child: 99.02%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m10s - GetNewBlockTime: 35.658ms - GetResultsTime: 3s541ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261281200) - PinTime: 611.203ms - RowsRepartitioned: 6.65M (6652437) - RowsReturned: 37.79M (37791815) - RowsReturnedRate: 268.27 K/sec - SpilledPartitions: 1 - UnpinTime: 191.331us HDFS_SCAN_NODE (id=0):(Total: 1s385ms, non-child: 1s385ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:9/644.15 MB 5:10/567.37 MB 4:12/695.78 MB 9:15/841.02 MB 1:15/724.39 MB 10:18/864.33 MB 7:18/817.49 MB 8:17/888.99 MB 2:18/840.33 MB 11:12/773.70 MB 3:12/616.56 MB 6:12/680.52 MB Hdfs Read Thread Concurrency Bucket: 0:98.12% 1:1.504% 2:0% 3:0% 4:0% 5:0% 6:0.3759% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:7 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 168 BytesRead(4s000ms): 457.78 MB, 541.51 MB, 602.88 MB, 674.89 MB, 686.45 MB, 747.35 MB, 815.39 MB, 874.96 MB, 981.90 MB, 1.01 GB, 1.09 GB, 1.19 GB, 1.23 GB, 1.34 GB, 1.47 GB, 1.50 GB, 1.54 GB, 1.67 GB, 1.79 GB, 1.85 GB, 1.96 GB, 2.00 GB, 2.04 GB, 2.10 GB, 2.16 GB, 2.23 GB, 2.29 GB, 2.36 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 32.15 - BytesRead: 2.40 GB (2579753906) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2579753906) - BytesReadShortCircuit: 2.40 GB (2579753906) - DecompressionTime: 12s549ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 851.97 MB (893359512) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RowsRead: 212.84M (212842691) - RowsReturned: 212.84M (212842691) - RowsReturnedRate: 153.59 M/sec - ScanRangesComplete: 168 - ScannerThreadsInvoluntaryContextSwitches: 525 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s792ms - ScannerThreadsUserTime: 47s435ms - ScannerThreadsVoluntaryContextSwitches: 208.41K (208414) - TotalRawHdfsReadTime(*): 1s741ms - TotalReadThroughput: 18.50 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e2 (host=atlas-ch2-07.sys.comcast.net:22000):(Total: 2m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:11/575.68 MB 9:12/621.22 MB 7:17/688.33 MB 8:12/528.07 MB 1:13/603.62 MB 6:21/1.34 GB 5:11/515.71 MB 0:13/633.41 MB 10:18/928.93 MB 11:14/870.89 MB 2:14/1.06 GB 4:10/553.33 MB MemoryUsage(4s000ms): 1.32 GB, 1.97 GB, 2.43 GB, 2.97 GB, 3.13 GB, 3.35 GB, 3.51 GB, 4.03 GB, 4.11 GB, 4.22 GB, 4.37 GB, 4.36 GB, 4.53 GB, 4.63 GB, 4.64 GB, 4.63 GB, 4.63 GB, 4.83 GB, 4.87 GB, 4.87 GB, 4.91 GB, 4.95 GB, 4.95 GB, 4.95 GB, 5.15 GB, 5.36 GB, 5.39 GB, 5.40 GB, 5.33 GB, 5.18 GB, 5.04 GB, 4.88 GB, 4.71 GB, 4.27 GB, 3.67 GB, 2.99 GB, 2.40 GB, 1.76 GB, 1.12 GB, 481.34 MB, 705.95 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 26, 19, 10, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.59 - PeakMemoryUsage: 5.43 GB (5832758136) - PerHostPeakMemUsage: 5.63 GB (6043266744) - PrepareTime: 250.612ms - RowsProduced: 37.41M (37410172) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 58.782ms - TotalStorageWaitTime: 5s386ms CodeGen:(Total: 517.710ms, non-child: 517.710ms, % non-child: 100.00%) - CodegenTime: 2.905ms - CompileTime: 271.989ms - LoadTime: 244.340ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s404ms, non-child: 26s404ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1619930162) - NetworkThroughput(*): 27.83 MB/sec - OverallThroughput: 58.51 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s086ms - ThriftTransmitTime(*): 55s517ms - UncompressedRowBatchSize: 3.39 GB (3639837348) AGGREGATION_NODE (id=1):(Total: 2m19s, non-child: 2m17s, % non-child: 99.03%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m9s - GetNewBlockTime: 32.377ms - GetResultsTime: 3s518ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 597.578ms - RowsRepartitioned: 6.64M (6638487) - RowsReturned: 37.41M (37410172) - RowsReturnedRate: 268.94 K/sec - SpilledPartitions: 1 - UnpinTime: 30.509us HDFS_SCAN_NODE (id=0):(Total: 1s355ms, non-child: 1s355ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:11/575.68 MB 9:12/621.22 MB 7:17/688.33 MB 8:12/528.07 MB 1:13/603.62 MB 6:21/1.34 GB 5:11/515.71 MB 0:13/633.41 MB 10:18/928.93 MB 11:14/870.89 MB 2:14/1.06 GB 4:10/553.33 MB Hdfs Read Thread Concurrency Bucket: 0:99.24% 1:0.7634% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:314 ExecOption: Codegen enabled: 0 out of 166 BytesRead(4s000ms): 392.92 MB, 460.45 MB, 466.29 MB, 533.60 MB, 635.10 MB, 684.01 MB, 797.73 MB, 916.13 MB, 970.02 MB, 1.02 GB, 1.10 GB, 1.19 GB, 1.25 GB, 1.33 GB, 1.41 GB, 1.50 GB, 1.55 GB, 1.62 GB, 1.69 GB, 1.78 GB, 1.89 GB, 2.01 GB, 2.07 GB, 2.13 GB, 2.16 GB, 2.23 GB, 2.31 GB, 2.38 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.42 - BytesRead: 2.41 GB (2583859074) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2583859074) - BytesReadShortCircuit: 2.41 GB (2583859074) - DecompressionTime: 11s325ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 830.35 MB (870686736) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RowsRead: 212.48M (212481152) - RowsReturned: 212.48M (212481152) - RowsReturnedRate: 156.80 M/sec - ScanRangesComplete: 166 - ScannerThreadsInvoluntaryContextSwitches: 576 - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s795ms - ScannerThreadsUserTime: 44s944ms - ScannerThreadsVoluntaryContextSwitches: 208.09K (208093) - TotalRawHdfsReadTime(*): 1s845ms - TotalReadThroughput: 18.74 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ff (host=atlas-ch2-28.sys.comcast.net:22000):(Total: 2m49s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:8/508.69 MB 1:16/815.93 MB 8:14/549.69 MB 9:15/807.69 MB 5:14/694.68 MB 0:17/1.00 GB 2:12/552.70 MB 11:12/595.72 MB 3:17/954.42 MB 10:9/636.03 MB 4:21/1.08 GB 7:14/703.19 MB MemoryUsage(4s000ms): 1.14 GB, 2.01 GB, 2.60 GB, 3.08 GB, 3.18 GB, 3.49 GB, 3.60 GB, 4.10 GB, 4.14 GB, 4.32 GB, 4.36 GB, 4.43 GB, 4.58 GB, 4.60 GB, 4.58 GB, 4.55 GB, 4.58 GB, 4.80 GB, 4.81 GB, 4.84 GB, 4.84 GB, 4.87 GB, 5.00 GB, 5.22 GB, 5.37 GB, 5.39 GB, 5.36 GB, 5.34 GB, 5.26 GB, 5.13 GB, 5.00 GB, 4.78 GB, 4.48 GB, 3.85 GB, 3.29 GB, 2.77 GB, 2.21 GB, 1.70 GB, 1.16 GB, 634.53 MB, 507.47 MB, 787.10 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 28, 20, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.04 - PeakMemoryUsage: 5.42 GB (5818720272) - PerHostPeakMemUsage: 5.62 GB (6033162256) - PrepareTime: 260.759ms - RowsProduced: 37.32M (37320488) - TotalCpuTime: 1h13m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 52.753ms - TotalStorageWaitTime: 7s356ms CodeGen:(Total: 538.773ms, non-child: 538.773ms, % non-child: 100.00%) - CodegenTime: 2.906ms - CompileTime: 282.778ms - LoadTime: 254.578ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s391ms, non-child: 29s391ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1616376702) - NetworkThroughput(*): 30.28 MB/sec - OverallThroughput: 52.45 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 11s980ms - ThriftTransmitTime(*): 50s899ms - UncompressedRowBatchSize: 3.38 GB (3631148987) AGGREGATION_NODE (id=1):(Total: 2m19s, non-child: 2m18s, % non-child: 98.95%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 31.406ms - GetResultsTime: 4s871ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005500368) - PinTime: 735.96ms - RowsRepartitioned: 6.60M (6600333) - RowsReturned: 37.32M (37320488) - RowsReturnedRate: 267.03 K/sec - SpilledPartitions: 1 - UnpinTime: 28.943us HDFS_SCAN_NODE (id=0):(Total: 1s468ms, non-child: 1s468ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:8/508.69 MB 1:16/815.93 MB 8:14/549.69 MB 9:15/807.69 MB 5:14/694.68 MB 0:17/1.00 GB 2:12/552.70 MB 11:12/595.72 MB 3:17/954.42 MB 10:9/636.03 MB 4:21/1.08 GB 7:14/703.19 MB Hdfs Read Thread Concurrency Bucket: 0:98.44% 1:1.562% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:332 ExecOption: Codegen enabled: 0 out of 169 BytesRead(4s000ms): 411.51 MB, 481.50 MB, 551.35 MB, 657.83 MB, 671.98 MB, 810.23 MB, 841.79 MB, 864.44 MB, 1012.54 MB, 1.04 GB, 1.11 GB, 1.25 GB, 1.29 GB, 1.33 GB, 1.38 GB, 1.46 GB, 1.54 GB, 1.59 GB, 1.67 GB, 1.80 GB, 1.87 GB, 1.97 GB, 2.05 GB, 2.11 GB, 2.22 GB, 2.28 GB, 2.32 GB, 2.36 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 33.16 - BytesRead: 2.40 GB (2577677418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2577677418) - BytesReadShortCircuit: 2.40 GB (2577677418) - DecompressionTime: 13s397ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 809.58 MB (848905192) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RowsRead: 211.34M (211344106) - RowsReturned: 211.34M (211344106) - RowsReturnedRate: 143.91 M/sec - ScanRangesComplete: 169 - ScannerThreadsInvoluntaryContextSwitches: 544 - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h10m - ScannerThreadsSysTime: 1s840ms - ScannerThreadsUserTime: 51s191ms - ScannerThreadsVoluntaryContextSwitches: 206.94K (206935) - TotalRawHdfsReadTime(*): 1s913ms - TotalReadThroughput: 19.21 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ee (host=atlas-ch2-44.sys.comcast.net:22000):(Total: 2m47s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:15/737.82 MB 9:14/732.99 MB 11:8/567.92 MB 2:11/635.85 MB 1:13/1.29 GB 7:11/612.67 MB 10:16/950.38 MB 3:12/781.98 MB 5:15/860.40 MB 0:10/591.31 MB 8:9/345.77 MB 6:18/998.49 MB MemoryUsage(4s000ms): 1.45 GB, 2.11 GB, 2.57 GB, 3.08 GB, 3.08 GB, 3.23 GB, 3.52 GB, 3.70 GB, 4.13 GB, 4.20 GB, 4.42 GB, 4.46 GB, 4.47 GB, 4.58 GB, 4.68 GB, 4.67 GB, 4.67 GB, 4.66 GB, 4.84 GB, 4.89 GB, 4.88 GB, 4.85 GB, 4.90 GB, 4.93 GB, 5.03 GB, 5.33 GB, 5.44 GB, 5.37 GB, 5.22 GB, 5.07 GB, 4.96 GB, 4.81 GB, 4.83 GB, 4.65 GB, 3.98 GB, 3.31 GB, 2.68 GB, 2.01 GB, 1.34 GB, 707.92 MB, 571.64 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 24, 19, 12, 5, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.68 - PeakMemoryUsage: 5.48 GB (5886442864) - PerHostPeakMemUsage: 5.68 GB (6098527040) - PrepareTime: 281.724ms - RowsProduced: 37.73M (37730316) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 61.590ms - TotalStorageWaitTime: 7s764ms CodeGen:(Total: 566.919ms, non-child: 566.919ms, % non-child: 100.00%) - CodegenTime: 2.920ms - CompileTime: 289.888ms - LoadTime: 275.727ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s818ms, non-child: 26s818ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1634137517) - NetworkThroughput(*): 27.96 MB/sec - OverallThroughput: 58.11 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s387ms - ThriftTransmitTime(*): 55s740ms - UncompressedRowBatchSize: 3.42 GB (3671163850) AGGREGATION_NODE (id=1):(Total: 2m20s, non-child: 2m18s, % non-child: 98.87%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m9s - GetNewBlockTime: 37.735ms - GetResultsTime: 3s546ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261251344) - PinTime: 633.222ms - RowsRepartitioned: 6.75M (6746978) - RowsReturned: 37.73M (37730316) - RowsReturnedRate: 268.82 K/sec - SpilledPartitions: 1 - UnpinTime: 201.580us HDFS_SCAN_NODE (id=0):(Total: 1s586ms, non-child: 1s586ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/737.82 MB 9:14/732.99 MB 11:8/567.92 MB 2:11/635.85 MB 1:13/1.29 GB 7:11/612.67 MB 10:16/950.38 MB 3:12/781.98 MB 5:15/860.40 MB 0:10/591.31 MB 8:9/345.77 MB 6:18/998.49 MB Hdfs Read Thread Concurrency Bucket: 0:99.24% 1:0.7605% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:286 ExecOption: Codegen enabled: 0 out of 152 BytesRead(4s000ms): 516.52 MB, 590.31 MB, 594.94 MB, 633.71 MB, 646.30 MB, 679.20 MB, 787.29 MB, 834.15 MB, 896.79 MB, 1.07 GB, 1.14 GB, 1.22 GB, 1.30 GB, 1.34 GB, 1.44 GB, 1.52 GB, 1.57 GB, 1.67 GB, 1.72 GB, 1.78 GB, 1.83 GB, 1.88 GB, 2.02 GB, 2.11 GB, 2.17 GB, 2.29 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.40 GB, 2.41 GB, 2.44 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.44 - BytesRead: 2.44 GB (2624968399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 GB (2624968399) - BytesReadShortCircuit: 2.44 GB (2624968399) - DecompressionTime: 13s550ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 844.52 MB (885545656) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RowsRead: 216.00M (216004729) - RowsReturned: 216.00M (216004729) - RowsReturnedRate: 136.13 M/sec - ScanRangesComplete: 152 - ScannerThreadsInvoluntaryContextSwitches: 495 - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s712ms - ScannerThreadsUserTime: 49s570ms - ScannerThreadsVoluntaryContextSwitches: 211.44K (211439) - TotalRawHdfsReadTime(*): 1s969ms - TotalReadThroughput: 18.96 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d4 (host=atlas-ch2-45.sys.comcast.net:22000):(Total: 2m58s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:7/318.07 MB 10:13/650.45 MB 6:13/632.48 MB 7:10/495.42 MB 4:16/904.00 MB 11:14/928.08 MB 2:16/852.57 MB 1:11/622.98 MB 9:17/823.49 MB 5:18/1.09 GB 0:16/681.36 MB 8:17/905.91 MB MemoryUsage(4s000ms): 1.12 GB, 1.94 GB, 2.36 GB, 2.95 GB, 3.05 GB, 3.24 GB, 3.54 GB, 3.52 GB, 3.98 GB, 4.16 GB, 4.18 GB, 4.41 GB, 4.43 GB, 4.41 GB, 4.64 GB, 4.68 GB, 4.66 GB, 4.70 GB, 4.76 GB, 4.88 GB, 4.90 GB, 4.93 GB, 4.90 GB, 4.90 GB, 4.90 GB, 5.11 GB, 5.32 GB, 5.34 GB, 5.35 GB, 5.31 GB, 5.22 GB, 5.13 GB, 4.99 GB, 4.86 GB, 4.82 GB, 4.49 GB, 3.94 GB, 3.37 GB, 2.78 GB, 2.23 GB, 1.66 GB, 1.08 GB, 526.54 MB, 630.25 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 28, 24, 20, 11, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.15 - PeakMemoryUsage: 5.36 GB (5760572208) - PerHostPeakMemUsage: 5.73 GB (6150832432) - PrepareTime: 289.72ms - RowsProduced: 37.71M (37713039) - TotalCpuTime: 1h17m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 53.143ms - TotalStorageWaitTime: 6s512ms CodeGen:(Total: 661.74ms, non-child: 661.74ms, % non-child: 100.00%) - CodegenTime: 3.893ms - CompileTime: 378.358ms - LoadTime: 280.783ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 31s051ms, non-child: 31s051ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1633298843) - NetworkThroughput(*): 32.09 MB/sec - OverallThroughput: 50.16 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s315ms - ThriftTransmitTime(*): 48s544ms - UncompressedRowBatchSize: 3.42 GB (3669480750) AGGREGATION_NODE (id=1):(Total: 2m27s, non-child: 2m26s, % non-child: 99.02%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m16s - GetNewBlockTime: 34.22ms - GetResultsTime: 3s952ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261253024) - PinTime: 625.39ms - RowsRepartitioned: 6.62M (6619197) - RowsReturned: 37.71M (37713039) - RowsReturnedRate: 255.46 K/sec - SpilledPartitions: 1 - UnpinTime: 32.36us HDFS_SCAN_NODE (id=0):(Total: 1s453ms, non-child: 1s453ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:7/318.07 MB 10:13/650.45 MB 6:13/632.48 MB 7:10/495.42 MB 4:16/904.00 MB 11:14/928.08 MB 2:16/852.57 MB 1:11/622.98 MB 9:17/823.49 MB 5:18/1.09 GB 0:16/681.36 MB 8:17/905.91 MB Hdfs Read Thread Concurrency Bucket: 0:98.92% 1:1.083% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:324 ExecOption: Codegen enabled: 0 out of 168 BytesRead(4s000ms): 393.58 MB, 449.81 MB, 461.14 MB, 577.50 MB, 616.56 MB, 735.84 MB, 822.41 MB, 844.69 MB, 884.64 MB, 1.04 GB, 1.07 GB, 1.18 GB, 1.26 GB, 1.31 GB, 1.41 GB, 1.51 GB, 1.56 GB, 1.64 GB, 1.69 GB, 1.72 GB, 1.82 GB, 1.90 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.12 GB, 2.15 GB, 2.26 GB, 2.34 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.51 - BytesRead: 2.39 GB (2571125040) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2571125040) - BytesReadShortCircuit: 2.39 GB (2571125040) - DecompressionTime: 11s482ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 830.66 MB (871011000) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RowsRead: 211.81M (211810073) - RowsReturned: 211.81M (211810073) - RowsReturnedRate: 145.69 M/sec - ScanRangesComplete: 168 - ScannerThreadsInvoluntaryContextSwitches: 542 - ScannerThreadsTotalWallClockTime: 1h14m - MaterializeTupleTime(*): 1h14m - ScannerThreadsSysTime: 1s711ms - ScannerThreadsUserTime: 44s744ms - ScannerThreadsVoluntaryContextSwitches: 207.46K (207459) - TotalRawHdfsReadTime(*): 1s972ms - TotalReadThroughput: 17.70 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f0 (host=atlas-ch2-23.sys.comcast.net:22000):(Total: 2m56s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:13/715.68 MB 10:9/259.30 MB 9:16/1.01 GB 7:11/679.02 MB 8:9/427.56 MB 2:13/786.91 MB 11:14/562.41 MB 5:16/784.48 MB 0:18/1.16 GB 1:17/978.55 MB 4:20/858.51 MB 6:13/732.98 MB MemoryUsage(4s000ms): 1.15 GB, 1.99 GB, 2.44 GB, 2.99 GB, 3.08 GB, 3.30 GB, 3.51 GB, 3.83 GB, 4.09 GB, 4.15 GB, 4.38 GB, 4.40 GB, 4.38 GB, 4.53 GB, 4.59 GB, 4.59 GB, 4.63 GB, 4.77 GB, 4.91 GB, 4.90 GB, 4.92 GB, 4.94 GB, 4.91 GB, 5.01 GB, 5.24 GB, 5.39 GB, 5.42 GB, 5.45 GB, 5.42 GB, 5.35 GB, 5.20 GB, 5.06 GB, 4.95 GB, 4.79 GB, 4.92 GB, 4.57 GB, 4.00 GB, 3.43 GB, 2.86 GB, 2.29 GB, 1.71 GB, 1.07 GB, 405.70 MB, 786.24 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 25, 20, 12, 5, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.92 - PeakMemoryUsage: 5.47 GB (5874087888) - PerHostPeakMemUsage: 5.69 GB (6109148640) - PrepareTime: 286.79ms - RowsProduced: 37.83M (37832125) - TotalCpuTime: 1h16m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 58.338ms - TotalStorageWaitTime: 7s959ms CodeGen:(Total: 576.725ms, non-child: 576.725ms, % non-child: 100.00%) - CodegenTime: 2.844ms - CompileTime: 295.365ms - LoadTime: 280.9ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s537ms, non-child: 29s537ms, % non-child: 100.00%) - BytesSent: 1.53 GB (1638622846) - NetworkThroughput(*): 28.87 MB/sec - OverallThroughput: 52.91 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s725ms - ThriftTransmitTime(*): 54s131ms - UncompressedRowBatchSize: 3.43 GB (3681034105) AGGREGATION_NODE (id=1):(Total: 2m27s, non-child: 2m25s, % non-child: 98.82%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m16s - GetNewBlockTime: 41.544ms - GetResultsTime: 3s819ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 594.26ms - RowsRepartitioned: 6.64M (6643753) - RowsReturned: 37.83M (37832125) - RowsReturnedRate: 257.27 K/sec - SpilledPartitions: 1 - UnpinTime: 31.99us HDFS_SCAN_NODE (id=0):(Total: 1s732ms, non-child: 1s732ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:13/715.68 MB 10:9/259.30 MB 9:16/1.01 GB 7:11/679.02 MB 8:9/427.56 MB 2:13/786.91 MB 11:14/562.41 MB 5:16/784.48 MB 0:18/1.16 GB 1:17/978.55 MB 4:20/858.51 MB 6:13/732.98 MB Hdfs Read Thread Concurrency Bucket: 0:98.56% 1:1.444% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:306 ExecOption: Codegen enabled: 0 out of 169 BytesRead(4s000ms): 439.47 MB, 502.08 MB, 512.62 MB, 584.14 MB, 619.64 MB, 736.39 MB, 809.61 MB, 835.31 MB, 938.52 MB, 1.08 GB, 1.12 GB, 1.20 GB, 1.23 GB, 1.26 GB, 1.39 GB, 1.43 GB, 1.53 GB, 1.67 GB, 1.72 GB, 1.77 GB, 1.86 GB, 1.95 GB, 1.98 GB, 2.04 GB, 2.13 GB, 2.16 GB, 2.28 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.85 - BytesRead: 2.41 GB (2586288321) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2586288321) - BytesReadShortCircuit: 2.41 GB (2586288321) - DecompressionTime: 13s644ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 832.52 MB (872957208) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RowsRead: 212.69M (212689377) - RowsReturned: 212.69M (212689377) - RowsReturnedRate: 122.78 M/sec - ScanRangesComplete: 169 - ScannerThreadsInvoluntaryContextSwitches: 636 - ScannerThreadsTotalWallClockTime: 1h13m - MaterializeTupleTime(*): 1h12m - ScannerThreadsSysTime: 1s903ms - ScannerThreadsUserTime: 51s488ms - ScannerThreadsVoluntaryContextSwitches: 208.23K (208228) - TotalRawHdfsReadTime(*): 1s855ms - TotalReadThroughput: 17.81 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac23303 (host=atlas-ch2-43.sys.comcast.net:22000):(Total: 2m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:20/1.10 GB 1:14/709.08 MB 10:12/663.49 MB 4:14/910.78 MB 6:14/620.35 MB 0:12/696.66 MB 5:11/508.30 MB 7:17/746.81 MB 11:15/775.39 MB 2:15/815.92 MB 3:15/762.93 MB 9:9/573.15 MB MemoryUsage(4s000ms): 1.14 GB, 2.01 GB, 2.55 GB, 3.03 GB, 3.16 GB, 3.47 GB, 3.61 GB, 4.16 GB, 4.13 GB, 4.27 GB, 4.37 GB, 4.38 GB, 4.50 GB, 4.61 GB, 4.61 GB, 4.58 GB, 4.58 GB, 4.79 GB, 4.84 GB, 4.85 GB, 4.85 GB, 4.80 GB, 4.83 GB, 4.94 GB, 5.17 GB, 5.41 GB, 5.38 GB, 5.30 GB, 5.19 GB, 5.08 GB, 4.94 GB, 4.73 GB, 4.40 GB, 3.78 GB, 3.22 GB, 2.68 GB, 2.12 GB, 1.57 GB, 1.01 GB, 481.47 MB, 628.53 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 30, 27, 22, 15, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.62 - PeakMemoryUsage: 5.46 GB (5858338528) - PerHostPeakMemUsage: 5.66 GB (6072780512) - PrepareTime: 286.994ms - RowsProduced: 37.15M (37145411) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 66.406ms - TotalStorageWaitTime: 7s856ms CodeGen:(Total: 577.855ms, non-child: 577.855ms, % non-child: 100.00%) - CodegenTime: 2.944ms - CompileTime: 295.622ms - LoadTime: 280.882ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s946ms, non-child: 29s946ms, % non-child: 100.00%) - BytesSent: 1.50 GB (1608832405) - NetworkThroughput(*): 28.43 MB/sec - OverallThroughput: 51.24 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s086ms - ThriftTransmitTime(*): 53s964ms - UncompressedRowBatchSize: 3.37 GB (3614141691) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m15s, % non-child: 98.88%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 32.562ms - GetResultsTime: 3s850ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 629.645ms - RowsRepartitioned: 6.56M (6558071) - RowsReturned: 37.15M (37145411) - RowsReturnedRate: 271.96 K/sec - SpilledPartitions: 1 - UnpinTime: 29.713us HDFS_SCAN_NODE (id=0):(Total: 1s525ms, non-child: 1s525ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:20/1.10 GB 1:14/709.08 MB 10:12/663.49 MB 4:14/910.78 MB 6:14/620.35 MB 0:12/696.66 MB 5:11/508.30 MB 7:17/746.81 MB 11:15/775.39 MB 2:15/815.92 MB 3:15/762.93 MB 9:9/573.15 MB Hdfs Read Thread Concurrency Bucket: 0:98.43% 1:1.575% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:10 PARQUET/SNAPPY:316 ExecOption: Codegen enabled: 0 out of 168 BytesRead(2s000ms): 363.37 MB, 484.50 MB, 493.58 MB, 496.61 MB, 496.61 MB, 538.43 MB, 560.49 MB, 585.34 MB, 618.86 MB, 647.99 MB, 744.36 MB, 811.73 MB, 847.85 MB, 900.38 MB, 909.60 MB, 909.60 MB, 992.18 MB, 1.02 GB, 1.03 GB, 1.07 GB, 1.12 GB, 1.14 GB, 1.20 GB, 1.24 GB, 1.26 GB, 1.31 GB, 1.32 GB, 1.38 GB, 1.40 GB, 1.43 GB, 1.46 GB, 1.51 GB, 1.54 GB, 1.57 GB, 1.61 GB, 1.68 GB, 1.71 GB, 1.73 GB, 1.78 GB, 1.83 GB, 1.85 GB, 1.87 GB, 1.89 GB, 1.89 GB, 1.98 GB, 2.04 GB, 2.10 GB, 2.13 GB, 2.20 GB, 2.25 GB, 2.29 GB, 2.34 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.37 - BytesRead: 2.39 GB (2563318756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2563318756) - BytesReadShortCircuit: 2.39 GB (2563318756) - DecompressionTime: 13s448ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 821.17 MB (861057672) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RowsRead: 209.96M (209958185) - RowsReturned: 209.96M (209958185) - RowsReturnedRate: 137.67 M/sec - ScanRangesComplete: 168 - ScannerThreadsInvoluntaryContextSwitches: 690 - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s500ms - ScannerThreadsUserTime: 50s965ms - ScannerThreadsVoluntaryContextSwitches: 205.55K (205553) - TotalRawHdfsReadTime(*): 1s664ms - TotalReadThroughput: 19.17 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f1 (host=atlas-ch2-54.sys.comcast.net:22000):(Total: 2m53s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:9/397.14 MB 6:18/797.00 MB 5:14/588.79 MB 0:10/491.16 MB 2:19/1.30 GB 11:19/1.17 GB 1:10/586.57 MB 8:14/745.73 MB 4:12/553.25 MB 9:16/996.49 MB 7:12/651.54 MB 10:12/632.07 MB MemoryUsage(4s000ms): 1.14 GB, 1.97 GB, 2.42 GB, 2.98 GB, 3.11 GB, 3.35 GB, 3.52 GB, 3.95 GB, 4.08 GB, 4.15 GB, 4.29 GB, 4.34 GB, 4.34 GB, 4.57 GB, 4.60 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.80 GB, 4.89 GB, 4.92 GB, 4.89 GB, 4.87 GB, 5.03 GB, 5.27 GB, 5.44 GB, 5.45 GB, 5.38 GB, 5.27 GB, 5.17 GB, 5.03 GB, 4.89 GB, 4.76 GB, 4.82 GB, 4.25 GB, 3.62 GB, 3.03 GB, 2.48 GB, 1.93 GB, 1.36 GB, 828.80 MB, 363.00 MB, 785.42 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 27, 23, 17, 10, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.14 - PeakMemoryUsage: 5.48 GB (5882082320) - PerHostPeakMemUsage: 5.67 GB (6088659920) - PrepareTime: 289.678ms - RowsProduced: 37.68M (37682183) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 54.880ms - TotalStorageWaitTime: 6s834ms CodeGen:(Total: 637.176ms, non-child: 637.176ms, % non-child: 100.00%) - CodegenTime: 4.41ms - CompileTime: 353.976ms - LoadTime: 281.281ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s432ms, non-child: 29s432ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1631975990) - NetworkThroughput(*): 30.33 MB/sec - OverallThroughput: 52.88 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s400ms - ThriftTransmitTime(*): 51s311ms - UncompressedRowBatchSize: 3.41 GB (3666457932) AGGREGATION_NODE (id=1):(Total: 2m23s, non-child: 2m22s, % non-child: 99.03%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m11s - GetNewBlockTime: 28.639ms - GetResultsTime: 4s671ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261213008) - PinTime: 712.933ms - RowsRepartitioned: 6.62M (6622431) - RowsReturned: 37.68M (37682183) - RowsReturnedRate: 261.92 K/sec - SpilledPartitions: 1 - UnpinTime: 186.170us HDFS_SCAN_NODE (id=0):(Total: 1s395ms, non-child: 1s395ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:9/397.14 MB 6:18/797.00 MB 5:14/588.79 MB 0:10/491.16 MB 2:19/1.30 GB 11:19/1.17 GB 1:10/586.57 MB 8:14/745.73 MB 4:12/553.25 MB 9:16/996.49 MB 7:12/651.54 MB 10:12/632.07 MB Hdfs Read Thread Concurrency Bucket: 0:99.25% 1:0.7491% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:6 PARQUET/SNAPPY:318 ExecOption: Codegen enabled: 0 out of 165 BytesRead(4s000ms): 414.89 MB, 477.30 MB, 496.71 MB, 568.56 MB, 653.84 MB, 749.65 MB, 810.76 MB, 821.33 MB, 915.77 MB, 993.35 MB, 1.01 GB, 1.16 GB, 1.24 GB, 1.31 GB, 1.37 GB, 1.41 GB, 1.48 GB, 1.59 GB, 1.68 GB, 1.77 GB, 1.90 GB, 1.92 GB, 1.98 GB, 2.09 GB, 2.18 GB, 2.25 GB, 2.34 GB, 2.36 GB, 2.36 GB, 2.36 GB, 2.37 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.46 - BytesRead: 2.41 GB (2585207268) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2585207268) - BytesReadShortCircuit: 2.41 GB (2585207268) - DecompressionTime: 10s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 836.37 MB (876999632) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RowsRead: 211.98M (211984426) - RowsReturned: 211.98M (211984426) - RowsReturnedRate: 151.86 M/sec - ScanRangesComplete: 165 - ScannerThreadsInvoluntaryContextSwitches: 391 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s675ms - ScannerThreadsUserTime: 42s861ms - ScannerThreadsVoluntaryContextSwitches: 207.59K (207586) - TotalRawHdfsReadTime(*): 1s834ms - TotalReadThroughput: 18.47 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f7 (host=atlas-ch2-02.sys.comcast.net:22000):(Total: 2m50s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:9/371.28 MB 6:11/544.01 MB 4:13/825.80 MB 1:15/957.07 MB 7:13/692.02 MB 5:15/695.83 MB 0:13/1022.87 MB 8:9/731.79 MB 10:18/801.25 MB 2:17/871.64 MB 11:14/629.57 MB 3:17/839.36 MB MemoryUsage(4s000ms): 1.13 GB, 1.93 GB, 2.46 GB, 3.00 GB, 3.07 GB, 3.34 GB, 3.53 GB, 3.83 GB, 4.11 GB, 4.16 GB, 4.37 GB, 4.38 GB, 4.37 GB, 4.59 GB, 4.61 GB, 4.59 GB, 4.58 GB, 4.68 GB, 4.84 GB, 4.89 GB, 4.99 GB, 5.02 GB, 5.00 GB, 4.97 GB, 5.16 GB, 5.36 GB, 5.41 GB, 5.41 GB, 5.36 GB, 5.23 GB, 5.15 GB, 5.03 GB, 4.86 GB, 4.73 GB, 4.52 GB, 3.93 GB, 3.33 GB, 2.69 GB, 2.04 GB, 1.39 GB, 769.63 MB, 545.90 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 27, 23, 17, 10, 3, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.23 - PeakMemoryUsage: 5.45 GB (5847529944) - PerHostPeakMemUsage: 5.65 GB (6061971928) - PrepareTime: 294.287ms - RowsProduced: 37.58M (37579564) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 57.268ms - TotalStorageWaitTime: 7s909ms CodeGen:(Total: 586.134ms, non-child: 586.134ms, % non-child: 100.00%) - CodegenTime: 2.892ms - CompileTime: 296.600ms - LoadTime: 288.160ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s127ms, non-child: 27s127ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1627566951) - NetworkThroughput(*): 27.98 MB/sec - OverallThroughput: 57.22 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s533ms - ThriftTransmitTime(*): 55s483ms - UncompressedRowBatchSize: 3.41 GB (3656460200) AGGREGATION_NODE (id=1):(Total: 2m23s, non-child: 2m22s, % non-child: 98.90%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m13s - GetNewBlockTime: 34.151ms - GetResultsTime: 3s578ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.70 GB (5051531000) - PinTime: 582.420ms - RowsRepartitioned: 6.63M (6626112) - RowsReturned: 37.58M (37579564) - RowsReturnedRate: 261.59 K/sec - SpilledPartitions: 1 - UnpinTime: 188.838us HDFS_SCAN_NODE (id=0):(Total: 1s586ms, non-child: 1s586ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:9/371.28 MB 6:11/544.01 MB 4:13/825.80 MB 1:15/957.07 MB 7:13/692.02 MB 5:15/695.83 MB 0:13/1022.87 MB 8:9/731.79 MB 10:18/801.25 MB 2:17/871.64 MB 11:14/629.57 MB 3:17/839.36 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:320 ExecOption: Codegen enabled: 0 out of 164 BytesRead(4s000ms): 415.28 MB, 474.60 MB, 508.89 MB, 616.94 MB, 638.45 MB, 782.43 MB, 848.99 MB, 873.85 MB, 980.36 MB, 1.03 GB, 1.12 GB, 1.22 GB, 1.26 GB, 1.32 GB, 1.42 GB, 1.47 GB, 1.52 GB, 1.60 GB, 1.68 GB, 1.82 GB, 1.98 GB, 2.05 GB, 2.07 GB, 2.12 GB, 2.19 GB, 2.24 GB, 2.27 GB, 2.34 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.05 - BytesRead: 2.41 GB (2584071837) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2584071837) - BytesReadShortCircuit: 2.41 GB (2584071837) - DecompressionTime: 12s882ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 902.41 MB (946244336) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RowsRead: 212.18M (212184734) - RowsReturned: 212.18M (212184734) - RowsReturnedRate: 133.76 M/sec - ScanRangesComplete: 164 - ScannerThreadsInvoluntaryContextSwitches: 618 - ScannerThreadsTotalWallClockTime: 1h12m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s945ms - ScannerThreadsUserTime: 50s326ms - ScannerThreadsVoluntaryContextSwitches: 207.78K (207783) - TotalRawHdfsReadTime(*): 1s846ms - TotalReadThroughput: 18.19 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f8 (host=atlas-ch2-57.sys.comcast.net:22000):(Total: 2m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:13/454.67 MB 8:17/933.16 MB 3:12/474.01 MB 6:16/838.36 MB 9:15/1.03 GB 11:10/585.71 MB 2:13/543.16 MB 10:10/634.56 MB 0:18/863.81 MB 5:14/741.16 MB 1:17/797.79 MB 7:18/1003.66 MB MemoryUsage(4s000ms): 1.19 GB, 1.87 GB, 2.40 GB, 2.96 GB, 3.10 GB, 3.34 GB, 3.52 GB, 3.87 GB, 4.07 GB, 4.13 GB, 4.31 GB, 4.33 GB, 4.31 GB, 4.52 GB, 4.59 GB, 4.59 GB, 4.64 GB, 4.78 GB, 4.87 GB, 4.92 GB, 4.94 GB, 4.89 GB, 4.87 GB, 5.00 GB, 5.32 GB, 5.42 GB, 5.40 GB, 5.29 GB, 5.16 GB, 5.06 GB, 4.92 GB, 4.76 GB, 4.42 GB, 3.82 GB, 3.22 GB, 2.60 GB, 1.95 GB, 1.35 GB, 768.55 MB, 468.80 MB, 785.97 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 28, 24, 20, 13, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.88 - PeakMemoryUsage: 5.45 GB (5853286336) - PerHostPeakMemUsage: 5.65 GB (6063957720) - PrepareTime: 315.120ms - RowsProduced: 37.51M (37505850) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 55.364ms - TotalStorageWaitTime: 4s149ms CodeGen:(Total: 775.958ms, non-child: 775.958ms, % non-child: 100.00%) - CodegenTime: 4.705ms - CompileTime: 468.710ms - LoadTime: 304.708ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s405ms, non-child: 27s405ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1624429167) - NetworkThroughput(*): 30.29 MB/sec - OverallThroughput: 56.53 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s381ms - ThriftTransmitTime(*): 51s147ms - UncompressedRowBatchSize: 3.40 GB (3649243242) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m15s, % non-child: 99.02%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 38.867ms - GetResultsTime: 3s669ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 614.520ms - RowsRepartitioned: 6.59M (6585793) - RowsReturned: 37.51M (37505850) - RowsReturnedRate: 273.83 K/sec - SpilledPartitions: 1 - UnpinTime: 33.533us HDFS_SCAN_NODE (id=0):(Total: 1s343ms, non-child: 1s343ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:13/454.67 MB 8:17/933.16 MB 3:12/474.01 MB 6:16/838.36 MB 9:15/1.03 GB 11:10/585.71 MB 2:13/543.16 MB 10:10/634.56 MB 0:18/863.81 MB 5:14/741.16 MB 1:17/797.79 MB 7:18/1003.66 MB Hdfs Read Thread Concurrency Bucket: 0:97.65% 1:2.353% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:12 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 173 BytesRead(4s000ms): 421.15 MB, 482.65 MB, 501.09 MB, 589.78 MB, 635.69 MB, 709.26 MB, 813.92 MB, 829.73 MB, 912.77 MB, 1.01 GB, 1.05 GB, 1.12 GB, 1.19 GB, 1.26 GB, 1.41 GB, 1.46 GB, 1.58 GB, 1.70 GB, 1.76 GB, 1.85 GB, 1.95 GB, 1.97 GB, 2.01 GB, 2.09 GB, 2.25 GB, 2.34 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.20 - BytesRead: 2.40 GB (2571910574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2571910574) - BytesReadShortCircuit: 2.40 GB (2571910574) - DecompressionTime: 11s789ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 822.12 MB (862051792) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RowsRead: 210.84M (210840825) - RowsReturned: 210.84M (210840825) - RowsReturnedRate: 156.95 M/sec - ScanRangesComplete: 173 - ScannerThreadsInvoluntaryContextSwitches: 459 - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s775ms - ScannerThreadsUserTime: 45s697ms - ScannerThreadsVoluntaryContextSwitches: 206.58K (206584) - TotalRawHdfsReadTime(*): 2s134ms - TotalReadThroughput: 19.16 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e9 (host=atlas-ch2-26.sys.comcast.net:22000):(Total: 2m49s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:16/719.53 MB 8:9/407.33 MB 7:17/673.79 MB 3:14/770.05 MB 0:12/693.42 MB 5:13/589.99 MB 6:16/994.74 MB 1:18/884.98 MB 2:16/754.63 MB 11:17/1.02 GB 9:13/649.64 MB 10:13/763.45 MB MemoryUsage(4s000ms): 1022.87 MB, 1.89 GB, 2.42 GB, 3.01 GB, 3.09 GB, 3.32 GB, 3.47 GB, 3.93 GB, 4.08 GB, 4.18 GB, 4.33 GB, 4.38 GB, 4.42 GB, 4.57 GB, 4.61 GB, 4.57 GB, 4.60 GB, 4.87 GB, 4.87 GB, 4.85 GB, 4.87 GB, 4.82 GB, 4.87 GB, 5.15 GB, 5.35 GB, 5.38 GB, 5.41 GB, 5.37 GB, 5.29 GB, 5.16 GB, 4.99 GB, 4.82 GB, 4.59 GB, 4.04 GB, 3.48 GB, 3.05 GB, 2.55 GB, 2.00 GB, 1.44 GB, 940.93 MB, 385.62 MB, 785.20 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 25, 17, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.65 - PeakMemoryUsage: 5.44 GB (5836676208) - PerHostPeakMemUsage: 5.63 GB (6047432640) - PrepareTime: 333.357ms - RowsProduced: 37.44M (37435391) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 64.139ms - TotalStorageWaitTime: 3s636ms CodeGen:(Total: 800.870ms, non-child: 800.870ms, % non-child: 100.00%) - CodegenTime: 5.1ms - CompileTime: 475.545ms - LoadTime: 322.874ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 31s322ms, non-child: 31s322ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1621130530) - NetworkThroughput(*): 32.03 MB/sec - OverallThroughput: 49.36 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s453ms - ThriftTransmitTime(*): 48s267ms - UncompressedRowBatchSize: 3.39 GB (3642481819) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m17s, % non-child: 99.04%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 34.677ms - GetResultsTime: 4s036ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 604.721ms - RowsRepartitioned: 6.60M (6599845) - RowsReturned: 37.44M (37435391) - RowsReturnedRate: 270.16 K/sec - SpilledPartitions: 1 - UnpinTime: 31.847us HDFS_SCAN_NODE (id=0):(Total: 1s335ms, non-child: 1s335ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:16/719.53 MB 8:9/407.33 MB 7:17/673.79 MB 3:14/770.05 MB 0:12/693.42 MB 5:13/589.99 MB 6:16/994.74 MB 1:18/884.98 MB 2:16/754.63 MB 11:17/1.02 GB 9:13/649.64 MB 10:13/763.45 MB Hdfs Read Thread Concurrency Bucket: 0:99.22% 1:0.7782% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:10 PARQUET/SNAPPY:328 ExecOption: Codegen enabled: 0 out of 174 BytesRead(4s000ms): 434.31 MB, 496.36 MB, 504.20 MB, 611.20 MB, 620.64 MB, 704.95 MB, 783.53 MB, 837.67 MB, 950.03 MB, 1.02 GB, 1.07 GB, 1.22 GB, 1.25 GB, 1.30 GB, 1.40 GB, 1.47 GB, 1.57 GB, 1.67 GB, 1.72 GB, 1.78 GB, 1.85 GB, 1.89 GB, 2.01 GB, 2.12 GB, 2.19 GB, 2.26 GB, 2.35 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.70 - BytesRead: 2.40 GB (2574327108) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2574327108) - BytesReadShortCircuit: 2.40 GB (2574327108) - DecompressionTime: 12s649ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 797.00 MB (835711176) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RowsRead: 211.39M (211392515) - RowsReturned: 211.39M (211392515) - RowsReturnedRate: 158.27 M/sec - ScanRangesComplete: 174 - ScannerThreadsInvoluntaryContextSwitches: 475 - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s829ms - ScannerThreadsUserTime: 48s794ms - ScannerThreadsVoluntaryContextSwitches: 207.15K (207150) - TotalRawHdfsReadTime(*): 1s887ms - TotalReadThroughput: 19.03 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232fd (host=atlas-ch2-48.sys.comcast.net:22000):(Total: 2m53s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:15/783.57 MB 1:19/867.09 MB 9:13/535.80 MB 6:10/329.97 MB 0:14/578.07 MB 5:10/556.34 MB 11:17/895.56 MB 2:11/672.80 MB 4:13/717.52 MB 3:11/500.32 MB 7:21/1.28 GB 8:19/1.14 GB MemoryUsage(4s000ms): 1.08 GB, 1.86 GB, 2.40 GB, 3.01 GB, 3.13 GB, 3.27 GB, 3.50 GB, 3.60 GB, 4.08 GB, 4.13 GB, 4.34 GB, 4.42 GB, 4.44 GB, 4.54 GB, 4.60 GB, 4.62 GB, 4.62 GB, 4.60 GB, 4.75 GB, 4.80 GB, 4.82 GB, 4.83 GB, 4.81 GB, 4.87 GB, 4.90 GB, 5.10 GB, 5.35 GB, 5.37 GB, 5.34 GB, 5.22 GB, 5.10 GB, 4.96 GB, 4.83 GB, 4.73 GB, 4.56 GB, 4.04 GB, 3.44 GB, 2.84 GB, 2.21 GB, 1.57 GB, 998.48 MB, 426.35 MB, 788.64 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 28, 20, 15, 7, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.66 - PeakMemoryUsage: 5.40 GB (5799091008) - PerHostPeakMemUsage: 5.60 GB (6013532992) - PrepareTime: 335.262ms - RowsProduced: 37.40M (37399193) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 56.806ms - TotalStorageWaitTime: 3s570ms CodeGen:(Total: 805.768ms, non-child: 805.768ms, % non-child: 100.00%) - CodegenTime: 4.994ms - CompileTime: 478.588ms - LoadTime: 324.771ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s644ms, non-child: 27s644ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1619703577) - NetworkThroughput(*): 29.62 MB/sec - OverallThroughput: 55.88 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s441ms - ThriftTransmitTime(*): 52s146ms - UncompressedRowBatchSize: 3.39 GB (3638873846) AGGREGATION_NODE (id=1):(Total: 2m26s, non-child: 2m24s, % non-child: 99.03%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m14s - GetNewBlockTime: 34.407ms - GetResultsTime: 3s690ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005500344) - PinTime: 650.869ms - RowsRepartitioned: 6.56M (6557461) - RowsReturned: 37.40M (37399193) - RowsReturnedRate: 256.06 K/sec - SpilledPartitions: 1 - UnpinTime: 35.890us HDFS_SCAN_NODE (id=0):(Total: 1s420ms, non-child: 1s420ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:15/783.57 MB 1:19/867.09 MB 9:13/535.80 MB 6:10/329.97 MB 0:14/578.07 MB 5:10/556.34 MB 11:17/895.56 MB 2:11/672.80 MB 4:13/717.52 MB 3:11/500.32 MB 7:21/1.28 GB 8:19/1.14 GB Hdfs Read Thread Concurrency Bucket: 0:98.9% 1:1.103% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:318 ExecOption: Codegen enabled: 0 out of 173 BytesRead(4s000ms): 438.65 MB, 501.32 MB, 526.57 MB, 620.90 MB, 656.07 MB, 701.13 MB, 787.27 MB, 820.97 MB, 847.62 MB, 1.03 GB, 1.07 GB, 1.18 GB, 1.24 GB, 1.25 GB, 1.34 GB, 1.45 GB, 1.49 GB, 1.51 GB, 1.59 GB, 1.65 GB, 1.75 GB, 1.82 GB, 1.85 GB, 2.01 GB, 2.07 GB, 2.12 GB, 2.20 GB, 2.30 GB, 2.34 GB, 2.34 GB, 2.34 GB, 2.35 GB, 2.36 GB, 2.38 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.64 - BytesRead: 2.39 GB (2563406019) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2563406019) - BytesReadShortCircuit: 2.39 GB (2563406019) - DecompressionTime: 12s663ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 805.29 MB (844407584) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RowsRead: 209.84M (209841513) - RowsReturned: 209.84M (209841513) - RowsReturnedRate: 147.76 M/sec - ScanRangesComplete: 173 - ScannerThreadsInvoluntaryContextSwitches: 580 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s849ms - ScannerThreadsUserTime: 48s833ms - ScannerThreadsVoluntaryContextSwitches: 205.63K (205629) - TotalRawHdfsReadTime(*): 2s049ms - TotalReadThroughput: 17.91 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232fb (host=atlas-ch2-15.sys.comcast.net:22000):(Total: 2m52s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:12/758.01 MB 8:11/475.64 MB 3:11/664.69 MB 7:18/972.03 MB 4:9/505.45 MB 11:16/803.73 MB 2:19/728.02 MB 0:11/583.68 MB 5:12/614.75 MB 1:15/1.00 GB 6:21/1.06 GB 10:15/771.00 MB MemoryUsage(4s000ms): 1.13 GB, 1.94 GB, 2.46 GB, 3.03 GB, 3.07 GB, 3.30 GB, 3.50 GB, 3.86 GB, 4.07 GB, 4.10 GB, 4.31 GB, 4.35 GB, 4.38 GB, 4.59 GB, 4.58 GB, 4.59 GB, 4.64 GB, 4.72 GB, 4.98 GB, 4.98 GB, 4.95 GB, 4.91 GB, 4.91 GB, 5.12 GB, 5.35 GB, 5.39 GB, 5.43 GB, 5.42 GB, 5.32 GB, 5.27 GB, 5.13 GB, 5.02 GB, 4.86 GB, 4.89 GB, 4.71 GB, 4.10 GB, 3.47 GB, 2.84 GB, 2.21 GB, 1.58 GB, 969.77 MB, 422.60 MB, 787.81 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 29, 27, 22, 17, 8, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.03 - PeakMemoryUsage: 5.46 GB (5865131432) - PerHostPeakMemUsage: 5.71 GB (6134935776) - PrepareTime: 336.321ms - RowsProduced: 37.82M (37823940) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 53.431ms - TotalStorageWaitTime: 4s428ms CodeGen:(Total: 797.483ms, non-child: 797.483ms, % non-child: 100.00%) - CodegenTime: 5.63ms - CompileTime: 469.362ms - LoadTime: 325.627ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 27s638ms, non-child: 27s638ms, % non-child: 100.00%) - BytesSent: 1.53 GB (1638155858) - NetworkThroughput(*): 29.86 MB/sec - OverallThroughput: 56.52 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s429ms - ThriftTransmitTime(*): 52s320ms - UncompressedRowBatchSize: 3.43 GB (3680327725) AGGREGATION_NODE (id=1):(Total: 2m24s, non-child: 2m23s, % non-child: 98.98%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m14s - GetNewBlockTime: 36.775ms - GetResultsTime: 3s763ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265416192) - PinTime: 595.425ms - RowsRepartitioned: 6.64M (6640641) - RowsReturned: 37.82M (37823940) - RowsReturnedRate: 261.70 K/sec - SpilledPartitions: 1 - UnpinTime: 32.216us HDFS_SCAN_NODE (id=0):(Total: 1s470ms, non-child: 1s470ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:12/758.01 MB 8:11/475.64 MB 3:11/664.69 MB 7:18/972.03 MB 4:9/505.45 MB 11:16/803.73 MB 2:19/728.02 MB 0:11/583.68 MB 5:12/614.75 MB 1:15/1.00 GB 6:21/1.06 GB 10:15/771.00 MB Hdfs Read Thread Concurrency Bucket: 0:98.16% 1:1.838% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:8 PARQUET/SNAPPY:324 ExecOption: Codegen enabled: 0 out of 170 BytesRead(4s000ms): 408.67 MB, 544.57 MB, 544.57 MB, 580.30 MB, 601.19 MB, 696.78 MB, 781.16 MB, 827.26 MB, 876.51 MB, 1005.49 MB, 1.04 GB, 1.14 GB, 1.22 GB, 1.29 GB, 1.34 GB, 1.42 GB, 1.54 GB, 1.67 GB, 1.79 GB, 1.83 GB, 1.88 GB, 1.91 GB, 1.99 GB, 2.06 GB, 2.12 GB, 2.17 GB, 2.29 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.41 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 31.75 - BytesRead: 2.41 GB (2589563647) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2589563647) - BytesReadShortCircuit: 2.41 GB (2589563647) - DecompressionTime: 13s622ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 856.98 MB (898607408) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RowsRead: 212.60M (212604139) - RowsReturned: 212.60M (212604139) - RowsReturnedRate: 144.54 M/sec - ScanRangesComplete: 170 - ScannerThreadsInvoluntaryContextSwitches: 395 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s778ms - ScannerThreadsUserTime: 49s912ms - ScannerThreadsVoluntaryContextSwitches: 208.22K (208215) - TotalRawHdfsReadTime(*): 2s369ms - TotalReadThroughput: 18.09 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d5 (host=atlas-ch2-50.sys.comcast.net:22000):(Total: 2m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:12/510.69 MB 1:17/1.01 GB 9:8/378.03 MB 8:10/619.92 MB 3:20/1.15 GB 4:15/834.16 MB 11:9/386.93 MB 2:13/607.89 MB 5:15/1.08 GB 0:16/821.12 MB 10:13/804.20 MB 6:13/634.98 MB MemoryUsage(4s000ms): 1.40 GB, 2.09 GB, 2.55 GB, 3.07 GB, 3.16 GB, 3.39 GB, 3.56 GB, 3.96 GB, 4.16 GB, 4.21 GB, 4.42 GB, 4.44 GB, 4.44 GB, 4.62 GB, 4.63 GB, 4.58 GB, 4.62 GB, 4.84 GB, 4.84 GB, 4.83 GB, 4.84 GB, 4.80 GB, 4.95 GB, 5.16 GB, 5.31 GB, 5.31 GB, 5.40 GB, 5.36 GB, 5.23 GB, 5.09 GB, 4.96 GB, 4.79 GB, 4.64 GB, 4.12 GB, 3.46 GB, 2.85 GB, 2.25 GB, 1.57 GB, 998.41 MB, 385.59 MB, 788.59 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 25, 20, 13, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.91 - PeakMemoryUsage: 5.42 GB (5821865136) - PerHostPeakMemUsage: 5.62 GB (6036307120) - PrepareTime: 241.891ms - RowsProduced: 37.56M (37555394) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.261ms - TotalStorageWaitTime: 6s941ms CodeGen:(Total: 523.589ms, non-child: 523.589ms, % non-child: 100.00%) - CodegenTime: 2.854ms - CompileTime: 286.464ms - LoadTime: 235.725ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s921ms, non-child: 26s921ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1626501918) - NetworkThroughput(*): 27.83 MB/sec - OverallThroughput: 57.62 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s343ms - ThriftTransmitTime(*): 55s729ms - UncompressedRowBatchSize: 3.40 GB (3654033747) AGGREGATION_NODE (id=1):(Total: 2m18s, non-child: 2m17s, % non-child: 98.99%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m8s - GetNewBlockTime: 30.243ms - GetResultsTime: 3s561ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 639.220ms - RowsRepartitioned: 6.59M (6590395) - RowsReturned: 37.56M (37555394) - RowsReturnedRate: 270.40 K/sec - SpilledPartitions: 1 - UnpinTime: 27.610us HDFS_SCAN_NODE (id=0):(Total: 1s400ms, non-child: 1s400ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:12/510.69 MB 1:17/1.01 GB 9:8/378.03 MB 8:10/619.92 MB 3:20/1.15 GB 4:15/834.16 MB 11:9/386.93 MB 2:13/607.89 MB 5:15/1.08 GB 0:16/821.12 MB 10:13/804.20 MB 6:13/634.98 MB Hdfs Read Thread Concurrency Bucket: 0:98.84% 1:1.158% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:7 PARQUET/SNAPPY:308 ExecOption: Codegen enabled: 0 out of 161 BytesRead(4s000ms): 461.40 MB, 559.23 MB, 582.91 MB, 662.08 MB, 708.58 MB, 787.88 MB, 841.52 MB, 913.82 MB, 1012.72 MB, 1.07 GB, 1.12 GB, 1.26 GB, 1.28 GB, 1.33 GB, 1.41 GB, 1.45 GB, 1.56 GB, 1.65 GB, 1.68 GB, 1.73 GB, 1.83 GB, 1.88 GB, 1.96 GB, 2.01 GB, 2.08 GB, 2.17 GB, 2.35 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.93 - BytesRead: 2.39 GB (2565454875) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2565454875) - BytesReadShortCircuit: 2.39 GB (2565454875) - DecompressionTime: 11s325ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 854.92 MB (896448424) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RowsRead: 210.99M (210987329) - RowsReturned: 210.99M (210987329) - RowsReturnedRate: 150.67 M/sec - ScanRangesComplete: 161 - ScannerThreadsInvoluntaryContextSwitches: 479 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s684ms - ScannerThreadsUserTime: 44s249ms - ScannerThreadsVoluntaryContextSwitches: 206.58K (206583) - TotalRawHdfsReadTime(*): 1s676ms - TotalReadThroughput: 18.82 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232e7 (host=atlas-ch2-11.sys.comcast.net:22000):(Total: 2m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:24/1.36 GB 9:14/679.47 MB 8:10/501.44 MB 1:16/832.56 MB 4:10/499.66 MB 11:14/855.44 MB 2:7/335.28 MB 0:16/805.07 MB 5:11/481.67 MB 10:13/678.73 MB 3:19/1.09 GB 6:16/745.89 MB MemoryUsage(4s000ms): 1.37 GB, 2.01 GB, 2.46 GB, 3.01 GB, 3.07 GB, 3.33 GB, 3.47 GB, 4.05 GB, 4.10 GB, 4.26 GB, 4.37 GB, 4.43 GB, 4.54 GB, 4.65 GB, 4.68 GB, 4.63 GB, 4.72 GB, 4.88 GB, 4.85 GB, 4.86 GB, 4.86 GB, 4.85 GB, 4.95 GB, 5.17 GB, 5.29 GB, 5.33 GB, 5.38 GB, 5.34 GB, 5.24 GB, 5.10 GB, 4.95 GB, 4.76 GB, 4.36 GB, 3.75 GB, 3.09 GB, 2.49 GB, 1.82 GB, 1.20 GB, 596.29 MB, 628.07 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 29, 24, 16, 5, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.59 - PeakMemoryUsage: 5.41 GB (5804704016) - PerHostPeakMemUsage: 5.60 GB (6015475176) - PrepareTime: 245.424ms - RowsProduced: 37.57M (37574325) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 60.268ms - TotalStorageWaitTime: 4s503ms CodeGen:(Total: 507.113ms, non-child: 507.113ms, % non-child: 100.00%) - CodegenTime: 2.846ms - CompileTime: 266.423ms - LoadTime: 239.354ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s644ms, non-child: 26s644ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1627229368) - NetworkThroughput(*): 28.42 MB/sec - OverallThroughput: 58.24 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s245ms - ThriftTransmitTime(*): 54s605ms - UncompressedRowBatchSize: 3.40 GB (3655814181) AGGREGATION_NODE (id=1):(Total: 2m16s, non-child: 2m15s, % non-child: 99.03%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 31.504ms - GetResultsTime: 3s527ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.68 GB (5026322816) - PinTime: 619.567ms - RowsRepartitioned: 6.56M (6555574) - RowsReturned: 37.57M (37574325) - RowsReturnedRate: 275.29 K/sec - SpilledPartitions: 1 - UnpinTime: 197.790us HDFS_SCAN_NODE (id=0):(Total: 1s330ms, non-child: 1s330ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:24/1.36 GB 9:14/679.47 MB 8:10/501.44 MB 1:16/832.56 MB 4:10/499.66 MB 11:14/855.44 MB 2:7/335.28 MB 0:16/805.07 MB 5:11/481.67 MB 10:13/678.73 MB 3:19/1.09 GB 6:16/745.89 MB Hdfs Read Thread Concurrency Bucket: 0:98.82% 1:1.181% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 170 BytesRead(2s000ms): 365.46 MB, 487.28 MB, 487.28 MB, 487.28 MB, 487.28 MB, 523.13 MB, 625.58 MB, 627.16 MB, 627.16 MB, 627.16 MB, 667.95 MB, 729.74 MB, 751.75 MB, 827.10 MB, 862.22 MB, 890.39 MB, 934.56 MB, 1022.37 MB, 1.00 GB, 1.03 GB, 1.11 GB, 1.13 GB, 1.29 GB, 1.30 GB, 1.31 GB, 1.34 GB, 1.36 GB, 1.43 GB, 1.48 GB, 1.51 GB, 1.53 GB, 1.54 GB, 1.61 GB, 1.65 GB, 1.66 GB, 1.67 GB, 1.69 GB, 1.73 GB, 1.78 GB, 1.87 GB, 1.87 GB, 1.91 GB, 1.94 GB, 1.94 GB, 1.96 GB, 1.97 GB, 2.01 GB, 2.07 GB, 2.11 GB, 2.14 GB, 2.22 GB, 2.26 GB, 2.34 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.94 - BytesRead: 2.39 GB (2565427575) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.39 GB (2565427575) - BytesReadShortCircuit: 2.39 GB (2565427575) - DecompressionTime: 11s981ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 788.09 MB (826367920) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RowsRead: 209.86M (209864464) - RowsReturned: 209.86M (209864464) - RowsReturnedRate: 157.76 M/sec - ScanRangesComplete: 170 - ScannerThreadsInvoluntaryContextSwitches: 480 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s698ms - ScannerThreadsUserTime: 46s207ms - ScannerThreadsVoluntaryContextSwitches: 205.55K (205548) - TotalRawHdfsReadTime(*): 1s919ms - TotalReadThroughput: 19.19 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232ce (host=atlas-ch2-39.sys.comcast.net:22000):(Total: 2m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:8/386.08 MB 8:10/551.34 MB 1:11/680.00 MB 11:16/1.02 GB 2:13/694.48 MB 7:7/465.16 MB 6:17/1.04 GB 10:19/848.68 MB 0:17/1.17 GB 5:19/962.10 MB 4:12/514.88 MB 9:13/544.63 MB MemoryUsage(4s000ms): 1.30 GB, 2.07 GB, 2.56 GB, 3.10 GB, 3.19 GB, 3.43 GB, 3.56 GB, 4.02 GB, 4.12 GB, 4.24 GB, 4.37 GB, 4.39 GB, 4.52 GB, 4.57 GB, 4.56 GB, 4.59 GB, 4.58 GB, 4.78 GB, 4.84 GB, 4.90 GB, 4.93 GB, 4.97 GB, 5.09 GB, 5.34 GB, 5.45 GB, 5.42 GB, 5.42 GB, 5.38 GB, 5.29 GB, 5.14 GB, 4.97 GB, 4.86 GB, 4.78 GB, 4.17 GB, 3.47 GB, 2.84 GB, 2.21 GB, 1.50 GB, 889.19 MB, 439.33 MB, 787.24 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 26, 16, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.56 - PeakMemoryUsage: 5.46 GB (5864359232) - PerHostPeakMemUsage: 5.66 GB (6078801216) - PrepareTime: 255.56ms - RowsProduced: 37.83M (37826482) - TotalCpuTime: 1h12m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 62.834ms - TotalStorageWaitTime: 7s085ms CodeGen:(Total: 533.264ms, non-child: 533.264ms, % non-child: 100.00%) - CodegenTime: 2.873ms - CompileTime: 282.869ms - LoadTime: 249.10ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 26s908ms, non-child: 26s908ms, % non-child: 100.00%) - BytesSent: 1.53 GB (1638160358) - NetworkThroughput(*): 28.04 MB/sec - OverallThroughput: 58.06 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s389ms - ThriftTransmitTime(*): 55s723ms - UncompressedRowBatchSize: 3.43 GB (3680456156) AGGREGATION_NODE (id=1):(Total: 2m17s, non-child: 2m16s, % non-child: 99.02%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m6s - GetNewBlockTime: 36.442ms - GetResultsTime: 3s581ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5265481720) - PinTime: 634.628ms - RowsRepartitioned: 6.62M (6618033) - RowsReturned: 37.83M (37826482) - RowsReturnedRate: 274.80 K/sec - SpilledPartitions: 1 - UnpinTime: 28.959us HDFS_SCAN_NODE (id=0):(Total: 1s345ms, non-child: 1s345ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:8/386.08 MB 8:10/551.34 MB 1:11/680.00 MB 11:16/1.02 GB 2:13/694.48 MB 7:7/465.16 MB 6:17/1.04 GB 10:19/848.68 MB 0:17/1.17 GB 5:19/962.10 MB 4:12/514.88 MB 9:13/544.63 MB Hdfs Read Thread Concurrency Bucket: 0:99.22% 1:0.3891% 2:0% 3:0.3891% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:7 PARQUET/SNAPPY:310 ExecOption: Codegen enabled: 0 out of 162 BytesRead(4s000ms): 528.47 MB, 587.08 MB, 636.30 MB, 680.42 MB, 727.99 MB, 819.32 MB, 864.04 MB, 902.21 MB, 974.09 MB, 1.03 GB, 1.10 GB, 1.19 GB, 1.26 GB, 1.30 GB, 1.35 GB, 1.48 GB, 1.54 GB, 1.59 GB, 1.70 GB, 1.86 GB, 1.94 GB, 2.04 GB, 2.11 GB, 2.20 GB, 2.26 GB, 2.30 GB, 2.36 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.82 - BytesRead: 2.40 GB (2574410819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2574410819) - BytesReadShortCircuit: 2.40 GB (2574410819) - DecompressionTime: 11s372ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 874.60 MB (917085656) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RowsRead: 211.83M (211834571) - RowsReturned: 211.83M (211834571) - RowsReturnedRate: 157.38 M/sec - ScanRangesComplete: 162 - ScannerThreadsInvoluntaryContextSwitches: 506 - ScannerThreadsTotalWallClockTime: 1h10m - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 1s820ms - ScannerThreadsUserTime: 45s016ms - ScannerThreadsVoluntaryContextSwitches: 207.43K (207433) - TotalRawHdfsReadTime(*): 1s803ms - TotalReadThroughput: 19.11 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac23301 (host=atlas-ch2-16.sys.comcast.net:22000):(Total: 2m52s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:12/518.04 MB 6:14/586.55 MB 10:10/370.22 MB 9:16/711.83 MB 2:14/857.09 MB 11:18/1.03 GB 3:20/1.06 GB 4:16/910.45 MB 5:12/789.40 MB 0:15/813.60 MB 8:14/654.44 MB 1:13/710.64 MB MemoryUsage(4s000ms): 1.15 GB, 1.96 GB, 2.42 GB, 3.00 GB, 3.15 GB, 3.37 GB, 3.56 GB, 4.01 GB, 4.16 GB, 4.19 GB, 4.33 GB, 4.31 GB, 4.33 GB, 4.54 GB, 4.57 GB, 4.59 GB, 4.62 GB, 4.69 GB, 4.81 GB, 4.90 GB, 4.91 GB, 4.94 GB, 4.97 GB, 5.16 GB, 5.30 GB, 5.39 GB, 5.39 GB, 5.35 GB, 5.33 GB, 5.28 GB, 5.15 GB, 4.99 GB, 4.80 GB, 4.71 GB, 4.13 GB, 3.45 GB, 2.95 GB, 2.43 GB, 1.88 GB, 1.33 GB, 775.39 MB, 418.94 MB, 788.80 MB ThreadUsage(4s000ms): 27, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 26, 18, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.12 - PeakMemoryUsage: 5.41 GB (5808370112) - PerHostPeakMemUsage: 5.61 GB (6022812096) - PrepareTime: 277.287ms - RowsProduced: 37.63M (37625771) - TotalCpuTime: 1h15m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 52.45ms - TotalStorageWaitTime: 8s063ms CodeGen:(Total: 577.828ms, non-child: 577.828ms, % non-child: 100.00%) - CodegenTime: 2.810ms - CompileTime: 305.292ms - LoadTime: 271.210ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s488ms, non-child: 29s488ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629310851) - NetworkThroughput(*): 29.57 MB/sec - OverallThroughput: 52.69 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 12s218ms - ThriftTransmitTime(*): 52s552ms - UncompressedRowBatchSize: 3.41 GB (3660813746) AGGREGATION_NODE (id=1):(Total: 2m23s, non-child: 2m21s, % non-child: 98.91%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m10s - GetNewBlockTime: 33.821ms - GetResultsTime: 4s782ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.85 GB (5202543880) - PinTime: 704.289ms - RowsRepartitioned: 6.68M (6683107) - RowsReturned: 37.63M (37625771) - RowsReturnedRate: 262.62 K/sec - SpilledPartitions: 1 - UnpinTime: 181.967us HDFS_SCAN_NODE (id=0):(Total: 1s560ms, non-child: 1s560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:12/518.04 MB 6:14/586.55 MB 10:10/370.22 MB 9:16/711.83 MB 2:14/857.09 MB 11:18/1.03 GB 3:20/1.06 GB 4:16/910.45 MB 5:12/789.40 MB 0:15/813.60 MB 8:14/654.44 MB 1:13/710.64 MB Hdfs Read Thread Concurrency Bucket: 0:98.49% 1:1.509% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:7 PARQUET/SNAPPY:334 ExecOption: Codegen enabled: 0 out of 174 BytesRead(4s000ms): 429.75 MB, 495.12 MB, 514.87 MB, 608.29 MB, 672.22 MB, 769.40 MB, 857.33 MB, 927.42 MB, 968.91 MB, 992.52 MB, 1.03 GB, 1.12 GB, 1.17 GB, 1.25 GB, 1.35 GB, 1.46 GB, 1.55 GB, 1.55 GB, 1.64 GB, 1.84 GB, 1.93 GB, 1.99 GB, 2.06 GB, 2.13 GB, 2.16 GB, 2.23 GB, 2.28 GB, 2.33 GB, 2.37 GB, 2.41 GB, 2.41 GB, 2.41 GB, 2.42 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.89 - BytesRead: 2.43 GB (2606216315) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.43 GB (2606216315) - BytesReadShortCircuit: 2.43 GB (2606216315) - DecompressionTime: 12s446ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 849.92 MB (891204752) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RowsRead: 213.97M (213967951) - RowsReturned: 213.97M (213967951) - RowsReturnedRate: 137.15 M/sec - ScanRangesComplete: 174 - ScannerThreadsInvoluntaryContextSwitches: 580 - ScannerThreadsTotalWallClockTime: 1h12m - MaterializeTupleTime(*): 1h12m - ScannerThreadsSysTime: 1s774ms - ScannerThreadsUserTime: 49s715ms - ScannerThreadsVoluntaryContextSwitches: 209.51K (209510) - TotalRawHdfsReadTime(*): 1s802ms - TotalReadThroughput: 18.69 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d6 (host=atlas-ch2-35.sys.comcast.net:22000):(Total: 2m47s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:14/622.48 MB 5:8/518.37 MB 9:15/943.82 MB 1:13/573.19 MB 4:20/1.17 GB 8:17/738.86 MB 3:15/862.57 MB 11:16/609.16 MB 2:13/568.26 MB 7:20/932.30 MB 6:15/692.45 MB 10:16/698.14 MB MemoryUsage(4s000ms): 1.29 GB, 2.04 GB, 2.51 GB, 3.02 GB, 3.12 GB, 3.38 GB, 3.52 GB, 4.07 GB, 4.13 GB, 4.24 GB, 4.32 GB, 4.37 GB, 4.48 GB, 4.60 GB, 4.62 GB, 4.57 GB, 4.58 GB, 4.79 GB, 4.79 GB, 4.84 GB, 4.86 GB, 4.86 GB, 4.87 GB, 5.16 GB, 5.35 GB, 5.39 GB, 5.39 GB, 5.30 GB, 5.16 GB, 5.02 GB, 4.84 GB, 4.79 GB, 4.59 GB, 3.94 GB, 3.31 GB, 2.76 GB, 2.17 GB, 1.62 GB, 1.03 GB, 486.27 MB, 706.54 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 24, 18, 8, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.42 - PeakMemoryUsage: 5.43 GB (5828035600) - PerHostPeakMemUsage: 5.63 GB (6042477584) - PrepareTime: 284.461ms - RowsProduced: 37.70M (37701734) - TotalCpuTime: 1h10m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 59.198ms - TotalStorageWaitTime: 7s817ms CodeGen:(Total: 613.817ms, non-child: 613.817ms, % non-child: 100.00%) - CodegenTime: 3.7ms - CompileTime: 334.581ms - LoadTime: 277.837ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s727ms, non-child: 29s727ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1632959813) - NetworkThroughput(*): 28.00 MB/sec - OverallThroughput: 52.39 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s880ms - ThriftTransmitTime(*): 55s627ms - UncompressedRowBatchSize: 3.42 GB (3668309908) AGGREGATION_NODE (id=1):(Total: 2m17s, non-child: 2m15s, % non-child: 98.89%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m5s - GetNewBlockTime: 34.324ms - GetResultsTime: 3s849ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.90 GB (5261213760) - PinTime: 650.302ms - RowsRepartitioned: 6.63M (6631829) - RowsReturned: 37.70M (37701734) - RowsReturnedRate: 274.30 K/sec - SpilledPartitions: 1 - UnpinTime: 177.913us HDFS_SCAN_NODE (id=0):(Total: 1s525ms, non-child: 1s525ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:14/622.48 MB 5:8/518.37 MB 9:15/943.82 MB 1:13/573.19 MB 4:20/1.17 GB 8:17/738.86 MB 3:15/862.57 MB 11:16/609.16 MB 2:13/568.26 MB 7:20/932.30 MB 6:15/692.45 MB 10:16/698.14 MB Hdfs Read Thread Concurrency Bucket: 0:98.82% 1:0.7843% 2:0.3922% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:334 ExecOption: Codegen enabled: 0 out of 182 BytesRead(4s000ms): 410.70 MB, 475.56 MB, 512.20 MB, 592.85 MB, 624.60 MB, 753.21 MB, 851.50 MB, 900.64 MB, 985.39 MB, 1.01 GB, 1.08 GB, 1.22 GB, 1.26 GB, 1.35 GB, 1.42 GB, 1.48 GB, 1.54 GB, 1.58 GB, 1.65 GB, 1.79 GB, 1.89 GB, 1.94 GB, 2.02 GB, 2.11 GB, 2.19 GB, 2.28 GB, 2.34 GB, 2.36 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.40 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 32.08 - BytesRead: 2.40 GB (2582148382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2582148382) - BytesReadShortCircuit: 2.40 GB (2582148382) - DecompressionTime: 13s751ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 792.33 MB (830817296) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RowsRead: 212.30M (212298748) - RowsReturned: 212.30M (212298748) - RowsReturnedRate: 139.20 M/sec - ScanRangesComplete: 182 - ScannerThreadsInvoluntaryContextSwitches: 393 - ScannerThreadsTotalWallClockTime: 1h8m - MaterializeTupleTime(*): 1h7m - ScannerThreadsSysTime: 1s819ms - ScannerThreadsUserTime: 50s325ms - ScannerThreadsVoluntaryContextSwitches: 207.92K (207918) - TotalRawHdfsReadTime(*): 1s842ms - TotalReadThroughput: 19.24 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232f9 (host=atlas-ch2-19.sys.comcast.net:22000):(Total: 2m50s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:9/319.87 MB 10:13/765.94 MB 3:19/1.01 GB 4:12/703.28 MB 8:14/718.37 MB 6:21/1.14 GB 9:10/435.17 MB 5:18/957.49 MB 0:14/681.30 MB 1:15/755.49 MB 11:12/699.94 MB 2:15/726.19 MB MemoryUsage(4s000ms): 1.14 GB, 1.97 GB, 2.43 GB, 2.96 GB, 3.07 GB, 3.44 GB, 3.63 GB, 4.13 GB, 4.12 GB, 4.29 GB, 4.37 GB, 4.44 GB, 4.63 GB, 4.65 GB, 4.62 GB, 4.62 GB, 4.84 GB, 4.90 GB, 4.93 GB, 4.92 GB, 4.91 GB, 4.96 GB, 5.16 GB, 5.36 GB, 5.36 GB, 5.39 GB, 5.37 GB, 5.34 GB, 5.29 GB, 5.22 GB, 5.09 GB, 4.91 GB, 4.76 GB, 4.68 GB, 4.15 GB, 3.57 GB, 2.95 GB, 2.35 GB, 1.78 GB, 1.23 GB, 631.33 MB, 573.72 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 31, 29, 24, 14, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 26.12 - PeakMemoryUsage: 5.41 GB (5803711544) - PerHostPeakMemUsage: 5.60 GB (6018153528) - PrepareTime: 259.670ms - RowsProduced: 37.62M (37617512) - TotalCpuTime: 1h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 51.481ms - TotalStorageWaitTime: 7s553ms CodeGen:(Total: 599.301ms, non-child: 599.301ms, % non-child: 100.00%) - CodegenTime: 2.831ms - CompileTime: 344.309ms - LoadTime: 253.728ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 29s622ms, non-child: 29s622ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629245609) - NetworkThroughput(*): 29.85 MB/sec - OverallThroughput: 52.45 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 13s681ms - ThriftTransmitTime(*): 52s056ms - UncompressedRowBatchSize: 3.41 GB (3660155727) AGGREGATION_NODE (id=1):(Total: 2m21s, non-child: 2m19s, % non-child: 98.91%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m10s - GetNewBlockTime: 37.590ms - GetResultsTime: 3s922ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.82 GB (5177355520) - PinTime: 598.274ms - RowsRepartitioned: 6.60M (6597581) - RowsReturned: 37.62M (37617512) - RowsReturnedRate: 266.54 K/sec - SpilledPartitions: 1 - UnpinTime: 173.749us HDFS_SCAN_NODE (id=0):(Total: 1s533ms, non-child: 1s533ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:9/319.87 MB 10:13/765.94 MB 3:19/1.01 GB 4:12/703.28 MB 8:14/718.37 MB 6:21/1.14 GB 9:10/435.17 MB 5:18/957.49 MB 0:14/681.30 MB 1:15/755.49 MB 11:12/699.94 MB 2:15/726.19 MB Hdfs Read Thread Concurrency Bucket: 0:98.86% 1:1.136% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:11 PARQUET/SNAPPY:322 ExecOption: Codegen enabled: 0 out of 172 BytesRead(4s000ms): 417.89 MB, 477.58 MB, 492.36 MB, 554.62 MB, 615.45 MB, 794.03 MB, 860.91 MB, 881.41 MB, 1013.42 MB, 1.03 GB, 1.17 GB, 1.28 GB, 1.34 GB, 1.42 GB, 1.47 GB, 1.55 GB, 1.64 GB, 1.72 GB, 1.83 GB, 1.88 GB, 1.95 GB, 2.04 GB, 2.10 GB, 2.12 GB, 2.17 GB, 2.27 GB, 2.32 GB, 2.37 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 32.64 - BytesRead: 2.40 GB (2575741689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.40 GB (2575741689) - BytesReadShortCircuit: 2.40 GB (2575741689) - DecompressionTime: 9s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 799.06 MB (837878480) - PerReadThreadRawHdfsThroughput: 1.62 GB/sec - RowsRead: 211.22M (211222944) - RowsReturned: 211.22M (211222944) - RowsReturnedRate: 137.70 M/sec - ScanRangesComplete: 172 - ScannerThreadsInvoluntaryContextSwitches: 634 - ScannerThreadsTotalWallClockTime: 1h11m - MaterializeTupleTime(*): 1h11m - ScannerThreadsSysTime: 1s395ms - ScannerThreadsUserTime: 36s616ms - ScannerThreadsVoluntaryContextSwitches: 206.80K (206796) - TotalRawHdfsReadTime(*): 1s483ms - TotalReadThroughput: 18.61 MB/sec Instance bc4f82f61a2b9b6e:23378c97dac232d7 (host=atlas-ch2-33.sys.comcast.net:22000):(Total: 2m51s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:7/349.88 MB 3:14/662.36 MB 4:16/864.96 MB 7:14/647.59 MB 1:12/580.69 MB 6:16/631.62 MB 8:12/852.85 MB 10:17/1.05 GB 5:18/1.17 GB 0:14/826.49 MB 11:11/520.77 MB 2:14/770.57 MB MemoryUsage(4s000ms): 1.35 GB, 2.12 GB, 2.65 GB, 3.06 GB, 3.15 GB, 3.44 GB, 3.54 GB, 4.12 GB, 4.12 GB, 4.20 GB, 4.37 GB, 4.40 GB, 4.45 GB, 4.62 GB, 4.60 GB, 4.56 GB, 4.56 GB, 4.74 GB, 4.84 GB, 4.87 GB, 4.88 GB, 4.86 GB, 4.85 GB, 4.85 GB, 5.01 GB, 5.24 GB, 5.41 GB, 5.34 GB, 5.23 GB, 5.10 GB, 4.99 GB, 4.84 GB, 4.71 GB, 4.34 GB, 3.82 GB, 3.29 GB, 2.75 GB, 2.17 GB, 1.65 GB, 1.09 GB, 538.85 MB, 548.69 MB ThreadUsage(4s000ms): 31, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 30, 24, 21, 16, 8, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 25.20 - PeakMemoryUsage: 5.46 GB (5863622768) - PerHostPeakMemUsage: 5.65 GB (6069741672) - PrepareTime: 289.398ms - RowsProduced: 37.41M (37407762) - TotalCpuTime: 1h11m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 56.878ms - TotalStorageWaitTime: 7s927ms CodeGen:(Total: 594.824ms, non-child: 594.824ms, % non-child: 100.00%) - CodegenTime: 2.829ms - CompileTime: 310.176ms - LoadTime: 283.242ms - ModuleFileSize: 1.94 MB (2033316) DataStreamSender (dst_id=3):(Total: 30s675ms, non-child: 30s675ms, % non-child: 100.00%) - BytesSent: 1.51 GB (1620271586) - NetworkThroughput(*): 28.66 MB/sec - OverallThroughput: 50.37 MB/sec - PeakMemoryUsage: 3.28 MB (3440640) - SerializeBatchTime: 14s438ms - ThriftTransmitTime(*): 53s924ms - UncompressedRowBatchSize: 3.39 GB (3639674141) AGGREGATION_NODE (id=1):(Total: 2m20s, non-child: 2m18s, % non-child: 98.89%) ExecOption: Codegen Enabled, Spilled - BuildTime: 2m9s - GetNewBlockTime: 33.2ms - GetResultsTime: 3s958ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 3 - MaxPartitionLevel: 1 - NumRepartitions: 1 - PartitionsCreated: 64 - PeakMemoryUsage: 4.66 GB (5005434872) - PinTime: 612.587ms - RowsRepartitioned: 6.65M (6653449) - RowsReturned: 37.41M (37407762) - RowsReturnedRate: 266.35 K/sec - SpilledPartitions: 1 - UnpinTime: 28.306us HDFS_SCAN_NODE (id=0):(Total: 1s558ms, non-child: 1s558ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:7/349.88 MB 3:14/662.36 MB 4:16/864.96 MB 7:14/647.59 MB 1:12/580.69 MB 6:16/631.62 MB 8:12/852.85 MB 10:17/1.05 GB 5:18/1.17 GB 0:14/826.49 MB 11:11/520.77 MB 2:14/770.57 MB Hdfs Read Thread Concurrency Bucket: 0:99.24% 1:0.7634% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% File Formats: PARQUET/NONE:9 PARQUET/SNAPPY:312 ExecOption: Codegen enabled: 0 out of 165 BytesRead(4s000ms): 472.29 MB, 541.27 MB, 587.88 MB, 622.41 MB, 640.17 MB, 768.09 MB, 817.06 MB, 873.36 MB, 994.48 MB, 1.03 GB, 1.12 GB, 1.22 GB, 1.27 GB, 1.33 GB, 1.39 GB, 1.44 GB, 1.50 GB, 1.61 GB, 1.69 GB, 1.80 GB, 1.87 GB, 1.93 GB, 1.97 GB, 2.04 GB, 2.09 GB, 2.24 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.37 GB, 2.38 GB, 2.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 31.69 - BytesRead: 2.41 GB (2589507685) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2589507685) - BytesReadShortCircuit: 2.41 GB (2589507685) - DecompressionTime: 14s459ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 12 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 818.33 MB (858077680) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RowsRead: 213.02M (213020233) - RowsReturned: 213.02M (213020233) - RowsReturnedRate: 136.65 M/sec - ScanRangesComplete: 165 - ScannerThreadsInvoluntaryContextSwitches: 649 - ScannerThreadsTotalWallClockTime: 1h9m - MaterializeTupleTime(*): 1h8m - ScannerThreadsSysTime: 1s714ms - ScannerThreadsUserTime: 53s816ms - ScannerThreadsVoluntaryContextSwitches: 208.58K (208579) - TotalRawHdfsReadTime(*): 2s008ms - TotalReadThroughput: 18.78 MB/sec