Query (id=1435c5e25359ded:9a359144764e26b5): Summary: Session ID: 8a490f799f27c012:a09b109a4f47528c Session Type: BEESWAX Start Time: 2015-02-27 18:02:51.657849000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.2.0-cdh5-INTERNAL RELEASE (build d241598463612b01c22012c630d965191baa5ef4) User: systest@IMPALA.CLOUDERA.COM Connected User: systest@IMPALA.CLOUDERA.COM Delegated User: Network Address: 10.20.130.120:56600 Default Db: tpch300gb Sql Statement: select LEAST(COALESCE((supplier_no) * (supplier_no), -355), COALESCE(MIN((supplier_no) * (supplier_no)), 137)) AS int_col, COUNT(COALESCE((supplier_no) * (supplier_no), supplier_no)) AS int_col_2, (supplier_no) + (supplier_no) AS int_col_3, (supplier_no) * (supplier_no) AS int_col_4 FROM revenue GROUP BY (supplier_no) + (supplier_no), (supplier_no) * (supplier_no) UNION SELECT (t1.l_suppkey) * (t1.l_quantity) AS decimal_col, t1.l_orderkey, LEAST(COALESCE(MIN(868) OVER (), -233), -755.787102873) AS float_col, COALESCE(SUM(t1.l_suppkey), t1.l_orderkey, LEAST(COALESCE(t1.l_orderkey, 650), COALESCE(t1.l_orderkey, 517))) AS int_col FROM lineitem t1 WHERE (t1.l_suppkey) != (t1.l_tax) GROUP BY (t1.l_suppkey) * (t1.l_quantity), t1.l_orderkey Coordinator: e1320.halxg.cloudera.com:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=14.75GB VCores=2 F07:PLAN FRAGMENT [UNPARTITIONED] 15:EXCHANGE [UNPARTITIONED] hosts=1 per-host-mem=unavailable tuple-ids=5 row-size=40B cardinality=179998909 F06:PLAN FRAGMENT [HASH(int_col,int_col_2,int_col_3,int_col_4)] DATASTREAM SINK [FRAGMENT=F07, EXCHANGE=15, UNPARTITIONED] 14:AGGREGATE [FINALIZE] | group by: int_col, int_col_2, int_col_3, int_col_4 | hosts=1 per-host-mem=7.38GB | tuple-ids=5 row-size=40B cardinality=179998909 | 13:EXCHANGE [HASH(int_col,int_col_2,int_col_3,int_col_4)] hosts=1 per-host-mem=0B tuple-ids=5 row-size=40B cardinality=179998909 F05:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F06, EXCHANGE=13, HASH(int_col,int_col_2,int_col_3,int_col_4)] 06:AGGREGATE | group by: int_col, int_col_2, int_col_3, int_col_4 | hosts=1 per-host-mem=7.38GB | tuple-ids=5 row-size=40B cardinality=179998909 | 00:UNION | hosts=1 per-host-mem=0B | tuple-ids=5 row-size=40B cardinality=179998909 | |--12:EXCHANGE [RANDOM] | hosts=10 per-host-mem=0B | tuple-ids=3,6 row-size=34B cardinality=179998909 | 08:AGGREGATE [FINALIZE] | output: min:merge((supplier_no) * (supplier_no)), count:merge(coalesce((supplier_no) * (supplier_no), supplier_no)) | group by: (supplier_no) + (supplier_no), (supplier_no) * (supplier_no) | hosts=1 per-host-mem=10.00MB | tuple-ids=1 row-size=32B cardinality=0 | 07:EXCHANGE [HASH((supplier_no) + (supplier_no),(supplier_no) * (supplier_no))] hosts=1 per-host-mem=0B tuple-ids=1 row-size=32B cardinality=0 F04:PLAN FRAGMENT [UNPARTITIONED] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=12, RANDOM] 05:ANALYTIC | functions: min(868) | hosts=10 per-host-mem=unavailable | tuple-ids=3,6 row-size=34B cardinality=179998909 | 11:EXCHANGE [UNPARTITIONED] hosts=10 per-host-mem=unavailable tuple-ids=3 row-size=32B cardinality=179998909 F03:PLAN FRAGMENT [HASH((t1.l_suppkey) * (t1.l_quantity),t1.l_orderkey)] DATASTREAM SINK [FRAGMENT=F04, EXCHANGE=11, UNPARTITIONED] 10:AGGREGATE [FINALIZE] | output: sum:merge(t1.l_suppkey) | group by: (t1.l_suppkey) * (t1.l_quantity), t1.l_orderkey | hosts=10 per-host-mem=5.90GB | tuple-ids=3 row-size=32B cardinality=179998909 | 09:EXCHANGE [HASH((t1.l_suppkey) * (t1.l_quantity),t1.l_orderkey)] hosts=10 per-host-mem=0B tuple-ids=3 row-size=32B cardinality=179998909 F02:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F03, EXCHANGE=09, HASH((t1.l_suppkey) * (t1.l_quantity),t1.l_orderkey)] 04:AGGREGATE | output: sum(t1.l_suppkey) | group by: (t1.l_suppkey) * (t1.l_quantity), t1.l_orderkey | hosts=10 per-host-mem=5.90GB | tuple-ids=3 row-size=32B cardinality=179998909 | 03:SCAN HDFS [tpch300gb.lineitem t1, RANDOM] partitions=1/1 files=1 size=225.14GB predicates: (t1.l_suppkey) != (t1.l_tax) table stats: 1799989091 rows total column stats: all hosts=10 per-host-mem=5.62GB tuple-ids=2 row-size=32B cardinality=179998909 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=07, HASH((supplier_no) + (supplier_no),(supplier_no) * (supplier_no))] 02:AGGREGATE | output: min((supplier_no) * (supplier_no)), count(coalesce((supplier_no) * (supplier_no), supplier_no)) | group by: (supplier_no) + (supplier_no), (supplier_no) * (supplier_no) | hosts=1 per-host-mem=10.00MB | tuple-ids=1 row-size=32B cardinality=0 | 01:SCAN HDFS [tpch300gb.revenue, RANDOM] partitions=1/1 files=0 size=0B table stats: 0 rows total column stats: all hosts=1 per-host-mem=0B tuple-ids=0 row-size=8B cardinality=0 ---------------- Estimated Per-Host Mem: 15839904256 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 510.952ms - Analysis finished: 126.592ms (126.592ms) - Equivalence classes computed: 128.164ms (1.572ms) - Single node plan created: 191.648ms (63.483ms) - Distributed plan created: 200.165ms (8.517ms) - Planning finished: 510.952ms (310.786ms) Query Timeline: 2h44m - Start execution: 90.540us (90.540us) - Planning finished: 876.740ms (876.649ms) - Ready to start remote fragments: 893.752ms (17.11ms) - Remote fragments started: 2s431ms (1s538ms) ImpalaServer: - ClientFetchWaitTimer: 0ns - RowMaterializationTimer: 0ns Execution Profile 1435c5e25359ded:9a359144764e26b5:(Total: 1s538ms, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 24, last: 0.191162ns, min: 0.006102ns, max: 0.510034ns, mean: 0.225582ns, stddev: 0.079910ns - FinalizationTimer: 0ns Coordinator Fragment F07:(Total: 407.943us, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4m16s): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB ThreadUsage(500.0ms): 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 68.550us - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 10.62K (10623) - BlocksRecycled: 15.25K (15252) - BufferedPins: 3.03K (3034) - BytesWritten: 89.47 GB (96064130840) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 40.23 GB (43201716224) - TotalBufferWaitTime: 239.998ms - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 7m1s EXCHANGE_NODE (id=15): BytesReceived(4m16s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F06:(Total: 507.495ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 10.74 GB (11534626816) - PerHostPeakMemUsage: 40.54 GB (43524388656) - PrepareTime: 506.974ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 2h42m - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 429.461ms, non-child: 429.461ms, % non-child: 100.00%) - CodegenTime: 30.410ms - CompileTime: 270ns - LoadTime: 9.203ms - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 354.421ms DataStreamSender (dst_id=15):(Total: 29.5us, non-child: 29.5us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=14):(Total: 468.363ms, non-child: 0ns, % non-child: 0.00%) - BuildTime: 1m37s - GetNewBlockTime: 22.817ms - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 10.74 GB (11534557184) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 1 (1) - UnpinTime: 5.9us EXCHANGE_NODE (id=13):(Total: 2h42m, non-child: 2h42m, % non-child: 100.00%) - BytesReceived: 4.90 GB (5263041282) - ConvertRowBatchTime: 7s415ms - DeserializeRowBatchTimer: 19s102ms - FirstBatchArrivalWaitTime: 2h36m - PeakMemoryUsage: 0 - RowsReturned: 206.92M (206923034) - RowsReturnedRate: 21.17 K/sec - SendersBlockedTimer: 1s767ms - SendersBlockedTotalTimer(*): 1s767ms Averaged Fragment F05:(Total: 2h44m, non-child: 44.229ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 38.08 GB (40892162048) - PerHostPeakMemUsage: 40.54 GB (43524388656) - PrepareTime: 342.987ms - RowsProduced: 206.26M (206264602) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1h46m - TotalNetworkSendTime: 5m28s - TotalStorageWaitTime: 0ns CodeGen:(Total: 678.119ms, non-child: 678.119ms, % non-child: 100.00%) - CodegenTime: 38.43ms - CompileTime: 105.134ms - LoadTime: 109.890us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 312.817ms - PrepareTime: 251.852ms DataStreamSender (dst_id=13):(Total: 7m4s, non-child: 7m4s, % non-child: 100.00%) - BytesSent: 4.89 GB (5246292211) - NetworkThroughput(*): 10.63 MB/sec - OverallThroughput: 11.79 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 1m34s - ThriftTransmitTime(*): 7m50s - UncompressedRowBatchSize: 8.45 GB (9076448216) AGGREGATION_NODE (id=6):(Total: 2h37m, non-child: 41m9s, % non-child: 26.15%) - BuildTime: 40m5s - GetNewBlockTime: 578.125ms - GetResultsTime: 56s673ms - HashBuckets: 268.44M (268435456) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 38.08 GB (40891826176) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 206.26M (206264602) - RowsReturnedRate: 21.84 K/sec - SpilledPartitions: 23 (23) - UnpinTime: 14.466ms UNION_NODE (id=0):(Total: 1h56m, non-child: 8m53s, % non-child: 7.65%) - PeakMemoryUsage: 123.99 KB (126968) - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 258.11 K/sec EXCHANGE_NODE (id=12):(Total: 1h47m, non-child: 1h47m, % non-child: 100.00%) - BytesReceived: 49.37 GB (53010138829) - ConvertRowBatchTime: 1m8s - DeserializeRowBatchTimer: 2m53s - FirstBatchArrivalWaitTime: 18m31s - PeakMemoryUsage: 0 - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 279.52 K/sec - SendersBlockedTimer: 4m33s - SendersBlockedTotalTimer(*): 4m33s AGGREGATION_NODE (id=8):(Total: 587.459ms, non-child: 79.51ms, % non-child: 13.46%) - BuildTime: 4.34us - GetNewBlockTime: 323.520us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 6.26 MB (6561792) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.665us EXCHANGE_NODE (id=7):(Total: 508.407ms, non-child: 508.407ms, % non-child: 100.00%) - BytesReceived: 0 - ConvertRowBatchTime: 874ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 508.400ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F04:(Total: 2h36m, non-child: 7s144ms, % non-child: 0.08%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 31.88 GB (34234296128) - PerHostPeakMemUsage: 40.54 GB (43524388656) - PrepareTime: 1.67ms - RowsProduced: 1.80B (1799988957) - TotalCpuTime: 25m52s - TotalNetworkReceiveTime: 12m - TotalNetworkSendTime: 1h58m - TotalStorageWaitTime: 0ns DataStreamSender (dst_id=12):(Total: 2h8m, non-child: 2h8m, % non-child: 100.00%) - BytesSent: 49.37 GB (53010138829) - NetworkThroughput(*): 6.54 MB/sec - OverallThroughput: 6.55 MB/sec - PeakMemoryUsage: 5.81 KB (5952) - SerializeBatchTime: 9m45s - ThriftTransmitTime(*): 2h8m - UncompressedRowBatchSize: 87.18 GB (93613501924) ANALYTIC_EVAL_NODE (id=5):(Total: 27m24s, non-child: 14m16s, % non-child: 52.07%) - EvaluationTime: 14m2s - GetNewBlockTime: 4s211ms - PeakMemoryUsage: 31.88 GB (34234028032) - PinTime: 6m59s - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 1.09 M/sec - UnpinTime: 15.191ms EXCHANGE_NODE (id=11):(Total: 13m8s, non-child: 13m8s, % non-child: 100.00%) - BytesReceived: 39.94 GB (42889395474) - ConvertRowBatchTime: 1m2s - DeserializeRowBatchTimer: 2m32s - FirstBatchArrivalWaitTime: 5m56s - PeakMemoryUsage: 0 - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 2.28 M/sec - SendersBlockedTimer: 1s316ms - SendersBlockedTotalTimer(*): 12s281ms Averaged Fragment F03:(Total: 17m58s, non-child: 438.319ms, % non-child: 0.04%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 15.43 GB (16566915033) - PrepareTime: 216.992ms - RowsProduced: 180.00M (179998895) - TotalCpuTime: 3m29s - TotalNetworkReceiveTime: 3m55s - TotalNetworkSendTime: 10m34s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.79K (1786) - BlocksRecycled: 1.53K (1533) - BufferedPins: 14 (14) - BytesWritten: 325.04 MB (340831746) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 12.80 GB (13743430769) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 539.153ms CodeGen:(Total: 215.204ms, non-child: 215.204ms, % non-child: 100.00%) - CodegenTime: 684.886us - CompileTime: 836ns - LoadTime: 117.920us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 213.374ms DataStreamSender (dst_id=11):(Total: 11m29s, non-child: 11m29s, % non-child: 100.00%) - BytesSent: 3.99 GB (4288939547) - NetworkThroughput(*): 5.80 MB/sec - OverallThroughput: 5.94 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53s235ms - ThriftTransmitTime(*): 11m45s - UncompressedRowBatchSize: 7.38 GB (7920654661) AGGREGATION_NODE (id=10):(Total: 6m28s, non-child: 2m25s, % non-child: 37.58%) - BuildTime: 1m53s - GetNewBlockTime: 29.836ms - GetResultsTime: 26s811ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 393.539ms - RowsRepartitioned: 5.63M (5625143) - RowsReturned: 180.00M (179998895) - RowsReturnedRate: 463.82 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 33.536us EXCHANGE_NODE (id=9):(Total: 4m2s, non-child: 4m2s, % non-child: 100.00%) - BytesReceived: 4.05 GB (4346984401) - ConvertRowBatchTime: 5s471ms - DeserializeRowBatchTimer: 18s049ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.00M (179998895) - RowsReturnedRate: 743.17 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F02:(Total: 5m28s, non-child: 0ns, % non-child: 0.00%) split sizes: min: 22.25 GB, max: 22.62 GB, avg: 22.51 GB, stddev: 118.80 MB - AverageThreadTokens: 17.68 - PeakMemoryUsage: 12.22 GB (13117348249) - PerHostPeakMemUsage: 13.11 GB (14075208448) - PrepareTime: 191.343ms - RowsProduced: 180.00M (179998895) - TotalCpuTime: 1h35m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 8s068ms - TotalStorageWaitTime: 32s408ms CodeGen:(Total: 510.404ms, non-child: 510.404ms, % non-child: 100.00%) - CodegenTime: 402.511us - CompileTime: 51.618ms - LoadTime: 55.311us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 270.67ms - PrepareTime: 187.188ms DataStreamSender (dst_id=9):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) - BytesSent: 4.05 GB (4346984401) - NetworkThroughput(*): 6.01 MB/sec - OverallThroughput: 37.74 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 31s704ms - ThriftTransmitTime(*): 11m30s - UncompressedRowBatchSize: 7.38 GB (7921711810) AGGREGATION_NODE (id=4):(Total: 3m38s, non-child: 3m36s, % non-child: 99.00%) - BuildTime: 2m51s - GetNewBlockTime: 107.729ms - GetResultsTime: 37s796ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.87 GB (12742233292) - PinTime: 354.870ms - RowsRepartitioned: 5.63M (5625747) - RowsReturned: 180.00M (179998895) - RowsReturnedRate: 826.24 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 95.520us HDFS_SCAN_NODE (id=3):(Total: 2s179ms, non-child: 2s179ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 31.70 - BytesRead: 22.51 GB (24174647629) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.51 GB (24174521882) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.51 GB (24174521882) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 32 (32) - PeakMemoryUsage: 1.05 GB (1131727257) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 714 (714) - RowsRead: 180.00M (179998909) - RowsReturned: 180.00M (179998909) - RowsReturnedRate: 124.63 M/sec - ScanRangesComplete: 180 (180) - ScannerThreadsInvoluntaryContextSwitches: 36.37K (36373) - ScannerThreadsTotalWallClockTime: 1h31m - DelimiterParseTime: 48s760ms - MaterializeTupleTime(*): 50s439ms - ScannerThreadsSysTime: 896.347ms - ScannerThreadsUserTime: 1m45s - ScannerThreadsVoluntaryContextSwitches: 176.41K (176406) - TotalRawHdfsReadTime(*): 48s929ms - TotalReadThroughput: 132.61 MB/sec Averaged Fragment F00:(Total: 188.463ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 6.27 MB (6574080) - PerHostPeakMemUsage: 118.16 MB (123897664) - PrepareTime: 187.481ms - RowsProduced: 0 (0) - TotalCpuTime: 440.316ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 182ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 429.477ms, non-child: 429.477ms, % non-child: 100.00%) - CodegenTime: 5.275ms - CompileTime: 34.884ms - LoadTime: 40.442us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 215.875ms - PrepareTime: 177.323ms DataStreamSender (dst_id=7):(Total: 19.911us, non-child: 19.911us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=2):(Total: 187.859ms, non-child: 187.756ms, % non-child: 99.95%) - BuildTime: 2.36us - GetNewBlockTime: 1.645ms - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 6.26 MB (6561792) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.761us HDFS_SCAN_NODE (id=1):(Total: 103.161us, non-child: 103.161us, % non-child: 100.00%) - BytesRead: 0 - PeakMemoryUsage: 0 - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F06: Instance 1435c5e25359ded:9a359144764e26b7 (host=e1320.halxg.cloudera.com:22000):(Total: 507.495ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(4m16s): 6.25 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 215.47 MB, 3.47 GB ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 10.74 GB (11534626816) - PerHostPeakMemUsage: 40.54 GB (43524388656) - PrepareTime: 506.974ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 2h42m - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 429.461ms, non-child: 429.461ms, % non-child: 100.00%) - CodegenTime: 30.410ms - CompileTime: 270ns - LoadTime: 9.203ms - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 354.421ms DataStreamSender (dst_id=15):(Total: 29.5us, non-child: 29.5us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=14):(Total: 468.363ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Spilled - BuildTime: 1m37s - GetNewBlockTime: 22.817ms - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 10.74 GB (11534557184) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 1 (1) - UnpinTime: 5.9us EXCHANGE_NODE (id=13):(Total: 2h42m, non-child: 9s622ms, % non-child: 0.10%) BytesReceived(4m16s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 224.38 MB, 2.36 GB - BytesReceived: 4.90 GB (5263041282) - ConvertRowBatchTime: 7s415ms - DeserializeRowBatchTimer: 19s102ms - FirstBatchArrivalWaitTime: 2h36m - PeakMemoryUsage: 0 - RowsReturned: 206.92M (206923034) - RowsReturnedRate: 21.17 K/sec - SendersBlockedTimer: 1s767ms - SendersBlockedTotalTimer(*): 1s767ms Fragment F05: Instance 1435c5e25359ded:9a359144764e26b8 (host=e1320.halxg.cloudera.com:22000):(Total: 2h44m, non-child: 44.229ms, % non-child: 0.00%) MemoryUsage(4m16s): 6.35 MB, 6.32 MB, 6.32 MB, 6.32 MB, 1.21 GB, 5.00 GB, 8.81 GB, 12.63 GB, 16.46 GB, 19.90 GB, 23.73 GB, 28.30 GB, 31.77 GB, 35.27 GB, 37.45 GB, 37.42 GB, 37.31 GB, 37.03 GB, 37.29 GB, 37.28 GB, 37.14 GB, 37.05 GB, 36.90 GB, 36.82 GB, 36.97 GB, 37.22 GB, 36.30 GB, 37.09 GB, 36.51 GB, 36.81 GB, 36.30 GB, 37.02 GB, 36.08 GB, 35.82 GB, 36.87 GB, 36.44 GB, 34.88 GB, 29.88 GB ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 38.08 GB (40892162048) - PerHostPeakMemUsage: 40.54 GB (43524388656) - PrepareTime: 342.987ms - RowsProduced: 206.26M (206264602) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1h46m - TotalNetworkSendTime: 5m28s - TotalStorageWaitTime: 0ns CodeGen:(Total: 678.119ms, non-child: 678.119ms, % non-child: 100.00%) - CodegenTime: 38.43ms - CompileTime: 105.134ms - LoadTime: 109.890us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 312.817ms - PrepareTime: 251.852ms DataStreamSender (dst_id=13):(Total: 7m4s, non-child: 7m4s, % non-child: 100.00%) - BytesSent: 4.89 GB (5246292211) - NetworkThroughput(*): 10.63 MB/sec - OverallThroughput: 11.79 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 1m34s - ThriftTransmitTime(*): 7m50s - UncompressedRowBatchSize: 8.45 GB (9076448216) AGGREGATION_NODE (id=6):(Total: 2h37m, non-child: 41m9s, % non-child: 26.15%) ExecOption: Spilled - BuildTime: 40m5s - GetNewBlockTime: 578.125ms - GetResultsTime: 56s673ms - HashBuckets: 268.44M (268435456) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 38.08 GB (40891826176) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 206.26M (206264602) - RowsReturnedRate: 21.84 K/sec - SpilledPartitions: 23 (23) - UnpinTime: 14.466ms UNION_NODE (id=0):(Total: 1h56m, non-child: 8m53s, % non-child: 7.65%) - PeakMemoryUsage: 123.99 KB (126968) - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 258.11 K/sec EXCHANGE_NODE (id=12):(Total: 1h47m, non-child: 1m30s, % non-child: 1.41%) BytesReceived(4m16s): 0, 0, 0, 0, 375.55 MB, 1.90 GB, 3.49 GB, 5.08 GB, 6.66 GB, 8.29 GB, 9.87 GB, 11.36 GB, 13.01 GB, 14.67 GB, 16.33 GB, 17.94 GB, 19.52 GB, 20.48 GB, 21.57 GB, 23.12 GB, 24.66 GB, 26.21 GB, 27.75 GB, 29.29 GB, 30.85 GB, 32.40 GB, 33.96 GB, 35.52 GB, 37.10 GB, 38.65 GB, 40.22 GB, 41.53 GB, 43.09 GB, 44.63 GB, 46.17 GB, 47.70 GB - BytesReceived: 49.37 GB (53010138829) - ConvertRowBatchTime: 1m8s - DeserializeRowBatchTimer: 2m53s - FirstBatchArrivalWaitTime: 18m31s - PeakMemoryUsage: 0 - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 279.52 K/sec - SendersBlockedTimer: 4m33s - SendersBlockedTotalTimer(*): 4m33s AGGREGATION_NODE (id=8):(Total: 587.459ms, non-child: 79.51ms, % non-child: 13.46%) ExecOption: Codegen Enabled - BuildTime: 4.34us - GetNewBlockTime: 323.520us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 6.26 MB (6561792) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.665us EXCHANGE_NODE (id=7):(Total: 508.407ms, non-child: 6.876us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 874ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 508.400ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F04: Instance 1435c5e25359ded:9a359144764e26b9 (host=e1320.halxg.cloudera.com:22000):(Total: 2h36m, non-child: 7s144ms, % non-child: 0.08%) MemoryUsage(4m16s): 25.81 KB, 4.54 GB, 16.74 GB, 16.43 MB, 16.16 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.04 MB, 16.35 MB, 16.68 MB, 16.22 MB, 17.02 MB, 16.68 MB, 16.77 MB, 16.68 MB, 16.69 MB, 16.46 MB, 16.87 MB, 16.83 MB, 16.68 MB, 16.77 MB, 16.76 MB, 16.65 MB, 16.66 MB, 16.57 MB, 16.62 MB, 16.72 MB, 16.83 MB, 16.90 MB ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 31.88 GB (34234296128) - PerHostPeakMemUsage: 40.54 GB (43524388656) - PrepareTime: 1.67ms - RowsProduced: 1.80B (1799988957) - TotalCpuTime: 25m52s - TotalNetworkReceiveTime: 12m - TotalNetworkSendTime: 1h58m - TotalStorageWaitTime: 0ns DataStreamSender (dst_id=12):(Total: 2h8m, non-child: 2h8m, % non-child: 100.00%) - BytesSent: 49.37 GB (53010138829) - NetworkThroughput(*): 6.54 MB/sec - OverallThroughput: 6.55 MB/sec - PeakMemoryUsage: 5.81 KB (5952) - SerializeBatchTime: 9m45s - ThriftTransmitTime(*): 2h8m - UncompressedRowBatchSize: 87.18 GB (93613501924) ANALYTIC_EVAL_NODE (id=5):(Total: 27m24s, non-child: 14m16s, % non-child: 52.07%) - EvaluationTime: 14m2s - GetNewBlockTime: 4s211ms - PeakMemoryUsage: 31.88 GB (34234028032) - PinTime: 6m59s - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 1.09 M/sec - UnpinTime: 15.191ms EXCHANGE_NODE (id=11):(Total: 13m8s, non-child: 1m48s, % non-child: 13.78%) BytesReceived(4m16s): 0, 2.70 GB, 16.02 GB, 29.78 GB, 39.57 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB, 39.94 GB - BytesReceived: 39.94 GB (42889395474) - ConvertRowBatchTime: 1m2s - DeserializeRowBatchTimer: 2m32s - FirstBatchArrivalWaitTime: 5m56s - PeakMemoryUsage: 0 - RowsReturned: 1.80B (1799988957) - RowsReturnedRate: 2.28 M/sec - SendersBlockedTimer: 1s316ms - SendersBlockedTotalTimer(*): 12s281ms Fragment F03: Instance 1435c5e25359ded:9a359144764e26c1 (host=e1518.halxg.cloudera.com:22000):(Total: 18m9s, non-child: 485.747ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.16 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 892.27 MB, 2.86 GB, 5.31 GB, 7.77 GB, 10.25 GB, 11.71 GB, 11.83 GB, 11.33 GB, 10.79 GB, 10.19 GB, 9.68 GB, 9.07 GB, 8.58 GB, 8.01 GB, 7.50 GB, 7.01 GB, 6.44 GB, 5.95 GB, 5.47 GB, 4.90 GB, 4.41 GB, 3.92 GB, 3.34 GB, 2.86 GB, 2.37 GB, 1.80 GB, 1.29 GB, 681.70 MB, 463.99 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 12.92 GB (13870395344) - PrepareTime: 205.770ms - RowsProduced: 179.97M (179974213) - TotalCpuTime: 3m26s - TotalNetworkReceiveTime: 3m58s - TotalNetworkSendTime: 10m45s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.79K (1786) - BlocksRecycled: 1.54K (1539) - BufferedPins: 15 (15) - BytesWritten: 317.98 MB (333422080) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 12.79 GB (13736574976) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 491.846ms CodeGen:(Total: 204.431ms, non-child: 204.431ms, % non-child: 100.00%) - CodegenTime: 573.306us - CompileTime: 599ns - LoadTime: 133.700us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 202.820ms DataStreamSender (dst_id=11):(Total: 11m41s, non-child: 11m41s, % non-child: 100.00%) - BytesSent: 3.99 GB (4288355753) - NetworkThroughput(*): 5.71 MB/sec - OverallThroughput: 5.83 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53s179ms - ThriftTransmitTime(*): 11m55s - UncompressedRowBatchSize: 7.38 GB (7919568532) AGGREGATION_NODE (id=10):(Total: 6m27s, non-child: 2m22s, % non-child: 36.74%) ExecOption: Spilled - BuildTime: 1m50s - GetNewBlockTime: 14.749ms - GetResultsTime: 27s052ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 179.906ms - RowsRepartitioned: 5.63M (5625226) - RowsReturned: 179.97M (179974213) - RowsReturnedRate: 464.34 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 30.499us EXCHANGE_NODE (id=9):(Total: 4m5s, non-child: 10s010ms, % non-child: 4.08%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.11 MB, 99.26 MB, 251.87 MB, 448.47 MB, 633.17 MB, 840.08 MB, 1.04 GB, 1.25 GB, 1.47 GB, 1.68 GB, 1.87 GB, 2.08 GB, 2.30 GB, 2.52 GB, 2.73 GB, 2.95 GB, 3.17 GB, 3.39 GB, 3.59 GB, 3.77 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.03 GB - BytesReceived: 4.05 GB (4346393413) - ConvertRowBatchTime: 5s601ms - DeserializeRowBatchTimer: 17s946ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 179.97M (179974213) - RowsReturnedRate: 733.98 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26bd (host=e1418.halxg.cloudera.com:22000):(Total: 18m4s, non-child: 443.275ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.16 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 886.97 MB, 2.86 GB, 5.30 GB, 7.76 GB, 10.24 GB, 11.71 GB, 11.83 GB, 11.33 GB, 10.79 GB, 10.20 GB, 9.69 GB, 9.08 GB, 8.58 GB, 8.02 GB, 7.50 GB, 7.01 GB, 6.42 GB, 5.93 GB, 5.42 GB, 4.86 GB, 4.38 GB, 3.85 GB, 3.30 GB, 2.82 GB, 2.26 GB, 1.76 GB, 1.21 GB, 601.94 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 13.06 GB (14024427312) - PrepareTime: 218.912ms - RowsProduced: 180.00M (179997904) - TotalCpuTime: 3m28s - TotalNetworkReceiveTime: 3m57s - TotalNetworkSendTime: 10m40s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.82K (1820) - BlocksRecycled: 1.51K (1507) - BufferedPins: 8 (8) - BytesWritten: 375.02 MB (393235280) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 13.02 GB (13975625728) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 589.692ms CodeGen:(Total: 217.596ms, non-child: 217.596ms, % non-child: 100.00%) - CodegenTime: 585.999us - CompileTime: 624ns - LoadTime: 135.251us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 215.679ms DataStreamSender (dst_id=11):(Total: 11m36s, non-child: 11m36s, % non-child: 100.00%) - BytesSent: 3.99 GB (4288925738) - NetworkThroughput(*): 5.75 MB/sec - OverallThroughput: 5.88 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 54s293ms - ThriftTransmitTime(*): 11m51s - UncompressedRowBatchSize: 7.38 GB (7920611028) AGGREGATION_NODE (id=10):(Total: 6m27s, non-child: 2m24s, % non-child: 37.17%) ExecOption: Spilled - BuildTime: 1m52s - GetNewBlockTime: 20.546ms - GetResultsTime: 26s738ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 277.482ms - RowsRepartitioned: 5.62M (5624591) - RowsReturned: 180.00M (179997904) - RowsReturnedRate: 464.26 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 33.158us EXCHANGE_NODE (id=9):(Total: 4m3s, non-child: 9s689ms, % non-child: 3.98%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.36 MB, 97.43 MB, 248.83 MB, 445.43 MB, 629.94 MB, 836.62 MB, 1.03 GB, 1.25 GB, 1.46 GB, 1.68 GB, 1.87 GB, 2.08 GB, 2.30 GB, 2.51 GB, 2.73 GB, 2.95 GB, 3.17 GB, 3.39 GB, 3.58 GB, 3.76 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.03 GB - BytesReceived: 4.05 GB (4346948216) - ConvertRowBatchTime: 5s358ms - DeserializeRowBatchTimer: 17s827ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.00M (179997904) - RowsReturnedRate: 738.93 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26ba (host=e1519.halxg.cloudera.com:22000):(Total: 18m27s, non-child: 441.669ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 899.78 MB, 2.88 GB, 5.32 GB, 7.79 GB, 10.27 GB, 11.72 GB, 11.83 GB, 11.34 GB, 10.83 GB, 10.23 GB, 9.74 GB, 9.18 GB, 8.65 GB, 8.16 GB, 7.60 GB, 7.11 GB, 6.62 GB, 6.07 GB, 5.58 GB, 5.11 GB, 4.58 GB, 4.07 GB, 3.58 GB, 3.06 GB, 2.54 GB, 2.09 GB, 1.52 GB, 970.08 MB, 518.89 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 13.40 GB (14391184912) - PrepareTime: 225.674ms - RowsProduced: 180.03M (180026634) - TotalCpuTime: 3m22s - TotalNetworkReceiveTime: 3m57s - TotalNetworkSendTime: 11m8s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.86K (1862) - BlocksRecycled: 1.46K (1464) - BufferedPins: 4 (4) - BytesWritten: 406.06 MB (425783840) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 13.35 GB (14336663552) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 595.210ms CodeGen:(Total: 224.147ms, non-child: 224.147ms, % non-child: 100.00%) - CodegenTime: 678.905us - CompileTime: 648ns - LoadTime: 101.628us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 222.339ms DataStreamSender (dst_id=11):(Total: 12m2s, non-child: 12m2s, % non-child: 100.00%) - BytesSent: 4.00 GB (4289611917) - NetworkThroughput(*): 5.58 MB/sec - OverallThroughput: 5.66 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 52s139ms - ThriftTransmitTime(*): 12m12s - UncompressedRowBatchSize: 7.38 GB (7921875252) AGGREGATION_NODE (id=10):(Total: 6m24s, non-child: 2m19s, % non-child: 36.39%) ExecOption: Spilled - BuildTime: 1m51s - GetNewBlockTime: 27.640ms - GetResultsTime: 23s072ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 322.984ms - RowsRepartitioned: 5.63M (5626942) - RowsReturned: 180.03M (180026634) - RowsReturnedRate: 468.60 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 30.931us EXCHANGE_NODE (id=9):(Total: 4m4s, non-child: 10s065ms, % non-child: 4.12%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 15.28 MB, 94.99 MB, 244.77 MB, 441.29 MB, 625.84 MB, 831.92 MB, 1.03 GB, 1.24 GB, 1.46 GB, 1.67 GB, 1.86 GB, 2.08 GB, 2.29 GB, 2.51 GB, 2.72 GB, 2.94 GB, 3.16 GB, 3.38 GB, 3.58 GB, 3.76 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.04 GB - BytesReceived: 4.05 GB (4347618973) - ConvertRowBatchTime: 5s530ms - DeserializeRowBatchTimer: 18s173ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.03M (180026634) - RowsReturnedRate: 736.68 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26c3 (host=e1320.halxg.cloudera.com:22000):(Total: 16m59s, non-child: 451.468ms, % non-child: 0.04%) MemoryUsage(16s000ms): 6.07 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 537.59 MB, 1.18 GB, 2.24 GB, 3.44 GB, 4.69 GB, 5.91 GB, 7.17 GB, 8.43 GB, 9.70 GB, 10.85 GB, 11.59 GB, 11.85 GB, 11.89 GB, 11.70 GB, 11.41 GB, 11.12 GB, 10.74 GB, 10.38 GB, 10.09 GB, 9.80 GB, 9.50 GB, 9.17 GB, 8.82 GB, 8.50 GB, 8.20 GB, 7.92 GB, 7.65 GB, 7.29 GB, 6.98 GB, 6.70 GB, 6.42 GB, 6.14 GB, 5.81 GB, 5.53 GB, 5.30 GB, 4.99 GB, 4.66 GB, 4.42 GB, 4.16 GB, 3.84 GB, 3.52 GB, 3.28 GB, 3.04 GB, 2.69 GB, 2.36 GB, 2.12 GB, 1.87 GB, 1.53 GB, 1.22 GB, 994.63 MB, 700.11 MB, 423.08 MB, 655.20 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 38.06 GB (40869328704) - PrepareTime: 186.620ms - RowsProduced: 180.00M (180002522) - TotalCpuTime: 3m27s - TotalNetworkReceiveTime: 3m55s - TotalNetworkSendTime: 9m37s - TotalStorageWaitTime: 0ns CodeGen:(Total: 182.205ms, non-child: 182.205ms, % non-child: 100.00%) - CodegenTime: 809.111us - CompileTime: 390ns - LoadTime: 80.923us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 180.634ms DataStreamSender (dst_id=11):(Total: 10m31s, non-child: 10m31s, % non-child: 100.00%) - BytesSent: 3.99 GB (4289027850) - NetworkThroughput(*): 6.34 MB/sec - OverallThroughput: 6.48 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 51s264ms - ThriftTransmitTime(*): 10m45s - UncompressedRowBatchSize: 7.38 GB (7920814228) AGGREGATION_NODE (id=10):(Total: 6m27s, non-child: 2m25s, % non-child: 37.49%) ExecOption: Spilled - BuildTime: 1m53s - GetNewBlockTime: 155.204ms - GetResultsTime: 23s223ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 2s159ms - RowsRepartitioned: 5.62M (5624822) - RowsReturned: 180.00M (180002522) - RowsReturnedRate: 465.00 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 34.619us EXCHANGE_NODE (id=9):(Total: 4m1s, non-child: 9s876ms, % non-child: 4.08%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.91 MB, 94.08 MB, 243.11 MB, 439.62 MB, 624.34 MB, 830.14 MB, 1.03 GB, 1.24 GB, 1.46 GB, 1.67 GB, 1.88 GB, 2.09 GB, 2.31 GB, 2.53 GB, 2.74 GB, 2.96 GB, 3.18 GB, 3.40 GB, 3.59 GB, 3.77 GB, 3.90 GB, 3.97 GB, 4.02 GB, 4.04 GB - BytesReceived: 4.05 GB (4347086659) - ConvertRowBatchTime: 5s248ms - DeserializeRowBatchTimer: 20s138ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.00M (180002522) - RowsReturnedRate: 743.90 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26c0 (host=e1421.halxg.cloudera.com:22000):(Total: 18m3s, non-child: 368.164ms, % non-child: 0.03%) MemoryUsage(32s000ms): 6.16 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 894.31 MB, 2.87 GB, 5.31 GB, 7.78 GB, 10.26 GB, 11.71 GB, 11.83 GB, 11.32 GB, 10.77 GB, 10.19 GB, 9.65 GB, 9.06 GB, 8.56 GB, 7.95 GB, 7.46 GB, 6.95 GB, 6.39 GB, 5.91 GB, 5.38 GB, 4.83 GB, 4.35 GB, 3.79 GB, 3.28 GB, 2.80 GB, 2.21 GB, 1.73 GB, 1.16 GB, 577.40 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 13.14 GB (14113698304) - PrepareTime: 223.282ms - RowsProduced: 179.98M (179978327) - TotalCpuTime: 3m27s - TotalNetworkReceiveTime: 3m57s - TotalNetworkSendTime: 10m39s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.83K (1830) - BlocksRecycled: 1.50K (1497) - BufferedPins: 7 (7) - BytesWritten: 382.08 MB (400639280) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 13.09 GB (14060044288) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 596.416ms CodeGen:(Total: 221.727ms, non-child: 221.727ms, % non-child: 100.00%) - CodegenTime: 699.128us - CompileTime: 677ns - LoadTime: 123.911us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 219.847ms DataStreamSender (dst_id=11):(Total: 11m33s, non-child: 11m33s, % non-child: 100.00%) - BytesSent: 3.99 GB (4288418824) - NetworkThroughput(*): 5.76 MB/sec - OverallThroughput: 5.90 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 52s206ms - ThriftTransmitTime(*): 11m50s - UncompressedRowBatchSize: 7.38 GB (7919749564) AGGREGATION_NODE (id=10):(Total: 6m29s, non-child: 2m24s, % non-child: 37.13%) ExecOption: Spilled - BuildTime: 1m50s - GetNewBlockTime: 22.616ms - GetResultsTime: 27s424ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 304.173ms - RowsRepartitioned: 5.62M (5622972) - RowsReturned: 179.98M (179978327) - RowsReturnedRate: 462.41 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 30.648us EXCHANGE_NODE (id=9):(Total: 4m4s, non-child: 10s289ms, % non-child: 4.21%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.41 MB, 99.97 MB, 253.05 MB, 449.53 MB, 634.27 MB, 841.17 MB, 1.04 GB, 1.25 GB, 1.47 GB, 1.68 GB, 1.87 GB, 2.08 GB, 2.30 GB, 2.52 GB, 2.73 GB, 2.95 GB, 3.17 GB, 3.39 GB, 3.59 GB, 3.77 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.03 GB - BytesReceived: 4.05 GB (4346476694) - ConvertRowBatchTime: 5s565ms - DeserializeRowBatchTimer: 18s966ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 179.98M (179978327) - RowsReturnedRate: 735.52 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26bf (host=e1521.halxg.cloudera.com:22000):(Total: 17m34s, non-child: 435.419ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.16 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 894.44 MB, 2.87 GB, 5.31 GB, 7.78 GB, 10.26 GB, 11.71 GB, 11.82 GB, 11.30 GB, 10.70 GB, 10.14 GB, 9.53 GB, 8.98 GB, 8.38 GB, 7.83 GB, 7.27 GB, 6.72 GB, 6.20 GB, 5.62 GB, 5.11 GB, 4.49 GB, 4.00 GB, 3.43 GB, 2.88 GB, 2.36 GB, 1.77 GB, 1.29 GB, 669.43 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 12.44 GB (13358186496) - PrepareTime: 220.962ms - RowsProduced: 180.02M (180021509) - TotalCpuTime: 3m39s - TotalNetworkReceiveTime: 3m53s - TotalNetworkSendTime: 10m3s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.71K (1712) - BlocksRecycled: 1.58K (1584) - BufferedPins: 26 (26) - BytesWritten: 228.87 MB (239991480) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 12.30 GB (13204054016) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 354.921ms CodeGen:(Total: 219.321ms, non-child: 219.321ms, % non-child: 100.00%) - CodegenTime: 773.553us - CompileTime: 1.280us - LoadTime: 126.240us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 217.476ms DataStreamSender (dst_id=11):(Total: 11m1s, non-child: 11m1s, % non-child: 100.00%) - BytesSent: 3.99 GB (4289481320) - NetworkThroughput(*): 5.98 MB/sec - OverallThroughput: 6.19 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 56s357ms - ThriftTransmitTime(*): 11m24s - UncompressedRowBatchSize: 7.38 GB (7921649728) AGGREGATION_NODE (id=10):(Total: 6m32s, non-child: 2m31s, % non-child: 38.71%) ExecOption: Spilled - BuildTime: 1m55s - GetNewBlockTime: 8.468ms - GetResultsTime: 32s041ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 29.583ms - RowsRepartitioned: 5.63M (5627398) - RowsReturned: 180.02M (180021509) - RowsReturnedRate: 458.74 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 30.566us EXCHANGE_NODE (id=9):(Total: 4m, non-child: 9s123ms, % non-child: 3.79%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.46 MB, 100.06 MB, 253.30 MB, 449.88 MB, 634.81 MB, 841.76 MB, 1.04 GB, 1.25 GB, 1.47 GB, 1.68 GB, 1.87 GB, 2.09 GB, 2.30 GB, 2.52 GB, 2.73 GB, 2.95 GB, 3.17 GB, 3.39 GB, 3.59 GB, 3.77 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.04 GB - BytesReceived: 4.05 GB (4347541964) - ConvertRowBatchTime: 5s385ms - DeserializeRowBatchTimer: 15s943ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.02M (180021509) - RowsReturnedRate: 748.43 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26bb (host=e1321.halxg.cloudera.com:22000):(Total: 18m7s, non-child: 401.716ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.16 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 896.35 MB, 2.87 GB, 5.31 GB, 7.78 GB, 10.26 GB, 11.71 GB, 11.83 GB, 11.33 GB, 10.79 GB, 10.20 GB, 9.70 GB, 9.08 GB, 8.59 GB, 8.04 GB, 7.51 GB, 7.02 GB, 6.44 GB, 5.95 GB, 5.47 GB, 4.90 GB, 4.42 GB, 3.94 GB, 3.36 GB, 2.87 GB, 2.38 GB, 1.80 GB, 1.29 GB, 657.16 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 12.74 GB (13684199400) - PrepareTime: 229.863ms - RowsProduced: 180.00M (180004268) - TotalCpuTime: 3m37s - TotalNetworkReceiveTime: 3m53s - TotalNetworkSendTime: 10m37s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.75K (1753) - BlocksRecycled: 1.57K (1574) - BufferedPins: 21 (21) - BytesWritten: 271.00 MB (284164560) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 12.57 GB (13501710336) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 415.674ms CodeGen:(Total: 228.306ms, non-child: 228.306ms, % non-child: 100.00%) - CodegenTime: 683.759us - CompileTime: 1.206us - LoadTime: 122.508us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 226.228ms DataStreamSender (dst_id=11):(Total: 11m31s, non-child: 11m31s, % non-child: 100.00%) - BytesSent: 3.99 GB (4289062708) - NetworkThroughput(*): 5.70 MB/sec - OverallThroughput: 5.91 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53s039ms - ThriftTransmitTime(*): 11m57s - UncompressedRowBatchSize: 7.38 GB (7920891064) AGGREGATION_NODE (id=10):(Total: 6m34s, non-child: 2m33s, % non-child: 38.99%) ExecOption: Spilled - BuildTime: 1m54s - GetNewBlockTime: 8.49ms - GetResultsTime: 33s411ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 106.887ms - RowsRepartitioned: 5.62M (5623539) - RowsReturned: 180.00M (180004268) - RowsReturnedRate: 456.01 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 30.146us EXCHANGE_NODE (id=9):(Total: 4m, non-child: 10s111ms, % non-child: 4.20%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.71 MB, 100.65 MB, 254.12 MB, 450.59 MB, 635.66 MB, 842.71 MB, 1.04 GB, 1.25 GB, 1.47 GB, 1.68 GB, 1.87 GB, 2.09 GB, 2.30 GB, 2.52 GB, 2.74 GB, 2.95 GB, 3.17 GB, 3.39 GB, 3.59 GB, 3.77 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.04 GB - BytesReceived: 4.05 GB (4347117887) - ConvertRowBatchTime: 5s613ms - DeserializeRowBatchTimer: 18s239ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.00M (180004268) - RowsReturnedRate: 747.46 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26c2 (host=e1520.halxg.cloudera.com:22000):(Total: 18m9s, non-child: 448.551ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.16 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 894.48 MB, 2.87 GB, 5.31 GB, 7.78 GB, 10.26 GB, 11.71 GB, 11.83 GB, 11.33 GB, 10.80 GB, 10.21 GB, 9.71 GB, 9.11 GB, 8.60 GB, 8.06 GB, 7.53 GB, 7.04 GB, 6.50 GB, 5.98 GB, 5.50 GB, 4.94 GB, 4.43 GB, 3.94 GB, 3.37 GB, 2.88 GB, 2.39 GB, 1.82 GB, 1.30 GB, 681.70 MB, 481.56 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 12.60 GB (13532458912) - PrepareTime: 216.412ms - RowsProduced: 180.00M (179997001) - TotalCpuTime: 3m30s - TotalNetworkReceiveTime: 3m55s - TotalNetworkSendTime: 10m44s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.75K (1752) - BlocksRecycled: 1.57K (1573) - BufferedPins: 21 (21) - BytesWritten: 269.90 MB (283008040) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 12.56 GB (13485056000) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 385.31ms CodeGen:(Total: 214.822ms, non-child: 214.822ms, % non-child: 100.00%) - CodegenTime: 727.749us - CompileTime: 1.47us - LoadTime: 147.682us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 212.996ms DataStreamSender (dst_id=11):(Total: 11m40s, non-child: 11m40s, % non-child: 100.00%) - BytesSent: 3.99 GB (4288897246) - NetworkThroughput(*): 5.72 MB/sec - OverallThroughput: 5.84 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53s378ms - ThriftTransmitTime(*): 11m55s - UncompressedRowBatchSize: 7.38 GB (7920571288) AGGREGATION_NODE (id=10):(Total: 6m28s, non-child: 2m26s, % non-child: 37.63%) ExecOption: Spilled - BuildTime: 1m53s - GetNewBlockTime: 9.104ms - GetResultsTime: 27s307ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 106.354ms - RowsRepartitioned: 5.63M (5627513) - RowsReturned: 180.00M (179997001) - RowsReturnedRate: 463.15 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 49.939us EXCHANGE_NODE (id=9):(Total: 4m2s, non-child: 10s103ms, % non-child: 4.17%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.46 MB, 100.08 MB, 253.24 MB, 449.79 MB, 634.62 MB, 841.48 MB, 1.04 GB, 1.25 GB, 1.47 GB, 1.68 GB, 1.87 GB, 2.09 GB, 2.30 GB, 2.52 GB, 2.73 GB, 2.95 GB, 3.17 GB, 3.39 GB, 3.59 GB, 3.77 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.03 GB - BytesReceived: 4.05 GB (4346974015) - ConvertRowBatchTime: 5s685ms - DeserializeRowBatchTimer: 17s566ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.00M (179997001) - RowsReturnedRate: 742.60 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26bc (host=e1419.halxg.cloudera.com:22000):(Total: 17m41s, non-child: 460.290ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 894.97 MB, 2.89 GB, 5.33 GB, 7.80 GB, 10.28 GB, 11.72 GB, 11.81 GB, 11.30 GB, 10.70 GB, 10.13 GB, 9.52 GB, 8.98 GB, 8.38 GB, 7.84 GB, 7.32 GB, 6.75 GB, 6.25 GB, 5.66 GB, 5.15 GB, 4.61 GB, 4.06 GB, 3.57 GB, 2.96 GB, 2.48 GB, 1.93 GB, 1.38 GB, 835.10 MB, 496.01 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 12.87 GB (13820551072) - PrepareTime: 217.657ms - RowsProduced: 179.97M (179974369) - TotalCpuTime: 3m33s - TotalNetworkReceiveTime: 3m48s - TotalNetworkSendTime: 10m20s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.75K (1749) - BlocksRecycled: 1.55K (1547) - BufferedPins: 16 (16) - BytesWritten: 307.43 MB (322361200) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 12.50 GB (13424099328) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 822.471ms CodeGen:(Total: 216.303ms, non-child: 216.303ms, % non-child: 100.00%) - CodegenTime: 560.675us - CompileTime: 641ns - LoadTime: 123.618us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 214.436ms DataStreamSender (dst_id=11):(Total: 11m15s, non-child: 11m15s, % non-child: 100.00%) - BytesSent: 3.99 GB (4288344515) - NetworkThroughput(*): 5.96 MB/sec - OverallThroughput: 6.05 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53s035ms - ThriftTransmitTime(*): 11m26s - UncompressedRowBatchSize: 7.38 GB (7919575380) AGGREGATION_NODE (id=10):(Total: 6m25s, non-child: 2m29s, % non-child: 38.88%) ExecOption: Spilled - BuildTime: 2m - GetNewBlockTime: 12.952ms - GetResultsTime: 24s129ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 170.238ms - RowsRepartitioned: 5.62M (5623808) - RowsReturned: 179.97M (179974369) - RowsReturnedRate: 467.40 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 32.521us EXCHANGE_NODE (id=9):(Total: 3m55s, non-child: 9s865ms, % non-child: 4.19%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.55 MB, 93.22 MB, 241.59 MB, 438.22 MB, 629.47 MB, 836.03 MB, 1.03 GB, 1.25 GB, 1.46 GB, 1.68 GB, 1.87 GB, 2.08 GB, 2.30 GB, 2.51 GB, 2.73 GB, 2.95 GB, 3.17 GB, 3.38 GB, 3.58 GB, 3.76 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.03 GB - BytesReceived: 4.05 GB (4346382063) - ConvertRowBatchTime: 5s281ms - DeserializeRowBatchTimer: 20s120ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 179.97M (179974369) - RowsReturnedRate: 764.71 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 1435c5e25359ded:9a359144764e26be (host=e1420.halxg.cloudera.com:22000):(Total: 18m30s, non-child: 446.887ms, % non-child: 0.04%) MemoryUsage(32s000ms): 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 6.26 MB, 897.95 MB, 2.88 GB, 5.32 GB, 7.79 GB, 10.26 GB, 11.71 GB, 11.84 GB, 11.36 GB, 10.86 GB, 10.28 GB, 9.77 GB, 9.23 GB, 8.67 GB, 8.18 GB, 7.64 GB, 7.14 GB, 6.66 GB, 6.15 GB, 5.62 GB, 5.15 GB, 4.67 GB, 4.12 GB, 3.64 GB, 3.17 GB, 2.62 GB, 2.15 GB, 1.63 GB, 1.00 GB, 529.38 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.90 GB (12782182304) - PerHostPeakMemUsage: 13.04 GB (14004719880) - PrepareTime: 224.768ms - RowsProduced: 180.01M (180012210) - TotalCpuTime: 3m24s - TotalNetworkReceiveTime: 3m56s - TotalNetworkSendTime: 11m9s - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.81K (1814) - BlocksRecycled: 1.51K (1513) - BufferedPins: 9 (9) - BytesWritten: 367.05 MB (384879960) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 40.24 GB (43209306112) - PeakMemoryUsage: 13.01 GB (13967048704) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 601.116ms CodeGen:(Total: 223.183ms, non-child: 223.183ms, % non-child: 100.00%) - CodegenTime: 756.681us - CompileTime: 1.253us - LoadTime: 83.746us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 0ns - PrepareTime: 221.287ms DataStreamSender (dst_id=11):(Total: 12m5s, non-child: 12m5s, % non-child: 100.00%) - BytesSent: 3.99 GB (4289269603) - NetworkThroughput(*): 5.55 MB/sec - OverallThroughput: 5.64 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53s465ms - ThriftTransmitTime(*): 12m17s - UncompressedRowBatchSize: 7.38 GB (7921240552) AGGREGATION_NODE (id=10):(Total: 6m24s, non-child: 2m20s, % non-child: 36.67%) ExecOption: Spilled - BuildTime: 1m52s - GetNewBlockTime: 19.34ms - GetResultsTime: 23s715ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12782145464) - PinTime: 278.576ms - RowsRepartitioned: 5.62M (5624626) - RowsReturned: 180.01M (180012210) - RowsReturnedRate: 468.32 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 32.336us EXCHANGE_NODE (id=9):(Total: 4m3s, non-child: 9s173ms, % non-child: 3.77%) BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.94 MB, 94.20 MB, 243.35 MB, 439.82 MB, 624.48 MB, 830.21 MB, 1.03 GB, 1.24 GB, 1.46 GB, 1.67 GB, 1.86 GB, 2.07 GB, 2.29 GB, 2.51 GB, 2.72 GB, 2.94 GB, 3.16 GB, 3.38 GB, 3.58 GB, 3.76 GB, 3.89 GB, 3.97 GB, 4.02 GB, 4.03 GB - BytesReceived: 4.05 GB (4347304134) - ConvertRowBatchTime: 5s442ms - DeserializeRowBatchTimer: 15s570ms - FirstBatchArrivalWaitTime: 2m40s - PeakMemoryUsage: 0 - RowsReturned: 180.01M (180012210) - RowsReturnedRate: 739.49 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F02: Instance 1435c5e25359ded:9a359144764e26c6 (host=e1419.halxg.cloudera.com:22000):(Total: 5m25s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:16/2.00 GB 2:15/1.88 GB 10:22/2.75 GB 8:20/2.50 GB 6:13/1.62 GB 1:15/1.88 GB 3:17/2.12 GB 5:20/2.50 GB 0:16/2.00 GB 9:12/1.50 GB 7:12/1.50 GB MemoryUsage(8s000ms): 1.52 GB, 2.18 GB, 2.87 GB, 3.42 GB, 4.02 GB, 4.69 GB, 5.31 GB, 5.79 GB, 6.40 GB, 6.85 GB, 7.41 GB, 7.98 GB, 8.52 GB, 9.07 GB, 9.56 GB, 9.97 GB, 10.35 GB, 10.96 GB, 11.35 GB, 11.72 GB, 12.00 GB, 11.62 GB, 11.03 GB, 10.35 GB, 9.73 GB, 9.10 GB, 8.46 GB, 7.81 GB, 7.19 GB, 6.56 GB, 5.95 GB, 5.31 GB, 4.68 GB, 3.97 GB, 3.34 GB, 2.70 GB, 2.07 GB, 1.39 GB, 795.28 MB, 640.29 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 31, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.93 - PeakMemoryUsage: 12.20 GB (13099692032) - PerHostPeakMemUsage: 12.87 GB (13820551072) - PrepareTime: 168.18ms - RowsProduced: 177.88M (177882402) - TotalCpuTime: 1h42m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 6s980ms - TotalStorageWaitTime: 9s317ms CodeGen:(Total: 425.693ms, non-child: 425.693ms, % non-child: 100.00%) - CodegenTime: 361.248us - CompileTime: 43.612ms - LoadTime: 29.596us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 216.324ms - PrepareTime: 164.494ms DataStreamSender (dst_id=9):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) - BytesSent: 4.00 GB (4295535994) - NetworkThroughput(*): 5.98 MB/sec - OverallThroughput: 37.36 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 31s285ms - ThriftTransmitTime(*): 11m25s - UncompressedRowBatchSize: 7.29 GB (7828565396) AGGREGATION_NODE (id=4):(Total: 3m35s, non-child: 3m34s, % non-child: 99.42%) ExecOption: Spilled - BuildTime: 2m48s - GetNewBlockTime: 120.75ms - GetResultsTime: 38s140ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.68 GB (12538421248) - PinTime: 652.556ms - RowsRepartitioned: 5.56M (5557017) - RowsReturned: 177.88M (177882402) - RowsReturnedRate: 825.94 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 42.361us HDFS_SCAN_NODE (id=3):(Total: 1s243ms, non-child: 1s243ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:16/2.00 GB 2:15/1.88 GB 10:22/2.75 GB 8:20/2.50 GB 6:13/1.62 GB 1:15/1.88 GB 3:17/2.12 GB 5:20/2.50 GB 0:16/2.00 GB 9:12/1.50 GB 7:12/1.50 GB Hdfs Read Thread Concurrency Bucket: 0:94.12% 1:5.294% 2:0.2941% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0.2941% 11:0% 12:0% File Formats: TEXT/NONE:178 ExecOption: Codegen enabled: 0 out of 178 BytesRead(4s000ms): 879.00 MB, 1.45 GB, 2.03 GB, 2.66 GB, 3.36 GB, 3.88 GB, 4.37 GB, 5.23 GB, 5.77 GB, 6.30 GB, 6.62 GB, 7.24 GB, 7.92 GB, 8.53 GB, 8.93 GB, 9.86 GB, 10.31 GB, 10.84 GB, 11.36 GB, 11.87 GB, 12.25 GB, 12.32 GB, 12.76 GB, 13.32 GB, 13.97 GB, 14.57 GB, 15.10 GB, 15.61 GB, 16.13 GB, 16.62 GB, 17.10 GB, 17.62 GB, 17.88 GB, 18.72 GB, 19.13 GB, 19.61 GB, 20.10 GB, 20.58 GB, 21.02 GB, 21.45 GB, 21.87 GB, 22.02 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 34.33 - BytesRead: 22.25 GB (23890937856) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.25 GB (23890801664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.25 GB (23890801664) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182171136) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 592 (592) - RowsRead: 177.88M (177882415) - RowsReturned: 177.88M (177882415) - RowsReturnedRate: 143.10 M/sec - ScanRangesComplete: 178 (178) - ScannerThreadsInvoluntaryContextSwitches: 45.80K (45798) - ScannerThreadsTotalWallClockTime: 1h37m - DelimiterParseTime: 49s344ms - MaterializeTupleTime(*): 51s653ms - ScannerThreadsSysTime: 1s031ms - ScannerThreadsUserTime: 1m47s - ScannerThreadsVoluntaryContextSwitches: 174.64K (174639) - TotalRawHdfsReadTime(*): 17s086ms - TotalReadThroughput: 133.63 MB/sec Instance 1435c5e25359ded:9a359144764e26cc (host=e1520.halxg.cloudera.com:22000):(Total: 5m17s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:12/1.50 GB 8:17/2.12 GB 6:18/2.25 GB 0:16/2.00 GB 5:17/2.12 GB 4:20/2.50 GB 2:12/1.50 GB 1:12/1.50 GB 10:18/2.25 GB 9:16/2.00 GB 7:22/2.75 GB MemoryUsage(8s000ms): 1.53 GB, 2.18 GB, 2.77 GB, 3.32 GB, 3.95 GB, 4.60 GB, 5.26 GB, 5.71 GB, 6.39 GB, 6.79 GB, 7.34 GB, 7.88 GB, 8.47 GB, 9.14 GB, 9.73 GB, 10.12 GB, 10.78 GB, 11.22 GB, 11.70 GB, 11.98 GB, 11.84 GB, 11.34 GB, 10.57 GB, 9.92 GB, 9.34 GB, 8.65 GB, 8.00 GB, 7.35 GB, 6.68 GB, 6.01 GB, 5.48 GB, 4.81 GB, 4.14 GB, 3.52 GB, 2.83 GB, 2.16 GB, 1.56 GB, 910.07 MB, 568.27 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.61 - PeakMemoryUsage: 12.25 GB (13150212096) - PerHostPeakMemUsage: 12.60 GB (13532458912) - PrepareTime: 204.528ms - RowsProduced: 179.89M (179887574) - TotalCpuTime: 1h38m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s303ms - TotalStorageWaitTime: 13s240ms CodeGen:(Total: 529.580ms, non-child: 529.580ms, % non-child: 100.00%) - CodegenTime: 350.964us - CompileTime: 51.353ms - LoadTime: 53.838us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 276.134ms - PrepareTime: 200.433ms DataStreamSender (dst_id=9):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) - BytesSent: 4.05 GB (4343944450) - NetworkThroughput(*): 5.92 MB/sec - OverallThroughput: 37.67 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 31s746ms - ThriftTransmitTime(*): 11m39s - UncompressedRowBatchSize: 7.37 GB (7916812564) AGGREGATION_NODE (id=4):(Total: 3m27s, non-child: 3m26s, % non-child: 99.41%) ExecOption: Spilled - BuildTime: 2m43s - GetNewBlockTime: 104.467ms - GetResultsTime: 36s859ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12781613056) - PinTime: 279.3ms - RowsRepartitioned: 5.62M (5621573) - RowsReturned: 179.89M (179887574) - RowsReturnedRate: 867.18 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 191.647us HDFS_SCAN_NODE (id=3):(Total: 1s223ms, non-child: 1s223ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:12/1.50 GB 8:17/2.12 GB 6:18/2.25 GB 0:16/2.00 GB 5:17/2.12 GB 4:20/2.50 GB 2:12/1.50 GB 1:12/1.50 GB 10:18/2.25 GB 9:16/2.00 GB 7:22/2.75 GB Hdfs Read Thread Concurrency Bucket: 0:92.1% 1:6.991% 2:0.6079% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0.304% 12:0% File Formats: TEXT/NONE:180 ExecOption: Codegen enabled: 0 out of 180 BytesRead(4s000ms): 894.00 MB, 1.48 GB, 2.07 GB, 2.62 GB, 3.22 GB, 3.69 GB, 4.28 GB, 4.89 GB, 5.65 GB, 6.20 GB, 6.56 GB, 7.06 GB, 7.75 GB, 8.44 GB, 8.79 GB, 9.79 GB, 10.26 GB, 10.81 GB, 11.26 GB, 11.73 GB, 12.22 GB, 12.35 GB, 12.58 GB, 13.11 GB, 13.75 GB, 14.51 GB, 15.14 GB, 15.80 GB, 16.45 GB, 17.07 GB, 17.52 GB, 18.03 GB, 18.76 GB, 19.27 GB, 19.79 GB, 20.31 GB, 20.82 GB, 21.33 GB, 21.80 GB, 21.97 GB, 22.26 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 34.05 - BytesRead: 22.50 GB (24159375360) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.50 GB (24159235072) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.50 GB (24159235072) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182171136) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 1.57K (1575) - RowsRead: 179.89M (179887585) - RowsReturned: 179.89M (179887585) - RowsReturnedRate: 147.02 M/sec - ScanRangesComplete: 180 (180) - ScannerThreadsInvoluntaryContextSwitches: 29.22K (29219) - ScannerThreadsTotalWallClockTime: 1h33m - DelimiterParseTime: 45s285ms - MaterializeTupleTime(*): 46s583ms - ScannerThreadsSysTime: 876.847ms - ScannerThreadsUserTime: 1m38s - ScannerThreadsVoluntaryContextSwitches: 176.55K (176552) - TotalRawHdfsReadTime(*): 20s868ms - TotalReadThroughput: 139.64 MB/sec Instance 1435c5e25359ded:9a359144764e26c7 (host=e1418.halxg.cloudera.com:22000):(Total: 5m30s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:20/2.50 GB 3:17/2.12 GB 7:15/1.88 GB 2:20/2.50 GB 5:16/2.00 GB 0:17/2.12 GB 9:14/1.75 GB 8:16/2.00 GB 4:14/1.75 GB 1:20/2.50 GB 10:12/1.50 GB MemoryUsage(8s000ms): 1.54 GB, 2.17 GB, 2.86 GB, 3.43 GB, 4.01 GB, 4.67 GB, 5.29 GB, 5.76 GB, 6.39 GB, 6.80 GB, 7.30 GB, 7.83 GB, 8.41 GB, 9.07 GB, 9.63 GB, 9.95 GB, 10.52 GB, 11.00 GB, 11.35 GB, 11.74 GB, 12.00 GB, 11.86 GB, 11.76 GB, 11.14 GB, 10.54 GB, 9.82 GB, 9.14 GB, 8.47 GB, 7.82 GB, 7.13 GB, 6.58 GB, 5.93 GB, 5.28 GB, 4.63 GB, 4.01 GB, 3.29 GB, 2.64 GB, 2.02 GB, 1.32 GB, 639.74 MB, 719.91 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 11, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.97 - PeakMemoryUsage: 12.25 GB (13150212096) - PerHostPeakMemUsage: 13.06 GB (14024427312) - PrepareTime: 166.373ms - RowsProduced: 180.87M (180866976) - TotalCpuTime: 1h44m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7s372ms - TotalStorageWaitTime: 12s088ms CodeGen:(Total: 509.9ms, non-child: 509.9ms, % non-child: 100.00%) - CodegenTime: 382.929us - CompileTime: 55.346ms - LoadTime: 26.471us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 289.484ms - PrepareTime: 162.830ms DataStreamSender (dst_id=9):(Total: 1m49s, non-child: 1m49s, % non-child: 100.00%) - BytesSent: 4.07 GB (4368172551) - NetworkThroughput(*): 6.00 MB/sec - OverallThroughput: 38.11 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 31s533ms - ThriftTransmitTime(*): 11m34s - UncompressedRowBatchSize: 7.41 GB (7959915836) AGGREGATION_NODE (id=4):(Total: 3m41s, non-child: 3m39s, % non-child: 99.44%) ExecOption: Spilled - BuildTime: 2m54s - GetNewBlockTime: 109.312ms - GetResultsTime: 38s323ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.92 GB (12798468096) - PinTime: 312.502ms - RowsRepartitioned: 5.65M (5650847) - RowsReturned: 180.87M (180866976) - RowsReturnedRate: 817.94 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 42.837us HDFS_SCAN_NODE (id=3):(Total: 1s234ms, non-child: 1s234ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:20/2.50 GB 3:17/2.12 GB 7:15/1.88 GB 2:20/2.50 GB 5:16/2.00 GB 0:17/2.12 GB 9:14/1.75 GB 8:16/2.00 GB 4:14/1.75 GB 1:20/2.50 GB 10:12/1.50 GB Hdfs Read Thread Concurrency Bucket: 0:91.76% 1:6.25% 2:1.705% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0.2841% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:181 ExecOption: Codegen enabled: 0 out of 181 BytesRead(4s000ms): 915.00 MB, 1.46 GB, 2.03 GB, 2.65 GB, 3.34 GB, 3.86 GB, 4.36 GB, 5.23 GB, 5.77 GB, 6.28 GB, 6.61 GB, 7.18 GB, 7.86 GB, 8.50 GB, 8.84 GB, 9.85 GB, 10.28 GB, 10.81 GB, 11.33 GB, 11.78 GB, 12.18 GB, 12.35 GB, 12.48 GB, 13.02 GB, 13.52 GB, 14.40 GB, 15.04 GB, 15.67 GB, 16.25 GB, 16.78 GB, 17.28 GB, 17.55 GB, 18.34 GB, 18.79 GB, 19.24 GB, 19.67 GB, 20.12 GB, 20.54 GB, 20.98 GB, 21.41 GB, 21.78 GB, 21.94 GB, 22.13 GB, 22.51 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 33.79 - BytesRead: 22.63 GB (24293594112) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.63 GB (24293460992) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.63 GB (24293460992) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182179328) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 579 (579) - RowsRead: 180.87M (180866988) - RowsReturned: 180.87M (180866988) - RowsReturnedRate: 146.47 M/sec - ScanRangesComplete: 181 (181) - ScannerThreadsInvoluntaryContextSwitches: 39.87K (39868) - ScannerThreadsTotalWallClockTime: 1h39m - DelimiterParseTime: 50s620ms - MaterializeTupleTime(*): 51s108ms - ScannerThreadsSysTime: 944.839ms - ScannerThreadsUserTime: 1m48s - ScannerThreadsVoluntaryContextSwitches: 177.58K (177584) - TotalRawHdfsReadTime(*): 18s789ms - TotalReadThroughput: 131.26 MB/sec Instance 1435c5e25359ded:9a359144764e26c4 (host=e1519.halxg.cloudera.com:22000):(Total: 5m35s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:13/1.62 GB 7:14/1.75 GB 6:16/2.00 GB 4:19/2.38 GB 3:16/2.00 GB 2:24/3.00 GB 1:19/2.38 GB 5:14/1.75 GB 0:13/1.62 GB 10:17/2.12 GB 9:15/1.88 GB MemoryUsage(8s000ms): 1.16 GB, 2.05 GB, 2.63 GB, 3.10 GB, 3.86 GB, 4.34 GB, 4.88 GB, 5.36 GB, 5.81 GB, 6.41 GB, 6.86 GB, 7.41 GB, 7.93 GB, 8.60 GB, 9.23 GB, 9.76 GB, 10.09 GB, 10.70 GB, 11.08 GB, 11.50 GB, 11.81 GB, 12.00 GB, 11.82 GB, 11.56 GB, 10.94 GB, 10.27 GB, 9.67 GB, 9.02 GB, 8.35 GB, 7.73 GB, 7.13 GB, 6.48 GB, 5.81 GB, 5.16 GB, 4.46 GB, 3.86 GB, 3.24 GB, 2.52 GB, 1.90 GB, 1.22 GB, 565.59 MB, 658.49 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 19.32 - PeakMemoryUsage: 12.24 GB (13141987328) - PerHostPeakMemUsage: 13.40 GB (14391184912) - PrepareTime: 191.709ms - RowsProduced: 179.88M (179881857) - TotalCpuTime: 1h47m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s007ms - TotalStorageWaitTime: 47s752ms CodeGen:(Total: 485.420ms, non-child: 485.420ms, % non-child: 100.00%) - CodegenTime: 353.739us - CompileTime: 44.219ms - LoadTime: 84.764us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 251.736ms - PrepareTime: 187.966ms DataStreamSender (dst_id=9):(Total: 1m51s, non-child: 1m51s, % non-child: 100.00%) - BytesSent: 4.05 GB (4344096131) - NetworkThroughput(*): 5.93 MB/sec - OverallThroughput: 37.17 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 32s654ms - ThriftTransmitTime(*): 11m38s - UncompressedRowBatchSize: 7.37 GB (7916560964) AGGREGATION_NODE (id=4):(Total: 3m44s, non-child: 3m41s, % non-child: 98.66%) ExecOption: Spilled - BuildTime: 2m57s - GetNewBlockTime: 107.933ms - GetResultsTime: 36s929ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.91 GB (12790001664) - PinTime: 272.499ms - RowsRepartitioned: 5.63M (5625942) - RowsReturned: 179.88M (179881857) - RowsReturnedRate: 802.68 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 160.532us HDFS_SCAN_NODE (id=3):(Total: 3s006ms, non-child: 3s006ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:13/1.62 GB 7:14/1.75 GB 6:16/2.00 GB 4:19/2.38 GB 3:16/2.00 GB 2:24/3.00 GB 1:19/2.38 GB 5:14/1.75 GB 0:13/1.62 GB 10:17/2.12 GB 9:15/1.88 GB Hdfs Read Thread Concurrency Bucket: 0:93.09% 1:4.696% 2:2.21% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:180 ExecOption: Codegen enabled: 0 out of 180 BytesRead(4s000ms): 554.00 MB, 1.27 GB, 1.87 GB, 2.40 GB, 3.01 GB, 3.52 GB, 4.07 GB, 4.38 GB, 5.40 GB, 5.84 GB, 6.37 GB, 6.67 GB, 7.15 GB, 7.68 GB, 8.25 GB, 8.70 GB, 9.08 GB, 9.92 GB, 10.38 GB, 10.92 GB, 11.43 GB, 11.95 GB, 12.34 GB, 12.37 GB, 12.85 GB, 13.21 GB, 14.20 GB, 14.79 GB, 15.42 GB, 16.05 GB, 16.66 GB, 17.18 GB, 17.54 GB, 18.10 GB, 18.71 GB, 19.11 GB, 19.57 GB, 19.97 GB, 20.41 GB, 20.82 GB, 21.25 GB, 21.64 GB, 21.90 GB, 22.02 GB, 22.29 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 34.06 - BytesRead: 22.50 GB (24159375360) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.50 GB (24159233024) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.50 GB (24159233024) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182253056) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 783 (783) - RowsRead: 179.88M (179881871) - RowsReturned: 179.88M (179881871) - RowsReturnedRate: 59.83 M/sec - ScanRangesComplete: 180 (180) - ScannerThreadsInvoluntaryContextSwitches: 38.07K (38072) - ScannerThreadsTotalWallClockTime: 1h42m - DelimiterParseTime: 51s218ms - MaterializeTupleTime(*): 51s244ms - ScannerThreadsSysTime: 914.843ms - ScannerThreadsUserTime: 1m48s - ScannerThreadsVoluntaryContextSwitches: 176.60K (176598) - TotalRawHdfsReadTime(*): 19s461ms - TotalReadThroughput: 127.29 MB/sec Instance 1435c5e25359ded:9a359144764e26ca (host=e1421.halxg.cloudera.com:22000):(Total: 5m29s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:14/1.75 GB 9:16/2.00 GB 5:14/1.75 GB 0:15/1.88 GB 8:14/1.75 GB 1:18/2.25 GB 7:20/2.50 GB 4:16/2.00 GB 3:17/2.12 GB 10:19/2.38 GB 6:17/2.12 GB MemoryUsage(8s000ms): 1.56 GB, 2.12 GB, 2.61 GB, 3.13 GB, 3.67 GB, 4.25 GB, 4.85 GB, 5.38 GB, 5.66 GB, 6.27 GB, 6.75 GB, 7.28 GB, 7.81 GB, 8.38 GB, 9.04 GB, 9.63 GB, 9.94 GB, 10.51 GB, 11.04 GB, 11.52 GB, 11.91 GB, 11.85 GB, 11.79 GB, 11.21 GB, 10.56 GB, 9.91 GB, 9.29 GB, 8.62 GB, 7.90 GB, 7.30 GB, 6.74 GB, 6.12 GB, 5.45 GB, 4.78 GB, 4.10 GB, 3.41 GB, 2.74 GB, 2.06 GB, 1.34 GB, 664.33 MB, 719.25 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 21, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 19.29 - PeakMemoryUsage: 12.25 GB (13150375936) - PerHostPeakMemUsage: 13.14 GB (14113698304) - PrepareTime: 206.268ms - RowsProduced: 179.88M (179880759) - TotalCpuTime: 1h45m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s932ms - TotalStorageWaitTime: 11s215ms CodeGen:(Total: 534.410ms, non-child: 534.410ms, % non-child: 100.00%) - CodegenTime: 380.962us - CompileTime: 54.894ms - LoadTime: 60.242us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 275.515ms - PrepareTime: 202.296ms DataStreamSender (dst_id=9):(Total: 1m50s, non-child: 1m50s, % non-child: 100.00%) - BytesSent: 4.05 GB (4344090167) - NetworkThroughput(*): 5.95 MB/sec - OverallThroughput: 37.40 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 32s554ms - ThriftTransmitTime(*): 11m36s - UncompressedRowBatchSize: 7.37 GB (7916512640) AGGREGATION_NODE (id=4):(Total: 3m38s, non-child: 3m37s, % non-child: 99.40%) ExecOption: Spilled - BuildTime: 2m55s - GetNewBlockTime: 105.569ms - GetResultsTime: 35s633ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.92 GB (12798390272) - PinTime: 292.557ms - RowsRepartitioned: 5.63M (5626388) - RowsReturned: 179.88M (179880759) - RowsReturnedRate: 822.09 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 53.699us HDFS_SCAN_NODE (id=3):(Total: 1s320ms, non-child: 1s320ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:14/1.75 GB 9:16/2.00 GB 5:14/1.75 GB 0:15/1.88 GB 8:14/1.75 GB 1:18/2.25 GB 7:20/2.50 GB 4:16/2.00 GB 3:17/2.12 GB 10:19/2.38 GB 6:17/2.12 GB Hdfs Read Thread Concurrency Bucket: 0:93.79% 1:5.367% 2:0.565% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0.2825% 11:0% 12:0% File Formats: TEXT/NONE:180 ExecOption: Codegen enabled: 0 out of 180 BytesRead(4s000ms): 937.00 MB, 1.44 GB, 1.97 GB, 2.44 GB, 2.98 GB, 3.47 GB, 3.87 GB, 4.34 GB, 4.90 GB, 5.63 GB, 6.16 GB, 6.52 GB, 6.95 GB, 7.55 GB, 8.12 GB, 8.63 GB, 8.77 GB, 9.55 GB, 10.09 GB, 10.62 GB, 11.13 GB, 11.65 GB, 12.14 GB, 12.34 GB, 12.47 GB, 13.01 GB, 13.46 GB, 14.37 GB, 14.96 GB, 15.59 GB, 16.21 GB, 16.75 GB, 17.27 GB, 17.53 GB, 18.30 GB, 18.84 GB, 19.35 GB, 19.85 GB, 20.36 GB, 20.86 GB, 21.34 GB, 21.78 GB, 21.96 GB, 22.21 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 34.10 - BytesRead: 22.50 GB (24159375360) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.50 GB (24159244288) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.50 GB (24159244288) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182167040) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 588 (588) - RowsRead: 179.88M (179880772) - RowsReturned: 179.88M (179880772) - RowsReturnedRate: 136.23 M/sec - ScanRangesComplete: 180 (180) - ScannerThreadsInvoluntaryContextSwitches: 36.85K (36854) - ScannerThreadsTotalWallClockTime: 1h40m - DelimiterParseTime: 48s319ms - MaterializeTupleTime(*): 51s554ms - ScannerThreadsSysTime: 822.856ms - ScannerThreadsUserTime: 1m45s - ScannerThreadsVoluntaryContextSwitches: 176.68K (176683) - TotalRawHdfsReadTime(*): 18s674ms - TotalReadThroughput: 129.80 MB/sec Instance 1435c5e25359ded:9a359144764e26cb (host=e1518.halxg.cloudera.com:22000):(Total: 5m25s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:13/1.62 GB 6:17/2.12 GB 3:18/2.25 GB 9:23/2.88 GB 8:20/2.50 GB 0:18/2.25 GB 5:13/1.62 GB 4:16/2.00 GB 2:19/2.38 GB 1:11/1.38 GB 10:12/1.50 GB MemoryUsage(8s000ms): 1.54 GB, 2.14 GB, 2.77 GB, 3.35 GB, 3.95 GB, 4.60 GB, 5.19 GB, 5.52 GB, 6.19 GB, 6.68 GB, 7.17 GB, 7.75 GB, 8.26 GB, 8.89 GB, 9.37 GB, 9.84 GB, 10.27 GB, 10.87 GB, 11.31 GB, 11.74 GB, 12.00 GB, 11.84 GB, 11.31 GB, 10.69 GB, 10.14 GB, 9.44 GB, 8.79 GB, 8.17 GB, 7.48 GB, 6.76 GB, 6.14 GB, 5.49 GB, 4.82 GB, 4.14 GB, 3.52 GB, 2.87 GB, 2.18 GB, 1.58 GB, 979.78 MB, 567.64 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.94 - PeakMemoryUsage: 12.25 GB (13150294016) - PerHostPeakMemUsage: 12.92 GB (13870395344) - PrepareTime: 165.150ms - RowsProduced: 179.89M (179887851) - TotalCpuTime: 1h42m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s789ms - TotalStorageWaitTime: 10s647ms CodeGen:(Total: 461.686ms, non-child: 461.686ms, % non-child: 100.00%) - CodegenTime: 359.930us - CompileTime: 43.699ms - LoadTime: 51.755us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 254.951ms - PrepareTime: 161.607ms DataStreamSender (dst_id=9):(Total: 1m51s, non-child: 1m51s, % non-child: 100.00%) - BytesSent: 4.05 GB (4344123379) - NetworkThroughput(*): 5.97 MB/sec - OverallThroughput: 37.24 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 32s318ms - ThriftTransmitTime(*): 11m33s - UncompressedRowBatchSize: 7.37 GB (7916824752) AGGREGATION_NODE (id=4):(Total: 3m34s, non-child: 3m32s, % non-child: 99.42%) ExecOption: Spilled - BuildTime: 2m50s - GetNewBlockTime: 107.259ms - GetResultsTime: 36s678ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.90 GB (12781613056) - PinTime: 312.234ms - RowsRepartitioned: 5.62M (5623985) - RowsReturned: 179.89M (179887851) - RowsReturnedRate: 840.21 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 50.893us HDFS_SCAN_NODE (id=3):(Total: 1s251ms, non-child: 1s251ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/1.62 GB 6:17/2.12 GB 3:18/2.25 GB 9:23/2.88 GB 8:20/2.50 GB 0:18/2.25 GB 5:13/1.62 GB 4:16/2.00 GB 2:19/2.38 GB 1:11/1.38 GB 10:12/1.50 GB Hdfs Read Thread Concurrency Bucket: 0:91.55% 1:6.997% 2:1.166% 3:0% 4:0% 5:0.2915% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:180 ExecOption: Codegen enabled: 0 out of 180 BytesRead(4s000ms): 961.00 MB, 1.42 GB, 1.94 GB, 2.51 GB, 3.19 GB, 3.71 GB, 4.29 GB, 4.93 GB, 5.62 GB, 6.17 GB, 6.57 GB, 7.02 GB, 7.68 GB, 8.25 GB, 8.69 GB, 9.08 GB, 9.93 GB, 10.41 GB, 10.92 GB, 11.42 GB, 11.93 GB, 12.33 GB, 12.35 GB, 12.84 GB, 13.17 GB, 14.17 GB, 14.64 GB, 15.20 GB, 15.75 GB, 16.30 GB, 16.84 GB, 17.34 GB, 17.60 GB, 18.49 GB, 18.96 GB, 19.48 GB, 19.99 GB, 20.50 GB, 21.00 GB, 21.51 GB, 21.89 GB, 22.03 GB, 22.37 GB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 34.11 - BytesRead: 22.50 GB (24159375360) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.50 GB (24159235072) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.50 GB (24159235072) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182167040) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 777 (777) - RowsRead: 179.89M (179887863) - RowsReturned: 179.89M (179887863) - RowsReturnedRate: 143.78 M/sec - ScanRangesComplete: 180 (180) - ScannerThreadsInvoluntaryContextSwitches: 33.60K (33605) - ScannerThreadsTotalWallClockTime: 1h37m - DelimiterParseTime: 47s485ms - MaterializeTupleTime(*): 50s791ms - ScannerThreadsSysTime: 827.858ms - ScannerThreadsUserTime: 1m45s - ScannerThreadsVoluntaryContextSwitches: 176.63K (176631) - TotalRawHdfsReadTime(*): 20s416ms - TotalReadThroughput: 133.95 MB/sec Instance 1435c5e25359ded:9a359144764e26c9 (host=e1521.halxg.cloudera.com:22000):(Total: 5m14s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:15/1.88 GB 2:15/1.88 GB 1:17/2.12 GB 10:18/2.25 GB 8:13/1.62 GB 7:20/2.50 GB 4:15/1.88 GB 3:17/2.12 GB 5:18/2.25 GB 0:18/2.14 GB 9:14/1.75 GB MemoryUsage(8s000ms): 1.59 GB, 2.36 GB, 3.06 GB, 3.66 GB, 4.39 GB, 5.02 GB, 5.54 GB, 6.27 GB, 6.84 GB, 7.43 GB, 7.91 GB, 8.52 GB, 9.06 GB, 9.54 GB, 9.93 GB, 10.44 GB, 11.01 GB, 11.51 GB, 11.92 GB, 11.81 GB, 11.47 GB, 10.77 GB, 10.09 GB, 9.45 GB, 8.84 GB, 8.18 GB, 7.57 GB, 6.94 GB, 6.28 GB, 5.67 GB, 5.10 GB, 4.49 GB, 3.86 GB, 3.20 GB, 2.54 GB, 1.91 GB, 1.29 GB, 578.60 MB, 730.13 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 20, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.32 - PeakMemoryUsage: 12.27 GB (13175459840) - PerHostPeakMemUsage: 12.44 GB (13358186496) - PrepareTime: 207.996ms - RowsProduced: 179.02M (179022978) - TotalCpuTime: 1h36m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 6s080ms - TotalStorageWaitTime: 12s612ms CodeGen:(Total: 522.597ms, non-child: 522.597ms, % non-child: 100.00%) - CodegenTime: 491.221us - CompileTime: 43.829ms - LoadTime: 57.322us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 273.419ms - PrepareTime: 203.734ms DataStreamSender (dst_id=9):(Total: 1m47s, non-child: 1m47s, % non-child: 100.00%) - BytesSent: 4.03 GB (4322288707) - NetworkThroughput(*): 6.13 MB/sec - OverallThroughput: 38.45 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 30s340ms - ThriftTransmitTime(*): 11m12s - UncompressedRowBatchSize: 7.34 GB (7878761884) AGGREGATION_NODE (id=4):(Total: 3m27s, non-child: 3m25s, % non-child: 99.46%) ExecOption: Spilled - BuildTime: 2m38s - GetNewBlockTime: 97.474ms - GetResultsTime: 40s556ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.68 GB (12538421248) - PinTime: 325.648ms - RowsRepartitioned: 5.59M (5594562) - RowsReturned: 179.02M (179022978) - RowsReturnedRate: 864.75 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 140.20us HDFS_SCAN_NODE (id=3):(Total: 1s128ms, non-child: 1s128ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:15/1.88 GB 2:15/1.88 GB 1:17/2.12 GB 10:18/2.25 GB 8:13/1.62 GB 7:20/2.50 GB 4:15/1.88 GB 3:17/2.12 GB 5:18/2.25 GB 0:18/2.14 GB 9:14/1.75 GB Hdfs Read Thread Concurrency Bucket: 0:92.5% 1:5.938% 2:0.9375% 3:0% 4:0.3125% 5:0% 6:0% 7:0% 8:0% 9:0.3125% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:180 ExecOption: Codegen enabled: 0 out of 180 BytesRead(4s000ms): 920.00 MB, 1.67 GB, 2.33 GB, 3.04 GB, 3.65 GB, 4.25 GB, 4.85 GB, 5.72 GB, 6.34 GB, 6.67 GB, 7.31 GB, 7.98 GB, 8.62 GB, 9.11 GB, 10.01 GB, 10.64 GB, 11.25 GB, 11.86 GB, 12.31 GB, 12.33 GB, 12.74 GB, 13.13 GB, 13.96 GB, 14.50 GB, 15.02 GB, 15.53 GB, 16.05 GB, 16.60 GB, 17.15 GB, 17.50 GB, 18.13 GB, 18.76 GB, 19.28 GB, 19.81 GB, 20.33 GB, 20.84 GB, 21.34 GB, 21.79 GB, 21.92 GB, 22.21 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 34.09 - BytesRead: 22.39 GB (24043660548) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.39 GB (24043513092) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.39 GB (24043513092) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.12 GB (1198944256) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 638 (638) - RowsRead: 179.02M (179022990) - RowsReturned: 179.02M (179022990) - RowsReturnedRate: 158.68 M/sec - ScanRangesComplete: 180 (180) - ScannerThreadsInvoluntaryContextSwitches: 32.12K (32122) - ScannerThreadsTotalWallClockTime: 1h31m - DelimiterParseTime: 47s317ms - MaterializeTupleTime(*): 46s521ms - ScannerThreadsSysTime: 849.854ms - ScannerThreadsUserTime: 1m40s - ScannerThreadsVoluntaryContextSwitches: 175.66K (175658) - TotalRawHdfsReadTime(*): 18s937ms - TotalReadThroughput: 142.86 MB/sec Instance 1435c5e25359ded:9a359144764e26c5 (host=e1321.halxg.cloudera.com:22000):(Total: 5m14s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:22/2.75 GB 8:14/1.75 GB 2:16/2.00 GB 5:13/1.62 GB 0:15/1.88 GB 7:14/1.75 GB 1:24/3.00 GB 9:20/2.50 GB 6:13/1.62 GB 4:15/1.88 GB 3:15/1.88 GB MemoryUsage(8s000ms): 1.57 GB, 2.32 GB, 3.05 GB, 3.59 GB, 4.36 GB, 4.97 GB, 5.39 GB, 6.04 GB, 6.54 GB, 6.92 GB, 7.51 GB, 7.97 GB, 8.76 GB, 9.30 GB, 9.86 GB, 10.29 GB, 10.90 GB, 11.34 GB, 11.78 GB, 11.98 GB, 11.89 GB, 11.28 GB, 10.54 GB, 9.79 GB, 9.14 GB, 8.43 GB, 7.80 GB, 7.13 GB, 6.48 GB, 5.88 GB, 5.23 GB, 4.61 GB, 4.01 GB, 3.31 GB, 2.66 GB, 1.97 GB, 1.27 GB, 590.59 MB, 743.67 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 30, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.68 - PeakMemoryUsage: 12.23 GB (13133434880) - PerHostPeakMemUsage: 12.74 GB (13684199400) - PrepareTime: 210.156ms - RowsProduced: 180.89M (180888151) - TotalCpuTime: 1h37m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s576ms - TotalStorageWaitTime: 13s010ms CodeGen:(Total: 536.129ms, non-child: 536.129ms, % non-child: 100.00%) - CodegenTime: 471.964us - CompileTime: 53.636ms - LoadTime: 33.390us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 274.938ms - PrepareTime: 206.24ms DataStreamSender (dst_id=9):(Total: 1m48s, non-child: 1m48s, % non-child: 100.00%) - BytesSent: 4.07 GB (4368086814) - NetworkThroughput(*): 6.11 MB/sec - OverallThroughput: 38.25 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 32s415ms - ThriftTransmitTime(*): 11m21s - UncompressedRowBatchSize: 7.41 GB (7960847740) AGGREGATION_NODE (id=4):(Total: 3m25s, non-child: 3m23s, % non-child: 99.39%) ExecOption: Spilled - BuildTime: 2m42s - GetNewBlockTime: 85.321ms - GetResultsTime: 34s364ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.92 GB (12798468096) - PinTime: 309.106ms - RowsRepartitioned: 5.65M (5650460) - RowsReturned: 180.89M (180888151) - RowsReturnedRate: 882.02 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 23.920us HDFS_SCAN_NODE (id=3):(Total: 1s247ms, non-child: 1s247ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:22/2.75 GB 8:14/1.75 GB 2:16/2.00 GB 5:13/1.62 GB 0:15/1.88 GB 7:14/1.75 GB 1:24/3.00 GB 9:20/2.50 GB 6:13/1.62 GB 4:15/1.88 GB 3:15/1.88 GB Hdfs Read Thread Concurrency Bucket: 0:89.02% 1:9.451% 2:1.22% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0.3049% 12:0% File Formats: TEXT/NONE:181 ExecOption: Codegen enabled: 0 out of 181 BytesRead(4s000ms): 909.00 MB, 1.65 GB, 2.31 GB, 3.01 GB, 3.60 GB, 4.18 GB, 4.71 GB, 5.64 GB, 6.28 GB, 6.65 GB, 7.23 GB, 7.83 GB, 8.41 GB, 8.75 GB, 9.50 GB, 10.06 GB, 10.60 GB, 11.12 GB, 11.56 GB, 12.03 GB, 12.33 GB, 12.42 GB, 12.93 GB, 13.34 GB, 14.33 GB, 14.90 GB, 15.55 GB, 16.19 GB, 16.82 GB, 17.37 GB, 17.64 GB, 18.55 GB, 19.01 GB, 19.53 GB, 20.05 GB, 20.55 GB, 21.06 GB, 21.55 GB, 21.91 GB, 22.08 GB, 22.47 GB - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 33.90 - BytesRead: 22.63 GB (24293594112) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.63 GB (24293449728) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.63 GB (24293449728) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.10 GB (1182257152) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 788 (788) - RowsRead: 180.89M (180888169) - RowsReturned: 180.89M (180888169) - RowsReturnedRate: 144.98 M/sec - ScanRangesComplete: 181 (181) - ScannerThreadsInvoluntaryContextSwitches: 25.70K (25705) - ScannerThreadsTotalWallClockTime: 1h32m - DelimiterParseTime: 46s260ms - MaterializeTupleTime(*): 48s275ms - ScannerThreadsSysTime: 700.877ms - ScannerThreadsUserTime: 1m39s - ScannerThreadsVoluntaryContextSwitches: 177.53K (177529) - TotalRawHdfsReadTime(*): 20s698ms - TotalReadThroughput: 140.84 MB/sec Instance 1435c5e25359ded:9a359144764e26c8 (host=e1420.halxg.cloudera.com:22000):(Total: 5m36s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:10/1.25 GB 7:16/2.00 GB 3:15/1.88 GB 10:22/2.75 GB 6:22/2.75 GB 4:19/2.38 GB 1:20/2.50 GB 8:12/1.50 GB 2:12/1.50 GB 5:16/2.00 GB 0:17/2.12 GB MemoryUsage(8s000ms): 1.54 GB, 2.32 GB, 3.04 GB, 3.59 GB, 4.21 GB, 4.88 GB, 5.37 GB, 6.02 GB, 6.57 GB, 6.95 GB, 7.51 GB, 7.96 GB, 8.61 GB, 9.10 GB, 9.60 GB, 9.94 GB, 10.40 GB, 10.96 GB, 11.36 GB, 11.75 GB, 12.00 GB, 11.87 GB, 11.74 GB, 11.09 GB, 10.54 GB, 9.86 GB, 9.29 GB, 8.66 GB, 8.06 GB, 7.46 GB, 6.89 GB, 6.29 GB, 5.62 GB, 4.97 GB, 4.37 GB, 3.67 GB, 3.02 GB, 2.45 GB, 1.75 GB, 1.13 GB, 589.31 MB, 687.04 MB ThreadUsage(8s000ms): 33, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.56 - PeakMemoryUsage: 12.23 GB (13133434880) - PerHostPeakMemUsage: 13.04 GB (14004719880) - PrepareTime: 214.934ms - RowsProduced: 180.88M (180883173) - TotalCpuTime: 1h43m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 6s519ms - TotalStorageWaitTime: 14s674ms CodeGen:(Total: 537.73ms, non-child: 537.73ms, % non-child: 100.00%) - CodegenTime: 446.377us - CompileTime: 50.411ms - LoadTime: 60.799us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 274.433ms - PrepareTime: 210.599ms DataStreamSender (dst_id=9):(Total: 1m50s, non-child: 1m50s, % non-child: 100.00%) - BytesSent: 4.07 GB (4369641337) - NetworkThroughput(*): 5.89 MB/sec - OverallThroughput: 37.55 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 30s921ms - ThriftTransmitTime(*): 11m47s - UncompressedRowBatchSize: 7.41 GB (7960628664) AGGREGATION_NODE (id=4):(Total: 3m44s, non-child: 3m43s, % non-child: 99.45%) ExecOption: Spilled - BuildTime: 2m53s - GetNewBlockTime: 112.832ms - GetResultsTime: 42s757ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.92 GB (12798468096) - PinTime: 322.845ms - RowsRepartitioned: 5.65M (5651788) - RowsReturned: 180.88M (180883173) - RowsReturnedRate: 804.86 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 44.690us HDFS_SCAN_NODE (id=3):(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:10/1.25 GB 7:16/2.00 GB 3:15/1.88 GB 10:22/2.75 GB 6:22/2.75 GB 4:19/2.38 GB 1:20/2.50 GB 8:12/1.50 GB 2:12/1.50 GB 5:16/2.00 GB 0:17/2.12 GB Hdfs Read Thread Concurrency Bucket: 0:92.29% 1:6.286% 2:0.8571% 3:0.2857% 4:0.2857% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:181 ExecOption: Codegen enabled: 0 out of 181 BytesRead(4s000ms): 1.03 GB, 1.72 GB, 2.39 GB, 3.09 GB, 3.67 GB, 4.25 GB, 4.88 GB, 5.66 GB, 6.20 GB, 6.50 GB, 7.04 GB, 7.71 GB, 8.33 GB, 8.78 GB, 9.60 GB, 10.21 GB, 10.74 GB, 11.25 GB, 11.67 GB, 12.13 GB, 12.35 GB, 12.45 GB, 12.98 GB, 13.32 GB, 14.24 GB, 14.67 GB, 15.20 GB, 15.72 GB, 16.24 GB, 16.75 GB, 17.24 GB, 17.54 GB, 18.14 GB, 18.76 GB, 19.22 GB, 19.69 GB, 20.16 GB, 20.63 GB, 21.09 GB, 21.54 GB, 21.85 GB, 22.02 GB, 22.25 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 33.76 - BytesRead: 22.63 GB (24293594112) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.63 GB (24293451776) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.63 GB (24293451776) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 35 (35) - PeakMemoryUsage: 1.11 GB (1190555648) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 824 (824) - RowsRead: 180.88M (180883189) - RowsReturned: 180.88M (180883189) - RowsReturnedRate: 145.85 M/sec - ScanRangesComplete: 181 (181) - ScannerThreadsInvoluntaryContextSwitches: 39.64K (39639) - ScannerThreadsTotalWallClockTime: 1h38m - DelimiterParseTime: 52s747ms - MaterializeTupleTime(*): 52s458ms - ScannerThreadsSysTime: 1s171ms - ScannerThreadsUserTime: 1m52s - ScannerThreadsVoluntaryContextSwitches: 177.54K (177537) - TotalRawHdfsReadTime(*): 19s686ms - TotalReadThroughput: 132.39 MB/sec Instance 1435c5e25359ded:9a359144764e26cd (host=e1320.halxg.cloudera.com:22000):(Total: 5m55s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:12/1.50 GB 2:11/1.38 GB 7:15/1.88 GB 8:12/1.50 GB 10:19/2.38 GB 1:17/2.12 GB 9:17/2.12 GB 3:20/2.50 GB 4:17/2.12 GB 5:19/2.38 GB 0:22/2.75 GB MemoryUsage(8s000ms): 401.72 MB, 1.20 GB, 1.70 GB, 2.19 GB, 2.66 GB, 3.27 GB, 3.68 GB, 4.25 GB, 4.78 GB, 5.14 GB, 5.59 GB, 6.09 GB, 6.56 GB, 7.08 GB, 7.55 GB, 7.95 GB, 8.49 GB, 8.90 GB, 9.33 GB, 9.81 GB, 10.23 GB, 10.57 GB, 11.07 GB, 11.45 GB, 11.78 GB, 11.85 GB, 11.30 GB, 10.58 GB, 9.94 GB, 9.24 GB, 8.64 GB, 7.97 GB, 7.37 GB, 6.72 GB, 6.07 GB, 5.40 GB, 4.73 GB, 4.06 GB, 3.38 GB, 2.76 GB, 2.09 GB, 1.37 GB, 713.47 MB, 697.88 MB ThreadUsage(8s000ms): 11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 7.16 - PeakMemoryUsage: 12.00 GB (12888379392) - PerHostPeakMemUsage: 14.86 GB (15952262848) - PrepareTime: 178.302ms - RowsProduced: 180.91M (180907236) - TotalCpuTime: 39m21s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 6s122ms - TotalStorageWaitTime: 2m59s CodeGen:(Total: 562.442ms, non-child: 562.442ms, % non-child: 100.00%) - CodegenTime: 425.776us - CompileTime: 75.175ms - LoadTime: 94.936us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 313.740ms - PrepareTime: 171.895ms DataStreamSender (dst_id=9):(Total: 1m48s, non-child: 1m48s, % non-child: 100.00%) - BytesSent: 4.07 GB (4369864488) - NetworkThroughput(*): 6.19 MB/sec - OverallThroughput: 38.25 MB/sec - PeakMemoryUsage: 280.00 KB (286720) - SerializeBatchTime: 31s270ms - ThriftTransmitTime(*): 11m12s - UncompressedRowBatchSize: 7.41 GB (7961687668) AGGREGATION_NODE (id=4):(Total: 4m6s, non-child: 3m57s, % non-child: 96.38%) ExecOption: Spilled - BuildTime: 3m12s - GetNewBlockTime: 127.49ms - GetResultsTime: 37s716ms - HashBuckets: 134.22M (134217728) - LargestPartitionPercent: 3 (3) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 64 (64) - PeakMemoryUsage: 11.92 GB (12798468096) - PinTime: 469.753ms - RowsRepartitioned: 5.65M (5654914) - RowsReturned: 180.91M (180907236) - RowsReturnedRate: 734.72 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 204.607us HDFS_SCAN_NODE (id=3):(Total: 8s902ms, non-child: 8s902ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:12/1.50 GB 2:11/1.38 GB 7:15/1.88 GB 8:12/1.50 GB 10:19/2.38 GB 1:17/2.12 GB 9:17/2.12 GB 3:20/2.50 GB 4:17/2.12 GB 5:19/2.38 GB 0:22/2.75 GB Hdfs Read Thread Concurrency Bucket: 0:38.61% 1:27.97% 2:18.32% 3:7.673% 4:1.733% 5:0.495% 6:0% 7:0.2475% 8:1.238% 9:0% 10:0.2475% 11:3.465% 12:0% File Formats: TEXT/NONE:181 ExecOption: Codegen enabled: 0 out of 181 BytesRead(4s000ms): 0, 123.00 MB, 518.00 MB, 1.36 GB, 1.71 GB, 2.25 GB, 2.75 GB, 3.14 GB, 3.65 GB, 4.17 GB, 4.74 GB, 5.26 GB, 5.74 GB, 6.05 GB, 6.44 GB, 6.98 GB, 7.52 GB, 8.03 GB, 8.37 GB, 8.96 GB, 9.48 GB, 9.92 GB, 10.43 GB, 10.91 GB, 11.39 GB, 11.79 GB, 11.83 GB, 12.03 GB, 12.54 GB, 13.08 GB, 13.56 GB, 14.01 GB, 14.54 GB, 15.04 GB, 15.51 GB, 15.97 GB, 16.45 GB, 16.93 GB, 17.42 GB, 17.89 GB, 18.36 GB, 18.80 GB, 19.23 GB, 19.69 GB, 20.15 GB, 20.59 GB, 21.04 GB, 21.50 GB, 21.94 GB, 22.28 GB - AverageHdfsReadThreadConcurrency: 1.49 - AverageScannerThreadConcurrency: 10.84 - BytesRead: 22.63 GB (24293594112) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.63 GB (24293594112) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.63 GB (24293594112) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 622.18 MB (652406784) - PerReadThreadRawHdfsThroughput: 73.62 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 180.91M (180907249) - RowsReturned: 180.91M (180907249) - RowsReturnedRate: 20.32 M/sec - ScanRangesComplete: 181 (181) - ScannerThreadsInvoluntaryContextSwitches: 42.85K (42851) - ScannerThreadsTotalWallClockTime: 36m30s - DelimiterParseTime: 49s006ms - MaterializeTupleTime(*): 54s203ms - ScannerThreadsSysTime: 821.869ms - ScannerThreadsUserTime: 1m48s - ScannerThreadsVoluntaryContextSwitches: 174.66K (174657) - TotalRawHdfsReadTime(*): 5m14s - TotalReadThroughput: 114.41 MB/sec Fragment F00: Instance 1435c5e25359ded:9a359144764e26ce (host=e1320.halxg.cloudera.com:22000):(Total: 188.463ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0 ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 6.27 MB (6574080) - PerHostPeakMemUsage: 118.16 MB (123897664) - PrepareTime: 187.481ms - RowsProduced: 0 (0) - TotalCpuTime: 440.316ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 182ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 429.477ms, non-child: 429.477ms, % non-child: 100.00%) - CodegenTime: 5.275ms - CompileTime: 34.884ms - LoadTime: 40.442us - ModuleFileSize: 1.98 MB (2073544) - OptimizationTime: 215.875ms - PrepareTime: 177.323ms DataStreamSender (dst_id=7):(Total: 19.911us, non-child: 19.911us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=2):(Total: 187.859ms, non-child: 187.756ms, % non-child: 99.95%) ExecOption: Codegen Enabled - BuildTime: 2.36us - GetNewBlockTime: 1.645ms - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 6.26 MB (6561792) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.761us HDFS_SCAN_NODE (id=1):(Total: 103.161us, non-child: 103.161us, % non-child: 100.00%) Hdfs split stats (:<# splits>/): - BytesRead: 0 - PeakMemoryUsage: 0 - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec