Query (id=9d49cd02cdb3df07:4cf79895d9408e9d): Summary: Session ID: 6446028f7b93a9d0:7678477396abcf88 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2015-03-04 00:01:23.578207000 End Time: 2015-03-04 00:11:38.742624000 Query Type: QUERY Query State: EXCEPTION Query Status: Cancelled from Impala's debug web interface Impala Version: impalad version 2.1.2-cdh5 RELEASE (build 92438b7fb62a875041ffd2ab324f408ecf8129e5) User: deploy Connected User: deploy Delegated User: Network Address: ::ffff:10.106.155.198:38786 Default Db: adrian Sql Statement: SELECT NDV(key) AS key, CAST(-1 as BIGINT), MAX(length(key)), AVG(length(key)), NDV(col) AS col, CAST(-1 as BIGINT), MAX(length(col)), AVG(length(col)), NDV(value) AS value, CAST(-1 as BIGINT), MAX(length(value)), AVG(length(value)) FROM adrian.hbase_user_view_length Coordinator: hadoop-slave01.local:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.35GB VCores=1 WARNING: The following tables are missing relevant table and/or column statistics. adrian.hbase_user_view_length F01:PLAN FRAGMENT [UNPARTITIONED] 03:AGGREGATE [FINALIZE] | output: ndv:merge(key), max:merge(length(key)), avg:merge(length(key)), ndv:merge(col), max:merge(length(col)), avg:merge(length(col)), ndv:merge(value), max:merge(length(value)), avg:merge(length(value)) | hosts=12 per-host-mem=unavailable | tuple-ids=2 row-size=60B cardinality=1 | 02:EXCHANGE [UNPARTITIONED] hosts=12 per-host-mem=unavailable tuple-ids=1 row-size=60B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=02, UNPARTITIONED] 01:AGGREGATE | output: ndv(key), max(length(key)), avg(length(key)), ndv(col), max(length(col)), avg(length(col)), ndv(value), max(length(value)), avg(length(value)) | hosts=12 per-host-mem=10.00MB | tuple-ids=1 row-size=60B cardinality=1 | 00:SCAN HDFS [adrian.hbase_user_view_length, RANDOM] partitions=1/1 files=600 size=18.68GB table stats: 394591019 rows total column stats: unavailable hosts=12 per-host-mem=2.34GB tuple-ids=0 row-size=45B cardinality=394591019 ---------------- Estimated Per-Host Mem: 2527068160 Estimated Per-Host VCores: 1 Tables Missing Stats: adrian.hbase_user_view_length Request Pool: root.deploy Resource reservation request: Reservation Request(queue=root.deploy user=deploy gang=1 request_timeout=300000 resources=[Resource(client_resource_id=854866edbf12a84a:a8b0c2fbf53d7998 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave08.local:0 enforcement=0),Resource(client_resource_id=3e4864bd2c90a3d1:d630ad284bcd1188 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave04.local:0 enforcement=0),Resource(client_resource_id=144b20b128383219:e479b827b8c2d5a2 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave06.local:0 enforcement=0),Resource(client_resource_id=1041b7c68e68a09d:5101bc18240f16ab v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave07.local:0 enforcement=0),Resource(client_resource_id=4c4ee28db706967f:2903d832c4b0a49d v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave03.local:0 enforcement=0),Resource(client_resource_id=3d47c1f2a5b8214c:b30d228c7e017b5 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave11.local:0 enforcement=0),Resource(client_resource_id=174d9155ae21e7d3:8b8fc8c8b449529a v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave05.local:0 enforcement=0),Resource(client_resource_id=1448b8575ce23eba:dd893cbb67723dbc v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave10.local:0 enforcement=0),Resource(client_resource_id=824005c54da9f991:e5eb548df0534480 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave02.local:0 enforcement=0),Resource(client_resource_id=9047abf8a1e1a908:5a53f29bbada87b5 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave12.local:0 enforcement=0),Resource(client_resource_id=5c458b71eae3e193:f5b037ca027d8cbd v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave09.local:0 enforcement=0),Resource(client_resource_id=4d4a2fa226403e52:b04215114aa668b7 v_cpu_cores=2 memory_mb=4096 asked_location=hadoop-slave01.local:0 enforcement=0)]) Granted resource reservation: Granted Reservation(reservation id=d64531e275091b35:b1423541b739c2ab resources=[(hadoop-slave01.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=4d4a2fa226403e52:b04215114aa668b7 rm_resource_id=container_1425356053600_2532_01_000623,container_1425356053600_2532_01_000633,container_1425356053600_2532_01_000510,container_1425356053600_2532_01_000512,container_1425356053600_2532_01_000514,container_1425356053600_2532_01_000516 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave01.local)),(hadoop-slave02.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=824005c54da9f991:e5eb548df0534480 rm_resource_id=container_1425356053600_2532_01_000699,container_1425356053600_2532_01_000707,container_1425356053600_2532_01_000525,container_1425356053600_2532_01_000535,container_1425356053600_2532_01_000546,container_1425356053600_2532_01_000556 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave02.local)),(hadoop-slave03.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=4c4ee28db706967f:2903d832c4b0a49d rm_resource_id=container_1425356053600_2532_01_000673,container_1425356053600_2532_01_000696,container_1425356053600_2532_01_000528,container_1425356053600_2532_01_000538,container_1425356053600_2532_01_000541,container_1425356053600_2532_01_000551 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave03.local)),(hadoop-slave04.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=3e4864bd2c90a3d1:d630ad284bcd1188 rm_resource_id=container_1425356053600_2532_01_000616,container_1425356053600_2532_01_000604,container_1425356053600_2532_01_000529,container_1425356053600_2532_01_000539,container_1425356053600_2532_01_000549,container_1425356053600_2532_01_000560 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave04.local)),(hadoop-slave05.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=174d9155ae21e7d3:8b8fc8c8b449529a rm_resource_id=container_1425356053600_2532_01_000678,container_1425356053600_2532_01_000670,container_1425356053600_2532_01_000509,container_1425356053600_2532_01_000511,container_1425356053600_2532_01_000513,container_1425356053600_2532_01_000515 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave05.local)),(hadoop-slave06.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=144b20b128383219:e479b827b8c2d5a2 rm_resource_id=container_1425356053600_2532_01_000613,container_1425356053600_2532_01_000589,container_1425356053600_2532_01_000526,container_1425356053600_2532_01_000536,container_1425356053600_2532_01_000547,container_1425356053600_2532_01_000557 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave06.local)),(hadoop-slave07.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=1041b7c68e68a09d:5101bc18240f16ab rm_resource_id=container_1425356053600_2532_01_000650,container_1425356053600_2532_01_000586,container_1425356053600_2532_01_000523,container_1425356053600_2532_01_000533,container_1425356053600_2532_01_000544,container_1425356053600_2532_01_000554 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave07.local)),(hadoop-slave08.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=854866edbf12a84a:a8b0c2fbf53d7998 rm_resource_id=container_1425356053600_2532_01_000708,container_1425356053600_2532_01_000684,container_1425356053600_2532_01_000530,container_1425356053600_2532_01_000540,container_1425356053600_2532_01_000550,container_1425356053600_2532_01_000561 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave08.local)),(hadoop-slave09.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=5c458b71eae3e193:f5b037ca027d8cbd rm_resource_id=container_1425356053600_2532_01_000695,container_1425356053600_2532_01_000664,container_1425356053600_2532_01_000524,container_1425356053600_2532_01_000534,container_1425356053600_2532_01_000545,container_1425356053600_2532_01_000555 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave09.local)),(hadoop-slave10.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=1448b8575ce23eba:dd893cbb67723dbc rm_resource_id=container_1425356053600_2532_01_000689,container_1425356053600_2532_01_000674,container_1425356053600_2532_01_000522,container_1425356053600_2532_01_000532,container_1425356053600_2532_01_000543,container_1425356053600_2532_01_000553 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave10.local)),(hadoop-slave11.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=3d47c1f2a5b8214c:b30d228c7e017b5 rm_resource_id=container_1425356053600_2532_01_000608,container_1425356053600_2532_01_000620,container_1425356053600_2532_01_000521,container_1425356053600_2532_01_000531,container_1425356053600_2532_01_000542,container_1425356053600_2532_01_000552 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave11.local)),(hadoop-slave12.local:0,Allocated Resource(reservation_id=d64531e275091b35:b1423541b739c2ab client_resource_id=9047abf8a1e1a908:5a53f29bbada87b5 rm_resource_id=container_1425356053600_2532_01_000614,container_1425356053600_2532_01_000644,container_1425356053600_2532_01_000527,container_1425356053600_2532_01_000537,container_1425356053600_2532_01_000548,container_1425356053600_2532_01_000559 v_cpu_cores=2 memory_mb=4096 location=hadoop-slave12.local))]) ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------- 03:AGGREGATE 1 173.399ms 173.399ms 0 1 24.00 KB -1.00 B FINALIZE 02:EXCHANGE 1 35.992us 35.992us 2 1 0 -1.00 B UNPARTITIONED 01:AGGREGATE 12 4s268ms 28s148ms 2 1 2.52 GB 10.00 MB 00:SCAN HDFS 12 9m53s 10m11s 163.98M 394.59M 77.52 GB 2.34 GB adrian.hbase_user_view_length Query Timeline: 10m15s - Start execution: 39.776us (39.776us) - Planning finished: 11.140ms (11.100ms) - Resources reserved: 23.712ms (12.572ms) - Ready to start remote fragments: 198.13ms (174.300ms) - Remote fragments started: 475.494ms (277.480ms) - Cancelled: 10m15s (10m14s) - Rows available: 10m15s (4.835ms) - Unregister query: 10m15s (10.321ms) ImpalaServer: - ClientFetchWaitTimer: 0ns - RowMaterializationTimer: 0ns Execution Profile 9d49cd02cdb3df07:4cf79895d9408e9d:(Total: 10m15s, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 12, last: 0.275827, min: 0.164675, max: 0.275827, mean: 0.189804, stddev: 0.0303003 Per Node Peak Memory Usage: hadoop-slave06.local:22000(35.13 GB) hadoop-slave04.local:22000(30.41 GB) hadoop-slave08.local:22000(29.38 GB) hadoop-slave07.local:22000(77.13 GB) hadoop-slave03.local:22000(25.60 GB) hadoop-slave11.local:22000(77.94 GB) hadoop-slave05.local:22000(63.68 GB) hadoop-slave10.local:22000(29.59 GB) hadoop-slave02.local:22000(25.91 GB) hadoop-slave12.local:22000(18.29 GB) hadoop-slave09.local:22000(27.69 GB) hadoop-slave01.local:22000(27.63 GB) - FinalizationTimer: 0ns Coordinator Fragment F01:(Total: 10m14s, non-child: 0ns, % non-child: 0.00%) MemoryUsage(16s000ms): 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 25.50 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 32.00 KB, 33.62 KB ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 36.00 KB (36864) - PerHostPeakMemUsage: 0 - PrepareTime: 173.365ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 10m14s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 338.380ms, non-child: 338.380ms, % non-child: 100.00%) - CodegenTime: 4.443ms - CompileTime: 11.335ms - LoadTime: 117.340us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 156.911ms - PrepareTime: 168.629ms AGGREGATION_NODE (id=3):(Total: 10m14s, non-child: 173.399ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 EXCHANGE_NODE (id=2):(Total: 10m14s, non-child: 35.992us, % non-child: 0.00%) BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.09 KB, 1.84 KB, 1.84 KB, 1.84 KB, 1.84 KB, 1.84 KB, 2.58 KB - BytesReceived: 3.67 KB (3756) - ConvertRowBatchTime: 4.377us - DeserializeRowBatchTimer: 26.976us - FirstBatchArrivalWaitTime: 8m22s - PeakMemoryUsage: 0 - RowsReturned: 2 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F00:(Total: 1m32s, non-child: 0ns, % non-child: 0.00%) split sizes: min: 1.53 GB, max: 1.59 GB, avg: 1.56 GB, stddev: 18.40 MB completion times: min:8m22s max:10m14s mean: 10m4s stddev:30s915ms execution rates: min:2.54 MB/sec max:3.11 MB/sec mean:2.65 MB/sec stddev:146.06 KB/sec num instances: 12 - AverageThreadTokens: 82.89 - PeakMemoryUsage: 39.03 GB (41908922026) - PerHostPeakMemUsage: 39.03 GB (41908920320) - PrepareTime: 183.438ms - RowsProduced: 0 - TotalCpuTime: 50m40s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 663.759us - TotalStorageWaitTime: 2s174ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 381.431ms, non-child: 381.431ms, % non-child: 100.00%) - CodegenTime: 4.719ms - CompileTime: 21.431ms - LoadTime: 102.651us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 181.519ms - PrepareTime: 176.941ms DataStreamSender (dst_id=2):(Total: 21.987us, non-child: 21.987us, % non-child: 100.00%) - BytesSent: 313.00 B (313) - NetworkThroughput(*): 304.28 KB/sec - OverallThroughput: 6.20 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 4.481us - ThriftTransmitTime(*): 657.542us - UncompressedRowBatchSize: 540.00 B (540) AGGREGATION_NODE (id=1):(Total: 1m32s, non-child: 0ns, % non-child: 0.00%) - BuildTime: 8s981ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 858.82 MB (900538709) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 9m53s, non-child: 9m53s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 26.81 - BytesRead: 1.07 GB (1150650824) - BytesReadDataNodeCache: 0 - BytesReadLocal: 263.02 MB (275798540) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 263.02 MB (275798540) - BytesSkipped: 0 - DecompressionTime: 4h29m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 28 - PeakMemoryUsage: 38.90 GB (41766350165) - PerReadThreadRawHdfsThroughput: 575.01 MB/sec - RemoteScanRanges: 315 - RowsRead: 13.68M (13676169) - RowsReturned: 13.67M (13665159) - RowsReturnedRate: 24.01 K/sec - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 22.26K (22263) - ScannerThreadsTotalWallClockTime: 49m8s - MaterializeTupleTime(*): 1h9m - ScannerThreadsSysTime: 21s098ms - ScannerThreadsUserTime: 2m24s - ScannerThreadsVoluntaryContextSwitches: 984.92K (984923) - TotalRawHdfsReadTime(*): 1s984ms - TotalReadThroughput: 1.84 MB/sec Fragment F00: Instance 9d49cd02cdb3df07:4cf79895d9408ea7 (host=hadoop-slave07.local:22000):(Total: 10m1s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/63.78 MB 3:1/31.86 MB 1:18/573.87 MB 4:8/255.05 MB 5:19/605.97 MB 0:2/63.81 MB MemoryUsage(16s000ms): 2.85 GB, 4.54 GB, 6.02 GB, 7.45 GB, 8.90 GB, 10.36 GB, 11.85 GB, 13.30 GB, 14.39 GB, 15.35 GB, 16.43 GB, 17.65 GB, 18.83 GB, 19.89 GB, 21.08 GB, 22.42 GB, 23.85 GB, 25.45 GB, 27.28 GB, 29.20 GB, 31.20 GB, 33.24 GB, 35.33 GB, 37.51 GB, 39.63 GB, 41.83 GB, 44.20 GB, 46.67 GB, 49.26 GB, 52.08 GB, 55.07 GB, 58.22 GB, 61.61 GB, 65.48 GB, 70.07 GB, 65.00 GB, 23.13 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 95, 87 - AverageThreadTokens: 95.34 - PeakMemoryUsage: 77.13 GB (82812641280) - PerHostPeakMemUsage: 77.13 GB (82812641280) - PrepareTime: 176.782ms - RowsProduced: 1 - TotalCpuTime: 5h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 576.912us - TotalStorageWaitTime: 3s599ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 372.317ms, non-child: 372.317ms, % non-child: 100.00%) - CodegenTime: 4.779ms - CompileTime: 21.94ms - LoadTime: 106.163us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 179.405ms - PrepareTime: 170.189ms DataStreamSender (dst_id=2):(Total: 47.106us, non-child: 47.106us, % non-child: 100.00%) - BytesSent: 1.83 KB (1870) - NetworkThroughput(*): 3.32 MB/sec - OverallThroughput: 37.86 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 26.108us - ThriftTransmitTime(*): 536.961us - UncompressedRowBatchSize: 3.16 KB (3240) AGGREGATION_NODE (id=1):(Total: 10m1s, non-child: 28s148ms, % non-child: 4.68%) ExecOption: Codegen Enabled - BuildTime: 27s749ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 2.52 GB (2701824000) - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 9m33s, non-child: 9m33s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/63.78 MB 3:1/31.86 MB 1:18/573.87 MB 4:8/255.05 MB 5:19/605.97 MB 0:2/63.81 MB Hdfs Read Thread Concurrency Bucket: 0:99.75% 1:0.1663% 2:0.08313% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: SEQUENCE_FILE/DEFAULT:50 ExecOption: Codegen enabled: 50 out of 50 BytesRead(16s000ms): 943.53 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 988.60 MB, 1.14 GB, 1.56 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 30.40 - BytesRead: 1.56 GB (1671831012) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.56 GB (1671831012) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.56 GB (1671831012) - BytesSkipped: 0 - DecompressionTime: 4h56m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 31 - PeakMemoryUsage: 76.70 GB (82356264960) - PerReadThreadRawHdfsThroughput: 607.30 MB/sec - RemoteScanRanges: 1.92K (1917) - RowsRead: 32.89M (32886995) - RowsReturned: 32.89M (32886995) - RowsReturnedRate: 57.37 K/sec - ScanRangesComplete: 50 - ScannerThreadsInvoluntaryContextSwitches: 113.60K (113601) - ScannerThreadsTotalWallClockTime: 5h4m - MaterializeTupleTime(*): 5h4m - ScannerThreadsSysTime: 1m57s - ScannerThreadsUserTime: 13m6s - ScannerThreadsVoluntaryContextSwitches: 5.56M (5557137) - TotalRawHdfsReadTime(*): 2s625ms - TotalReadThroughput: 2.65 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408eaa (host=hadoop-slave06.local:22000):(Total: 8m22s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/63.82 MB 2:4/127.48 MB 4:11/350.49 MB 3:1/31.91 MB 5:9/286.76 MB 0:22/701.37 MB MemoryUsage(8s000ms): 1.63 GB, 2.81 GB, 3.81 GB, 4.80 GB, 5.78 GB, 6.77 GB, 7.75 GB, 8.71 GB, 9.78 GB, 10.85 GB, 11.90 GB, 12.97 GB, 14.06 GB, 15.20 GB, 16.29 GB, 17.17 GB, 17.87 GB, 18.59 GB, 19.35 GB, 20.15 GB, 20.99 GB, 21.89 GB, 22.76 GB, 23.77 GB, 24.91 GB, 26.06 GB, 27.17 GB, 28.32 GB, 23.63 GB, 7.66 GB, 8.92 GB, 9.88 GB, 10.77 GB, 11.69 GB, 12.63 GB, 13.56 GB, 14.51 GB, 15.44 GB, 16.39 GB, 17.42 GB, 18.49 GB, 19.61 GB, 20.78 GB, 21.99 GB, 23.14 GB, 24.36 GB, 25.67 GB, 26.99 GB, 28.42 GB, 7.72 GB, 16.73 GB, 20.37 GB, 21.56 GB, 22.69 GB, 23.85 GB, 25.56 GB, 26.96 GB, 28.41 GB, 29.96 GB, 31.54 GB, 33.18 GB, 26.66 GB ThreadUsage(8s000ms): 45, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 62, 64, 64, 64, 64, 64, 59 - AverageThreadTokens: 49.63 - PeakMemoryUsage: 35.13 GB (37718335488) - PerHostPeakMemUsage: 35.13 GB (37718335488) - PrepareTime: 168.545ms - RowsProduced: 1 - TotalCpuTime: 1h59m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.388ms - TotalStorageWaitTime: 5s266ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 370.522ms, non-child: 370.522ms, % non-child: 100.00%) - CodegenTime: 4.709ms - CompileTime: 24.649ms - LoadTime: 114.264us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 182.184ms - PrepareTime: 162.185ms DataStreamSender (dst_id=2):(Total: 49.155us, non-child: 49.155us, % non-child: 100.00%) - BytesSent: 1.84 KB (1886) - NetworkThroughput(*): 250.46 KB/sec - OverallThroughput: 36.59 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 27.665us - ThriftTransmitTime(*): 7.353ms - UncompressedRowBatchSize: 3.16 KB (3240) AGGREGATION_NODE (id=1):(Total: 8m22s, non-child: 23s071ms, % non-child: 4.59%) ExecOption: Codegen Enabled - BuildTime: 22s679ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 2.52 GB (2701012992) - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 7m59s, non-child: 7m59s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/63.82 MB 2:4/127.48 MB 4:11/350.49 MB 3:1/31.91 MB 5:9/286.76 MB 0:22/701.37 MB Hdfs Read Thread Concurrency Bucket: 0:99.3% 1:0.4975% 2:0.199% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: SEQUENCE_FILE/DEFAULT:49 ExecOption: Codegen enabled: 49 out of 49 BytesRead(8s000ms): 358.75 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 382.66 MB, 484.74 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 764.93 MB, 765.43 MB, 1.08 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.13 GB, 1.48 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 13.30 - BytesRead: 1.53 GB (1637751477) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.53 GB (1637751477) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.53 GB (1637751477) - BytesSkipped: 0 - DecompressionTime: 1h47m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 25 - PeakMemoryUsage: 34.80 GB (37363851264) - PerReadThreadRawHdfsThroughput: 379.07 MB/sec - RemoteScanRanges: 1.86K (1864) - RowsRead: 32.22M (32217328) - RowsReturned: 32.22M (32217328) - RowsReturnedRate: 67.21 K/sec - ScanRangesComplete: 49 - ScannerThreadsInvoluntaryContextSwitches: 106.68K (106679) - ScannerThreadsTotalWallClockTime: 1h51m - MaterializeTupleTime(*): 1h51m - ScannerThreadsSysTime: 1m27s - ScannerThreadsUserTime: 10m - ScannerThreadsVoluntaryContextSwitches: 3.44M (3444562) - TotalRawHdfsReadTime(*): 4s120ms - TotalReadThroughput: 3.11 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea5 (host=hadoop-slave11.local:22000):(Total: 272.63ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:8/255.07 MB 1:10/318.88 MB 0:7/223.26 MB 5:6/191.31 MB 4:4/127.58 MB 2:15/478.32 MB MemoryUsage(16s000ms): 1.84 GB, 3.55 GB, 5.49 GB, 6.79 GB, 8.10 GB, 9.46 GB, 10.85 GB, 12.16 GB, 12.99 GB, 13.78 GB, 14.76 GB, 15.71 GB, 16.62 GB, 17.52 GB, 18.52 GB, 19.56 GB, 20.68 GB, 22.15 GB, 23.76 GB, 25.43 GB, 27.10 GB, 28.92 GB, 30.81 GB, 32.76 GB, 34.67 GB, 36.60 GB, 38.74 GB, 40.93 GB, 43.28 GB, 45.61 GB, 47.70 GB, 50.29 GB, 53.25 GB, 56.48 GB, 60.06 GB, 64.32 GB, 69.60 GB, 64.96 GB ThreadUsage(16s000ms): 34, 44, 71, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 71 - AverageThreadTokens: 70.19 - PeakMemoryUsage: 77.94 GB (83686023168) - PerHostPeakMemUsage: 77.94 GB (83686023168) - PrepareTime: 271.207ms - RowsProduced: 0 - TotalCpuTime: 2h53m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 2s573ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 444.757ms, non-child: 444.757ms, % non-child: 100.00%) - CodegenTime: 4.81ms - CompileTime: 18.953ms - LoadTime: 123.738us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 158.893ms - PrepareTime: 265.306ms DataStreamSender (dst_id=2):(Total: 13.532us, non-child: 13.532us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 271.206ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 15s813ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 2.52 GB (2700746752) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 9m55s, non-child: 9m55s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:8/255.07 MB 1:10/318.88 MB 0:7/223.26 MB 5:6/191.31 MB 4:4/127.58 MB 2:15/478.32 MB BytesRead(16s000ms): 343.30 MB, 546.10 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.27 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.83 - BytesRead: 1.56 GB (1671916493) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h29m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 34 - PeakMemoryUsage: 77.52 GB (83236823040) - PerReadThreadRawHdfsThroughput: 565.39 MB/sec - RemoteScanRanges: 0 - RowsRead: 23.97M (23968218) - RowsReturned: 23.96M (23957455) - RowsReturnedRate: 40.23 K/sec - ScanRangesComplete: 34 - ScannerThreadsInvoluntaryContextSwitches: 46.88K (46876) - ScannerThreadsTotalWallClockTime: 2h53m - MaterializeTupleTime(*): 5h31m - ScannerThreadsSysTime: 48s141ms - ScannerThreadsUserTime: 5m52s - ScannerThreadsVoluntaryContextSwitches: 2.82M (2817382) - TotalRawHdfsReadTime(*): 2s820ms - TotalReadThroughput: 2.61 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea0 (host=hadoop-slave12.local:22000):(Total: 209.129ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:3/95.65 MB 2:11/350.81 MB 5:4/127.48 MB 1:13/414.19 MB 4:10/319.03 MB 3:9/286.80 MB MemoryUsage(16s000ms): 3.82 GB, 4.93 GB, 5.54 GB, 6.16 GB, 6.73 GB, 7.22 GB, 7.69 GB, 8.15 GB, 8.38 GB, 8.55 GB, 8.73 GB, 8.87 GB, 9.02 GB, 9.24 GB, 9.46 GB, 9.66 GB, 9.84 GB, 9.90 GB, 9.97 GB, 10.08 GB, 10.34 GB, 10.73 GB, 11.12 GB, 11.53 GB, 12.01 GB, 12.49 GB, 12.97 GB, 13.45 GB, 13.91 GB, 14.39 GB, 14.86 GB, 15.32 GB, 15.79 GB, 16.24 GB, 16.71 GB, 17.15 GB, 17.60 GB, 18.03 GB ThreadUsage(16s000ms): 68, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72, 72 - AverageThreadTokens: 71.90 - PeakMemoryUsage: 18.29 GB (19637469184) - PerHostPeakMemUsage: 18.29 GB (19637469184) - PrepareTime: 208.101ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1s232ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 385.767ms, non-child: 385.767ms, % non-child: 100.00%) - CodegenTime: 5.115ms - CompileTime: 19.604ms - LoadTime: 133.754us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 163.453ms - PrepareTime: 201.131ms DataStreamSender (dst_id=2):(Total: 22.473us, non-child: 22.473us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 208.100ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 2s072ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m7s, non-child: 10m7s, % non-child: 100.00%) ExecOption: Missing Volume Id Hdfs split stats (:<# splits>/): -1:3/95.65 MB 2:11/350.81 MB 5:4/127.48 MB 1:13/414.19 MB 4:10/319.03 MB 3:9/286.80 MB BytesRead(16s000ms): 524.95 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB, 541.89 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 16.99 - BytesRead: 541.89 MB (568208993) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 2h52m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 17 - PeakMemoryUsage: 18.29 GB (19637440512) - PerReadThreadRawHdfsThroughput: 340.80 MB/sec - RemoteScanRanges: 0 - RowsRead: 4.69M (4689545) - RowsReturned: 4.68M (4682352) - RowsReturnedRate: 7.71 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s590ms - TotalReadThroughput: 910.35 KB/sec Instance 9d49cd02cdb3df07:4cf79895d9408e9f (host=hadoop-slave09.local:22000):(Total: 189.865ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:8/254.92 MB 1:8/255.27 MB 4:8/255.17 MB 0:9/286.81 MB 5:10/318.73 MB 3:7/223.14 MB MemoryUsage(16s000ms): 4.49 GB, 5.75 GB, 6.57 GB, 7.30 GB, 7.97 GB, 8.65 GB, 9.34 GB, 9.99 GB, 10.48 GB, 10.88 GB, 11.28 GB, 11.76 GB, 12.25 GB, 12.77 GB, 13.26 GB, 13.74 GB, 14.25 GB, 14.82 GB, 15.43 GB, 16.04 GB, 16.66 GB, 17.33 GB, 17.95 GB, 18.56 GB, 19.21 GB, 19.83 GB, 20.36 GB, 20.90 GB, 21.49 GB, 22.11 GB, 22.71 GB, 23.33 GB, 23.95 GB, 24.57 GB, 25.18 GB, 25.82 GB, 26.44 GB, 27.10 GB ThreadUsage(16s000ms): 92, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.91 - PeakMemoryUsage: 27.69 GB (29735649280) - PerHostPeakMemUsage: 27.69 GB (29735649280) - PrepareTime: 189.122ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 2s241ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 428.779ms, non-child: 428.779ms, % non-child: 100.00%) - CodegenTime: 4.920ms - CompileTime: 21.378ms - LoadTime: 84.17us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 223.523ms - PrepareTime: 182.256ms DataStreamSender (dst_id=2):(Total: 13.320us, non-child: 13.320us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 189.121ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 4s523ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m9s, non-child: 10m9s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:8/254.92 MB 1:8/255.27 MB 4:8/255.17 MB 0:9/286.81 MB 5:10/318.73 MB 3:7/223.14 MB BytesRead(16s000ms): 930.20 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB, 988.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 30.99 - BytesRead: 988.48 MB (1036495015) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h16m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 31 - PeakMemoryUsage: 27.69 GB (29735620608) - PerReadThreadRawHdfsThroughput: 579.99 MB/sec - RemoteScanRanges: 0 - RowsRead: 7.07M (7068654) - RowsReturned: 7.05M (7052628) - RowsReturnedRate: 11.56 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s704ms - TotalReadThroughput: 1.61 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea6 (host=hadoop-slave03.local:22000):(Total: 178.182ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:11/350.69 MB 3:3/95.69 MB 2:10/318.86 MB 1:16/510.36 MB 0:3/95.50 MB 5:7/223.10 MB MemoryUsage(16s000ms): 3.54 GB, 4.59 GB, 5.36 GB, 6.02 GB, 6.67 GB, 7.31 GB, 7.94 GB, 8.51 GB, 8.95 GB, 9.28 GB, 9.72 GB, 10.21 GB, 10.72 GB, 11.22 GB, 11.71 GB, 12.21 GB, 12.73 GB, 13.28 GB, 13.87 GB, 14.47 GB, 15.06 GB, 15.64 GB, 16.26 GB, 16.86 GB, 17.45 GB, 18.05 GB, 18.64 GB, 19.22 GB, 19.78 GB, 20.31 GB, 20.85 GB, 21.39 GB, 21.98 GB, 22.57 GB, 23.17 GB, 23.78 GB, 24.40 GB, 25.05 GB ThreadUsage(16s000ms): 92, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.92 - PeakMemoryUsage: 25.60 GB (27483746304) - PerHostPeakMemUsage: 25.60 GB (27483746304) - PrepareTime: 177.428ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 2s271ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 377.659ms, non-child: 377.659ms, % non-child: 100.00%) - CodegenTime: 6.295ms - CompileTime: 20.797ms - LoadTime: 86.718us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 186.9ms - PrepareTime: 169.386ms DataStreamSender (dst_id=2):(Total: 18.84us, non-child: 18.84us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 177.427ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 2s721ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m11s, non-child: 10m11s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:11/350.69 MB 3:3/95.69 MB 2:10/318.86 MB 1:16/510.36 MB 0:3/95.50 MB 5:7/223.10 MB BytesRead(16s000ms): 941.95 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB, 988.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 31.00 - BytesRead: 988.24 MB (1036242900) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h16m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 31 - PeakMemoryUsage: 25.60 GB (27483717632) - PerReadThreadRawHdfsThroughput: 695.08 MB/sec - RemoteScanRanges: 0 - RowsRead: 6.52M (6518858) - RowsReturned: 6.50M (6502602) - RowsReturnedRate: 10.63 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s421ms - TotalReadThroughput: 1.61 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea1 (host=hadoop-slave02.local:22000):(Total: 177.600ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:6/191.18 MB 2:18/573.99 MB 0:6/191.10 MB 4:12/382.62 MB 3:8/255.13 MB MemoryUsage(16s000ms): 3.22 GB, 4.32 GB, 5.11 GB, 5.83 GB, 6.51 GB, 7.16 GB, 7.81 GB, 8.44 GB, 8.93 GB, 9.30 GB, 9.75 GB, 10.25 GB, 10.71 GB, 11.15 GB, 11.66 GB, 12.16 GB, 12.58 GB, 13.00 GB, 13.50 GB, 14.06 GB, 14.66 GB, 15.29 GB, 15.93 GB, 16.59 GB, 17.23 GB, 17.88 GB, 18.53 GB, 19.19 GB, 19.81 GB, 20.37 GB, 20.96 GB, 21.57 GB, 22.22 GB, 22.88 GB, 23.52 GB, 24.16 GB, 24.81 GB, 25.46 GB ThreadUsage(16s000ms): 92, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.91 - PeakMemoryUsage: 25.91 GB (27821330432) - PerHostPeakMemUsage: 25.91 GB (27821322240) - PrepareTime: 176.801ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 2s140ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 365.497ms, non-child: 365.497ms, % non-child: 100.00%) - CodegenTime: 4.215ms - CompileTime: 20.897ms - LoadTime: 110.872us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 172.193ms - PrepareTime: 170.540ms DataStreamSender (dst_id=2):(Total: 13.687us, non-child: 13.687us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 176.800ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 2s629ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m7s, non-child: 10m7s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:6/191.18 MB 2:18/573.99 MB 0:6/191.10 MB 4:12/382.62 MB 3:8/255.13 MB BytesRead(16s000ms): 936.80 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB, 988.32 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 30.99 - BytesRead: 988.32 MB (1036329773) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h14m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 31 - PeakMemoryUsage: 25.91 GB (27821301760) - PerReadThreadRawHdfsThroughput: 584.67 MB/sec - RemoteScanRanges: 0 - RowsRead: 6.60M (6601292) - RowsReturned: 6.59M (6587750) - RowsReturnedRate: 10.84 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s690ms - TotalReadThroughput: 1.62 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea3 (host=hadoop-slave10.local:22000):(Total: 175.137ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:11/350.91 MB 2:12/382.36 MB 3:9/287.00 MB 5:4/127.47 MB 0:5/159.43 MB 4:10/318.94 MB MemoryUsage(16s000ms): 3.47 GB, 4.65 GB, 5.51 GB, 6.32 GB, 7.08 GB, 7.85 GB, 8.60 GB, 9.35 GB, 9.90 GB, 10.32 GB, 10.78 GB, 11.31 GB, 11.81 GB, 12.31 GB, 12.86 GB, 13.37 GB, 13.79 GB, 14.38 GB, 15.10 GB, 15.83 GB, 16.56 GB, 17.32 GB, 18.08 GB, 18.82 GB, 19.51 GB, 20.15 GB, 20.85 GB, 21.60 GB, 22.33 GB, 23.07 GB, 23.80 GB, 24.56 GB, 25.30 GB, 26.04 GB, 26.76 GB, 27.51 GB, 28.26 GB, 29.06 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.92 - PeakMemoryUsage: 29.59 GB (31770136576) - PerHostPeakMemUsage: 29.59 GB (31770120192) - PrepareTime: 174.429ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1s460ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 364.44ms, non-child: 364.44ms, % non-child: 100.00%) - CodegenTime: 4.726ms - CompileTime: 20.668ms - LoadTime: 92.923us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 173.976ms - PrepareTime: 167.970ms DataStreamSender (dst_id=2):(Total: 25.863us, non-child: 25.863us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 174.428ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 6s848ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m3s, non-child: 10m3s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/350.91 MB 2:12/382.36 MB 3:9/287.00 MB 5:4/127.47 MB 0:5/159.43 MB 4:10/318.94 MB BytesRead(16s000ms): 925.83 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB, 956.72 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 29.98 - BytesRead: 956.72 MB (1003193705) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h4m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 30 - PeakMemoryUsage: 29.59 GB (31770107904) - PerReadThreadRawHdfsThroughput: 585.31 MB/sec - RemoteScanRanges: 0 - RowsRead: 7.57M (7571515) - RowsReturned: 7.56M (7557507) - RowsReturnedRate: 12.52 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s634ms - TotalReadThroughput: 1.57 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea9 (host=hadoop-slave04.local:22000):(Total: 170.446ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:6/191.37 MB 3:9/287.00 MB 0:5/159.30 MB 5:12/382.39 MB 4:10/318.93 MB 1:8/255.07 MB MemoryUsage(16s000ms): 3.10 GB, 4.27 GB, 5.16 GB, 6.00 GB, 6.79 GB, 7.56 GB, 8.33 GB, 9.12 GB, 9.66 GB, 10.03 GB, 10.47 GB, 11.06 GB, 11.61 GB, 12.21 GB, 12.80 GB, 13.37 GB, 13.99 GB, 14.62 GB, 15.34 GB, 16.08 GB, 16.86 GB, 17.64 GB, 18.41 GB, 19.16 GB, 19.92 GB, 20.55 GB, 21.23 GB, 22.00 GB, 22.76 GB, 23.54 GB, 24.30 GB, 25.08 GB, 25.86 GB, 26.65 GB, 27.40 GB, 28.19 GB, 28.98 GB, 29.78 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.93 - PeakMemoryUsage: 30.41 GB (32650534912) - PerHostPeakMemUsage: 30.41 GB (32650518528) - PrepareTime: 169.768ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1s832ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 366.379ms, non-child: 366.379ms, % non-child: 100.00%) - CodegenTime: 4.907ms - CompileTime: 20.930ms - LoadTime: 85.268us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 180.907ms - PrepareTime: 163.95ms DataStreamSender (dst_id=2):(Total: 13.641us, non-child: 13.641us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 169.767ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 4s593ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m8s, non-child: 10m8s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:6/191.37 MB 3:9/287.00 MB 0:5/159.30 MB 5:12/382.39 MB 4:10/318.93 MB 1:8/255.07 MB BytesRead(16s000ms): 957.07 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB, 988.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 30.98 - BytesRead: 988.45 MB (1036467518) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h16m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 31 - PeakMemoryUsage: 30.41 GB (32650506240) - PerReadThreadRawHdfsThroughput: 582.30 MB/sec - RemoteScanRanges: 0 - RowsRead: 7.78M (7780295) - RowsReturned: 7.76M (7763202) - RowsReturnedRate: 12.75 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s697ms - TotalReadThroughput: 1.61 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea2 (host=hadoop-slave01.local:22000):(Total: 164.451ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:10/318.94 MB 2:9/287.14 MB 3:7/223.14 MB 0:5/159.34 MB 5:8/255.26 MB 1:10/318.70 MB MemoryUsage(16s000ms): 1.73 GB, 2.81 GB, 3.73 GB, 4.60 GB, 5.48 GB, 6.33 GB, 7.14 GB, 7.99 GB, 8.63 GB, 9.07 GB, 9.64 GB, 10.29 GB, 10.94 GB, 11.58 GB, 12.31 GB, 12.99 GB, 13.72 GB, 14.56 GB, 15.42 GB, 16.28 GB, 17.14 GB, 18.01 GB, 18.85 GB, 19.67 GB, 20.55 GB, 21.41 GB, 22.29 GB, 23.21 GB, 24.48 GB, 25.37 GB, 26.26 GB, 20.33 GB, 10.90 GB, 11.98 GB, 12.98 GB, 13.88 GB, 14.76 GB, 15.60 GB ThreadUsage(16s000ms): 31, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 32, 34, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48 - AverageThreadTokens: 36.30 - PeakMemoryUsage: 27.63 GB (29669736448) - PerHostPeakMemUsage: 27.63 GB (29669769216) - PrepareTime: 163.950ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 994.735ms CodeGen:(Total: 351.799ms, non-child: 351.799ms, % non-child: 100.00%) - CodegenTime: 4.526ms - CompileTime: 20.727ms - LoadTime: 110.517us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 171.861ms - PrepareTime: 157.627ms DataStreamSender (dst_id=2):(Total: 14.327us, non-child: 14.327us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 163.949ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 6s286ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 2.52 GB (2702217216) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m4s, non-child: 10m4s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:10/318.94 MB 2:9/287.14 MB 3:7/223.14 MB 0:5/159.34 MB 5:8/255.26 MB 1:10/318.70 MB BytesRead(16s000ms): 308.92 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 318.89 MB, 364.70 MB, 701.48 MB, 701.48 MB, 701.48 MB, 828.04 MB, 1020.36 MB, 1020.36 MB, 1020.36 MB, 1020.36 MB, 1020.36 MB, 1020.36 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.25 - BytesRead: 1020.36 MB (1069929034) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 2h13m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 22 - PeakMemoryUsage: 27.21 GB (29219143680) - PerReadThreadRawHdfsThroughput: 716.42 MB/sec - RemoteScanRanges: 0 - RowsRead: 10.67M (10665363) - RowsReturned: 10.65M (10654158) - RowsReturnedRate: 17.62 K/sec - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 1h24m - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s424ms - TotalReadThroughput: 1.67 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea8 (host=hadoop-slave08.local:22000):(Total: 164.143ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:5/159.34 MB 2:8/254.94 MB 4:10/318.75 MB 1:9/286.93 MB 5:11/350.69 MB 0:8/255.09 MB MemoryUsage(16s000ms): 2.89 GB, 4.09 GB, 4.97 GB, 5.77 GB, 6.56 GB, 7.33 GB, 8.10 GB, 8.88 GB, 9.42 GB, 9.84 GB, 10.22 GB, 10.66 GB, 11.07 GB, 11.62 GB, 12.20 GB, 12.74 GB, 13.19 GB, 13.69 GB, 14.34 GB, 15.04 GB, 15.77 GB, 16.54 GB, 17.34 GB, 18.12 GB, 18.89 GB, 19.58 GB, 20.20 GB, 20.94 GB, 21.68 GB, 22.43 GB, 23.19 GB, 23.98 GB, 24.74 GB, 25.53 GB, 26.28 GB, 27.06 GB, 27.85 GB, 28.65 GB ThreadUsage(16s000ms): 91, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.88 - PeakMemoryUsage: 29.38 GB (31550144512) - PerHostPeakMemUsage: 29.38 GB (31550144512) - PrepareTime: 163.381ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1s405ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 400.797ms, non-child: 400.797ms, % non-child: 100.00%) - CodegenTime: 4.341ms - CompileTime: 26.751ms - LoadTime: 89.876us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 215.222ms - PrepareTime: 157.421ms DataStreamSender (dst_id=2):(Total: 19.128us, non-child: 19.128us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 163.380ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 4s748ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m9s, non-child: 10m9s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:5/159.34 MB 2:8/254.94 MB 4:10/318.75 MB 1:9/286.93 MB 5:11/350.69 MB 0:8/255.09 MB BytesRead(16s000ms): 926.64 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB, 956.53 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 29.99 - BytesRead: 956.53 MB (1002998618) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h6m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 30 - PeakMemoryUsage: 29.38 GB (31550115840) - PerReadThreadRawHdfsThroughput: 598.51 MB/sec - RemoteScanRanges: 0 - RowsRead: 7.52M (7517808) - RowsReturned: 7.50M (7504007) - RowsReturnedRate: 12.31 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s598ms - TotalReadThroughput: 1.56 MB/sec Instance 9d49cd02cdb3df07:4cf79895d9408ea4 (host=hadoop-slave05.local:22000):(Total: 162.501ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:10/318.73 MB 3:13/414.53 MB 4:14/446.31 MB 0:1/31.94 MB 5:5/159.51 MB 1:7/223.18 MB MemoryUsage(16s000ms): 3.32 GB, 4.99 GB, 6.32 GB, 7.61 GB, 8.90 GB, 10.19 GB, 11.48 GB, 12.78 GB, 13.83 GB, 14.68 GB, 15.55 GB, 16.64 GB, 17.63 GB, 18.70 GB, 19.82 GB, 20.87 GB, 22.06 GB, 23.49 GB, 24.97 GB, 26.49 GB, 28.03 GB, 29.62 GB, 31.23 GB, 32.89 GB, 34.59 GB, 36.32 GB, 38.05 GB, 39.73 GB, 41.46 GB, 43.35 GB, 45.34 GB, 47.37 GB, 49.46 GB, 51.59 GB, 53.84 GB, 56.20 GB, 58.59 GB, 61.07 GB ThreadUsage(16s000ms): 92, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.90 - PeakMemoryUsage: 63.68 GB (68371316736) - PerHostPeakMemUsage: 63.68 GB (68371304448) - PrepareTime: 161.742ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 1s075ms BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 176.00 GB (188978561024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 348.857ms, non-child: 348.857ms, % non-child: 100.00%) - CodegenTime: 4.14ms - CompileTime: 20.723ms - LoadTime: 93.709us - ModuleFileSize: 1.96 MB (2055524) - OptimizationTime: 170.600ms - PrepareTime: 156.184ms DataStreamSender (dst_id=2):(Total: 13.531us, non-child: 13.531us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 161.741ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 7s116ms - GetResultsTime: 0ns - HashBuckets: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 81.00 KB (82944) - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 HDFS_SCAN_NODE (id=0):(Total: 10m7s, non-child: 10m7s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/318.73 MB 3:13/414.53 MB 4:14/446.31 MB 0:1/31.94 MB 5:5/159.51 MB 1:7/223.18 MB BytesRead(16s000ms): 961.29 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB, 988.43 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 30.99 - BytesRead: 988.43 MB (1036445356) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - BytesSkipped: 0 - DecompressionTime: 5h16m - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 31 - PeakMemoryUsage: 63.68 GB (68371308544) - PerReadThreadRawHdfsThroughput: 665.25 MB/sec - RemoteScanRanges: 0 - RowsRead: 16.63M (16628168) - RowsReturned: 16.62M (16615929) - RowsReturnedRate: 27.36 K/sec - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 1s485ms - TotalReadThroughput: 1.61 MB/sec