[cloudera1.cloudera.intern:21000] > INSERT INTO GRIDVIS.VALUE_DATA_TIME_PARTITIONED > PARTITION (value_id) GRIDVIS.VALUE_DATA_TIME; > SELECT from_ns, to_ns, value_min, value_avg, value_max, value_id FROM Query: insert INTO GRIDVIS.VALUE_DATA_TIME_PARTITIONED PARTITION (value_id) SELECT from_ns, to_ns, value_min, value_avg, value_max, value_id FROM GRIDVIS.VALUE_DATA_TIME WARNINGS: Memory limit exceeded Backend 3:Memory Limit Exceeded Query(e741abc9349c9ef4:6b8d010fe155ab99) Limit: Consumption=10.25 GB Fragment e741abc9349c9ef4:6b8d010fe155ab9a: Consumption=8.58 GB UDFs: Consumption=0 EXCHANGE_NODE (id=1): Consumption=0 DataStreamRecvr: Consumption=359.72 KB HdfsTableSink: Consumption=8.58 GB Block Manager: Limit=12.12 GB Consumption=0 Fragment e741abc9349c9ef4:6b8d010fe155ab9d: Consumption=1.67 GB UDFs: Consumption=0 HDFS_SCAN_NODE (id=0): Consumption=1.67 GB DataStreamSender: Consumption=68.00 KB Backend 4:Memory Limit Exceeded Query(e741abc9349c9ef4:6b8d010fe155ab99) Limit: Consumption=10.12 GB Fragment e741abc9349c9ef4:6b8d010fe155ab9b: Consumption=8.45 GB UDFs: Consumption=0 EXCHANGE_NODE (id=1): Consumption=0 DataStreamRecvr: Consumption=343.73 KB HdfsTableSink: Consumption=8.45 GB Block Manager: Limit=12.12 GB Consumption=0 Fragment e741abc9349c9ef4:6b8d010fe155ab9e: Consumption=1.67 GB UDFs: Consumption=0 HDFS_SCAN_NODE (id=0): Consumption=1.67 GB DataStreamSender: Consumption=44.00 KB [cloudera1.cloudera.intern:21000] > [cloudera1.cloudera.intern:21000] > SET NUM_SCANNER_THREADS=1; SET MEM_NUM_SCANNER_THREADS set to 1 L[cloudera1.cloudera.intern:21000] > SET MEM_LIMIT=15000000000; MEM_LIMIT set to 15000000000 [cloudera1.cloudera.intern:21000] > insert INTO GRIDVIS.VALUE_DATA_TIME_PARTITIONED PARTITION (value_id) SELECT from_ns, to_ns, value_min, value_avg, value_max, value_id FROM GRIDVIS.VALUE_DATA_TIME; Query: insert INTO GRIDVIS.VALUE_DATA_TIME_PARTITIONED PARTITION (value_id) SELECT from_ns, to_ns, value_min, value_avg, value_max, value_id FROM GRIDVIS.VALUE_DATA_TIME WARNINGS: Memory limit exceeded Backend 0:Memory Limit Exceeded Query(f64c24be726ebf95:75ab0f93ba6720a2) Limit: Limit=13.97 GB Consumption=8.56 GB Fragment f64c24be726ebf95:75ab0f93ba6720a3: Consumption=8.53 GB UDFs: Consumption=0 EXCHANGE_NODE (id=1): Consumption=0 DataStreamRecvr: Consumption=21.16 MB HdfsTableSink: Consumption=8.51 GB Block Manager: Limit=11.18 GB Consumption=0 Fragment f64c24be726ebf95:75ab0f93ba6720a6: Consumption=30.30 MB UDFs: Consumption=0 HDFS_SCAN_NODE (id=0): Consumption=30.17 MB DataStreamSender: Consumption=68.00 KB Query (id=f64c24be726ebf95:75ab0f93ba6720a2): Summary: Session ID: 5c4ec0acee11c346:a4c393574df6098e Session Type: BEESWAX Start Time: 2015-02-19 12:03:18.562149000 End Time: 2015-02-19 12:07:56.303747000 Query Type: DML Query State: EXCEPTION Query Status: Memory limit exceeded Impala Version: impalad version 2.0.1-cdh5 RELEASE (build cc09df07d93c79351052eef2f4e5baf52373dc33) User: aduser Connected User: aduser Delegated User: Network Address: 192.168.10.1:53749 Default Db: GRIDVIS Sql Statement: insert INTO GRIDVIS.VALUE_DATA_TIME_PARTITIONED PARTITION (value_id) SELECT from_ns, to_ns, value_min, value_avg, value_max, value_id FROM GRIDVIS.VALUE_DATA_TIME Coordinator: cloudera1.cloudera.intern:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=41.81GB VCores=2 F01:PLAN FRAGMENT [HASH(value_id)] WRITE TO HDFS [gridvis.value_data_time_partitioned, OVERWRITE=false, PARTITION-KEYS=(value_id)] | partitions=47052 | hosts=3 per-host-mem=41.72GB | 01:EXCHANGE [HASH(value_id)] hosts=3 per-host-mem=0B tuple-ids=0 row-size=44B cardinality=3054475370 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, HASH(value_id)] 00:SCAN HDFS [gridvis.value_data_time, RANDOM] partitions=1/1 size=258.00GB table stats: 3054475370 rows total column stats: all hosts=3 per-host-mem=88.00MB tuple-ids=0 row-size=44B cardinality=3054475370 ---------------- Estimated Per-Host Mem: 44891246592 Estimated Per-Host VCores: 2 Admission result: Admitted immediately Request Pool: root.aduser ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------- 01:EXCHANGE 3 1s683ms 1s913ms 132.54M 3.05B 0 0 HASH(value_id) 00:SCAN HDFS 3 629.828ms 643.162ms 134.71M 3.05B 46.26 MB 88.00 MB gridvis.value_data_time Query Timeline: 4m37s - Start execution: 103.118us (103.118us) - Planning finished: 25.943ms (25.840ms) - Submit for admission: 78.705ms (52.761ms) - Completed admission: 78.874ms (169.518us) - Ready to start remote fragments: 83.680ms (4.805ms) - Remote fragments started: 301.57ms (217.376ms) - Request finished: 4m36s (4m36s) - Unregister query: 4m37s (864.846ms) ImpalaServer: - ClientFetchWaitTimer: 0ns - RowMaterializationTimer: 0ns Execution Profile f64c24be726ebf95:75ab0f93ba6720a2:(Total: 4m36s, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 6, last: 0.192957, min: 0.0185087, max: 0.192957, mean: 0.0988735, stddev: 0.0788209 Per Node Peak Memory Usage: cloudera1.cloudera.intern:22000(8.59 GB) cloudera3.cloudera.intern:22000(8.30 GB) cloudera2.cloudera.intern:22000(8.56 GB) - FinalizationTimer: 127.804ms Averaged Fragment F01:(Total: 4m32s, non-child: 77.576ms, % non-child: 0.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m36s max:4m36s mean: 4m36s stddev:1.464ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.44 GB (9059430282) - PerHostPeakMemUsage: 8.47 GB (9096002714) - PrepareTime: 40.762us - RowsProduced: 44.18M (44178382) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 4s991ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 11.18 GB (12000001024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns HdfsTableSink:(Total: 4m26s, non-child: 4m26s, % non-child: 100.00%) - BytesWritten: 32.66 KB (33442) - CompressTimer: 1s446ms - EncodeTimer: 1m53s - HdfsWriteTimer: 0ns - PeakMemoryUsage: 8.43 GB (9047778074) - RowsInserted: 0 - TmpFileCreateTimer: 1m35s EXCHANGE_NODE (id=1):(Total: 6s090ms, non-child: 6s090ms, % non-child: 100.00%) - BytesReceived: 1.18 GB (1269965771) - ConvertRowBatchTime: 885.754ms - DeserializeRowBatchTimer: 5s040ms - FirstBatchArrivalWaitTime: 394.328ms - PeakMemoryUsage: 0 - RowsReturned: 44.18M (44178382) - RowsReturnedRate: 9.74 M/sec - SendersBlockedTimer: 1m27s - SendersBlockedTotalTimer(*): 4m8s Averaged Fragment F00:(Total: 4m34s, non-child: 0ns, % non-child: 0.00%) split sizes: min: 85.96 GB, max: 86.05 GB, avg: 86.00 GB, stddev: 38.60 MB completion times: min:4m36s max:4m36s mean: 4m36s stddev:11.286ms execution rates: min:318.37 MB/sec max:318.73 MB/sec mean:318.54 MB/sec stddev:153.65 KB/sec num instances: 3 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 41.08 MB (43070805) - PerHostPeakMemUsage: 8.48 GB (9106591376) - PrepareTime: 173.933ms - RowsProduced: 44.90M (44903593) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 4m17s - TotalStorageWaitTime: 1s872ms CodeGen:(Total: 371.159ms, non-child: 371.159ms, % non-child: 100.00%) - CodegenTime: 1.903ms - CompileTime: 200.718ms - LoadTime: 169.246ms - ModuleFileSize: 1.96 MB (2051624) DataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 1.20 GB (1284639557) - NetworkThroughput(*): 4.19 MB/sec - OverallThroughput: 4.48 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 9s946ms - ThriftTransmitTime(*): 4m52s - UncompressedRowBatchSize: 2.18 GB (2335464656) HDFS_SCAN_NODE (id=0):(Total: 629.828ms, non-child: 629.828ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.85 GB (4132818261) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 40.93 MB (42919253) - PerReadThreadRawHdfsThroughput: 239.46 MB/sec - RowsRead: 45.02M (45017257) - RowsReturned: 44.90M (44903593) - RowsReturnedRate: 71.33 M/sec - ScanRangesComplete: 30 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - DelimiterParseTime: 6s334ms - MaterializeTupleTime(*): 16s790ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 16s488ms - TotalReadThroughput: 14.34 MB/sec Fragment F01: Instance f64c24be726ebf95:75ab0f93ba6720a4 (host=cloudera3.cloudera.intern:22000):(Total: 4m33s, non-child: 77.654ms, % non-child: 0.03%) MemoryUsage(8s000ms): 288.76 MB, 904.92 MB, 1.49 GB, 2.10 GB, 2.50 GB, 3.06 GB, 3.66 GB, 4.26 GB, 4.86 GB, 5.46 GB, 6.05 GB, 6.62 GB, 6.86 GB, 7.01 GB, 7.15 GB, 7.18 GB, 7.23 GB, 7.24 GB, 7.30 GB, 7.41 GB, 7.59 GB, 7.64 GB, 7.67 GB, 7.69 GB, 7.73 GB, 7.76 GB, 7.85 GB, 7.90 GB, 8.01 GB, 8.13 GB, 8.18 GB, 8.20 GB, 8.22 GB, 8.24 GB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.26 GB (8870084352) - PerHostPeakMemUsage: 8.30 GB (8909545776) - PrepareTime: 52.444us - RowsProduced: 39.58M (39578995) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 8s380ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 11.18 GB (12000001024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns HdfsTableSink:(Total: 4m24s, non-child: 4m24s, % non-child: 100.00%) - BytesWritten: 32.40 KB (33180) - CompressTimer: 1s023ms - EncodeTimer: 1m54s - HdfsWriteTimer: 0ns - PeakMemoryUsage: 8.25 GB (8861072000) - RowsInserted: 0 - TmpFileCreateTimer: 1m35s EXCHANGE_NODE (id=1):(Total: 9s365ms, non-child: 1s361ms, % non-child: 14.54%) BytesReceived(8s000ms): 8.98 MB, 9.98 MB, 10.08 MB, 10.21 MB, 10.38 MB, 10.53 MB, 11.16 MB, 11.65 MB, 11.78 MB, 12.38 MB, 13.10 MB, 18.86 MB, 56.49 MB, 102.70 MB, 144.03 MB, 195.04 MB, 234.76 MB, 277.07 MB, 325.63 MB, 363.14 MB, 405.30 MB, 456.73 MB, 498.53 MB, 544.70 MB, 590.29 MB, 634.87 MB, 686.60 MB, 736.76 MB, 786.29 MB, 835.84 MB, 897.25 MB, 950.99 MB, 1001.48 MB, 1.02 GB - BytesReceived: 1.06 GB (1136735512) - ConvertRowBatchTime: 792.406ms - DeserializeRowBatchTimer: 4s873ms - FirstBatchArrivalWaitTime: 396.208ms - PeakMemoryUsage: 0 - RowsReturned: 39.58M (39578995) - RowsReturnedRate: 4.23 M/sec - SendersBlockedTimer: 29s209ms - SendersBlockedTotalTimer(*): 1m21s Instance f64c24be726ebf95:75ab0f93ba6720a5 (host=cloudera1.cloudera.intern:22000):(Total: 4m31s, non-child: 74.427ms, % non-child: 0.03%) MemoryUsage(8s000ms): 284.20 MB, 902.02 MB, 1.49 GB, 2.09 GB, 2.70 GB, 3.30 GB, 3.90 GB, 4.50 GB, 5.10 GB, 5.69 GB, 6.29 GB, 6.75 GB, 6.95 GB, 7.10 GB, 7.22 GB, 7.26 GB, 7.32 GB, 7.34 GB, 7.40 GB, 7.49 GB, 7.73 GB, 7.79 GB, 7.81 GB, 7.83 GB, 7.89 GB, 7.93 GB, 8.02 GB, 8.09 GB, 8.22 GB, 8.35 GB, 8.43 GB, 8.44 GB, 8.47 GB, 8.50 GB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.53 GB (9159181792) - PerHostPeakMemUsage: 8.57 GB (9197775584) - PrepareTime: 33.96us - RowsProduced: 45.18M (45178247) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 5s073ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 11.18 GB (12000001024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns HdfsTableSink:(Total: 4m25s, non-child: 4m25s, % non-child: 100.00%) - BytesWritten: 33.00 KB (33792) - CompressTimer: 1s649ms - EncodeTimer: 1m50s - HdfsWriteTimer: 0ns - PeakMemoryUsage: 8.53 GB (9154773840) - RowsInserted: 0 - TmpFileCreateTimer: 1m34s EXCHANGE_NODE (id=1):(Total: 6s209ms, non-child: 1s773ms, % non-child: 28.57%) BytesReceived(8s000ms): 9.06 MB, 10.16 MB, 10.26 MB, 10.68 MB, 11.05 MB, 11.21 MB, 11.65 MB, 12.09 MB, 12.20 MB, 12.80 MB, 13.48 MB, 19.38 MB, 59.12 MB, 107.87 MB, 150.32 MB, 204.08 MB, 247.60 MB, 293.78 MB, 349.11 MB, 391.31 MB, 444.39 MB, 507.00 MB, 554.21 MB, 609.67 MB, 664.98 MB, 718.59 MB, 780.79 MB, 841.03 MB, 898.95 MB, 957.09 MB, 1.00 GB, 1.07 GB, 1.12 GB, 1.17 GB - BytesReceived: 1.20 GB (1288220172) - ConvertRowBatchTime: 920.94ms - DeserializeRowBatchTimer: 4s221ms - FirstBatchArrivalWaitTime: 394.780ms - PeakMemoryUsage: 0 - RowsReturned: 45.18M (45178247) - RowsReturnedRate: 7.28 M/sec - SendersBlockedTimer: 1m - SendersBlockedTotalTimer(*): 2m48s Instance f64c24be726ebf95:75ab0f93ba6720a3 (host=cloudera2.cloudera.intern:22000):(Total: 4m31s, non-child: 80.647ms, % non-child: 0.03%) MemoryUsage(8s000ms): 303.30 MB, 920.61 MB, 1.51 GB, 2.11 GB, 2.71 GB, 3.31 GB, 3.91 GB, 4.51 GB, 4.93 GB, 5.52 GB, 6.11 GB, 6.64 GB, 6.86 GB, 7.01 GB, 7.15 GB, 7.18 GB, 7.26 GB, 7.29 GB, 7.37 GB, 7.47 GB, 7.68 GB, 7.74 GB, 7.77 GB, 7.83 GB, 7.87 GB, 7.92 GB, 7.99 GB, 8.04 GB, 8.17 GB, 8.31 GB, 8.40 GB, 8.44 GB, 8.46 GB, 8.49 GB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.52 GB (9149024704) - PerHostPeakMemUsage: 8.55 GB (9180686784) - PrepareTime: 36.748us - RowsProduced: 47.78M (47777905) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 1s521ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 11.18 GB (12000001024) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns HdfsTableSink:(Total: 4m28s, non-child: 4m28s, % non-child: 100.00%) - BytesWritten: 32.57 KB (33356) - CompressTimer: 1s665ms - EncodeTimer: 1m54s - HdfsWriteTimer: 0ns - PeakMemoryUsage: 8.50 GB (9127488384) - RowsInserted: 0 - TmpFileCreateTimer: 1m36s EXCHANGE_NODE (id=1):(Total: 2s697ms, non-child: 1s913ms, % non-child: 70.94%) BytesReceived(8s000ms): 9.52 MB, 10.43 MB, 10.59 MB, 10.82 MB, 11.16 MB, 11.41 MB, 11.77 MB, 12.12 MB, 12.27 MB, 13.04 MB, 13.77 MB, 20.49 MB, 64.40 MB, 119.20 MB, 165.27 MB, 223.64 MB, 278.38 MB, 347.08 MB, 415.33 MB, 454.89 MB, 505.06 MB, 561.41 MB, 619.93 MB, 691.83 MB, 748.61 MB, 799.40 MB, 868.57 MB, 942.45 MB, 999.68 MB, 1.03 GB, 1.10 GB, 1.16 GB, 1.21 GB, 1.26 GB - BytesReceived: 1.29 GB (1384941629) - ConvertRowBatchTime: 944.762ms - DeserializeRowBatchTimer: 6s026ms - FirstBatchArrivalWaitTime: 391.996ms - PeakMemoryUsage: 0 - RowsReturned: 47.78M (47777905) - RowsReturnedRate: 17.71 M/sec - SendersBlockedTimer: 2m52s - SendersBlockedTotalTimer(*): 8m15s Fragment F00: Instance f64c24be726ebf95:75ab0f93ba6720a8 (host=cloudera1.cloudera.intern:22000):(Total: 4m35s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:70/8.75 GB 1:66/8.25 GB 8:67/8.38 GB 2:69/8.59 GB 9:70/8.75 GB 6:69/8.62 GB 3:67/8.30 GB 5:68/8.41 GB 0:72/9.00 GB 7:72/9.00 GB MemoryUsage(8s000ms): 28.41 MB, 30.31 MB, 30.31 MB, 30.35 MB, 30.38 MB, 30.38 MB, 30.31 MB, 30.29 MB, 30.29 MB, 30.32 MB, 30.39 MB, 30.31 MB, 29.29 MB, 29.30 MB, 28.81 MB, 28.79 MB, 29.35 MB, 28.79 MB, 27.80 MB, 28.81 MB, 29.33 MB, 28.81 MB, 29.32 MB, 29.31 MB, 28.28 MB, 30.32 MB, 29.78 MB, 28.28 MB, 30.82 MB, 29.79 MB, 29.32 MB, 29.32 MB, 29.82 MB, 28.30 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 38.41 MB (40275968) - PerHostPeakMemUsage: 8.59 GB (9218983632) - PrepareTime: 189.106ms - RowsProduced: 45.02M (45020995) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 4m21s - TotalStorageWaitTime: 1s448ms CodeGen:(Total: 379.888ms, non-child: 379.888ms, % non-child: 100.00%) - CodegenTime: 2.7ms - CompileTime: 194.536ms - LoadTime: 183.982ms - ModuleFileSize: 1.96 MB (2051624) DataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 1.20 GB (1289911170) - NetworkThroughput(*): 4.18 MB/sec - OverallThroughput: 4.47 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 8s477ms - ThriftTransmitTime(*): 4m54s - UncompressedRowBatchSize: 2.18 GB (2341577664) HDFS_SCAN_NODE (id=0):(Total: 609.787ms, non-child: 609.787ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:70/8.75 GB 1:66/8.25 GB 8:67/8.38 GB 2:69/8.59 GB 9:70/8.75 GB 6:69/8.62 GB 3:67/8.30 GB 5:68/8.41 GB 0:72/9.00 GB 7:72/9.00 GB BytesRead(8s000ms): 44.50 MB, 48.00 MB, 48.00 MB, 52.50 MB, 56.00 MB, 56.00 MB, 56.00 MB, 56.00 MB, 56.00 MB, 58.00 MB, 64.00 MB, 78.00 MB, 186.00 MB, 321.00 MB, 445.50 MB, 620.00 MB, 763.51 MB, 910.01 MB, 1.08 GB, 1.21 GB, 1.36 GB, 1.55 GB, 1.73 GB, 1.96 GB, 2.14 GB, 2.29 GB, 2.44 GB, 2.56 GB, 2.74 GB, 2.92 GB, 3.14 GB, 3.33 GB, 3.51 GB, 3.67 GB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.86 GB (4144003072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38.27 MB (40124416) - PerReadThreadRawHdfsThroughput: 246.81 MB/sec - RowsRead: 45.13M (45134659) - RowsReturned: 45.02M (45020995) - RowsReturnedRate: 73.83 M/sec - ScanRangesComplete: 30 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - DelimiterParseTime: 5s821ms - MaterializeTupleTime(*): 15s223ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 16s012ms - TotalReadThroughput: 14.29 MB/sec Instance f64c24be726ebf95:75ab0f93ba6720a7 (host=cloudera3.cloudera.intern:22000):(Total: 4m33s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:65/8.12 GB 1:67/8.38 GB 6:65/8.12 GB 7:68/8.50 GB 5:76/9.50 GB 0:65/8.12 GB 8:70/8.75 GB 4:64/8.00 GB 2:74/9.25 GB 9:74/9.25 GB MemoryUsage(8s000ms): 27.91 MB, 30.30 MB, 30.29 MB, 30.35 MB, 30.37 MB, 30.33 MB, 30.29 MB, 30.30 MB, 30.30 MB, 30.33 MB, 30.34 MB, 28.73 MB, 29.31 MB, 28.31 MB, 28.79 MB, 28.81 MB, 27.79 MB, 30.31 MB, 29.81 MB, 28.79 MB, 29.32 MB, 29.31 MB, 29.30 MB, 28.78 MB, 28.80 MB, 29.83 MB, 29.70 MB, 29.67 MB, 28.82 MB, 25.66 MB, 28.25 MB, 29.29 MB, 29.29 MB, 28.78 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 46.41 MB (48660480) - PerHostPeakMemUsage: 8.30 GB (8910339776) - PrepareTime: 164.552ms - RowsProduced: 44.56M (44562712) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 4m15s - TotalStorageWaitTime: 2s479ms CodeGen:(Total: 368.65ms, non-child: 368.65ms, % non-child: 100.00%) - CodegenTime: 1.775ms - CompileTime: 206.367ms - LoadTime: 160.604ms - ModuleFileSize: 1.96 MB (2051624) DataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 1.19 GB (1278969727) - NetworkThroughput(*): 4.19 MB/sec - OverallThroughput: 4.47 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 10s626ms - ThriftTransmitTime(*): 4m51s - UncompressedRowBatchSize: 2.16 GB (2317740480) HDFS_SCAN_NODE (id=0):(Total: 636.534ms, non-child: 636.534ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:65/8.12 GB 1:67/8.38 GB 6:65/8.12 GB 7:68/8.50 GB 5:76/9.50 GB 0:65/8.12 GB 8:70/8.75 GB 4:64/8.00 GB 2:74/9.25 GB 9:74/9.25 GB BytesRead(8s000ms): 66.50 MB, 72.00 MB, 72.00 MB, 77.00 MB, 80.00 MB, 80.00 MB, 80.00 MB, 80.00 MB, 80.00 MB, 82.50 MB, 88.00 MB, 104.50 MB, 224.00 MB, 373.50 MB, 510.00 MB, 686.50 MB, 838.01 MB, 1005.51 MB, 1.14 GB, 1.26 GB, 1.41 GB, 1.59 GB, 1.70 GB, 1.90 GB, 2.08 GB, 2.23 GB, 2.42 GB, 2.64 GB, 2.80 GB, 2.96 GB, 3.17 GB, 3.35 GB, 3.53 GB, 3.68 GB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.81 GB (4093671424) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 46.26 MB (48508928) - PerReadThreadRawHdfsThroughput: 224.22 MB/sec - RowsRead: 44.68M (44676376) - RowsReturned: 44.56M (44562712) - RowsReturnedRate: 70.01 M/sec - ScanRangesComplete: 30 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - DelimiterParseTime: 6s516ms - MaterializeTupleTime(*): 17s414ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 17s411ms - TotalReadThroughput: 14.22 MB/sec Instance f64c24be726ebf95:75ab0f93ba6720a6 (host=cloudera2.cloudera.intern:22000):(Total: 4m32s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:70/8.75 GB 2:62/7.75 GB 9:67/8.17 GB 6:73/9.12 GB 3:72/9.00 GB 7:69/8.53 GB 0:70/8.75 GB 5:64/8.00 GB 1:71/8.88 GB 8:72/9.00 GB MemoryUsage(8s000ms): 28.44 MB, 30.29 MB, 30.29 MB, 30.29 MB, 30.29 MB, 30.29 MB, 30.33 MB, 30.38 MB, 30.36 MB, 30.29 MB, 30.29 MB, 28.77 MB, 29.82 MB, 30.29 MB, 29.28 MB, 29.79 MB, 27.81 MB, 29.30 MB, 28.30 MB, 30.79 MB, 29.27 MB, 29.82 MB, 29.30 MB, 29.29 MB, 29.31 MB, 28.30 MB, 27.60 MB, 30.31 MB, 26.82 MB, 29.29 MB, 28.69 MB, 27.82 MB, 29.30 MB, 29.80 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 38.41 MB (40275968) - PerHostPeakMemUsage: 8.56 GB (9190450720) - PrepareTime: 168.140ms - RowsProduced: 45.13M (45127073) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 4m14s - TotalStorageWaitTime: 1s690ms CodeGen:(Total: 365.523ms, non-child: 365.523ms, % non-child: 100.00%) - CodegenTime: 1.928ms - CompileTime: 201.250ms - LoadTime: 163.152ms - ModuleFileSize: 1.96 MB (2051624) DataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 1.20 GB (1285037774) - NetworkThroughput(*): 4.20 MB/sec - OverallThroughput: 4.50 MB/sec - PeakMemoryUsage: 84.00 KB (86016) - SerializeBatchTime: 10s736ms - ThriftTransmitTime(*): 4m51s - UncompressedRowBatchSize: 2.19 GB (2347075824) HDFS_SCAN_NODE (id=0):(Total: 643.162ms, non-child: 643.162ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:70/8.75 GB 2:62/7.75 GB 9:67/8.17 GB 6:73/9.12 GB 3:72/9.00 GB 7:69/8.53 GB 0:70/8.75 GB 5:64/8.00 GB 1:71/8.88 GB 8:72/9.00 GB BytesRead(8s000ms): 60.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 67.00 MB, 72.00 MB, 72.00 MB, 72.00 MB, 72.00 MB, 92.00 MB, 236.50 MB, 401.00 MB, 541.50 MB, 699.50 MB, 836.51 MB, 988.51 MB, 1.13 GB, 1.27 GB, 1.42 GB, 1.60 GB, 1.77 GB, 1.88 GB, 2.02 GB, 2.18 GB, 2.40 GB, 2.64 GB, 2.83 GB, 3.01 GB, 3.23 GB, 3.43 GB, 3.60 GB, 3.76 GB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.88 GB (4160780288) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 38.27 MB (40124416) - PerReadThreadRawHdfsThroughput: 247.35 MB/sec - RowsRead: 45.24M (45240737) - RowsReturned: 45.13M (45127073) - RowsReturnedRate: 70.16 M/sec - ScanRangesComplete: 30 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - DelimiterParseTime: 6s663ms - MaterializeTupleTime(*): 17s732ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 16s042ms - TotalReadThroughput: 14.51 MB/sec