Query Runtime Profile: Query (id=e241c4b5fd96d258:d273fb15ab2475ae): Summary: Session ID: f24f79e5667e006f:18d3ce2b6cab6181 Session Type: BEESWAX Start Time: 2014-10-23 09:23:49.323155000 End Time: 2014-10-23 09:32:41.695164000 Query Type: QUERY Query State: EXCEPTION Query Status: Memory limit exceeded Impala Version: impalad version 2.0.0-cdh5 RELEASE (build ecf30af0b4d6e56ea80297df2189367ada6b7da7) User: hdfs Connected User: hdfs Delegated User: Network Address: 192.168.0.8:36575 Default Db: http Sql Statement: select * from test_data where lower(path) = "abcd" or lower(path) = "efgh" or lower(path) = "ijkl" or lower(path) = "mnop" or lower(path) = "qrst" or lower(path) = "uvwx" Coordinator: slave01:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=7.50GB VCores=1 WARNING: The following tables are missing relevant table and/or column statistics. http.test_data F01:PLAN FRAGMENT [UNPARTITIONED] 01:EXCHANGE [UNPARTITIONED] hosts=24 per-host-mem=unavailable tuple-ids=0 row-size=192B cardinality=unavailable F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED] 00:SCAN HDFS [http.test_data, RANDOM] partitions=1/1 size=23.96TB predicates: lower(path) = 'abcd' OR lower(path) = 'efgh' OR lower(path) = 'ijkl' OR lower(path) = 'mnop' OR lower(path) = 'qrst' OR lower(path) = 'uvwx' table stats: unavailable column stats: unavailable hosts=24 per-host-mem=7.50GB tuple-ids=0 row-size=192B cardinality=unavailable ---------------- Estimated Per-Host Mem: 8053063680 Estimated Per-Host VCores: 1 Tables Missing Stats: http.test_data Admission result: Admitted immediately Request Pool: root.hdfs ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 39.453us 39.453us 1 -1 0 -1.00 B UNPARTITIONED 00:SCAN HDFS 24 8m43s 8m46s 1 -1 1.05 GB 7.50 GB http.test_data Query Timeline: 8m52s - Start execution: 46.273us (46.273us) - Planning finished: 1s822ms (1s822ms) - Submit for admission: 1s906ms (84.29ms) - Completed admission: 1s906ms (173.979us) - Ready to start remote fragments: 2s209ms (303.83ms) - Remote fragments started: 2s743ms (533.152ms) - Rows available: 8m (7m58s) - First row fetched: 8m1s (655.568ms) - Unregister query: 8m52s (50s798ms) ImpalaServer: - ClientFetchWaitTimer: 655.635ms - RowMaterializationTimer: 0ns Execution Profile e241c4b5fd96d258:d273fb15ab2475ae:(Total: 8m49s, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 24, last: 0.492795, min: 0.247714, max: 0.492795, mean: 0.293993, stddev: 0.0642448 Per Node Peak Memory Usage: slave16:22000(37.01 GB) slave20:22000(32.57 GB) slave12:22000(33.77 GB) slave06:22000(37.16 GB) slave22:22000(34.74 GB) slave09:22000(33.16 GB) slave15:22000(39.05 GB) slave11:22000(32.89 GB) slave23:22000(32.72 GB) slave21:22000(32.53 GB) slave19:22000(36.72 GB) slave14:22000(33.30 GB) slave24:22000(35.48 GB) slave18:22000(34.00 GB) slave08:22000(35.15 GB) slave17:22000(34.18 GB) slave07:22000(35.85 GB) slave04:22000(33.90 GB) slave05:22000(32.84 GB) slave10:22000(34.81 GB) slave13:22000(33.11 GB) slave03:22000(33.79 GB) slave01:22000(15.64 GB) slave02:22000(38.41 GB) - FinalizationTimer: 0ns Coordinator Fragment F01:(Total: 8m48s, non-child: 17.137ms, % non-child: 0.00%) MemoryUsage(16s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.50 KB, 16.00 KB, 16.00 KB, 16.00 KB ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 16.00 KB (16384) - PerHostPeakMemUsage: 0 - PrepareTime: 32.34us - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 8m48s - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns EXCHANGE_NODE (id=1):(Total: 8m48s, non-child: 39.453us, % non-child: 0.00%) BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 15.00 B, 163.00 B, 163.00 B, 163.00 B - BytesReceived: 163.00 B (163) - ConvertRowBatchTime: 1.806us - DeserializeRowBatchTimer: 14.864us - FirstBatchArrivalWaitTime: 7m58s - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F00:(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) split sizes: min: 1022.40 GB, max: 1022.60 GB, avg: 1022.50 GB, stddev: 68.75 MB completion times: min:8m49s max:8m49s mean: 8m49s stddev:64.800ms execution rates: min:1.93 GB/sec max:1.93 GB/sec mean:1.93 GB/sec stddev:248.48 KB/sec num instances: 24 - AverageThreadTokens: 93.46 - PeakMemoryUsage: 33.87 GB (36363092778) - PerHostPeakMemUsage: 33.87 GB (36363093120) - PrepareTime: 234.436ms - RowsProduced: 0 - TotalCpuTime: 1h18m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 15ns - TotalStorageWaitTime: 11h59m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 554.483ms, non-child: 554.483ms, % non-child: 100.00%) - CodegenTime: 6.902ms - CompileTime: 398.893ms - LoadTime: 154.192ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 30.546us, non-child: 30.546us, % non-child: 100.00%) - BytesSent: 6.00 B (6) - NetworkThroughput(*): 21.74 KB/sec - OverallThroughput: 52.72 KB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 2.3us - ThriftTransmitTime(*): 12.712us - UncompressedRowBatchSize: 11.00 B (11) HDFS_SCAN_NODE (id=0):(Total: 8m43s, non-child: 8m43s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 16.90 - AverageScannerThreadConcurrency: 92.57 - BytesRead: 388.05 GB (416665577865) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 93 - PeakMemoryUsage: 1009.15 MB (1058174080) - PerReadThreadRawHdfsThroughput: 45.82 MB/sec - RowsRead: 1.58B (1579446402) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.11K (3109) - ScannerThreadsInvoluntaryContextSwitches: 16.72K (16717) - ScannerThreadsTotalWallClockTime: 1h18m - DelimiterParseTime: 8m - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 10s228ms - ScannerThreadsUserTime: 8m41s - ScannerThreadsVoluntaryContextSwitches: 8.37K (8367) - TotalRawHdfsReadTime(*): 2h28m - TotalReadThroughput: 753.21 MB/sec Fragment F00: Instance e241c4b5fd96d258:d273fb15ab2475bf (host=slave23:22000):(Total: 8m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:694/85.62 GB 1:701/86.60 GB 2:682/84.52 GB 11:736/91.00 GB 3:657/81.27 GB 6:655/80.94 GB 0:662/81.49 GB 5:701/86.95 GB 7:718/88.89 GB 8:719/88.91 GB 4:644/79.81 GB 10:700/86.49 GB MemoryUsage(16s000ms): 19.11 GB, 25.21 GB, 24.01 GB, 24.05 GB, 24.69 GB, 24.92 GB, 25.79 GB, 25.38 GB, 25.85 GB, 25.59 GB, 25.33 GB, 24.95 GB, 25.58 GB, 25.31 GB, 25.38 GB, 25.11 GB, 25.02 GB, 25.08 GB, 24.99 GB, 24.85 GB, 24.79 GB, 25.12 GB, 25.07 GB, 24.68 GB, 25.03 GB, 25.30 GB, 25.63 GB, 25.77 GB, 25.50 GB, 24.74 GB, 23.59 GB, 21.57 GB, 19.89 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 95, 91, 81, 75 - AverageThreadTokens: 94.62 - PeakMemoryUsage: 32.72 GB (35131012096) - PerHostPeakMemUsage: 32.72 GB (35131012096) - PrepareTime: 216.878ms - RowsProduced: 0 - TotalCpuTime: 2h53m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h11m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 544.349ms, non-child: 544.349ms, % non-child: 100.00%) - CodegenTime: 6.610ms - CompileTime: 389.503ms - LoadTime: 153.506ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 24.369us, non-child: 24.369us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m46s, non-child: 8m46s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:694/85.62 GB 1:701/86.60 GB 2:682/84.52 GB 11:736/91.00 GB 3:657/81.27 GB 6:655/80.94 GB 0:662/81.49 GB 5:701/86.95 GB 7:718/88.89 GB 8:719/88.91 GB 4:644/79.81 GB 10:700/86.49 GB BytesRead(16s000ms): 5.61 GB, 18.00 GB, 30.41 GB, 42.81 GB, 55.17 GB, 67.56 GB, 79.91 GB, 92.21 GB, 104.44 GB, 116.62 GB, 129.02 GB, 141.26 GB, 153.27 GB, 165.40 GB, 177.59 GB, 189.77 GB, 201.99 GB, 214.23 GB, 226.56 GB, 238.65 GB, 250.88 GB, 263.01 GB, 275.19 GB, 287.22 GB, 299.35 GB, 311.44 GB, 323.54 GB, 335.58 GB, 347.54 GB, 359.46 GB, 371.37 GB, 383.06 GB, 394.83 GB - AverageHdfsReadThreadConcurrency: 11.98 - AverageScannerThreadConcurrency: 93.71 - BytesRead: 401.83 GB (431461240445) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.00 GB (1075515392) - PerReadThreadRawHdfsThroughput: 65.07 MB/sec - RowsRead: 1.64B (1635499770) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.22K (3216) - ScannerThreadsInvoluntaryContextSwitches: 28.12K (28117) - ScannerThreadsTotalWallClockTime: 2h53m - DelimiterParseTime: 8m12s - MaterializeTupleTime(*): 1h6m - ScannerThreadsSysTime: 24s500ms - ScannerThreadsUserTime: 20m12s - ScannerThreadsVoluntaryContextSwitches: 21.06K (21059) - TotalRawHdfsReadTime(*): 1h45m - TotalReadThroughput: 776.99 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c1 (host=slave15:22000):(Total: 8m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:696/86.30 GB 10:684/84.55 GB 1:708/87.48 GB 6:732/90.51 GB 4:694/86.26 GB 7:651/80.15 GB 11:686/85.04 GB 2:639/78.98 GB 5:718/88.59 GB 0:681/84.33 GB 9:675/83.53 GB 3:706/86.87 GB MemoryUsage(16s000ms): 20.09 GB, 23.65 GB, 24.33 GB, 24.09 GB, 25.11 GB, 25.20 GB, 25.81 GB, 25.67 GB, 25.68 GB, 24.99 GB, 24.95 GB, 25.00 GB, 24.86 GB, 25.36 GB, 25.22 GB, 25.51 GB, 24.71 GB, 24.87 GB, 24.28 GB, 24.95 GB, 24.96 GB, 24.02 GB, 24.31 GB, 24.72 GB, 25.06 GB, 25.39 GB, 24.74 GB, 24.88 GB, 24.61 GB, 25.43 GB, 25.34 GB, 24.50 GB, 22.81 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 91, 86 - AverageThreadTokens: 95.37 - PeakMemoryUsage: 39.05 GB (41927525376) - PerHostPeakMemUsage: 39.05 GB (41927525376) - PrepareTime: 284.317ms - RowsProduced: 0 - TotalCpuTime: 1h24m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h20m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 590.26ms, non-child: 590.26ms, % non-child: 100.00%) - CodegenTime: 6.715ms - CompileTime: 431.111ms - LoadTime: 157.412ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 29.32us, non-child: 29.32us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m46s, non-child: 8m46s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:696/86.30 GB 10:684/84.55 GB 1:708/87.48 GB 6:732/90.51 GB 4:694/86.26 GB 7:651/80.15 GB 11:686/85.04 GB 2:639/78.98 GB 5:718/88.59 GB 0:681/84.33 GB 9:675/83.53 GB 3:706/86.87 GB BytesRead(16s000ms): 5.38 GB, 17.64 GB, 29.79 GB, 41.64 GB, 53.51 GB, 65.50 GB, 77.40 GB, 89.36 GB, 101.19 GB, 112.79 GB, 124.65 GB, 136.50 GB, 148.41 GB, 160.27 GB, 171.87 GB, 183.44 GB, 194.90 GB, 206.30 GB, 217.75 GB, 229.01 GB, 240.36 GB, 251.85 GB, 263.84 GB, 275.87 GB, 287.93 GB, 300.01 GB, 312.03 GB, 323.49 GB, 335.01 GB, 346.85 GB, 358.95 GB, 370.92 GB, 382.80 GB - AverageHdfsReadThreadConcurrency: 18.23 - AverageScannerThreadConcurrency: 94.55 - BytesRead: 389.92 GB (418673795134) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.00 GB (1074417664) - PerReadThreadRawHdfsThroughput: 41.44 MB/sec - RowsRead: 1.59B (1586296840) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.12K (3118) - ScannerThreadsInvoluntaryContextSwitches: 15.76K (15760) - ScannerThreadsTotalWallClockTime: 1h24m - DelimiterParseTime: 7m59s - MaterializeTupleTime(*): 1h5m - ScannerThreadsSysTime: 10s271ms - ScannerThreadsUserTime: 9m12s - ScannerThreadsVoluntaryContextSwitches: 9.30K (9305) - TotalRawHdfsReadTime(*): 2h40m - TotalReadThroughput: 753.68 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475ba (host=slave19:22000):(Total: 8m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:718/88.99 GB 4:682/84.49 GB 1:667/82.58 GB 10:686/84.85 GB 7:694/85.83 GB 2:696/86.00 GB 11:694/85.56 GB 9:683/84.28 GB 8:712/87.84 GB 6:666/82.58 GB 0:715/88.01 GB 5:659/81.46 GB MemoryUsage(16s000ms): 19.98 GB, 24.51 GB, 24.05 GB, 24.31 GB, 24.89 GB, 25.00 GB, 25.53 GB, 25.26 GB, 25.03 GB, 25.37 GB, 25.32 GB, 25.06 GB, 25.44 GB, 25.56 GB, 25.23 GB, 25.15 GB, 24.96 GB, 25.33 GB, 24.94 GB, 24.66 GB, 24.83 GB, 24.39 GB, 24.69 GB, 24.89 GB, 25.84 GB, 25.03 GB, 25.48 GB, 25.33 GB, 25.39 GB, 25.11 GB, 24.83 GB, 24.25 GB, 23.73 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 94, 89 - AverageThreadTokens: 95.64 - PeakMemoryUsage: 36.72 GB (39429332992) - PerHostPeakMemUsage: 36.72 GB (39429332992) - PrepareTime: 220.33ms - RowsProduced: 0 - TotalCpuTime: 59m23s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h22m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 581.536ms, non-child: 581.536ms, % non-child: 100.00%) - CodegenTime: 8.245ms - CompileTime: 426.769ms - LoadTime: 153.397ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 27.300us, non-child: 27.300us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m46s, non-child: 8m46s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:718/88.99 GB 4:682/84.49 GB 1:667/82.58 GB 10:686/84.85 GB 7:694/85.83 GB 2:696/86.00 GB 11:694/85.56 GB 9:683/84.28 GB 8:712/87.84 GB 6:666/82.58 GB 0:715/88.01 GB 5:659/81.46 GB BytesRead(16s000ms): 5.56 GB, 17.65 GB, 29.82 GB, 41.78 GB, 53.57 GB, 65.32 GB, 76.93 GB, 88.48 GB, 100.10 GB, 111.42 GB, 122.67 GB, 133.73 GB, 144.68 GB, 155.62 GB, 166.42 GB, 177.30 GB, 187.98 GB, 198.44 GB, 209.28 GB, 220.97 GB, 232.79 GB, 244.86 GB, 257.04 GB, 269.36 GB, 281.75 GB, 294.11 GB, 306.35 GB, 318.65 GB, 330.94 GB, 343.25 GB, 355.48 GB, 367.75 GB, 379.86 GB - AverageHdfsReadThreadConcurrency: 17.68 - AverageScannerThreadConcurrency: 94.73 - BytesRead: 386.88 GB (415414307416) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1017.68 MB (1067110400) - PerReadThreadRawHdfsThroughput: 42.36 MB/sec - RowsRead: 1.57B (1574352392) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.08K (3084) - ScannerThreadsInvoluntaryContextSwitches: 11.88K (11881) - ScannerThreadsTotalWallClockTime: 59m23s - DelimiterParseTime: 7m59s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 6s483ms - ScannerThreadsUserTime: 5m40s - ScannerThreadsVoluntaryContextSwitches: 6.51K (6512) - TotalRawHdfsReadTime(*): 2h35m - TotalReadThroughput: 748.11 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c0 (host=slave11:22000):(Total: 8m46s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:690/85.19 GB 7:691/84.86 GB 9:708/87.58 GB 0:703/87.25 GB 5:692/84.76 GB 4:724/89.15 GB 8:676/82.85 GB 2:734/90.15 GB 11:669/82.22 GB 10:660/81.17 GB 3:703/86.76 GB 1:655/80.64 GB MemoryUsage(16s000ms): 18.87 GB, 25.08 GB, 23.48 GB, 24.60 GB, 24.99 GB, 24.04 GB, 24.28 GB, 25.77 GB, 25.07 GB, 25.26 GB, 24.74 GB, 24.54 GB, 24.24 GB, 25.10 GB, 24.67 GB, 24.75 GB, 24.86 GB, 24.92 GB, 25.37 GB, 25.36 GB, 25.61 GB, 25.08 GB, 25.47 GB, 24.98 GB, 25.11 GB, 24.86 GB, 25.17 GB, 25.25 GB, 25.03 GB, 25.00 GB, 25.03 GB, 23.73 GB, 22.25 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 87, 82 - AverageThreadTokens: 95.22 - PeakMemoryUsage: 32.89 GB (35316099072) - PerHostPeakMemUsage: 32.89 GB (35316099072) - PrepareTime: 214.559ms - RowsProduced: 0 - TotalCpuTime: 1h57m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h17m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 558.718ms, non-child: 558.718ms, % non-child: 100.00%) - CodegenTime: 6.640ms - CompileTime: 403.994ms - LoadTime: 153.255ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 29.768us, non-child: 29.768us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m45s, non-child: 8m45s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:690/85.19 GB 7:691/84.86 GB 9:708/87.58 GB 0:703/87.25 GB 5:692/84.76 GB 4:724/89.15 GB 8:676/82.85 GB 2:734/90.15 GB 11:669/82.22 GB 10:660/81.17 GB 3:703/86.76 GB 1:655/80.64 GB BytesRead(16s000ms): 5.35 GB, 17.21 GB, 29.31 GB, 40.98 GB, 52.34 GB, 63.82 GB, 75.26 GB, 86.59 GB, 97.96 GB, 109.16 GB, 120.16 GB, 131.28 GB, 142.20 GB, 152.94 GB, 163.82 GB, 175.10 GB, 186.97 GB, 198.91 GB, 211.03 GB, 223.35 GB, 235.59 GB, 247.85 GB, 260.07 GB, 272.37 GB, 284.67 GB, 297.00 GB, 309.30 GB, 321.46 GB, 333.65 GB, 345.84 GB, 357.94 GB, 369.88 GB, 381.79 GB - AverageHdfsReadThreadConcurrency: 16.53 - AverageScannerThreadConcurrency: 94.31 - BytesRead: 388.80 GB (417474278802) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1017.23 MB (1066643456) - PerReadThreadRawHdfsThroughput: 45.58 MB/sec - RowsRead: 1.58B (1580114707) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.12K (3124) - ScannerThreadsInvoluntaryContextSwitches: 24.51K (24514) - ScannerThreadsTotalWallClockTime: 1h57m - DelimiterParseTime: 8m - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 15s837ms - ScannerThreadsUserTime: 13m55s - ScannerThreadsVoluntaryContextSwitches: 15.95K (15949) - TotalRawHdfsReadTime(*): 2h25m - TotalReadThroughput: 751.71 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b6 (host=slave17:22000):(Total: 8m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:683/85.01 GB 7:711/87.77 GB 4:683/84.37 GB 10:691/85.55 GB 3:700/86.97 GB 5:679/84.14 GB 0:715/88.43 GB 11:683/84.66 GB 2:685/85.00 GB 9:678/83.70 GB 8:664/82.06 GB 6:687/84.83 GB MemoryUsage(16s000ms): 18.92 GB, 25.00 GB, 24.37 GB, 24.83 GB, 24.69 GB, 24.32 GB, 25.01 GB, 25.60 GB, 25.38 GB, 25.12 GB, 24.57 GB, 25.06 GB, 24.72 GB, 24.91 GB, 25.41 GB, 25.01 GB, 24.81 GB, 24.68 GB, 24.82 GB, 24.49 GB, 25.12 GB, 25.47 GB, 25.89 GB, 25.35 GB, 25.76 GB, 25.42 GB, 26.01 GB, 25.09 GB, 24.87 GB, 25.08 GB, 24.64 GB, 24.02 GB, 24.12 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.91 - PeakMemoryUsage: 34.18 GB (36695467008) - PerHostPeakMemUsage: 34.18 GB (36695467008) - PrepareTime: 216.388ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h23m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 366.150ms, non-child: 366.150ms, % non-child: 100.00%) - CodegenTime: 6.653ms - CompileTime: 211.673ms - LoadTime: 153.100ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 25.732us, non-child: 25.732us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m45s, non-child: 8m45s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:683/85.01 GB 7:711/87.77 GB 4:683/84.37 GB 10:691/85.55 GB 3:700/86.97 GB 5:679/84.14 GB 0:715/88.43 GB 11:683/84.66 GB 2:685/85.00 GB 9:678/83.70 GB 8:664/82.06 GB 6:687/84.83 GB BytesRead(16s000ms): 5.25 GB, 16.94 GB, 28.85 GB, 40.72 GB, 52.31 GB, 63.90 GB, 75.50 GB, 86.83 GB, 98.13 GB, 109.21 GB, 120.32 GB, 131.09 GB, 141.89 GB, 152.65 GB, 163.65 GB, 175.21 GB, 187.34 GB, 199.60 GB, 211.95 GB, 224.34 GB, 236.63 GB, 248.93 GB, 261.17 GB, 273.48 GB, 285.87 GB, 298.21 GB, 310.45 GB, 322.76 GB, 334.96 GB, 347.18 GB, 359.49 GB, 371.63 GB, 383.84 GB - AverageHdfsReadThreadConcurrency: 18.34 - AverageScannerThreadConcurrency: 95.00 - BytesRead: 390.48 GB (419270058987) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1017.48 MB (1066905600) - PerReadThreadRawHdfsThroughput: 41.26 MB/sec - RowsRead: 1.59B (1590479367) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.11K (3110) - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - DelimiterParseTime: 8m1s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 2h41m - TotalReadThroughput: 756.02 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b7 (host=slave18:22000):(Total: 8m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:687/84.70 GB 4:696/85.27 GB 9:716/88.52 GB 5:706/87.46 GB 0:656/81.04 GB 8:691/85.50 GB 1:678/83.63 GB 6:675/83.60 GB 3:738/91.31 GB 2:674/83.44 GB 11:690/84.95 GB 10:672/83.13 GB MemoryUsage(16s000ms): 15.65 GB, 27.98 GB, 23.92 GB, 24.00 GB, 24.99 GB, 24.74 GB, 24.55 GB, 25.28 GB, 25.26 GB, 24.83 GB, 25.09 GB, 24.77 GB, 25.05 GB, 25.10 GB, 25.52 GB, 24.87 GB, 24.96 GB, 24.75 GB, 24.56 GB, 25.13 GB, 24.79 GB, 24.96 GB, 25.37 GB, 25.29 GB, 24.33 GB, 24.69 GB, 24.32 GB, 24.76 GB, 25.44 GB, 25.85 GB, 25.22 GB, 24.12 GB, 22.72 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 88, 85 - AverageThreadTokens: 95.27 - PeakMemoryUsage: 34.00 GB (36507545600) - PerHostPeakMemUsage: 34.00 GB (36507545600) - PrepareTime: 215.980ms - RowsProduced: 0 - TotalCpuTime: 1h31m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h17m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 546.380ms, non-child: 546.380ms, % non-child: 100.00%) - CodegenTime: 6.543ms - CompileTime: 390.972ms - LoadTime: 154.50ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 27.659us, non-child: 27.659us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m45s, non-child: 8m45s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:687/84.70 GB 4:696/85.27 GB 9:716/88.52 GB 5:706/87.46 GB 0:656/81.04 GB 8:691/85.50 GB 1:678/83.63 GB 6:675/83.60 GB 3:738/91.31 GB 2:674/83.44 GB 11:690/84.95 GB 10:672/83.13 GB BytesRead(16s000ms): 4.71 GB, 15.46 GB, 27.59 GB, 39.68 GB, 51.42 GB, 63.12 GB, 74.72 GB, 86.03 GB, 97.27 GB, 108.46 GB, 119.50 GB, 130.44 GB, 141.26 GB, 152.25 GB, 163.54 GB, 175.12 GB, 187.00 GB, 199.16 GB, 211.44 GB, 223.79 GB, 236.22 GB, 248.63 GB, 260.92 GB, 273.19 GB, 285.62 GB, 298.05 GB, 310.42 GB, 322.66 GB, 334.82 GB, 346.97 GB, 359.11 GB, 371.06 GB, 382.95 GB - AverageHdfsReadThreadConcurrency: 16.61 - AverageScannerThreadConcurrency: 94.45 - BytesRead: 389.58 GB (418308688608) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 999.72 MB (1048285184) - PerReadThreadRawHdfsThroughput: 45.39 MB/sec - RowsRead: 1.59B (1587465081) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.12K (3119) - ScannerThreadsInvoluntaryContextSwitches: 22.14K (22141) - ScannerThreadsTotalWallClockTime: 1h31m - DelimiterParseTime: 8m4s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 11s942ms - ScannerThreadsUserTime: 10m51s - ScannerThreadsVoluntaryContextSwitches: 7.79K (7795) - TotalRawHdfsReadTime(*): 2h26m - TotalReadThroughput: 754.20 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b8 (host=slave08:22000):(Total: 8m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:679/84.08 GB 4:682/84.11 GB 7:679/83.78 GB 9:686/84.66 GB 1:672/82.74 GB 5:713/88.32 GB 0:674/83.29 GB 8:710/87.66 GB 3:720/88.83 GB 6:685/84.56 GB 2:678/84.27 GB 11:704/86.22 GB MemoryUsage(16s000ms): 19.51 GB, 24.95 GB, 23.50 GB, 25.02 GB, 24.90 GB, 24.86 GB, 24.71 GB, 25.10 GB, 25.51 GB, 24.60 GB, 25.26 GB, 25.01 GB, 24.53 GB, 25.04 GB, 25.00 GB, 25.43 GB, 24.88 GB, 24.71 GB, 24.27 GB, 24.56 GB, 25.06 GB, 24.80 GB, 25.37 GB, 25.35 GB, 25.63 GB, 25.36 GB, 24.94 GB, 25.31 GB, 25.03 GB, 25.15 GB, 24.74 GB, 23.63 GB, 21.47 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 87, 82 - AverageThreadTokens: 95.20 - PeakMemoryUsage: 35.15 GB (37741089792) - PerHostPeakMemUsage: 35.15 GB (37741089792) - PrepareTime: 275.300ms - RowsProduced: 0 - TotalCpuTime: 1h56m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h16m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 553.392ms, non-child: 553.392ms, % non-child: 100.00%) - CodegenTime: 6.758ms - CompileTime: 396.205ms - LoadTime: 155.717ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 27.547us, non-child: 27.547us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m45s, non-child: 8m45s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:679/84.08 GB 4:682/84.11 GB 7:679/83.78 GB 9:686/84.66 GB 1:672/82.74 GB 5:713/88.32 GB 0:674/83.29 GB 8:710/87.66 GB 3:720/88.83 GB 6:685/84.56 GB 2:678/84.27 GB 11:704/86.22 GB BytesRead(16s000ms): 5.30 GB, 17.23 GB, 29.29 GB, 41.07 GB, 52.72 GB, 64.34 GB, 75.86 GB, 87.39 GB, 98.70 GB, 110.24 GB, 121.29 GB, 132.29 GB, 143.33 GB, 154.26 GB, 164.99 GB, 175.67 GB, 187.33 GB, 199.43 GB, 211.56 GB, 223.83 GB, 236.12 GB, 248.41 GB, 260.65 GB, 272.93 GB, 285.29 GB, 297.69 GB, 310.04 GB, 322.35 GB, 334.65 GB, 346.92 GB, 358.91 GB, 370.86 GB, 382.87 GB - AverageHdfsReadThreadConcurrency: 17.43 - AverageScannerThreadConcurrency: 94.29 - BytesRead: 389.40 GB (418117341900) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.00 GB (1073991680) - PerReadThreadRawHdfsThroughput: 43.35 MB/sec - RowsRead: 1.58B (1584405598) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.12K (3120) - ScannerThreadsInvoluntaryContextSwitches: 28.06K (28061) - ScannerThreadsTotalWallClockTime: 1h56m - DelimiterParseTime: 7m58s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 15s265ms - ScannerThreadsUserTime: 11m44s - ScannerThreadsVoluntaryContextSwitches: 14.92K (14917) - TotalRawHdfsReadTime(*): 2h33m - TotalReadThroughput: 753.99 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c5 (host=slave12:22000):(Total: 8m45s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:659/81.32 GB 4:706/86.65 GB 2:688/84.80 GB 11:717/88.48 GB 7:703/86.79 GB 6:703/87.24 GB 1:747/92.10 GB 0:652/80.39 GB 5:662/81.46 GB 8:726/89.96 GB 3:663/80.55 GB 9:671/82.77 GB MemoryUsage(16s000ms): 18.49 GB, 24.82 GB, 23.26 GB, 25.12 GB, 25.18 GB, 24.80 GB, 25.21 GB, 24.76 GB, 25.36 GB, 25.61 GB, 25.23 GB, 24.87 GB, 24.21 GB, 24.97 GB, 25.24 GB, 24.89 GB, 24.90 GB, 25.13 GB, 25.05 GB, 24.37 GB, 24.52 GB, 23.85 GB, 23.84 GB, 25.21 GB, 25.02 GB, 25.89 GB, 25.37 GB, 25.39 GB, 25.47 GB, 25.24 GB, 25.09 GB, 23.80 GB, 23.55 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 92, 88 - AverageThreadTokens: 95.48 - PeakMemoryUsage: 33.77 GB (36265553920) - PerHostPeakMemUsage: 33.77 GB (36265553920) - PrepareTime: 285.966ms - RowsProduced: 0 - TotalCpuTime: 1h7m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h20m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 553.448ms, non-child: 553.448ms, % non-child: 100.00%) - CodegenTime: 8.302ms - CompileTime: 394.797ms - LoadTime: 157.209ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 25.74us, non-child: 25.74us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m44s, non-child: 8m44s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:659/81.32 GB 4:706/86.65 GB 2:688/84.80 GB 11:717/88.48 GB 7:703/86.79 GB 6:703/87.24 GB 1:747/92.10 GB 0:652/80.39 GB 5:662/81.46 GB 8:726/89.96 GB 3:663/80.55 GB 9:671/82.77 GB BytesRead(16s000ms): 5.26 GB, 17.22 GB, 29.45 GB, 41.32 GB, 52.90 GB, 64.41 GB, 75.72 GB, 86.90 GB, 97.96 GB, 109.23 GB, 120.57 GB, 131.80 GB, 143.04 GB, 154.02 GB, 165.03 GB, 176.07 GB, 186.92 GB, 197.54 GB, 208.22 GB, 219.60 GB, 231.72 GB, 243.99 GB, 256.14 GB, 268.23 GB, 280.38 GB, 292.54 GB, 304.56 GB, 316.80 GB, 329.02 GB, 341.21 GB, 353.42 GB, 365.50 GB, 377.60 GB - AverageHdfsReadThreadConcurrency: 18.32 - AverageScannerThreadConcurrency: 94.66 - BytesRead: 384.06 GB (412386519581) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1017.06 MB (1066463232) - PerReadThreadRawHdfsThroughput: 40.67 MB/sec - RowsRead: 1.56B (1564649285) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.09K (3089) - ScannerThreadsInvoluntaryContextSwitches: 12.41K (12408) - ScannerThreadsTotalWallClockTime: 1h7m - DelimiterParseTime: 7m53s - MaterializeTupleTime(*): 1h3m - ScannerThreadsSysTime: 7s078ms - ScannerThreadsUserTime: 6m28s - ScannerThreadsVoluntaryContextSwitches: 5.80K (5797) - TotalRawHdfsReadTime(*): 2h41m - TotalReadThroughput: 743.67 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b9 (host=slave24:22000):(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:656/81.11 GB 8:701/86.55 GB 6:698/86.15 GB 4:684/84.36 GB 1:717/88.52 GB 9:684/84.44 GB 0:671/82.65 GB 5:695/85.89 GB 3:729/90.31 GB 11:692/85.32 GB 2:683/84.72 GB 7:672/82.61 GB MemoryUsage(16s000ms): 18.03 GB, 25.30 GB, 23.58 GB, 25.40 GB, 24.57 GB, 24.46 GB, 24.29 GB, 24.70 GB, 24.80 GB, 25.25 GB, 24.58 GB, 24.60 GB, 24.57 GB, 24.02 GB, 24.41 GB, 24.15 GB, 23.03 GB, 23.72 GB, 24.97 GB, 26.13 GB, 25.68 GB, 25.62 GB, 25.35 GB, 24.64 GB, 25.27 GB, 25.97 GB, 26.68 GB, 25.43 GB, 25.71 GB, 25.12 GB, 25.43 GB, 24.30 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 86 - AverageThreadTokens: 95.23 - PeakMemoryUsage: 35.48 GB (38100377600) - PerHostPeakMemUsage: 35.48 GB (38100377600) - PrepareTime: 211.200ms - RowsProduced: 0 - TotalCpuTime: 1h56m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h16m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 560.362ms, non-child: 560.362ms, % non-child: 100.00%) - CodegenTime: 6.551ms - CompileTime: 407.326ms - LoadTime: 151.661ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 28.409us, non-child: 28.409us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m44s, non-child: 8m44s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:656/81.11 GB 8:701/86.55 GB 6:698/86.15 GB 4:684/84.36 GB 1:717/88.52 GB 9:684/84.44 GB 0:671/82.65 GB 5:695/85.89 GB 3:729/90.31 GB 11:692/85.32 GB 2:683/84.72 GB 7:672/82.61 GB BytesRead(16s000ms): 4.97 GB, 16.52 GB, 28.20 GB, 39.57 GB, 51.02 GB, 62.23 GB, 73.50 GB, 84.85 GB, 96.16 GB, 107.35 GB, 118.48 GB, 129.67 GB, 140.60 GB, 151.73 GB, 163.21 GB, 174.47 GB, 186.08 GB, 197.03 GB, 206.73 GB, 217.70 GB, 229.94 GB, 242.24 GB, 254.66 GB, 267.05 GB, 279.32 GB, 291.58 GB, 303.81 GB, 316.05 GB, 328.23 GB, 340.34 GB, 352.56 GB, 364.48 GB - AverageHdfsReadThreadConcurrency: 22.09 - AverageScannerThreadConcurrency: 94.32 - BytesRead: 382.21 GB (410399250723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.01 GB (1082382336) - PerReadThreadRawHdfsThroughput: 33.58 MB/sec - RowsRead: 1.56B (1556648141) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.07K (3069) - ScannerThreadsInvoluntaryContextSwitches: 34.46K (34460) - ScannerThreadsTotalWallClockTime: 1h56m - DelimiterParseTime: 7m54s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 13s907ms - ScannerThreadsUserTime: 12m40s - ScannerThreadsVoluntaryContextSwitches: 10.14K (10141) - TotalRawHdfsReadTime(*): 3h14m - TotalReadThroughput: 741.54 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c3 (host=slave22:22000):(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:685/84.16 GB 6:673/82.20 GB 7:696/86.05 GB 8:706/87.58 GB 3:687/85.31 GB 11:662/81.39 GB 2:716/88.32 GB 9:688/85.63 GB 0:668/82.68 GB 5:730/90.70 GB 1:707/87.49 GB 10:657/80.91 GB MemoryUsage(16s000ms): 19.37 GB, 24.77 GB, 24.35 GB, 24.31 GB, 24.66 GB, 25.19 GB, 25.70 GB, 25.49 GB, 25.77 GB, 25.06 GB, 25.16 GB, 25.08 GB, 25.38 GB, 24.90 GB, 25.06 GB, 25.14 GB, 25.08 GB, 24.72 GB, 24.64 GB, 24.98 GB, 24.93 GB, 24.49 GB, 24.60 GB, 25.21 GB, 24.40 GB, 25.61 GB, 25.17 GB, 24.93 GB, 24.92 GB, 24.96 GB, 24.74 GB, 23.78 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 94 - AverageThreadTokens: 95.71 - PeakMemoryUsage: 34.74 GB (37305009152) - PerHostPeakMemUsage: 34.74 GB (37305009152) - PrepareTime: 212.796ms - RowsProduced: 0 - TotalCpuTime: 1h25m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h19m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 558.706ms, non-child: 558.706ms, % non-child: 100.00%) - CodegenTime: 6.623ms - CompileTime: 405.131ms - LoadTime: 152.100ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 27.472us, non-child: 27.472us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m44s, non-child: 8m44s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:685/84.16 GB 6:673/82.20 GB 7:696/86.05 GB 8:706/87.58 GB 3:687/85.31 GB 11:662/81.39 GB 2:716/88.32 GB 9:688/85.63 GB 0:668/82.68 GB 5:730/90.70 GB 1:707/87.49 GB 10:657/80.91 GB BytesRead(16s000ms): 5.49 GB, 17.64 GB, 29.95 GB, 42.12 GB, 54.36 GB, 66.41 GB, 78.42 GB, 90.41 GB, 102.25 GB, 114.17 GB, 126.00 GB, 137.92 GB, 149.69 GB, 161.49 GB, 173.12 GB, 184.71 GB, 196.24 GB, 207.89 GB, 219.34 GB, 230.69 GB, 242.03 GB, 253.53 GB, 264.96 GB, 276.82 GB, 288.92 GB, 301.00 GB, 313.21 GB, 325.51 GB, 337.85 GB, 350.25 GB, 362.50 GB, 374.78 GB - AverageHdfsReadThreadConcurrency: 18.42 - AverageScannerThreadConcurrency: 94.80 - BytesRead: 392.09 GB (421006470280) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1016.83 MB (1066225664) - PerReadThreadRawHdfsThroughput: 41.44 MB/sec - RowsRead: 1.59B (1593737292) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.13K (3130) - ScannerThreadsInvoluntaryContextSwitches: 21.81K (21809) - ScannerThreadsTotalWallClockTime: 1h25m - DelimiterParseTime: 7m58s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 11s043ms - ScannerThreadsUserTime: 9m9s - ScannerThreadsVoluntaryContextSwitches: 8.40K (8402) - TotalRawHdfsReadTime(*): 2h41m - TotalReadThroughput: 761.09 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b1 (host=slave13:22000):(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:706/86.90 GB 9:705/86.83 GB 8:691/84.93 GB 7:693/85.02 GB 3:687/85.10 GB 0:661/80.83 GB 5:719/88.77 GB 11:698/86.37 GB 2:671/82.36 GB 1:663/82.15 GB 6:688/84.86 GB 10:717/88.32 GB MemoryUsage(16s000ms): 18.63 GB, 25.24 GB, 24.75 GB, 24.24 GB, 24.55 GB, 24.71 GB, 24.93 GB, 25.54 GB, 25.52 GB, 25.47 GB, 25.15 GB, 24.24 GB, 24.82 GB, 25.14 GB, 24.81 GB, 24.92 GB, 24.46 GB, 25.21 GB, 24.47 GB, 25.20 GB, 25.15 GB, 25.43 GB, 25.04 GB, 25.51 GB, 25.90 GB, 25.54 GB, 25.86 GB, 25.38 GB, 25.77 GB, 24.57 GB, 24.30 GB, 24.35 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 91 - AverageThreadTokens: 95.61 - PeakMemoryUsage: 33.11 GB (35547169792) - PerHostPeakMemUsage: 33.11 GB (35547169792) - PrepareTime: 216.553ms - RowsProduced: 0 - TotalCpuTime: 50m1s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h18m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 572.269ms, non-child: 572.269ms, % non-child: 100.00%) - CodegenTime: 6.419ms - CompileTime: 417.49ms - LoadTime: 153.848ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 23.335us, non-child: 23.335us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m44s, non-child: 8m44s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:706/86.90 GB 9:705/86.83 GB 8:691/84.93 GB 7:693/85.02 GB 3:687/85.10 GB 0:661/80.83 GB 5:719/88.77 GB 11:698/86.37 GB 2:671/82.36 GB 1:663/82.15 GB 6:688/84.86 GB 10:717/88.32 GB BytesRead(16s000ms): 5.32 GB, 17.28 GB, 29.29 GB, 41.28 GB, 52.98 GB, 64.52 GB, 75.92 GB, 87.27 GB, 98.55 GB, 109.77 GB, 120.96 GB, 132.09 GB, 142.63 GB, 153.40 GB, 164.04 GB, 174.83 GB, 186.15 GB, 197.80 GB, 209.69 GB, 221.84 GB, 233.97 GB, 246.26 GB, 258.51 GB, 270.89 GB, 283.30 GB, 295.67 GB, 308.01 GB, 320.33 GB, 332.59 GB, 344.87 GB, 357.15 GB, 369.50 GB - AverageHdfsReadThreadConcurrency: 18.02 - AverageScannerThreadConcurrency: 94.70 - BytesRead: 387.26 GB (415819000115) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1023.04 MB (1072738304) - PerReadThreadRawHdfsThroughput: 41.77 MB/sec - RowsRead: 1.58B (1575383922) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.11K (3111) - ScannerThreadsInvoluntaryContextSwitches: 13.03K (13029) - ScannerThreadsTotalWallClockTime: 50m1s - DelimiterParseTime: 7m55s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 5s973ms - ScannerThreadsUserTime: 4m53s - ScannerThreadsVoluntaryContextSwitches: 5.56K (5564) - TotalRawHdfsReadTime(*): 2h38m - TotalReadThroughput: 751.70 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c6 (host=slave20:22000):(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:681/83.67 GB 10:703/86.44 GB 9:674/83.16 GB 7:679/83.80 GB 3:708/86.99 GB 0:684/84.50 GB 5:683/84.88 GB 1:693/85.14 GB 6:720/89.33 GB 4:707/87.43 GB 2:693/85.88 GB 11:659/81.37 GB MemoryUsage(16s000ms): 18.67 GB, 23.84 GB, 24.73 GB, 24.98 GB, 24.61 GB, 25.28 GB, 25.63 GB, 25.42 GB, 25.84 GB, 25.36 GB, 25.17 GB, 25.05 GB, 25.60 GB, 25.41 GB, 25.17 GB, 25.14 GB, 24.77 GB, 25.19 GB, 24.44 GB, 25.07 GB, 24.97 GB, 25.69 GB, 24.63 GB, 24.77 GB, 25.26 GB, 25.03 GB, 24.96 GB, 25.67 GB, 24.58 GB, 24.68 GB, 24.52 GB, 22.99 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 95, 85 - AverageThreadTokens: 95.06 - PeakMemoryUsage: 32.57 GB (34972451840) - PerHostPeakMemUsage: 32.57 GB (34972451840) - PrepareTime: 270.369ms - RowsProduced: 0 - TotalCpuTime: 2h5m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h13m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 577.136ms, non-child: 577.136ms, % non-child: 100.00%) - CodegenTime: 6.715ms - CompileTime: 422.280ms - LoadTime: 153.449ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 24.72us, non-child: 24.72us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m43s, non-child: 8m43s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:681/83.67 GB 10:703/86.44 GB 9:674/83.16 GB 7:679/83.80 GB 3:708/86.99 GB 0:684/84.50 GB 5:683/84.88 GB 1:693/85.14 GB 6:720/89.33 GB 4:707/87.43 GB 2:693/85.88 GB 11:659/81.37 GB BytesRead(16s000ms): 5.30 GB, 17.72 GB, 30.17 GB, 42.67 GB, 55.05 GB, 67.30 GB, 79.55 GB, 91.88 GB, 104.23 GB, 116.63 GB, 129.02 GB, 141.31 GB, 153.50 GB, 165.65 GB, 177.79 GB, 190.00 GB, 202.25 GB, 214.54 GB, 226.79 GB, 238.99 GB, 251.18 GB, 263.29 GB, 275.56 GB, 287.78 GB, 300.02 GB, 312.19 GB, 324.42 GB, 336.47 GB, 348.54 GB, 360.58 GB, 372.67 GB, 384.21 GB - AverageHdfsReadThreadConcurrency: 11.40 - AverageScannerThreadConcurrency: 94.24 - BytesRead: 401.73 GB (431358048231) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1023.71 MB (1073442816) - PerReadThreadRawHdfsThroughput: 68.60 MB/sec - RowsRead: 1.63B (1632379941) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.22K (3220) - ScannerThreadsInvoluntaryContextSwitches: 17.65K (17647) - ScannerThreadsTotalWallClockTime: 2h5m - DelimiterParseTime: 8m9s - MaterializeTupleTime(*): 1h6m - ScannerThreadsSysTime: 15s468ms - ScannerThreadsUserTime: 13m27s - ScannerThreadsVoluntaryContextSwitches: 10.05K (10047) - TotalRawHdfsReadTime(*): 1h39m - TotalReadThroughput: 779.16 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c7 (host=slave16:22000):(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:671/82.60 GB 7:647/79.66 GB 10:714/87.67 GB 3:685/85.16 GB 6:701/85.87 GB 0:689/84.96 GB 5:721/89.22 GB 4:694/85.20 GB 1:712/88.19 GB 9:695/85.67 GB 2:688/84.79 GB 11:681/83.58 GB MemoryUsage(16s000ms): 19.28 GB, 25.01 GB, 23.71 GB, 24.60 GB, 25.04 GB, 25.16 GB, 25.15 GB, 25.52 GB, 24.89 GB, 24.88 GB, 24.84 GB, 24.47 GB, 25.23 GB, 24.71 GB, 24.96 GB, 25.26 GB, 24.66 GB, 24.77 GB, 24.25 GB, 24.22 GB, 24.57 GB, 24.19 GB, 24.23 GB, 25.23 GB, 25.35 GB, 25.29 GB, 25.25 GB, 25.32 GB, 24.91 GB, 25.66 GB, 24.90 GB, 24.00 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 92 - AverageThreadTokens: 95.61 - PeakMemoryUsage: 37.01 GB (39737569280) - PerHostPeakMemUsage: 37.01 GB (39737569280) - PrepareTime: 212.262ms - RowsProduced: 0 - TotalCpuTime: 58m49s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h19m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 585.506ms, non-child: 585.506ms, % non-child: 100.00%) - CodegenTime: 6.521ms - CompileTime: 431.602ms - LoadTime: 152.559ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 23.649us, non-child: 23.649us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m43s, non-child: 8m43s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:671/82.60 GB 7:647/79.66 GB 10:714/87.67 GB 3:685/85.16 GB 6:701/85.87 GB 0:689/84.96 GB 5:721/89.22 GB 4:694/85.20 GB 1:712/88.19 GB 9:695/85.67 GB 2:688/84.79 GB 11:681/83.58 GB BytesRead(16s000ms): 5.33 GB, 17.12 GB, 29.25 GB, 41.05 GB, 52.39 GB, 63.73 GB, 75.22 GB, 86.59 GB, 98.02 GB, 109.35 GB, 120.55 GB, 131.87 GB, 142.84 GB, 153.77 GB, 164.70 GB, 175.67 GB, 187.37 GB, 199.28 GB, 211.39 GB, 223.73 GB, 235.93 GB, 248.19 GB, 260.47 GB, 272.64 GB, 284.77 GB, 296.87 GB, 309.12 GB, 321.38 GB, 333.61 GB, 345.79 GB, 357.97 GB, 370.06 GB - AverageHdfsReadThreadConcurrency: 18.14 - AverageScannerThreadConcurrency: 94.70 - BytesRead: 387.65 GB (416232361726) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.00 GB (1075605504) - PerReadThreadRawHdfsThroughput: 41.62 MB/sec - RowsRead: 1.58B (1577876796) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.11K (3106) - ScannerThreadsInvoluntaryContextSwitches: 12.35K (12354) - ScannerThreadsTotalWallClockTime: 58m49s - DelimiterParseTime: 7m54s - MaterializeTupleTime(*): 1h3m - ScannerThreadsSysTime: 7s123ms - ScannerThreadsUserTime: 6m21s - ScannerThreadsVoluntaryContextSwitches: 5.14K (5138) - TotalRawHdfsReadTime(*): 2h38m - TotalReadThroughput: 752.42 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475bd (host=slave01:22000):(Total: 8m44s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:687/85.40 GB 5:691/85.22 GB 0:697/85.86 GB 4:710/87.66 GB 11:709/87.58 GB 2:708/86.97 GB 9:624/77.08 GB 6:685/84.81 GB 8:664/81.76 GB 3:710/87.70 GB 7:709/87.68 GB 1:685/84.73 GB MemoryUsage(16s000ms): 10.06 GB, 12.60 GB, 12.07 GB, 12.30 GB, 12.32 GB, 12.41 GB, 12.48 GB, 12.55 GB, 13.06 GB, 12.77 GB, 12.75 GB, 12.64 GB, 12.72 GB, 12.44 GB, 12.58 GB, 12.54 GB, 12.76 GB, 12.49 GB, 12.70 GB, 12.05 GB, 12.19 GB, 12.71 GB, 13.09 GB, 13.36 GB, 13.45 GB, 13.41 GB, 12.92 GB, 12.42 GB, 12.38 GB, 12.45 GB, 12.68 GB, 12.41 GB ThreadUsage(16s000ms): 46, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48, 48 - AverageThreadTokens: 47.96 - PeakMemoryUsage: 15.64 GB (16788005888) - PerHostPeakMemUsage: 15.64 GB (16788014080) - PrepareTime: 271.102ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 5h17m CodeGen:(Total: 554.925ms, non-child: 554.925ms, % non-child: 100.00%) - CodegenTime: 6.504ms - CompileTime: 397.228ms - LoadTime: 156.202ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 20.964us, non-child: 20.964us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m43s, non-child: 8m43s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:687/85.40 GB 5:691/85.22 GB 0:697/85.86 GB 4:710/87.66 GB 11:709/87.58 GB 2:708/86.97 GB 9:624/77.08 GB 6:685/84.81 GB 8:664/81.76 GB 3:710/87.70 GB 7:709/87.68 GB 1:685/84.73 GB BytesRead(16s000ms): 5.59 GB, 17.83 GB, 30.06 GB, 41.98 GB, 53.79 GB, 65.43 GB, 77.15 GB, 88.97 GB, 100.40 GB, 111.91 GB, 123.07 GB, 134.19 GB, 145.33 GB, 156.37 GB, 167.23 GB, 177.84 GB, 188.53 GB, 199.11 GB, 210.21 GB, 221.90 GB, 233.97 GB, 245.28 GB, 256.80 GB, 268.38 GB, 280.67 GB, 293.09 GB, 305.46 GB, 317.77 GB, 330.13 GB, 342.39 GB, 354.49 GB, 366.49 GB - AverageHdfsReadThreadConcurrency: 16.65 - AverageScannerThreadConcurrency: 47.00 - BytesRead: 383.94 GB (412255415005) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 47 - PeakMemoryUsage: 620.74 MB (650891264) - PerReadThreadRawHdfsThroughput: 44.85 MB/sec - RowsRead: 1.56B (1561815308) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.09K (3092) - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0ns - DelimiterParseTime: 8m16s - MaterializeTupleTime(*): 1h6m - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 2h26m - TotalReadThroughput: 745.45 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475be (host=slave02:22000):(Total: 8m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:694/85.03 GB 7:655/80.84 GB 9:679/83.81 GB 1:684/85.18 GB 3:660/81.60 GB 10:684/84.22 GB 8:725/89.93 GB 0:725/89.12 GB 5:699/86.20 GB 2:691/85.33 GB 11:681/84.23 GB 6:705/87.03 GB MemoryUsage(16s000ms): 18.54 GB, 25.30 GB, 24.20 GB, 24.77 GB, 24.71 GB, 24.63 GB, 24.53 GB, 25.37 GB, 25.28 GB, 24.76 GB, 24.90 GB, 24.87 GB, 24.70 GB, 24.61 GB, 25.07 GB, 24.45 GB, 24.90 GB, 24.69 GB, 24.30 GB, 25.63 GB, 24.80 GB, 25.15 GB, 24.98 GB, 25.73 GB, 25.43 GB, 25.65 GB, 25.11 GB, 25.39 GB, 24.98 GB, 25.00 GB, 24.78 GB, 24.22 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 90 - AverageThreadTokens: 95.50 - PeakMemoryUsage: 38.41 GB (41247649792) - PerHostPeakMemUsage: 38.41 GB (41247649792) - PrepareTime: 220.143ms - RowsProduced: 0 - TotalCpuTime: 1h15m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h16m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 563.670ms, non-child: 563.670ms, % non-child: 100.00%) - CodegenTime: 6.454ms - CompileTime: 406.797ms - LoadTime: 155.513ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 24.754us, non-child: 24.754us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m42s, non-child: 8m42s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:694/85.03 GB 7:655/80.84 GB 9:679/83.81 GB 1:684/85.18 GB 3:660/81.60 GB 10:684/84.22 GB 8:725/89.93 GB 0:725/89.12 GB 5:699/86.20 GB 2:691/85.33 GB 11:681/84.23 GB 6:705/87.03 GB BytesRead(16s000ms): 5.02 GB, 16.55 GB, 28.68 GB, 40.80 GB, 52.54 GB, 64.06 GB, 75.61 GB, 87.06 GB, 98.54 GB, 110.04 GB, 121.38 GB, 132.46 GB, 143.65 GB, 154.60 GB, 165.29 GB, 176.41 GB, 186.92 GB, 197.33 GB, 208.15 GB, 219.51 GB, 231.51 GB, 243.58 GB, 255.88 GB, 268.21 GB, 280.55 GB, 292.94 GB, 305.26 GB, 317.57 GB, 329.92 GB, 342.30 GB, 354.56 GB, 366.84 GB - AverageHdfsReadThreadConcurrency: 17.94 - AverageScannerThreadConcurrency: 94.59 - BytesRead: 383.94 GB (412251446349) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1011.29 MB (1060409344) - PerReadThreadRawHdfsThroughput: 41.71 MB/sec - RowsRead: 1.56B (1560954651) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.08K (3076) - ScannerThreadsInvoluntaryContextSwitches: 19.61K (19605) - ScannerThreadsTotalWallClockTime: 1h15m - DelimiterParseTime: 7m55s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 9s593ms - ScannerThreadsUserTime: 9m12s - ScannerThreadsVoluntaryContextSwitches: 7.83K (7825) - TotalRawHdfsReadTime(*): 2h37m - TotalReadThroughput: 746.58 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b4 (host=slave05:22000):(Total: 8m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:718/88.71 GB 9:670/83.24 GB 4:661/82.03 GB 1:734/90.70 GB 7:677/83.69 GB 10:683/84.37 GB 6:681/84.44 GB 11:667/82.09 GB 2:684/84.86 GB 8:713/88.33 GB 5:693/85.50 GB 0:686/84.47 GB MemoryUsage(16s000ms): 18.88 GB, 25.41 GB, 24.24 GB, 24.05 GB, 24.63 GB, 24.98 GB, 25.26 GB, 25.20 GB, 25.10 GB, 24.71 GB, 23.85 GB, 23.44 GB, 23.80 GB, 23.43 GB, 23.98 GB, 23.96 GB, 23.66 GB, 23.86 GB, 24.76 GB, 24.88 GB, 24.36 GB, 23.97 GB, 23.03 GB, 23.35 GB, 23.19 GB, 23.22 GB, 23.12 GB, 23.21 GB, 23.97 GB, 24.99 GB, 26.25 GB, 26.42 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.90 - PeakMemoryUsage: 32.84 GB (35257839616) - PerHostPeakMemUsage: 32.84 GB (35257839616) - PrepareTime: 212.340ms - RowsProduced: 0 - TotalCpuTime: 8m41s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h14m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 562.6ms, non-child: 562.6ms, % non-child: 100.00%) - CodegenTime: 6.571ms - CompileTime: 408.28ms - LoadTime: 152.635ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 24.621us, non-child: 24.621us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m42s, non-child: 8m42s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:718/88.71 GB 9:670/83.24 GB 4:661/82.03 GB 1:734/90.70 GB 7:677/83.69 GB 10:683/84.37 GB 6:681/84.44 GB 11:667/82.09 GB 2:684/84.86 GB 8:713/88.33 GB 5:693/85.50 GB 0:686/84.47 GB BytesRead(16s000ms): 5.36 GB, 17.23 GB, 29.14 GB, 41.02 GB, 52.57 GB, 63.80 GB, 74.90 GB, 86.16 GB, 97.09 GB, 107.82 GB, 118.83 GB, 129.76 GB, 140.47 GB, 151.34 GB, 161.85 GB, 172.40 GB, 183.54 GB, 194.06 GB, 203.62 GB, 213.48 GB, 224.52 GB, 236.62 GB, 248.78 GB, 260.56 GB, 272.57 GB, 284.67 GB, 296.62 GB, 307.56 GB, 317.89 GB, 329.08 GB, 340.29 GB, 351.24 GB - AverageHdfsReadThreadConcurrency: 15.86 - AverageScannerThreadConcurrency: 94.99 - BytesRead: 366.55 GB (393580019174) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.04 GB (1111634944) - PerReadThreadRawHdfsThroughput: 45.07 MB/sec - RowsRead: 1.49B (1494370204) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2.92K (2918) - ScannerThreadsInvoluntaryContextSwitches: 1.42K (1423) - ScannerThreadsTotalWallClockTime: 8m41s - DelimiterParseTime: 7m55s - MaterializeTupleTime(*): 1h3m - ScannerThreadsSysTime: 1s135ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 1.09K (1091) - TotalRawHdfsReadTime(*): 2h18m - TotalReadThroughput: 713.15 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c2 (host=slave09:22000):(Total: 8m43s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:685/84.29 GB 8:718/88.80 GB 9:722/89.35 GB 4:655/80.51 GB 6:706/87.45 GB 7:637/78.19 GB 11:715/88.57 GB 2:700/86.09 GB 5:645/79.43 GB 0:709/87.60 GB 3:686/84.88 GB 1:707/87.26 GB MemoryUsage(16s000ms): 19.32 GB, 24.16 GB, 24.46 GB, 24.82 GB, 24.86 GB, 25.41 GB, 25.27 GB, 25.45 GB, 25.59 GB, 25.14 GB, 25.19 GB, 25.56 GB, 24.90 GB, 25.23 GB, 25.12 GB, 25.46 GB, 25.68 GB, 24.48 GB, 25.38 GB, 25.02 GB, 25.13 GB, 25.21 GB, 25.04 GB, 25.12 GB, 25.00 GB, 24.89 GB, 24.96 GB, 25.07 GB, 24.69 GB, 25.29 GB, 24.83 GB, 22.89 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 84 - AverageThreadTokens: 95.11 - PeakMemoryUsage: 33.16 GB (35602996224) - PerHostPeakMemUsage: 33.16 GB (35602996224) - PrepareTime: 215.524ms - RowsProduced: 0 - TotalCpuTime: 2h21m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h9m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 544.996ms, non-child: 544.996ms, % non-child: 100.00%) - CodegenTime: 6.692ms - CompileTime: 392.12ms - LoadTime: 151.597ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 26.994us, non-child: 26.994us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m42s, non-child: 8m42s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:685/84.29 GB 8:718/88.80 GB 9:722/89.35 GB 4:655/80.51 GB 6:706/87.45 GB 7:637/78.19 GB 11:715/88.57 GB 2:700/86.09 GB 5:645/79.43 GB 0:709/87.60 GB 3:686/84.88 GB 1:707/87.26 GB BytesRead(16s000ms): 5.46 GB, 17.83 GB, 30.24 GB, 42.64 GB, 54.92 GB, 67.25 GB, 79.60 GB, 91.90 GB, 104.21 GB, 116.48 GB, 128.77 GB, 141.07 GB, 153.34 GB, 165.49 GB, 177.68 GB, 189.89 GB, 202.04 GB, 214.20 GB, 226.48 GB, 238.69 GB, 250.99 GB, 263.12 GB, 275.16 GB, 287.33 GB, 299.59 GB, 311.70 GB, 323.62 GB, 335.60 GB, 347.54 GB, 359.59 GB, 371.70 GB, 383.58 GB - AverageHdfsReadThreadConcurrency: 11.27 - AverageScannerThreadConcurrency: 94.20 - BytesRead: 400.24 GB (429759120723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1016.57 MB (1065947136) - PerReadThreadRawHdfsThroughput: 69.02 MB/sec - RowsRead: 1.63B (1628865771) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.22K (3221) - ScannerThreadsInvoluntaryContextSwitches: 19.85K (19851) - ScannerThreadsTotalWallClockTime: 2h21m - DelimiterParseTime: 8m9s - MaterializeTupleTime(*): 1h5m - ScannerThreadsSysTime: 20s567ms - ScannerThreadsUserTime: 16m25s - ScannerThreadsVoluntaryContextSwitches: 16.89K (16891) - TotalRawHdfsReadTime(*): 1h38m - TotalReadThroughput: 778.46 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475bb (host=slave14:22000):(Total: 8m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:666/82.68 GB 6:714/88.11 GB 2:707/87.04 GB 11:746/90.97 GB 8:722/88.99 GB 4:696/85.71 GB 5:678/84.00 GB 0:680/83.91 GB 1:664/81.95 GB 3:696/85.35 GB 7:632/78.53 GB 9:686/85.17 GB MemoryUsage(16s000ms): 18.76 GB, 25.37 GB, 23.61 GB, 23.67 GB, 24.74 GB, 24.94 GB, 25.16 GB, 25.37 GB, 25.59 GB, 25.50 GB, 25.09 GB, 25.05 GB, 25.09 GB, 25.09 GB, 24.95 GB, 25.60 GB, 24.75 GB, 24.78 GB, 25.25 GB, 25.07 GB, 25.20 GB, 25.15 GB, 25.15 GB, 25.10 GB, 25.13 GB, 24.87 GB, 25.56 GB, 25.36 GB, 25.41 GB, 25.31 GB, 24.64 GB, 24.05 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 88 - AverageThreadTokens: 95.19 - PeakMemoryUsage: 33.30 GB (35760680960) - PerHostPeakMemUsage: 33.30 GB (35760680960) - PrepareTime: 286.429ms - RowsProduced: 0 - TotalCpuTime: 1h57m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h14m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 552.64ms, non-child: 552.64ms, % non-child: 100.00%) - CodegenTime: 6.584ms - CompileTime: 394.137ms - LoadTime: 156.593ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 24.94us, non-child: 24.94us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m42s, non-child: 8m42s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:666/82.68 GB 6:714/88.11 GB 2:707/87.04 GB 11:746/90.97 GB 8:722/88.99 GB 4:696/85.71 GB 5:678/84.00 GB 0:680/83.91 GB 1:664/81.95 GB 3:696/85.35 GB 7:632/78.53 GB 9:686/85.17 GB BytesRead(16s000ms): 5.22 GB, 17.33 GB, 29.45 GB, 41.47 GB, 53.18 GB, 64.82 GB, 76.32 GB, 87.82 GB, 99.20 GB, 110.32 GB, 121.34 GB, 132.25 GB, 143.11 GB, 154.17 GB, 165.54 GB, 176.81 GB, 188.72 GB, 200.97 GB, 213.37 GB, 225.84 GB, 238.25 GB, 250.54 GB, 262.87 GB, 275.25 GB, 287.62 GB, 300.08 GB, 312.18 GB, 324.36 GB, 336.50 GB, 348.63 GB, 360.58 GB, 372.22 GB - AverageHdfsReadThreadConcurrency: 16.77 - AverageScannerThreadConcurrency: 94.37 - BytesRead: 388.67 GB (417331891317) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.05 GB (1131548672) - PerReadThreadRawHdfsThroughput: 45.21 MB/sec - RowsRead: 1.58B (1582794524) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.12K (3124) - ScannerThreadsInvoluntaryContextSwitches: 25.81K (25809) - ScannerThreadsTotalWallClockTime: 1h57m - DelimiterParseTime: 7m55s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 13s951ms - ScannerThreadsUserTime: 12m8s - ScannerThreadsVoluntaryContextSwitches: 11.23K (11234) - TotalRawHdfsReadTime(*): 2h26m - TotalReadThroughput: 755.57 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475bc (host=slave21:22000):(Total: 8m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:657/80.62 GB 3:678/83.57 GB 8:728/89.81 GB 1:678/83.33 GB 4:646/78.89 GB 10:696/86.53 GB 5:698/85.72 GB 0:698/86.23 GB 2:735/91.35 GB 11:655/80.70 GB 9:721/88.98 GB 7:700/86.75 GB MemoryUsage(16s000ms): 19.60 GB, 24.82 GB, 24.09 GB, 24.53 GB, 24.93 GB, 25.23 GB, 24.87 GB, 25.17 GB, 25.35 GB, 25.35 GB, 25.22 GB, 24.91 GB, 24.87 GB, 25.18 GB, 25.43 GB, 24.86 GB, 24.70 GB, 24.70 GB, 24.84 GB, 24.89 GB, 25.15 GB, 25.15 GB, 24.53 GB, 24.86 GB, 25.15 GB, 25.42 GB, 25.87 GB, 25.24 GB, 25.44 GB, 24.98 GB, 24.24 GB, 23.95 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96 - AverageThreadTokens: 95.88 - PeakMemoryUsage: 32.53 GB (34930737152) - PerHostPeakMemUsage: 32.53 GB (34930737152) - PrepareTime: 218.849ms - RowsProduced: 0 - TotalCpuTime: 17m15s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h19m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 566.190ms, non-child: 566.190ms, % non-child: 100.00%) - CodegenTime: 8.400ms - CompileTime: 412.9ms - LoadTime: 152.801ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 27.651us, non-child: 27.651us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m42s, non-child: 8m42s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:657/80.62 GB 3:678/83.57 GB 8:728/89.81 GB 1:678/83.33 GB 4:646/78.89 GB 10:696/86.53 GB 5:698/85.72 GB 0:698/86.23 GB 2:735/91.35 GB 11:655/80.70 GB 9:721/88.98 GB 7:700/86.75 GB BytesRead(16s000ms): 5.54 GB, 17.64 GB, 29.93 GB, 42.10 GB, 53.83 GB, 65.49 GB, 77.13 GB, 88.86 GB, 100.69 GB, 112.35 GB, 123.85 GB, 135.38 GB, 146.79 GB, 158.12 GB, 169.52 GB, 180.81 GB, 191.99 GB, 202.91 GB, 213.84 GB, 224.88 GB, 236.04 GB, 247.70 GB, 259.49 GB, 271.52 GB, 283.73 GB, 295.92 GB, 308.16 GB, 320.42 GB, 332.56 GB, 344.78 GB, 356.84 GB, 368.95 GB - AverageHdfsReadThreadConcurrency: 18.05 - AverageScannerThreadConcurrency: 94.97 - BytesRead: 385.43 GB (413856205282) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.00 GB (1075154944) - PerReadThreadRawHdfsThroughput: 41.60 MB/sec - RowsRead: 1.57B (1567906198) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.08K (3078) - ScannerThreadsInvoluntaryContextSwitches: 3.84K (3836) - ScannerThreadsTotalWallClockTime: 17m15s - DelimiterParseTime: 7m56s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 2s095ms - ScannerThreadsUserTime: 1m54s - ScannerThreadsVoluntaryContextSwitches: 1.57K (1573) - TotalRawHdfsReadTime(*): 2h38m - TotalReadThroughput: 749.89 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b3 (host=slave04:22000):(Total: 8m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:697/85.67 GB 9:725/89.67 GB 4:692/85.25 GB 1:644/80.12 GB 2:672/83.13 GB 11:708/87.37 GB 7:705/87.04 GB 3:692/85.69 GB 6:708/87.59 GB 10:685/84.26 GB 5:680/83.58 GB 0:675/83.20 GB MemoryUsage(16s000ms): 18.52 GB, 25.02 GB, 23.92 GB, 24.76 GB, 24.87 GB, 24.49 GB, 25.02 GB, 25.38 GB, 25.25 GB, 25.19 GB, 24.68 GB, 24.54 GB, 24.59 GB, 24.89 GB, 24.88 GB, 24.74 GB, 24.66 GB, 24.41 GB, 23.43 GB, 24.49 GB, 24.38 GB, 24.94 GB, 25.55 GB, 25.92 GB, 25.82 GB, 25.22 GB, 25.16 GB, 25.45 GB, 25.34 GB, 24.98 GB, 25.33 GB, 24.68 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 93 - AverageThreadTokens: 95.58 - PeakMemoryUsage: 33.90 GB (36397593600) - PerHostPeakMemUsage: 33.90 GB (36397593600) - PrepareTime: 220.59ms - RowsProduced: 0 - TotalCpuTime: 50m26s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h17m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 561.635ms, non-child: 561.635ms, % non-child: 100.00%) - CodegenTime: 6.513ms - CompileTime: 406.181ms - LoadTime: 154.110ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 28.978us, non-child: 28.978us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m42s, non-child: 8m42s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:697/85.67 GB 9:725/89.67 GB 4:692/85.25 GB 1:644/80.12 GB 2:672/83.13 GB 11:708/87.37 GB 7:705/87.04 GB 3:692/85.69 GB 6:708/87.59 GB 10:685/84.26 GB 5:680/83.58 GB 0:675/83.20 GB BytesRead(16s000ms): 5.19 GB, 17.10 GB, 29.24 GB, 41.15 GB, 52.56 GB, 64.13 GB, 75.59 GB, 86.97 GB, 98.37 GB, 109.69 GB, 120.78 GB, 132.08 GB, 143.31 GB, 154.35 GB, 165.14 GB, 175.73 GB, 186.59 GB, 197.42 GB, 208.99 GB, 220.34 GB, 231.52 GB, 243.54 GB, 255.80 GB, 268.14 GB, 280.44 GB, 292.67 GB, 304.97 GB, 317.29 GB, 329.58 GB, 341.83 GB, 354.10 GB, 366.35 GB - AverageHdfsReadThreadConcurrency: 18.31 - AverageScannerThreadConcurrency: 94.76 - BytesRead: 383.61 GB (411900555046) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.02 GB (1090981888) - PerReadThreadRawHdfsThroughput: 40.84 MB/sec - RowsRead: 1.56B (1560595377) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.08K (3080) - ScannerThreadsInvoluntaryContextSwitches: 13.23K (13228) - ScannerThreadsTotalWallClockTime: 50m26s - DelimiterParseTime: 7m51s - MaterializeTupleTime(*): 1h3m - ScannerThreadsSysTime: 6s723ms - ScannerThreadsUserTime: 5m14s - ScannerThreadsVoluntaryContextSwitches: 6.21K (6206) - TotalRawHdfsReadTime(*): 2h40m - TotalReadThroughput: 745.80 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475c4 (host=slave06:22000):(Total: 8m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:694/85.37 GB 6:673/82.52 GB 1:684/84.40 GB 10:658/81.19 GB 7:698/85.80 GB 4:666/82.30 GB 5:734/90.39 GB 0:694/85.86 GB 2:701/86.50 GB 11:691/85.77 GB 9:697/85.82 GB 3:702/86.47 GB MemoryUsage(16s000ms): 19.60 GB, 25.15 GB, 24.16 GB, 24.17 GB, 24.84 GB, 25.04 GB, 25.03 GB, 25.57 GB, 25.55 GB, 25.35 GB, 25.01 GB, 24.68 GB, 25.06 GB, 25.29 GB, 24.86 GB, 25.10 GB, 24.40 GB, 24.33 GB, 25.64 GB, 24.79 GB, 25.65 GB, 24.75 GB, 25.66 GB, 24.83 GB, 24.74 GB, 25.57 GB, 24.67 GB, 24.60 GB, 25.42 GB, 25.08 GB, 25.35 GB, 24.67 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 89 - AverageThreadTokens: 95.41 - PeakMemoryUsage: 37.16 GB (39896457216) - PerHostPeakMemUsage: 37.16 GB (39896457216) - PrepareTime: 220.899ms - RowsProduced: 0 - TotalCpuTime: 1h40m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h13m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 547.472ms, non-child: 547.472ms, % non-child: 100.00%) - CodegenTime: 8.610ms - CompileTime: 390.587ms - LoadTime: 155.519ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 29.705us, non-child: 29.705us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m41s, non-child: 8m41s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:694/85.37 GB 6:673/82.52 GB 1:684/84.40 GB 10:658/81.19 GB 7:698/85.80 GB 4:666/82.30 GB 5:734/90.39 GB 0:694/85.86 GB 2:701/86.50 GB 11:691/85.77 GB 9:697/85.82 GB 3:702/86.47 GB BytesRead(16s000ms): 5.29 GB, 17.24 GB, 29.30 GB, 41.19 GB, 52.82 GB, 64.37 GB, 75.83 GB, 87.07 GB, 98.25 GB, 109.48 GB, 120.63 GB, 131.59 GB, 142.55 GB, 153.48 GB, 164.52 GB, 175.88 GB, 187.65 GB, 199.53 GB, 211.12 GB, 223.08 GB, 235.38 GB, 247.80 GB, 260.04 GB, 272.32 GB, 284.63 GB, 297.01 GB, 309.44 GB, 321.78 GB, 334.07 GB, 346.15 GB, 358.17 GB, 370.14 GB - AverageHdfsReadThreadConcurrency: 17.18 - AverageScannerThreadConcurrency: 94.50 - BytesRead: 386.07 GB (414543836129) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1018.21 MB (1067675648) - PerReadThreadRawHdfsThroughput: 43.91 MB/sec - RowsRead: 1.57B (1572200293) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.10K (3099) - ScannerThreadsInvoluntaryContextSwitches: 22.36K (22357) - ScannerThreadsTotalWallClockTime: 1h40m - DelimiterParseTime: 7m59s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 13s649ms - ScannerThreadsUserTime: 11m18s - ScannerThreadsVoluntaryContextSwitches: 11.92K (11923) - TotalRawHdfsReadTime(*): 2h30m - TotalReadThroughput: 752.09 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b5 (host=slave07:22000):(Total: 8m42s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:708/87.63 GB 6:676/83.45 GB 9:670/83.24 GB 7:679/83.83 GB 3:717/88.77 GB 1:686/84.83 GB 10:686/84.11 GB 8:708/87.52 GB 2:690/84.76 GB 11:673/83.27 GB 5:699/86.85 GB 0:685/84.14 GB MemoryUsage(16s000ms): 19.20 GB, 24.13 GB, 24.34 GB, 24.46 GB, 24.48 GB, 25.24 GB, 25.47 GB, 25.19 GB, 25.64 GB, 25.29 GB, 24.16 GB, 24.70 GB, 24.78 GB, 24.98 GB, 24.54 GB, 24.37 GB, 24.59 GB, 24.56 GB, 24.42 GB, 24.94 GB, 25.49 GB, 25.42 GB, 25.20 GB, 25.35 GB, 24.57 GB, 24.92 GB, 24.15 GB, 24.51 GB, 24.77 GB, 25.37 GB, 24.97 GB, 23.82 GB ThreadUsage(16s000ms): 90, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 88 - AverageThreadTokens: 95.23 - PeakMemoryUsage: 35.85 GB (38496026624) - PerHostPeakMemUsage: 35.85 GB (38496026624) - PrepareTime: 276.905ms - RowsProduced: 0 - TotalCpuTime: 1h57m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h12m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 561.197ms, non-child: 561.197ms, % non-child: 100.00%) - CodegenTime: 6.714ms - CompileTime: 402.83ms - LoadTime: 157.603ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 30.343us, non-child: 30.343us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m41s, non-child: 8m41s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:708/87.63 GB 6:676/83.45 GB 9:670/83.24 GB 7:679/83.83 GB 3:717/88.77 GB 1:686/84.83 GB 10:686/84.11 GB 8:708/87.52 GB 2:690/84.76 GB 11:673/83.27 GB 5:699/86.85 GB 0:685/84.14 GB BytesRead(16s000ms): 5.26 GB, 17.20 GB, 29.25 GB, 41.22 GB, 52.86 GB, 64.19 GB, 75.61 GB, 87.12 GB, 98.46 GB, 109.80 GB, 121.13 GB, 132.16 GB, 143.21 GB, 154.01 GB, 165.15 GB, 176.97 GB, 188.99 GB, 201.21 GB, 213.53 GB, 225.90 GB, 238.26 GB, 250.62 GB, 262.87 GB, 275.21 GB, 287.55 GB, 299.85 GB, 312.22 GB, 324.48 GB, 336.65 GB, 348.81 GB, 361.07 GB, 373.10 GB - AverageHdfsReadThreadConcurrency: 17.11 - AverageScannerThreadConcurrency: 94.41 - BytesRead: 389.31 GB (418016657501) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.01 GB (1084084224) - PerReadThreadRawHdfsThroughput: 44.36 MB/sec - RowsRead: 1.59B (1587676832) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.12K (3124) - ScannerThreadsInvoluntaryContextSwitches: 28.04K (28035) - ScannerThreadsTotalWallClockTime: 1h57m - DelimiterParseTime: 8m1s - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 17s291ms - ScannerThreadsUserTime: 13m48s - ScannerThreadsVoluntaryContextSwitches: 12.10K (12097) - TotalRawHdfsReadTime(*): 2h29m - TotalReadThroughput: 758.12 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b2 (host=slave10:22000):(Total: 8m41s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:698/85.96 GB 3:699/85.88 GB 1:701/86.58 GB 9:698/85.67 GB 8:693/85.43 GB 2:665/82.42 GB 11:683/84.33 GB 7:673/82.30 GB 10:665/82.01 GB 0:709/87.34 GB 5:694/85.48 GB 4:722/89.14 GB MemoryUsage(16s000ms): 19.10 GB, 24.97 GB, 24.37 GB, 24.31 GB, 25.05 GB, 24.99 GB, 25.19 GB, 25.60 GB, 25.18 GB, 24.99 GB, 24.10 GB, 25.02 GB, 24.80 GB, 25.31 GB, 25.02 GB, 24.97 GB, 24.66 GB, 24.36 GB, 24.43 GB, 24.35 GB, 25.22 GB, 24.99 GB, 25.21 GB, 25.38 GB, 24.67 GB, 24.82 GB, 25.36 GB, 25.05 GB, 24.67 GB, 24.76 GB, 24.56 GB, 23.57 GB ThreadUsage(16s000ms): 92, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 88 - AverageThreadTokens: 95.40 - PeakMemoryUsage: 34.81 GB (37380035584) - PerHostPeakMemUsage: 34.81 GB (37380035584) - PrepareTime: 212.555ms - RowsProduced: 1 - TotalCpuTime: 1h40m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 370ns - TotalStorageWaitTime: 12h14m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 586.185ms, non-child: 586.185ms, % non-child: 100.00%) - CodegenTime: 6.612ms - CompileTime: 432.687ms - LoadTime: 152.167ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 125.803us, non-child: 125.803us, % non-child: 100.00%) - BytesSent: 163.00 B (163) - NetworkThroughput(*): 521.73 KB/sec - OverallThroughput: 1.24 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 48.86us - ThriftTransmitTime(*): 305.100us - UncompressedRowBatchSize: 280.00 B (280) HDFS_SCAN_NODE (id=0):(Total: 8m41s, non-child: 8m41s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:698/85.96 GB 3:699/85.88 GB 1:701/86.58 GB 9:698/85.67 GB 8:693/85.43 GB 2:665/82.42 GB 11:683/84.33 GB 7:673/82.30 GB 10:665/82.01 GB 0:709/87.34 GB 5:694/85.48 GB 4:722/89.14 GB BytesRead(16s000ms): 5.23 GB, 17.06 GB, 29.05 GB, 40.99 GB, 52.58 GB, 64.21 GB, 75.73 GB, 87.02 GB, 98.33 GB, 109.50 GB, 120.78 GB, 131.63 GB, 142.52 GB, 153.38 GB, 164.51 GB, 176.17 GB, 188.39 GB, 200.74 GB, 213.06 GB, 225.44 GB, 237.68 GB, 249.86 GB, 262.06 GB, 274.25 GB, 286.41 GB, 298.55 GB, 310.64 GB, 322.73 GB, 334.87 GB, 346.99 GB, 359.06 GB, 371.12 GB - AverageHdfsReadThreadConcurrency: 15.54 - AverageScannerThreadConcurrency: 94.49 - BytesRead: 387.27 GB (415824648558) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1023.36 MB (1073074176) - PerReadThreadRawHdfsThroughput: 48.56 MB/sec - RowsRead: 1.58B (1577244032) - RowsReturned: 1 - RowsReturnedRate: 0 - ScanRangesComplete: 3.11K (3112) - ScannerThreadsInvoluntaryContextSwitches: 19.23K (19231) - ScannerThreadsTotalWallClockTime: 1h40m - DelimiterParseTime: 7m54s - MaterializeTupleTime(*): 1h3m - ScannerThreadsSysTime: 12s014ms - ScannerThreadsUserTime: 10m19s - ScannerThreadsVoluntaryContextSwitches: 9.00K (9001) - TotalRawHdfsReadTime(*): 2h16m - TotalReadThroughput: 754.56 MB/sec Instance e241c4b5fd96d258:d273fb15ab2475b0 (host=slave03:22000):(Total: 8m41s, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:697/86.06 GB 9:694/85.18 GB 1:671/82.74 GB 8:699/86.53 GB 4:673/83.38 GB 11:668/82.38 GB 2:680/83.94 GB 10:685/84.68 GB 6:660/81.60 GB 5:770/94.81 GB 0:695/85.78 GB 7:699/85.48 GB MemoryUsage(16s000ms): 19.13 GB, 25.84 GB, 23.11 GB, 25.10 GB, 25.05 GB, 24.70 GB, 24.85 GB, 25.53 GB, 25.61 GB, 25.74 GB, 24.54 GB, 25.08 GB, 25.15 GB, 25.10 GB, 25.26 GB, 25.32 GB, 25.36 GB, 24.69 GB, 24.33 GB, 23.77 GB, 24.48 GB, 25.33 GB, 25.25 GB, 24.77 GB, 25.31 GB, 25.87 GB, 25.56 GB, 25.34 GB, 25.07 GB, 24.50 GB, 24.66 GB, 23.83 GB ThreadUsage(16s000ms): 93, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 96, 95 - AverageThreadTokens: 95.86 - PeakMemoryUsage: 33.79 GB (36280000512) - PerHostPeakMemUsage: 33.79 GB (36280000512) - PrepareTime: 219.51ms - RowsProduced: 0 - TotalCpuTime: 17m3s - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 12h15m BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 86.40 GB (92771295232) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 559.278ms, non-child: 559.278ms, % non-child: 100.00%) - CodegenTime: 6.699ms - CompileTime: 403.281ms - LoadTime: 154.598ms - ModuleFileSize: 1.94 MB (2032752) DataStreamSender (dst_id=1):(Total: 25.798us, non-child: 25.798us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0):(Total: 8m41s, non-child: 8m41s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:697/86.06 GB 9:694/85.18 GB 1:671/82.74 GB 8:699/86.53 GB 4:673/83.38 GB 11:668/82.38 GB 2:680/83.94 GB 10:685/84.68 GB 6:660/81.60 GB 5:770/94.81 GB 0:695/85.78 GB 7:699/85.48 GB BytesRead(16s000ms): 5.49 GB, 17.62 GB, 29.89 GB, 41.92 GB, 53.79 GB, 65.66 GB, 77.40 GB, 88.90 GB, 100.38 GB, 111.60 GB, 123.08 GB, 133.84 GB, 144.58 GB, 155.47 GB, 166.19 GB, 176.71 GB, 187.58 GB, 198.81 GB, 210.62 GB, 222.81 GB, 234.99 GB, 247.12 GB, 259.46 GB, 271.82 GB, 284.13 GB, 296.52 GB, 308.92 GB, 321.22 GB, 333.54 GB, 345.86 GB, 358.04 GB, 370.28 GB - AverageHdfsReadThreadConcurrency: 17.84 - AverageScannerThreadConcurrency: 94.95 - BytesRead: 386.25 GB (414732711728) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 95 - PeakMemoryUsage: 1.00 GB (1075048448) - PerReadThreadRawHdfsThroughput: 42.30 MB/sec - RowsRead: 1.57B (1573001334) - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3.09K (3093) - ScannerThreadsInvoluntaryContextSwitches: 5.67K (5669) - ScannerThreadsTotalWallClockTime: 17m3s - DelimiterParseTime: 8m - MaterializeTupleTime(*): 1h4m - ScannerThreadsSysTime: 3s565ms - ScannerThreadsUserTime: 2m17s - ScannerThreadsVoluntaryContextSwitches: 2.35K (2350) - TotalRawHdfsReadTime(*): 2h35m - TotalReadThroughput: 752.99 MB/sec