Query (id=614d319e839e4194:b77d548d516ca6ac): Summary: Session ID: a0432f0879fbdee5:8e020a1ac459b99f Session Type: BEESWAX Start Time: 2016-12-30 09:30:08.213995000 End Time: 2016-12-30 09:30:19.784330000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.6.0-cdh5.8.3 RELEASE (build c644f476b774db9db87a619628f7a6ecc5f843e0) User: dejanp Connected User: dejanp Delegated User: Network Address: 88.150.218.17:54802 Default Db: dejanp Sql Statement: with battles AS ( SELECT * FROM event e, (SELECT MAX(CASE WHEN key='won' THEN value END) AS won FROM e.event_map) m WHERE e.date_id = 2420 AND e.event_id = 10012 and user_id % 10 = 0 ) SELECT won, count(*) FROM battles GROUP BY won Coordinator: datanode-02.zamboni.test.hadoop.bol.nordeus.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=882.00MB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. dejanp.event 09:EXCHANGE [UNPARTITIONED] | hosts=3 per-host-mem=unavailable | tuple-ids=5 row-size=24B cardinality=26485020 | 08:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: won | hosts=3 per-host-mem=128.00MB | tuple-ids=5 row-size=24B cardinality=26485020 | 07:EXCHANGE [HASH(won)] | hosts=3 per-host-mem=0B | tuple-ids=5 row-size=24B cardinality=26485020 | 06:AGGREGATE [STREAMING] | output: count(*) | group by: max(CASE WHEN key = 'won' THEN value END) | hosts=3 per-host-mem=128.00MB | tuple-ids=5 row-size=24B cardinality=26485020 | 01:SUBPLAN | hosts=3 per-host-mem=0B | tuple-ids=2,0 row-size=44B cardinality=26485020 | |--05:NESTED LOOP JOIN [CROSS JOIN] | | hosts=3 per-host-mem=28B | | tuple-ids=2,0 row-size=44B cardinality=1 | | | |--02:SINGULAR ROW SRC | | parent-subplan=01 | | hosts=3 per-host-mem=0B | | tuple-ids=0 row-size=28B cardinality=1 | | | 04:AGGREGATE [FINALIZE] | | output: max(CASE WHEN key = 'won' THEN value END) | | hosts=3 per-host-mem=10.00MB | | tuple-ids=2 row-size=16B cardinality=1 | | | 03:UNNEST [e.event_map] | parent-subplan=01 | hosts=3 per-host-mem=0B | tuple-ids=1 row-size=0B cardinality=10 | 00:SCAN HDFS [dejanp.event e, RANDOM] partitions=1/1 files=64 size=18.76GB predicates: e.event_id = 10012, user_id % 10 = 0 table stats: unavailable columns missing stats: event_map, user_id, event_id, event_type_id, ts_bigint, processed_ts_bigint, server_id hosts=3 per-host-mem=616.00MB tuple-ids=0 row-size=28B cardinality=26485020 ---------------- Estimated Per-Host Mem: 924844060 Estimated Per-Host VCores: 2 Tables Missing Stats: dejanp.event Request Pool: root.dejanp ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------- 09:EXCHANGE 1 10.960us 10.960us 1 26.49M 0 -1.00 B UNPARTITIONED 08:AGGREGATE 3 174.256ms 190.494ms 1 26.49M 2.29 MB 128.00 MB FINALIZE 07:EXCHANGE 3 12.130us 27.432us 3 26.49M 0 0 HASH(won) 06:AGGREGATE 3 7s768ms 7s916ms 3 26.49M 28.36 MB 128.00 MB STREAMING 01:SUBPLAN 3 271.275ms 280.126ms 0 26.49M 22.11 MB 0 |--05:NESTED LOOP JOIN 3 814.474ms 847.829ms 0 1 1.02 MB 28.00 B CROSS JOIN | |--02:SINGULAR ROW SRC 3 0.000ns 0.000ns 0 1 0 0 | 04:AGGREGATE 3 1s574ms 1s600ms 0 1 2.02 MB 10.00 MB FINALIZE | 03:UNNEST 3 160.025ms 163.923ms 0 10 0 0 e.event_map 00:SCAN HDFS 3 551.087ms 697.184ms 2.01M 26.49M 1.93 GB 616.00 MB dejanp.event e Planner Timeline: 8.409ms - Analysis finished: 4.483ms (4.483ms) - Equivalence classes computed: 4.695ms (212.474us) - Single node plan created: 6.426ms (1.730ms) - Runtime filters computed: 6.434ms (7.679us) - Distributed plan created: 7.161ms (727.193us) - Lineage info computed: 7.352ms (191.681us) - Planning finished: 8.409ms (1.056ms) Query Timeline: 11s581ms - Start execution: 252.168us (252.168us) - Planning finished: 10.864ms (10.611ms) - Ready to start 6 remote fragments: 15.027ms (4.163ms) - All 6 remote fragments started: 17.966ms (2.939ms) - Rows available: 11s377ms (11s359ms) - First row fetched: 11s567ms (190.587ms) - Unregister query: 11s570ms (2.572ms) ImpalaServer: - ClientFetchWaitTimer: 191.806ms - RowMaterializationTimer: 34.580us Execution Profile 614d319e839e4194:b77d548d516ca6ac:(Total: 11s365ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 6, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: datanode-03.zamboni.test.hadoop.bol.nordeus.com:22000(1.94 GB) datanode-01.zamboni.test.hadoop.bol.nordeus.com:22000(1.80 GB) datanode-02.zamboni.test.hadoop.bol.nordeus.com:22000(1.39 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F02:(Total: 11s359ms, non-child: 1.305ms, % non-child: 0.01%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.01 KB (12296) - PerHostPeakMemUsage: 0 - PrepareTime: 218.184us - RowsProduced: 1 (1) - TotalCpuTime: 196.457ms - TotalNetworkReceiveTime: 11s358ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 48.00 GB (51539607552) - PeakMemoryUsage: 512.00 KB (524288) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=9):(Total: 11s358ms, non-child: 10.960us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 37.00 B (37) - ConvertRowBatchTime: 1.500us - DeserializeRowBatchTimer: 5.636us - FirstBatchArrivalWaitTime: 11s358ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 11s280ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:11s360ms max:11s362ms mean: 11s361ms stddev:906.402us execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.29 MB (2405509) - PerHostPeakMemUsage: 1.71 GB (1834473672) - PrepareTime: 173.635ms - RowsProduced: 0 (0) - TotalCpuTime: 255.005ms - TotalNetworkReceiveTime: 11s105ms - TotalNetworkSendTime: 110.757us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 48.00 GB (51539607552) - PeakMemoryUsage: 512.00 KB (524288) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 252.232ms, non-child: 252.232ms, % non-child: 100.00%) - CodegenTime: 791.953us - CompileTime: 16.474ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 42 (42) - NumInstructions: 852 (852) - OptimizationTime: 63.168ms - PrepareTime: 172.127ms DataStreamSender (dst_id=9):(Total: 33.442us, non-child: 33.442us, % non-child: 100.00%) - BytesSent: 12.00 B (12) - NetworkThroughput(*): 315.33 KB/sec - OverallThroughput: 153.19 KB/sec - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - SerializeBatchTime: 10.410us - TransmitDataRPCTime: 12.732us - UncompressedRowBatchSize: 14.00 B (14) AGGREGATION_NODE (id=8):(Total: 11s279ms, non-child: 174.256ms, % non-child: 1.54%) - BuildTime: 8.276us - GetNewBlockTime: 79.732us - GetResultsTime: 426.000ns - HTResizeTime: 2.830us - HashBuckets: 341 (341) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.28 MB (2393216) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 492.000ns EXCHANGE_NODE (id=7):(Total: 11s105ms, non-child: 11s105ms, % non-child: 100.00%) - BytesReceived: 37.00 B (37) - ConvertRowBatchTime: 1.681us - DeserializeRowBatchTimer: 81.926us - FirstBatchArrivalWaitTime: 11s021ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 11s141ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 6.21 GB, max: 6.29 GB, avg: 6.25 GB, stddev: 34.29 MB completion times: min:11s108ms max:11s359ms mean: 11s234ms stddev:102.499ms execution rates: min:563.94 MB/sec max:573.48 MB/sec mean:569.96 MB/sec stddev:4.28 MB/sec num instances: 3 - AverageThreadTokens: 18.66 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.71 GB (1832077725) - PerHostPeakMemUsage: 1.71 GB (1834473672) - PrepareTime: 213.737ms - RowsProduced: 1 (1) - TotalCpuTime: 3m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 325.936us - TotalStorageWaitTime: 2s350ms CodeGen:(Total: 272.042ms, non-child: 272.042ms, % non-child: 100.00%) - CodegenTime: 62.776ms - CompileTime: 19.759ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 60 (60) - NumInstructions: 1.23K (1230) - OptimizationTime: 71.283ms - PrepareTime: 180.504ms DataStreamSender (dst_id=7):(Total: 62.297us, non-child: 62.297us, % non-child: 100.00%) - BytesSent: 37.00 B (37) - NetworkThroughput(*): 1.48 MB/sec - OverallThroughput: 608.09 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 18.404us - TransmitDataRPCTime: 28.106us - UncompressedRowBatchSize: 44.00 B (44) AGGREGATION_NODE (id=6):(Total: 11s140ms, non-child: 7s768ms, % non-child: 69.73%) - GetNewBlockTime: 37.649us - GetResultsTime: 2.322us - HTResizeTime: 0.000ns - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.17 MB (27436080) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - StreamingTime: 7s566ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 3s371ms, non-child: 271.275ms, % non-child: 8.05%) - PeakMemoryUsage: 21.68 MB (22730325) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=5):(Total: 2s549ms, non-child: 814.474ms, % non-child: 31.95%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 1.02 MB (1064960) - ProbeRows: 668.71K (668710) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=4):(Total: 1s734ms, non-child: 1s574ms, % non-child: 90.78%) - BuildTime: 426.247ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.02 MB (2113536) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) UNNEST_NODE (id=3):(Total: 160.025ms, non-child: 160.025ms, % non-child: 100.00%) - AvgCollectionSize: 3.00 - MaxCollectionSize: 3 (3) - MinCollectionSize: 3 (3) - NumCollections: 668.71K (668710) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 551.087ms, non-child: 551.087ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 18.15 - BytesRead: 5.71 GB (6129236940) - BytesReadDataNodeCache: 0 - BytesReadLocal: 5.71 GB (6129236940) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5.71 GB (6129236940) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 63 (63) - NumScannerThreadsStarted: 20 (20) - PeakMemoryUsage: 1.69 GB (1818868338) - PerReadThreadRawHdfsThroughput: 2.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 575.34M (575340108) - RowsReturned: 668.71K (668710) - RowsReturnedRate: 1.28 M/sec - ScanRangesComplete: 63 (63) - ScannerThreadsInvoluntaryContextSwitches: 12.76K (12756) - ScannerThreadsTotalWallClockTime: 3m18s - MaterializeTupleTime(*): 3m14s - ScannerThreadsSysTime: 15s961ms - ScannerThreadsUserTime: 1m31s - ScannerThreadsVoluntaryContextSwitches: 449.53K (449529) - TotalRawHdfsReadTime(*): 2s148ms - TotalReadThroughput: 530.10 MB/sec Fragment F01: Instance 614d319e839e4194:b77d548d516ca6b0 (host=datanode-03.zamboni.test.hadoop.bol.nordeus.com:22000):(Total: 11s281ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.30 MB (2413712) - PerHostPeakMemUsage: 1.94 GB (2084136040) - PrepareTime: 153.260ms - RowsProduced: 1 (1) - TotalCpuTime: 234.731ms - TotalNetworkReceiveTime: 11s126ms - TotalNetworkSendTime: 331.708us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 48.00 GB (51539607552) - PeakMemoryUsage: 512.00 KB (524288) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 232.169ms, non-child: 232.169ms, % non-child: 100.00%) - CodegenTime: 743.532us - CompileTime: 16.829ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 42 (42) - NumInstructions: 852 (852) - OptimizationTime: 63.033ms - PrepareTime: 151.866ms DataStreamSender (dst_id=9):(Total: 78.624us, non-child: 78.624us, % non-child: 100.00%) - BytesSent: 37.00 B (37) - NetworkThroughput(*): 945.98 KB/sec - OverallThroughput: 459.56 KB/sec - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 1 (1) - SerializeBatchTime: 31.232us - TransmitDataRPCTime: 38.196us - UncompressedRowBatchSize: 44.00 B (44) AGGREGATION_NODE (id=8):(Total: 11s280ms, non-child: 153.889ms, % non-child: 1.36%) ExecOption: Codegen Enabled - BuildTime: 13.340us - GetNewBlockTime: 68.608us - GetResultsTime: 1.280us - HTResizeTime: 2.684us - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 33 (33) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.29 MB (2401408) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 472.000ns EXCHANGE_NODE (id=7):(Total: 11s126ms, non-child: 27.432us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 111.00 B (111) - ConvertRowBatchTime: 4.032us - DeserializeRowBatchTimer: 245.780us - FirstBatchArrivalWaitTime: 10s874ms - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 614d319e839e4194:b77d548d516ca6af (host=datanode-02.zamboni.test.hadoop.bol.nordeus.com:22000):(Total: 11s280ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.29 MB (2401408) - PerHostPeakMemUsage: 1.39 GB (1490805608) - PrepareTime: 177.810ms - RowsProduced: 0 (0) - TotalCpuTime: 258.822ms - TotalNetworkReceiveTime: 11s101ms - TotalNetworkSendTime: 368.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 256.079ms, non-child: 256.079ms, % non-child: 100.00%) - CodegenTime: 759.840us - CompileTime: 16.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 42 (42) - NumInstructions: 852 (852) - OptimizationTime: 63.311ms - PrepareTime: 176.315ms DataStreamSender (dst_id=9):(Total: 8.208us, non-child: 8.208us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=8):(Total: 11s280ms, non-child: 178.385ms, % non-child: 1.58%) ExecOption: Codegen Enabled - BuildTime: 6.512us - GetNewBlockTime: 73.828us - GetResultsTime: 0.000ns - HTResizeTime: 3.124us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.28 MB (2389120) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 512.000ns EXCHANGE_NODE (id=7):(Total: 11s101ms, non-child: 4.940us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 636.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 11s101ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 614d319e839e4194:b77d548d516ca6ae (host=datanode-01.zamboni.test.hadoop.bol.nordeus.com:22000):(Total: 11s279ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.29 MB (2401408) - PerHostPeakMemUsage: 1.80 GB (1928479368) - PrepareTime: 189.835ms - RowsProduced: 0 (0) - TotalCpuTime: 271.463ms - TotalNetworkReceiveTime: 11s088ms - TotalNetworkSendTime: 196.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 48.00 GB (51539607552) - PeakMemoryUsage: 512.00 KB (524288) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 268.449ms, non-child: 268.449ms, % non-child: 100.00%) - CodegenTime: 872.488us - CompileTime: 16.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 42 (42) - NumInstructions: 852 (852) - OptimizationTime: 63.159ms - PrepareTime: 188.199ms DataStreamSender (dst_id=9):(Total: 13.496us, non-child: 13.496us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=8):(Total: 11s278ms, non-child: 190.494ms, % non-child: 1.69%) ExecOption: Codegen Enabled - BuildTime: 4.976us - GetNewBlockTime: 96.760us - GetResultsTime: 0.000ns - HTResizeTime: 2.684us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.28 MB (2389120) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 492.000ns EXCHANGE_NODE (id=7):(Total: 11s088ms, non-child: 4.019us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 376.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 11s088ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance 614d319e839e4194:b77d548d516ca6b1 (host=datanode-01.zamboni.test.hadoop.bol.nordeus.com:22000):(Total: 11s263ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:30/2.78 GB 1:34/3.47 GB MemoryUsage(500.000ms): 0, 1.07 GB, 1.70 GB, 1.74 GB, 1.71 GB, 1.74 GB, 1.67 GB, 1.68 GB, 1.54 GB, 1.33 GB, 1.26 GB, 1.57 GB, 1.43 GB, 1.50 GB, 1.56 GB, 1.70 GB, 1.63 GB, 1.54 GB, 1.47 GB, 1.39 GB, 1.24 GB, 679.44 MB, 193.81 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 22, 21, 21, 21, 21, 21, 21, 21, 21, 21, 21, 17, 16, 8, 5 - AverageThreadTokens: 19.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.79 GB (1926086152) - PerHostPeakMemUsage: 1.80 GB (1928479368) - PrepareTime: 227.025ms - RowsProduced: 1 (1) - TotalCpuTime: 3m40s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 316.840us - TotalStorageWaitTime: 3s160ms CodeGen:(Total: 279.511ms, non-child: 279.511ms, % non-child: 100.00%) - CodegenTime: 81.901ms - CompileTime: 21.443ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 60 (60) - NumInstructions: 1.23K (1230) - OptimizationTime: 73.382ms - PrepareTime: 184.166ms DataStreamSender (dst_id=7):(Total: 66.120us, non-child: 66.120us, % non-child: 100.00%) - BytesSent: 37.00 B (37) - NetworkThroughput(*): 838.81 KB/sec - OverallThroughput: 546.47 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.416us - TransmitDataRPCTime: 43.076us - UncompressedRowBatchSize: 44.00 B (44) AGGREGATION_NODE (id=6):(Total: 11s261ms, non-child: 7s829ms, % non-child: 69.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 47.796us - GetResultsTime: 1.920us - HTResizeTime: 0.000ns - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 28.36 MB (29742208) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - StreamingTime: 7s622ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 3s432ms, non-child: 267.353ms, % non-child: 7.79%) - PeakMemoryUsage: 21.51 MB (22554528) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=5):(Total: 2s592ms, non-child: 847.829ms, % non-child: 32.70%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 1.02 MB (1064960) - ProbeRows: 690.19K (690192) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=4):(Total: 1s745ms, non-child: 1s583ms, % non-child: 90.75%) ExecOption: Codegen Disabled: Could not codegen PartitionedAggregationNode::UpdateTuple because intermediate type STRING is not yet supported for aggregate function "max()" - BuildTime: 427.043ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.02 MB (2113536) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) UNNEST_NODE (id=3):(Total: 161.336ms, non-child: 161.336ms, % non-child: 100.00%) - AvgCollectionSize: 3.00 - MaxCollectionSize: 3 (3) - MinCollectionSize: 3 (3) - NumCollections: 690.19K (690192) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 572.392ms, non-child: 572.392ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 64 Hdfs split stats (:<# splits>/): 0:30/2.78 GB 1:34/3.47 GB Hdfs Read Thread Concurrency Bucket: 0:95.45% 1:4.545% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/NONE:256 BytesRead(500.000ms): 780.06 MB, 1.09 GB, 1.37 GB, 1.57 GB, 1.83 GB, 2.02 GB, 2.29 GB, 2.44 GB, 2.51 GB, 2.85 GB, 3.39 GB, 3.50 GB, 3.80 GB, 4.13 GB, 4.50 GB, 4.69 GB, 4.86 GB, 5.04 GB, 5.35 GB, 5.50 GB, 5.57 GB, 5.70 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 19.27 - BytesRead: 5.71 GB (6128410298) - BytesReadDataNodeCache: 0 - BytesReadLocal: 5.71 GB (6128410298) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5.71 GB (6128410298) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1.78 GB (1912752520) - PerReadThreadRawHdfsThroughput: 2.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 575.76M (575763234) - RowsReturned: 690.19K (690192) - RowsReturnedRate: 1.21 M/sec - ScanRangesComplete: 64 (64) - ScannerThreadsInvoluntaryContextSwitches: 12.86K (12857) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 3m27s - ScannerThreadsSysTime: 15s985ms - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 438.23K (438232) - TotalRawHdfsReadTime(*): 2s352ms - TotalReadThroughput: 530.93 MB/sec Instance 614d319e839e4194:b77d548d516ca6b2 (host=datanode-02.zamboni.test.hadoop.bol.nordeus.com:22000):(Total: 11s143ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:37/3.52 GB 1:26/2.77 GB MemoryUsage(500.000ms): 1.31 MB, 1004.08 MB, 1.03 GB, 1.29 GB, 1.30 GB, 1.24 GB, 1.04 GB, 1.31 GB, 1.10 GB, 1.31 GB, 1.26 GB, 1.33 GB, 1.20 GB, 1.30 GB, 1.28 GB, 1.34 GB, 1.30 GB, 1.22 GB, 1.10 GB, 937.84 MB, 417.22 MB, 265.78 MB ThreadUsage(500.000ms): 1, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 12, 10, 7 - AverageThreadTokens: 14.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.39 GB (1488404200) - PerHostPeakMemUsage: 1.39 GB (1490805608) - PrepareTime: 204.661ms - RowsProduced: 1 (1) - TotalCpuTime: 2m41s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 509.500us - TotalStorageWaitTime: 1s390ms CodeGen:(Total: 265.127ms, non-child: 265.127ms, % non-child: 100.00%) - CodegenTime: 55.526ms - CompileTime: 19.330ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 60 (60) - NumInstructions: 1.23K (1230) - OptimizationTime: 70.306ms - PrepareTime: 175.016ms DataStreamSender (dst_id=7):(Total: 75.596us, non-child: 75.596us, % non-child: 100.00%) - BytesSent: 37.00 B (37) - NetworkThroughput(*): 2.26 MB/sec - OverallThroughput: 477.97 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 39.160us - TransmitDataRPCTime: 15.632us - UncompressedRowBatchSize: 44.00 B (44) AGGREGATION_NODE (id=6):(Total: 11s142ms, non-child: 7s560ms, % non-child: 67.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 34.804us - GetResultsTime: 1.828us - HTResizeTime: 0.000ns - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.06 MB (27321472) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - StreamingTime: 7s365ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 3s581ms, non-child: 280.126ms, % non-child: 7.82%) - PeakMemoryUsage: 21.42 MB (22457424) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=5):(Total: 2s604ms, non-child: 840.136ms, % non-child: 32.26%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 1.02 MB (1064960) - ProbeRows: 673.92K (673921) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=4):(Total: 1s764ms, non-child: 1s600ms, % non-child: 90.71%) ExecOption: Codegen Disabled: Could not codegen PartitionedAggregationNode::UpdateTuple because intermediate type STRING is not yet supported for aggregate function "max()" - BuildTime: 446.204ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.02 MB (2113536) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) UNNEST_NODE (id=3):(Total: 163.923ms, non-child: 163.923ms, % non-child: 100.00%) - AvgCollectionSize: 3.00 - MaxCollectionSize: 3 (3) - MinCollectionSize: 3 (3) - NumCollections: 673.92K (673921) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 697.184ms, non-child: 697.184ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 63 Hdfs split stats (:<# splits>/): 0:37/3.52 GB 1:26/2.77 GB Hdfs Read Thread Concurrency Bucket: 0:95.24% 1:4.762% 2:0% 3:0% 4:0% 5:0% 6:0% File Formats: PARQUET/NONE:252 BytesRead(500.000ms): 0, 733.95 MB, 909.95 MB, 1.22 GB, 1.43 GB, 1.66 GB, 1.74 GB, 2.36 GB, 2.43 GB, 2.88 GB, 3.06 GB, 3.40 GB, 3.52 GB, 3.98 GB, 4.18 GB, 4.52 GB, 4.69 GB, 4.96 GB, 5.20 GB, 5.41 GB, 5.56 GB, 5.70 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 14.10 - BytesRead: 5.74 GB (6163531421) - BytesReadDataNodeCache: 0 - BytesReadLocal: 5.74 GB (6163531421) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5.74 GB (6163531421) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 62 (62) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 1.37 GB (1475070568) - PerReadThreadRawHdfsThroughput: 2.82 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 577.67M (577667760) - RowsReturned: 673.92K (673921) - RowsReturnedRate: 966.63 K/sec - ScanRangesComplete: 63 (63) - ScannerThreadsInvoluntaryContextSwitches: 8.58K (8582) - ScannerThreadsTotalWallClockTime: 2m31s - MaterializeTupleTime(*): 2m28s - ScannerThreadsSysTime: 15s873ms - ScannerThreadsUserTime: 1m32s - ScannerThreadsVoluntaryContextSwitches: 463.22K (463219) - TotalRawHdfsReadTime(*): 2s033ms - TotalReadThroughput: 530.92 MB/sec Instance 614d319e839e4194:b77d548d516ca6b3 (host=datanode-03.zamboni.test.hadoop.bol.nordeus.com:22000):(Total: 11s018ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:26/2.65 GB 0:38/3.56 GB MemoryUsage(500.000ms): 823.27 MB, 1.80 GB, 1.74 GB, 1.85 GB, 1.81 GB, 1.84 GB, 1.80 GB, 1.77 GB, 1.56 GB, 1.45 GB, 1.84 GB, 1.75 GB, 1.68 GB, 1.89 GB, 1.82 GB, 1.89 GB, 1.86 GB, 1.73 GB, 1.55 GB, 1.37 GB, 747.82 MB, 100.10 MB ThreadUsage(500.000ms): 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 16, 12, 4 - AverageThreadTokens: 22.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.94 GB (2081742824) - PerHostPeakMemUsage: 1.94 GB (2084136040) - PrepareTime: 209.524ms - RowsProduced: 1 (1) - TotalCpuTime: 3m58s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 151.468us - TotalStorageWaitTime: 2s500ms CodeGen:(Total: 271.488ms, non-child: 271.488ms, % non-child: 100.00%) - CodegenTime: 50.901ms - CompileTime: 18.504ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.15 MB (2254656) - NumFunctions: 60 (60) - NumInstructions: 1.23K (1230) - OptimizationTime: 70.160ms - PrepareTime: 182.329ms DataStreamSender (dst_id=7):(Total: 45.176us, non-child: 45.176us, % non-child: 100.00%) - BytesSent: 37.00 B (37) - NetworkThroughput(*): 1.38 MB/sec - OverallThroughput: 799.82 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 5.636us - TransmitDataRPCTime: 25.612us - UncompressedRowBatchSize: 44.00 B (44) AGGREGATION_NODE (id=6):(Total: 11s017ms, non-child: 7s916ms, % non-child: 71.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 30.348us - GetResultsTime: 3.220us - HTResizeTime: 0.000ns - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 24.08 MB (25244560) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - StreamingTime: 7s713ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 3s100ms, non-child: 266.346ms, % non-child: 8.59%) - PeakMemoryUsage: 22.11 MB (23179024) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=5):(Total: 2s450ms, non-child: 755.457ms, % non-child: 30.82%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 1.02 MB (1064960) - ProbeRows: 642.02K (642018) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=4):(Total: 1s695ms, non-child: 1s540ms, % non-child: 90.87%) ExecOption: Codegen Disabled: Could not codegen PartitionedAggregationNode::UpdateTuple because intermediate type STRING is not yet supported for aggregate function "max()" - BuildTime: 405.496ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 2.02 MB (2113536) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) UNNEST_NODE (id=3):(Total: 154.817ms, non-child: 154.817ms, % non-child: 100.00%) - AvgCollectionSize: 3.00 - MaxCollectionSize: 3 (3) - MinCollectionSize: 3 (3) - NumCollections: 642.02K (642018) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 383.684ms, non-child: 383.684ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 64 Hdfs split stats (:<# splits>/): 1:26/2.65 GB 0:38/3.56 GB Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% File Formats: PARQUET/NONE:256 BytesRead(500.000ms): 626.93 MB, 1.10 GB, 1.25 GB, 1.61 GB, 1.85 GB, 2.08 GB, 2.30 GB, 2.56 GB, 2.66 GB, 2.86 GB, 3.59 GB, 3.74 GB, 3.88 GB, 4.36 GB, 4.58 GB, 4.90 GB, 5.10 GB, 5.25 GB, 5.37 GB, 5.53 GB, 5.65 GB, 5.68 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 21.09 - BytesRead: 5.68 GB (6095769103) - BytesReadDataNodeCache: 0 - BytesReadLocal: 5.68 GB (6095769103) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 5.68 GB (6095769103) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 64 (64) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1.93 GB (2068781928) - PerReadThreadRawHdfsThroughput: 2.76 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 572.59M (572589332) - RowsReturned: 642.02K (642018) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 64 (64) - ScannerThreadsInvoluntaryContextSwitches: 16.83K (16831) - ScannerThreadsTotalWallClockTime: 3m50s - MaterializeTupleTime(*): 3m45s - ScannerThreadsSysTime: 16s026ms - ScannerThreadsUserTime: 1m33s - ScannerThreadsVoluntaryContextSwitches: 447.14K (447137) - TotalRawHdfsReadTime(*): 2s059ms - TotalReadThroughput: 528.44 MB/sec