Starting Impala Shell without Kerberos authentication Connected to d2402.halxg.cloudera.com:21000 Server version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 9168b83da5b8cf83d2bdae43e3995b3af306ef56) Query: use `tpch_1000_decimal_parquet` RUNTIME_FILTER_MODE set to 2 MAX_NUM_RUNTIME_FILTERS set to 50 RUNTIME_FILTER_WAIT_TIME_MS set to 10000 RUNTIME_BLOOM_FILTER_SIZE set to 16777216 Query: select 100.00 * sum(case when p_type like 'PROMO%' then l_extendedprice * (1 - l_discount) else 0.0 end) / sum(l_extendedprice * (1 - l_discount)) as promo_revenue from lineitem, part where l_partkey = p_partkey and l_shipdate >= '1995-09-01' and l_shipdate < '1995-10-01' 16.674226 Fetched 1 row(s) in 16.82s Query Runtime Profile: Query (id=d4651cba0a55add:45db634c6f70b1a5): Summary: Session ID: 5149fc1f2b544206:83a063666a56239d Session Type: BEESWAX Start Time: 2016-05-24 14:15:09.609440000 End Time: 2016-05-24 14:15:26.426081000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 9168b83da5b8cf83d2bdae43e3995b3af306ef56) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.20.122.102:54601 Default Db: tpch_1000_decimal_parquet Sql Statement: select 100.00 * sum(case when p_type like 'PROMO%' then l_extendedprice * (1 - l_discount) else 0.0 end) / sum(l_extendedprice * (1 - l_discount)) as promo_revenue from lineitem, part where l_partkey = p_partkey and l_shipdate >= '1995-09-01' and l_shipdate < '1995-10-01' Coordinator: d2402.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=24,RUNTIME_FILTER_MODE=2,RUNTIME_BLOOM_FILTER_SIZE=16777216,RUNTIME_FILTER_WAIT_TIME_MS=10000,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=829.87MB VCores=2 07:AGGREGATE [FINALIZE] | output: sum:merge(CASE WHEN p_type LIKE 'PROMO%' THEN l_extendedprice * (1 - l_discount) ELSE 0.0 END), sum:merge(l_extendedprice * (1 - l_discount)) | hosts=20 per-host-mem=unavailable | tuple-ids=2 row-size=32B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=20 per-host-mem=unavailable | tuple-ids=2 row-size=32B cardinality=1 | 03:AGGREGATE | output: sum(CASE WHEN p_type LIKE 'PROMO%' THEN l_extendedprice * (1 - l_discount) ELSE 0.0 END), sum(l_extendedprice * (1 - l_discount)) | hosts=20 per-host-mem=10.00MB | tuple-ids=2 row-size=32B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_partkey = p_partkey | runtime filters: RF000 <- p_partkey | hosts=20 per-host-mem=467.87MB | tuple-ids=0,1 row-size=95B cardinality=599842820 | |--05:EXCHANGE [HASH(p_partkey)] | | hosts=20 per-host-mem=0B | | tuple-ids=1 row-size=45B cardinality=200000000 | | | 01:SCAN HDFS [tpch_1000_decimal_parquet.part, RANDOM] | partitions=1/1 files=40 size=6.38GB | table stats: 200000000 rows total | column stats: all | hosts=20 per-host-mem=176.00MB | tuple-ids=1 row-size=45B cardinality=200000000 | 04:EXCHANGE [HASH(l_partkey)] | hosts=20 per-host-mem=0B | tuple-ids=0 row-size=50B cardinality=599998971 | 00:SCAN HDFS [tpch_1000_decimal_parquet.lineitem, RANDOM] partitions=1/1 files=880 size=216.61GB predicates: l_shipdate >= '1995-09-01', l_shipdate < '1995-10-01' runtime filters: RF000 -> l_partkey table stats: 5999989709 rows total column stats: all hosts=20 per-host-mem=352.00MB tuple-ids=0 row-size=50B cardinality=599998971 ---------------- Estimated Per-Host Mem: 870183413 Estimated Per-Host VCores: 2 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------ 07:AGGREGATE 1 185.510ms 185.510ms 1 1 92.00 KB -1.00 B FINALIZE 06:EXCHANGE 1 169.728us 169.728us 20 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 20 1s147ms 1s268ms 20 1 155.90 KB 10.00 MB 02:HASH JOIN 20 2s292ms 2s673ms 74.82M 599.84M 778.02 MB 467.87 MB INNER JOIN, PARTITIONED |--05:EXCHANGE 20 449.062ms 1s184ms 200.00M 200.00M 0 0 HASH(p_partkey) | 01:SCAN HDFS 20 53.483ms 94.685ms 200.00M 200.00M 94.05 MB 176.00 MB tpch_1000_decimal_parquet.part 04:EXCHANGE 20 443.154ms 1s068ms 74.82M 600.00M 0 0 HASH(l_partkey) 00:SCAN HDFS 20 11s920ms 13s258ms 74.82M 600.00M 2.17 GB 352.00 MB tpch_1000_decimal_parquet.l... Planner Timeline: 10.326ms - Analysis finished: 2.923ms (2.923ms) - Equivalence classes computed: 3.200ms (277.283us) - Single node plan created: 6.553ms (3.353ms) - Runtime filters computed: 6.667ms (113.346us) - Distributed plan created: 8.470ms (1.803ms) - Lineage info computed: 8.831ms (360.444us) - Planning finished: 10.326ms (1.495ms) Query Timeline: 16s831ms - Start execution: 35.783us (35.783us) - Planning finished: 14.556ms (14.521ms) - Submit for admission: 16.468ms (1.911ms) - Completed admission: 16.829ms (361.005us) - Ready to start 60 remote fragments: 204.179ms (187.349ms) - All 60 remote fragments started: 253.643ms (49.463ms) - First dynamic filter received: 9s956ms (9s702ms) - Rows available: 16s520ms (6s564ms) - First row fetched: 16s810ms (289.756ms) - Unregister query: 16s816ms (6.286ms) ImpalaServer: - ClientFetchWaitTimer: 290.869ms - RowMaterializationTimer: 34.685us Execution Profile d4651cba0a55add:45db634c6f70b1a5:(Total: 16s507ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 20 GLOBAL (Partition) false 20 (20) N/A N/A Fragment start latencies: Count: 60, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 41ms, 95th %-ile: 42ms, 99.9th %-ile: 47ms Final filter table: ID Src. Node Tgt. Node Targets Type Partition filter Pending First arrived Completed ------------------------------------------------------------------------------------------------------------ 0 2 0 20 GLOBAL (Partition) false 0 (20) 9s956ms 11s088ms Per Node Peak Memory Usage: d2406.halxg.cloudera.com:22000(2.89 GB) d2405.halxg.cloudera.com:22000(2.87 GB) d2414.halxg.cloudera.com:22000(2.89 GB) d2416.halxg.cloudera.com:22000(2.86 GB) d2404.halxg.cloudera.com:22000(2.82 GB) d2410.halxg.cloudera.com:22000(2.86 GB) d2420.halxg.cloudera.com:22000(2.96 GB) d2415.halxg.cloudera.com:22000(2.83 GB) d2421.halxg.cloudera.com:22000(2.86 GB) d2408.halxg.cloudera.com:22000(2.85 GB) d2403.halxg.cloudera.com:22000(2.86 GB) d2412.halxg.cloudera.com:22000(2.85 GB) d2407.halxg.cloudera.com:22000(2.84 GB) d2418.halxg.cloudera.com:22000(2.83 GB) d2411.halxg.cloudera.com:22000(2.89 GB) d2419.halxg.cloudera.com:22000(2.85 GB) d2409.halxg.cloudera.com:22000(2.86 GB) d2413.halxg.cloudera.com:22000(2.86 GB) d2417.halxg.cloudera.com:22000(2.86 GB) d2402.halxg.cloudera.com:22000(2.32 GB) - FiltersReceived: 20 (20) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 15s820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 100.02 KB (102416) - PerHostPeakMemUsage: 0 - PrepareTime: 185.132ms - RowsProduced: 1 (1) - TotalCpuTime: 1s158ms - TotalNetworkReceiveTime: 15s635ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 813.262ms, non-child: 813.262ms, % non-child: 100.00%) - CodegenTime: 1.124ms - CompileTime: 139.068ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 490.235ms - PrepareTime: 182.321ms AGGREGATION_NODE (id=7):(Total: 15s820ms, non-child: 185.510ms, % non-child: 1.17%) ExecOption: Codegen Enabled - BuildTime: 16.297us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 92.00 KB (94208) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 15s635ms, non-child: 169.728us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 840.00 B (840) - ConvertRowBatchTime: 26.670us - DeserializeRowBatchTimer: 103.003us - FirstBatchArrivalWaitTime: 15s625ms - PeakMemoryUsage: 0 - RowsReturned: 20 (20) - RowsReturnedRate: 1.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 15s787ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:16s264ms max:16s314ms mean: 16s307ms stddev:10.136ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 20 - AverageThreadTokens: 1.59 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 788.44 MB (826735640) - PerHostPeakMemUsage: 2.83 GB (3043991896) - PrepareTime: 193.797ms - RowsProduced: 1 (1) - TotalCpuTime: 9s640ms - TotalNetworkReceiveTime: 17s376ms - TotalNetworkSendTime: 273.935us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 692.822ms, non-child: 692.822ms, % non-child: 100.00%) - CodegenTime: 1.962ms - CompileTime: 106.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 398.768ms - PrepareTime: 185.883ms DataStreamSender (dst_id=6):(Total: 30.187us, non-child: 30.187us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 261.11 KB/sec - OverallThroughput: 1.37 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 11.122us - ThriftTransmitTime(*): 177.662us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s786ms, non-child: 1s147ms, % non-child: 7.27%) - BuildTime: 945.400ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 123.24 KB (126200) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s639ms, non-child: 2s292ms, % non-child: 15.66%) - BuildPartitionTime: 999.973ms - BuildRows: 10.00M (10000000) - BuildRowsPartitioned: 10.00M (10000000) - BuildTime: 2s782ms - GetNewBlockTime: 18.221ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3740945) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s940ms - RowsReturned: 3.74M (3740945) - RowsReturnedRate: 255.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.275us EXCHANGE_NODE (id=5):(Total: 5s370ms, non-child: 5s370ms, % non-child: 100.00%) - BytesReceived: 285.17 MB (299020616) - ConvertRowBatchTime: 193.513ms - DeserializeRowBatchTimer: 974.091ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10000000) - RowsReturnedRate: 1.87 M/sec - SendersBlockedTimer: 290.354ms - SendersBlockedTotalTimer(*): 5s519ms EXCHANGE_NODE (id=4):(Total: 12s353ms, non-child: 12s353ms, % non-child: 100.00%) - BytesReceived: 124.74 MB (130802435) - ConvertRowBatchTime: 116.968ms - DeserializeRowBatchTimer: 533.720ms - FirstBatchArrivalWaitTime: 9s354ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740945) - RowsReturnedRate: 302.98 K/sec - SendersBlockedTimer: 73.995ms - SendersBlockedTotalTimer(*): 1s306ms Averaged Fragment F01:(Total: 4s580ms, non-child: 19.059ms, % non-child: 0.42%) split sizes: min: 124.04 MB, max: 507.42 MB, avg: 326.57 MB, stddev: 119.10 MB completion times: min:2s357ms max:7s109ms mean: 4s605ms stddev:1s398ms execution rates: min:50.63 MB/sec max:77.03 MB/sec mean:69.31 MB/sec stddev:6.40 MB/sec num instances: 20 - AverageThreadTokens: 2.66 - BloomFilterBytes: 0 - PeakMemoryUsage: 67.86 MB (71161069) - PerHostPeakMemUsage: 515.41 MB (540442463) - PrepareTime: 129.963us - RowsProduced: 10.00M (10000000) - TotalCpuTime: 11s610ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 827.311ms - TotalStorageWaitTime: 19.117ms DataStreamSender (dst_id=5):(Total: 4s507ms, non-child: 4s507ms, % non-child: 100.00%) - BytesSent: 285.17 MB (299020616) - NetworkThroughput(*): 21.45 MB/sec - OverallThroughput: 61.63 MB/sec - PeakMemoryUsage: 678.40 KB (694681) - SerializeBatchTime: 2s375ms - ThriftTransmitTime(*): 12s945ms - UncompressedRowBatchSize: 539.85 MB (566077098) HDFS_SCAN_NODE (id=1):(Total: 53.483ms, non-child: 53.483ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.66 - BytesRead: 48.19 MB (50529977) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.19 MB (50529977) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.19 MB (50529977) - DecompressionTime: 148.281ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 67.20 MB (70461187) - PerReadThreadRawHdfsThroughput: 2.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.00M (10000000) - RowsReturned: 10.00M (10000000) - RowsReturnedRate: 185.42 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 371 (371) - ScannerThreadsTotalWallClockTime: 7s853ms - MaterializeTupleTime(*): 7s672ms - ScannerThreadsSysTime: 17.646ms - ScannerThreadsUserTime: 866.717ms - ScannerThreadsVoluntaryContextSwitches: 9.44K (9441) - TotalRawHdfsReadTime(*): 22.747ms - TotalReadThroughput: 10.11 MB/sec BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 256.00 MB (268435456) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns Averaged Fragment F00:(Total: 15s088ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 10.63 GB, max: 11.04 GB, avg: 10.83 GB, stddev: 99.15 MB completion times: min:15s220ms max:16s273ms mean: 15s572ms stddev:279.163ms execution rates: min:684.65 MB/sec max:724.90 MB/sec mean:712.31 MB/sec stddev:9.49 MB/sec num instances: 20 - AverageThreadTokens: 16.14 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.05 GB (2206423423) - PerHostPeakMemUsage: 2.83 GB (3043991896) - PrepareTime: 186.075ms - RowsProduced: 3.74M (3740945) - TotalCpuTime: 4m9s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 768.713ms - TotalStorageWaitTime: 2s427ms CodeGen:(Total: 435.081ms, non-child: 435.081ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 243.393ms - PrepareTime: 183.490ms DataStreamSender (dst_id=4):(Total: 3s334ms, non-child: 3s334ms, % non-child: 100.00%) - BytesSent: 124.74 MB (130802435) - NetworkThroughput(*): 28.59 MB/sec - OverallThroughput: 37.49 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s432ms - ThriftTransmitTime(*): 4s374ms - UncompressedRowBatchSize: 221.24 MB (231982523) HDFS_SCAN_NODE (id=0):(Total: 11s920ms, non-child: 11s920ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 15.66 - BytesRead: 3.69 GB (3961672307) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3961672307) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3961672307) - DecompressionTime: 15s208ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 22 (22) - PeakMemoryUsage: 2.05 GB (2204711858) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00M (299999485) - RowsReturned: 3.74M (3740945) - RowsReturnedRate: 314.11 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 36.44K (36441) - ScannerThreadsTotalWallClockTime: 3m56s - MaterializeTupleTime(*): 1m34s - ScannerThreadsSysTime: 867.907ms - ScannerThreadsUserTime: 1m42s - ScannerThreadsVoluntaryContextSwitches: 8.08K (8079) - TotalRawHdfsReadTime(*): 3s289ms - TotalReadThroughput: 246.23 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Fragment F02: Instance d4651cba0a55add:45db634c6f70b1a7 (host=d2413.halxg.cloudera.com:22000):(Total: 15s822ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.32 MB, 138.09 MB, 138.06 MB, 266.12 MB, 266.12 MB, 394.06 MB, 394.09 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.06 MB, 522.09 MB, 538.04 MB, 570.04 MB, 618.04 MB, 650.04 MB, 698.04 MB, 730.04 MB, 762.58 MB, 790.60 MB, 777.14 MB, 777.22 MB, 777.33 MB, 778.04 MB, 777.20 MB, 777.20 MB, 777.16 MB, 777.18 MB, 777.16 MB, 777.14 MB, 777.14 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 792.21 MB (830694280) - PerHostPeakMemUsage: 2.86 GB (3067441152) - PrepareTime: 184.655ms - RowsProduced: 1 (1) - TotalCpuTime: 9s926ms - TotalNetworkReceiveTime: 17s242ms - TotalNetworkSendTime: 205.353us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 659.562ms, non-child: 659.562ms, % non-child: 100.00%) - CodegenTime: 1.928ms - CompileTime: 104.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 377.191ms - PrepareTime: 176.764ms DataStreamSender (dst_id=6):(Total: 27.113us, non-child: 27.113us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 271.66 KB/sec - OverallThroughput: 1.48 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 9.145us - ThriftTransmitTime(*): 150.979us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s821ms, non-child: 1s076ms, % non-child: 6.80%) ExecOption: Codegen Enabled - BuildTime: 884.482ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 155.90 KB (159640) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s745ms, non-child: 2s524ms, % non-child: 17.12%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 1s071ms - BuildRows: 10.00M (10003786) - BuildRowsPartitioned: 10.00M (10003786) - BuildTime: 3s013ms - GetNewBlockTime: 19.752ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3740622) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s979ms - RowsReturned: 3.74M (3740622) - RowsReturnedRate: 253.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.261us EXCHANGE_NODE (id=5):(Total: 5s345ms, non-child: 383.442ms, % non-child: 7.17%) BytesReceived(500.000ms): 10.23 MB, 23.90 MB, 61.07 MB, 98.89 MB, 134.87 MB, 167.66 MB, 198.92 MB, 222.94 MB, 241.92 MB, 255.64 MB, 267.25 MB, 275.99 MB, 283.49 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB, 285.28 MB - BytesReceived: 285.28 MB (299132617) - ConvertRowBatchTime: 181.071ms - DeserializeRowBatchTimer: 890.776ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10003786) - RowsReturnedRate: 1.87 M/sec - SendersBlockedTimer: 239.183ms - SendersBlockedTotalTimer(*): 4s747ms EXCHANGE_NODE (id=4):(Total: 12s228ms, non-child: 350.970ms, % non-child: 2.87%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 296.78 KB, 9.14 MB, 17.31 MB, 27.76 MB, 41.78 MB, 55.86 MB, 67.31 MB, 80.56 MB, 93.85 MB, 107.12 MB, 119.45 MB, 124.01 MB, 124.66 MB - BytesReceived: 124.72 MB (130779271) - ConvertRowBatchTime: 115.948ms - DeserializeRowBatchTimer: 595.725ms - FirstBatchArrivalWaitTime: 9s402ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740622) - RowsReturnedRate: 305.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1ba (host=d2417.halxg.cloudera.com:22000):(Total: 15s821ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 962.55 KB, 138.09 MB, 138.09 MB, 138.12 MB, 266.09 MB, 266.06 MB, 394.12 MB, 394.06 MB, 522.09 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 538.04 MB, 586.04 MB, 634.04 MB, 682.04 MB, 730.04 MB, 778.04 MB, 777.14 MB, 777.14 MB, 777.31 MB, 777.24 MB, 777.20 MB, 777.35 MB, 777.20 MB, 777.16 MB, 777.18 MB, 777.20 MB, 777.18 MB, 777.16 MB, 777.12 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.68 MB (816504840) - PerHostPeakMemUsage: 2.86 GB (3067836120) - PrepareTime: 187.894ms - RowsProduced: 1 (1) - TotalCpuTime: 9s186ms - TotalNetworkReceiveTime: 17s838ms - TotalNetworkSendTime: 390.482us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 671.632ms, non-child: 671.632ms, % non-child: 100.00%) - CodegenTime: 1.830ms - CompileTime: 103.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.672ms - PrepareTime: 180.819ms DataStreamSender (dst_id=6):(Total: 25.580us, non-child: 25.580us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 157.52 KB/sec - OverallThroughput: 1.57 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 7.561us - ThriftTransmitTime(*): 260.387us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s819ms, non-child: 1s141ms, % non-child: 7.22%) ExecOption: Codegen Enabled - BuildTime: 944.647ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 105.28 KB (107808) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s678ms, non-child: 1s996ms, % non-child: 13.60%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 936.411ms - BuildRows: 9.99M (9992762) - BuildRowsPartitioned: 9.99M (9992762) - BuildTime: 2s387ms - GetNewBlockTime: 17.306ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3737705) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s974ms - RowsReturned: 3.74M (3737705) - RowsReturnedRate: 254.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.308us EXCHANGE_NODE (id=5):(Total: 5s476ms, non-child: 383.908ms, % non-child: 7.01%) BytesReceived(500.000ms): 421.44 KB, 10.25 MB, 31.38 MB, 68.66 MB, 106.68 MB, 141.41 MB, 174.17 MB, 204.97 MB, 225.73 MB, 244.95 MB, 257.81 MB, 268.99 MB, 277.28 MB, 283.58 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB - BytesReceived: 284.96 MB (298798698) - ConvertRowBatchTime: 183.669ms - DeserializeRowBatchTimer: 877.196ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 9.99M (9992762) - RowsReturnedRate: 1.82 M/sec - SendersBlockedTimer: 251.718ms - SendersBlockedTotalTimer(*): 4s730ms EXCHANGE_NODE (id=4):(Total: 12s688ms, non-child: 234.008ms, % non-child: 1.84%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.15 MB, 10.26 MB, 19.59 MB, 29.74 MB, 45.29 MB, 58.37 MB, 69.96 MB, 83.35 MB, 96.66 MB, 109.89 MB, 121.23 MB, 124.13 MB, 124.61 MB - BytesReceived: 124.64 MB (130693280) - ConvertRowBatchTime: 109.447ms - DeserializeRowBatchTimer: 465.604ms - FirstBatchArrivalWaitTime: 9s388ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3737705) - RowsReturnedRate: 294.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b5 (host=d2416.halxg.cloudera.com:22000):(Total: 15s821ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.35 MB, 138.09 MB, 138.15 MB, 266.09 MB, 266.06 MB, 394.06 MB, 394.06 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.12 MB, 522.09 MB, 522.09 MB, 538.04 MB, 570.04 MB, 618.04 MB, 650.04 MB, 698.04 MB, 730.04 MB, 763.09 MB, 779.47 MB, 777.16 MB, 777.52 MB, 782.69 MB, 777.48 MB, 777.50 MB, 777.16 MB, 777.14 MB, 777.16 MB, 777.14 MB, 777.14 MB, 777.15 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 786.65 MB (824863672) - PerHostPeakMemUsage: 2.86 GB (3067393488) - PrepareTime: 185.207ms - RowsProduced: 1 (1) - TotalCpuTime: 9s794ms - TotalNetworkReceiveTime: 17s575ms - TotalNetworkSendTime: 237.886us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 668.185ms, non-child: 668.185ms, % non-child: 100.00%) - CodegenTime: 1.780ms - CompileTime: 103.734ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 384.672ms - PrepareTime: 178.300ms DataStreamSender (dst_id=6):(Total: 24.839us, non-child: 24.839us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 249.38 KB/sec - OverallThroughput: 1.61 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.048us - ThriftTransmitTime(*): 164.469us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s819ms, non-child: 1s122ms, % non-child: 7.10%) ExecOption: Codegen Enabled - BuildTime: 931.437ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 110.74 KB (113400) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s696ms, non-child: 2s301ms, % non-child: 15.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 920.583ms - BuildRows: 10.00M (9997550) - BuildRowsPartitioned: 10.00M (9997550) - BuildTime: 2s926ms - GetNewBlockTime: 18.566ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3738866) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s885ms - RowsReturned: 3.74M (3738866) - RowsReturnedRate: 254.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.513us EXCHANGE_NODE (id=5):(Total: 5s494ms, non-child: 389.916ms, % non-child: 7.10%) BytesReceived(500.000ms): 10.21 MB, 25.77 MB, 63.00 MB, 100.86 MB, 136.53 MB, 169.23 MB, 200.33 MB, 222.79 MB, 242.61 MB, 256.07 MB, 267.58 MB, 276.22 MB, 283.43 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB, 285.10 MB - BytesReceived: 285.10 MB (298944226) - ConvertRowBatchTime: 180.787ms - DeserializeRowBatchTimer: 898.700ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9997550) - RowsReturnedRate: 1.82 M/sec - SendersBlockedTimer: 247.784ms - SendersBlockedTotalTimer(*): 4s175ms EXCHANGE_NODE (id=4):(Total: 12s401ms, non-child: 462.000ms, % non-child: 3.73%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 576.74 KB, 9.73 MB, 17.78 MB, 28.22 MB, 42.62 MB, 56.45 MB, 67.94 MB, 81.24 MB, 94.49 MB, 107.77 MB, 119.89 MB, 123.99 MB, 124.61 MB - BytesReceived: 124.67 MB (130725521) - ConvertRowBatchTime: 103.938ms - DeserializeRowBatchTimer: 560.072ms - FirstBatchArrivalWaitTime: 9s397ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3738866) - RowsReturnedRate: 301.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b6 (host=d2414.halxg.cloudera.com:22000):(Total: 15s820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 872.07 KB, 138.06 MB, 138.26 MB, 138.09 MB, 266.09 MB, 266.09 MB, 394.09 MB, 394.09 MB, 522.12 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.06 MB, 538.04 MB, 586.04 MB, 618.04 MB, 666.04 MB, 698.04 MB, 730.04 MB, 764.25 MB, 788.49 MB, 777.81 MB, 777.12 MB, 785.61 MB, 782.91 MB, 777.22 MB, 777.18 MB, 777.12 MB, 777.16 MB, 777.16 MB, 777.12 MB, 777.14 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 794.40 MB (832983624) - PerHostPeakMemUsage: 2.89 GB (3100663896) - PrepareTime: 190.710ms - RowsProduced: 1 (1) - TotalCpuTime: 9s951ms - TotalNetworkReceiveTime: 17s155ms - TotalNetworkSendTime: 236.007us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 674.369ms, non-child: 674.369ms, % non-child: 100.00%) - CodegenTime: 1.852ms - CompileTime: 104.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.002ms - PrepareTime: 183.659ms DataStreamSender (dst_id=6):(Total: 27.119us, non-child: 27.119us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 295.85 KB/sec - OverallThroughput: 1.48 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 7.747us - ThriftTransmitTime(*): 138.635us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s819ms, non-child: 1s195ms, % non-child: 7.56%) ExecOption: Codegen Enabled - BuildTime: 997.330ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 101.28 KB (103712) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s623ms, non-child: 2s617ms, % non-child: 17.90%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 936.407ms - BuildRows: 10.00M (9997738) - BuildRowsPartitioned: 10.00M (9997738) - BuildTime: 3s094ms - GetNewBlockTime: 20.746ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3739824) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s037ms - RowsReturned: 3.74M (3739824) - RowsReturnedRate: 255.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.157us EXCHANGE_NODE (id=5):(Total: 5s471ms, non-child: 408.477ms, % non-child: 7.47%) BytesReceived(500.000ms): 382.18 KB, 10.34 MB, 32.93 MB, 70.26 MB, 108.23 MB, 142.89 MB, 175.52 MB, 206.31 MB, 226.77 MB, 245.63 MB, 258.34 MB, 269.44 MB, 277.72 MB, 283.77 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB - BytesReceived: 285.08 MB (298933195) - ConvertRowBatchTime: 185.068ms - DeserializeRowBatchTimer: 931.737ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9997738) - RowsReturnedRate: 1.83 M/sec - SendersBlockedTimer: 253.858ms - SendersBlockedTotalTimer(*): 4s532ms EXCHANGE_NODE (id=4):(Total: 12s012ms, non-child: 488.665ms, % non-child: 4.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.18 MB, 10.27 MB, 20.04 MB, 29.98 MB, 45.77 MB, 58.72 MB, 70.36 MB, 83.85 MB, 97.11 MB, 110.31 MB, 121.46 MB, 124.22 MB, 124.67 MB - BytesReceived: 124.69 MB (130749775) - ConvertRowBatchTime: 107.108ms - DeserializeRowBatchTimer: 620.293ms - FirstBatchArrivalWaitTime: 9s391ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3739824) - RowsReturnedRate: 311.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1a9 (host=d2409.halxg.cloudera.com:22000):(Total: 15s820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 750.78 KB, 150.28 MB, 138.06 MB, 138.06 MB, 266.09 MB, 266.06 MB, 394.09 MB, 394.09 MB, 522.20 MB, 522.12 MB, 522.09 MB, 522.09 MB, 522.06 MB, 522.06 MB, 538.04 MB, 586.04 MB, 618.04 MB, 666.04 MB, 714.04 MB, 762.04 MB, 777.16 MB, 777.71 MB, 777.35 MB, 777.12 MB, 777.22 MB, 777.76 MB, 777.22 MB, 777.20 MB, 777.14 MB, 777.22 MB, 777.14 MB, 777.15 MB, 777.14 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.34 MB (816152832) - PerHostPeakMemUsage: 2.86 GB (3074694000) - PrepareTime: 185.536ms - RowsProduced: 1 (1) - TotalCpuTime: 9s423ms - TotalNetworkReceiveTime: 17s987ms - TotalNetworkSendTime: 408.459us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 663.981ms, non-child: 663.981ms, % non-child: 100.00%) - CodegenTime: 1.895ms - CompileTime: 104.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 380.392ms - PrepareTime: 178.002ms DataStreamSender (dst_id=6):(Total: 25.170us, non-child: 25.170us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 147.80 KB/sec - OverallThroughput: 1.59 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 7.399us - ThriftTransmitTime(*): 277.507us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s819ms, non-child: 1s088ms, % non-child: 6.88%) ExecOption: Codegen Enabled - BuildTime: 893.575ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 126.66 KB (129704) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s730ms, non-child: 1s956ms, % non-child: 13.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 872.156ms - BuildRows: 10.00M (9999165) - BuildRowsPartitioned: 10.00M (9999165) - BuildTime: 2s573ms - GetNewBlockTime: 10.527ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3741194) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s910ms - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 253.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.267us EXCHANGE_NODE (id=5):(Total: 5s543ms, non-child: 391.056ms, % non-child: 7.05%) BytesReceived(500.000ms): 323.93 KB, 10.23 MB, 28.52 MB, 65.75 MB, 103.68 MB, 138.93 MB, 171.76 MB, 202.72 MB, 224.03 MB, 243.80 MB, 257.00 MB, 268.31 MB, 276.81 MB, 283.58 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB, 285.12 MB - BytesReceived: 285.12 MB (298972406) - ConvertRowBatchTime: 181.915ms - DeserializeRowBatchTimer: 899.922ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9999165) - RowsReturnedRate: 1.80 M/sec - SendersBlockedTimer: 242.618ms - SendersBlockedTotalTimer(*): 4s565ms EXCHANGE_NODE (id=4):(Total: 12s780ms, non-child: 266.577ms, % non-child: 2.09%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 947.44 KB, 10.26 MB, 18.76 MB, 28.95 MB, 43.85 MB, 57.38 MB, 68.84 MB, 82.23 MB, 95.53 MB, 108.75 MB, 120.64 MB, 124.19 MB, 124.72 MB - BytesReceived: 124.76 MB (130822444) - ConvertRowBatchTime: 121.343ms - DeserializeRowBatchTimer: 467.741ms - FirstBatchArrivalWaitTime: 9s403ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 292.73 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1ab (host=d2418.halxg.cloudera.com:22000):(Total: 15s810ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.35 MB, 138.06 MB, 138.06 MB, 266.12 MB, 266.06 MB, 394.12 MB, 394.06 MB, 522.09 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.09 MB, 522.09 MB, 522.09 MB, 570.04 MB, 602.04 MB, 634.04 MB, 682.04 MB, 714.04 MB, 746.06 MB, 791.85 MB, 796.80 MB, 797.81 MB, 792.08 MB, 778.92 MB, 777.86 MB, 779.19 MB, 781.22 MB, 777.20 MB, 777.16 MB, 777.14 MB, 777.16 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 797.92 MB (836675592) - PerHostPeakMemUsage: 2.83 GB (3040021872) - PrepareTime: 191.166ms - RowsProduced: 1 (1) - TotalCpuTime: 10s126ms - TotalNetworkReceiveTime: 17s183ms - TotalNetworkSendTime: 279.768us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 681.241ms, non-child: 681.241ms, % non-child: 100.00%) - CodegenTime: 1.750ms - CompileTime: 104.403ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 390.949ms - PrepareTime: 184.514ms DataStreamSender (dst_id=6):(Total: 37.942us, non-child: 37.942us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 255.93 KB/sec - OverallThroughput: 1.06 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 19.819us - ThriftTransmitTime(*): 160.260us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s809ms, non-child: 1s167ms, % non-child: 7.38%) ExecOption: Codegen Enabled - BuildTime: 968.522ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 147.01 KB (150536) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s641ms, non-child: 2s593ms, % non-child: 17.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 923.465ms - BuildRows: 9.99M (9992941) - BuildRowsPartitioned: 9.99M (9992941) - BuildTime: 3s260ms - GetNewBlockTime: 19.604ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3736416) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s821ms - RowsReturned: 3.74M (3736416) - RowsReturnedRate: 255.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.161us EXCHANGE_NODE (id=5):(Total: 5s473ms, non-child: 421.656ms, % non-child: 7.70%) BytesReceived(500.000ms): 10.23 MB, 18.86 MB, 55.73 MB, 93.49 MB, 130.16 MB, 162.92 MB, 194.37 MB, 222.53 MB, 239.39 MB, 253.69 MB, 265.47 MB, 274.57 MB, 282.38 MB, 284.83 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB, 284.96 MB - BytesReceived: 284.96 MB (298802780) - ConvertRowBatchTime: 186.210ms - DeserializeRowBatchTimer: 967.425ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 9.99M (9992941) - RowsReturnedRate: 1.83 M/sec - SendersBlockedTimer: 261.723ms - SendersBlockedTotalTimer(*): 4s920ms EXCHANGE_NODE (id=4):(Total: 12s055ms, non-child: 1s068ms, % non-child: 8.87%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.07 KB, 7.31 MB, 15.82 MB, 26.26 MB, 39.18 MB, 54.11 MB, 65.61 MB, 78.56 MB, 91.90 MB, 105.15 MB, 117.85 MB, 123.74 MB, 124.48 MB - BytesReceived: 124.59 MB (130646058) - ConvertRowBatchTime: 121.185ms - DeserializeRowBatchTimer: 575.261ms - FirstBatchArrivalWaitTime: 9s380ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3736416) - RowsReturnedRate: 309.94 K/sec - SendersBlockedTimer: 986.384ms - SendersBlockedTotalTimer(*): 17s635ms Instance d4651cba0a55add:45db634c6f70b1b0 (host=d2403.halxg.cloudera.com:22000):(Total: 15s808ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 10.53 MB, 138.06 MB, 138.06 MB, 266.09 MB, 266.09 MB, 394.06 MB, 394.09 MB, 394.09 MB, 522.09 MB, 522.06 MB, 522.06 MB, 522.06 MB, 522.06 MB, 522.06 MB, 554.04 MB, 602.04 MB, 650.04 MB, 698.04 MB, 730.04 MB, 778.04 MB, 777.18 MB, 777.14 MB, 777.20 MB, 779.76 MB, 782.82 MB, 777.18 MB, 777.14 MB, 777.89 MB, 777.22 MB, 777.18 MB, 777.17 MB, 777.12 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 786.54 MB (824744232) - PerHostPeakMemUsage: 2.86 GB (3067212008) - PrepareTime: 189.913ms - RowsProduced: 1 (1) - TotalCpuTime: 9s196ms - TotalNetworkReceiveTime: 17s707ms - TotalNetworkSendTime: 230.980us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 683.576ms, non-child: 683.576ms, % non-child: 100.00%) - CodegenTime: 1.796ms - CompileTime: 105.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 393.830ms - PrepareTime: 183.269ms DataStreamSender (dst_id=6):(Total: 25.828us, non-child: 25.828us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 374.68 KB/sec - OverallThroughput: 1.55 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.057us - ThriftTransmitTime(*): 109.469us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s807ms, non-child: 1s204ms, % non-child: 7.62%) ExecOption: Codegen Enabled - BuildTime: 1s005ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 143.92 KB (147376) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s603ms, non-child: 2s046ms, % non-child: 14.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 901.705ms - BuildRows: 10.00M (10004990) - BuildRowsPartitioned: 10.00M (10004990) - BuildTime: 2s406ms - GetNewBlockTime: 13.933ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3741647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s026ms - RowsReturned: 3.74M (3741647) - RowsReturnedRate: 256.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.373us EXCHANGE_NODE (id=5):(Total: 5s494ms, non-child: 418.514ms, % non-child: 7.62%) BytesReceived(500.000ms): 4.38 MB, 10.37 MB, 39.45 MB, 77.02 MB, 115.14 MB, 148.80 MB, 181.19 MB, 211.63 MB, 231.24 MB, 248.75 MB, 260.75 MB, 271.49 MB, 279.37 MB, 284.36 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB, 285.33 MB - BytesReceived: 285.33 MB (299184987) - ConvertRowBatchTime: 182.689ms - DeserializeRowBatchTimer: 937.729ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10004990) - RowsReturnedRate: 1.82 M/sec - SendersBlockedTimer: 265.542ms - SendersBlockedTotalTimer(*): 5s266ms EXCHANGE_NODE (id=4):(Total: 12s562ms, non-child: 449.712ms, % non-child: 3.58%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.20 MB, 10.43 MB, 22.01 MB, 32.81 MB, 48.45 MB, 60.66 MB, 72.81 MB, 86.29 MB, 99.55 MB, 112.73 MB, 122.63 MB, 124.42 MB - BytesReceived: 124.77 MB (130828743) - ConvertRowBatchTime: 123.289ms - DeserializeRowBatchTimer: 471.020ms - FirstBatchArrivalWaitTime: 9s377ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741647) - RowsReturnedRate: 297.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1af (host=d2408.halxg.cloudera.com:22000):(Total: 15s806ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 750.62 KB, 24.35 MB, 138.06 MB, 138.12 MB, 266.09 MB, 266.09 MB, 394.12 MB, 394.12 MB, 522.12 MB, 522.09 MB, 522.12 MB, 522.09 MB, 522.12 MB, 522.06 MB, 538.04 MB, 586.04 MB, 634.04 MB, 682.04 MB, 730.04 MB, 778.04 MB, 777.12 MB, 777.16 MB, 778.92 MB, 777.14 MB, 785.51 MB, 790.21 MB, 782.09 MB, 777.18 MB, 777.16 MB, 777.14 MB, 777.12 MB, 777.14 MB, 777.14 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 791.05 MB (829471752) - PerHostPeakMemUsage: 2.85 GB (3060465832) - PrepareTime: 202.727ms - RowsProduced: 1 (1) - TotalCpuTime: 9s108ms - TotalNetworkReceiveTime: 17s383ms - TotalNetworkSendTime: 433.204us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 698.390ms, non-child: 698.390ms, % non-child: 100.00%) - CodegenTime: 2.039ms - CompileTime: 104.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 397.031ms - PrepareTime: 195.269ms DataStreamSender (dst_id=6):(Total: 35.390us, non-child: 35.390us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 164.08 KB/sec - OverallThroughput: 1.13 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.445us - ThriftTransmitTime(*): 249.977us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s804ms, non-child: 1s144ms, % non-child: 7.24%) ExecOption: Codegen Enabled - BuildTime: 933.799ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 117.31 KB (120128) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s659ms, non-child: 2s243ms, % non-child: 15.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 1s077ms - BuildRows: 10.00M (10000886) - BuildRowsPartitioned: 10.00M (10000886) - BuildTime: 2s316ms - GetNewBlockTime: 19.418ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3741194) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s223ms - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 255.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.294us EXCHANGE_NODE (id=5):(Total: 5s304ms, non-child: 411.215ms, % non-child: 7.75%) BytesReceived(500.000ms): 322.28 KB, 10.24 MB, 28.91 MB, 66.23 MB, 104.21 MB, 139.39 MB, 172.19 MB, 203.08 MB, 224.34 MB, 244.09 MB, 257.21 MB, 268.51 MB, 276.97 MB, 283.68 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB, 285.19 MB - BytesReceived: 285.19 MB (299040160) - ConvertRowBatchTime: 182.607ms - DeserializeRowBatchTimer: 960.882ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10000886) - RowsReturnedRate: 1.89 M/sec - SendersBlockedTimer: 278.606ms - SendersBlockedTotalTimer(*): 5s523ms EXCHANGE_NODE (id=4):(Total: 12s422ms, non-child: 567.369ms, % non-child: 4.57%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 959.24 KB, 10.24 MB, 18.80 MB, 29.06 MB, 44.08 MB, 57.52 MB, 69.00 MB, 82.43 MB, 95.75 MB, 108.99 MB, 120.77 MB, 124.17 MB, 124.72 MB - BytesReceived: 124.75 MB (130813510) - ConvertRowBatchTime: 124.712ms - DeserializeRowBatchTimer: 465.310ms - FirstBatchArrivalWaitTime: 9s362ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 301.17 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1ac (host=d2407.halxg.cloudera.com:22000):(Total: 15s805ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 18.13 MB, 138.06 MB, 138.12 MB, 266.12 MB, 266.09 MB, 394.12 MB, 394.06 MB, 394.09 MB, 522.09 MB, 522.12 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.06 MB, 554.04 MB, 602.04 MB, 634.04 MB, 682.04 MB, 730.04 MB, 762.04 MB, 777.14 MB, 777.14 MB, 777.14 MB, 777.24 MB, 787.20 MB, 777.84 MB, 777.16 MB, 777.14 MB, 777.20 MB, 777.12 MB, 777.16 MB, 777.12 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 789.03 MB (827355624) - PerHostPeakMemUsage: 2.84 GB (3047296952) - PrepareTime: 185.352ms - RowsProduced: 1 (1) - TotalCpuTime: 9s630ms - TotalNetworkReceiveTime: 17s743ms - TotalNetworkSendTime: 244.076us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 680.508ms, non-child: 680.508ms, % non-child: 100.00%) - CodegenTime: 1.812ms - CompileTime: 104.665ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 396.167ms - PrepareTime: 178.249ms DataStreamSender (dst_id=6):(Total: 29.088us, non-child: 29.088us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 289.30 KB/sec - OverallThroughput: 1.38 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 9.794us - ThriftTransmitTime(*): 141.777us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s804ms, non-child: 1s074ms, % non-child: 6.80%) ExecOption: Codegen Enabled - BuildTime: 881.772ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 117.77 KB (120592) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s730ms, non-child: 2s081ms, % non-child: 14.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 977.043ms - BuildRows: 10.00M (9998747) - BuildRowsPartitioned: 10.00M (9998747) - BuildTime: 2s781ms - GetNewBlockTime: 19.922ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3741079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s811ms - RowsReturned: 3.74M (3741079) - RowsReturnedRate: 253.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.256us EXCHANGE_NODE (id=5):(Total: 5s420ms, non-child: 392.463ms, % non-child: 7.24%) BytesReceived(500.000ms): 7.51 MB, 10.37 MB, 42.94 MB, 80.54 MB, 118.51 MB, 151.78 MB, 183.96 MB, 213.99 MB, 232.97 MB, 249.88 MB, 261.64 MB, 272.12 MB, 279.89 MB, 284.36 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB - BytesReceived: 285.15 MB (298996440) - ConvertRowBatchTime: 188.430ms - DeserializeRowBatchTimer: 892.465ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9998747) - RowsReturnedRate: 1.84 M/sec - SendersBlockedTimer: 259.556ms - SendersBlockedTotalTimer(*): 5s151ms EXCHANGE_NODE (id=4):(Total: 12s656ms, non-child: 420.420ms, % non-child: 3.32%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.04 MB, 11.89 MB, 22.93 MB, 34.55 MB, 49.67 MB, 61.61 MB, 74.01 MB, 87.45 MB, 100.72 MB, 113.86 MB, 123.01 MB, 124.47 MB - BytesReceived: 124.75 MB (130811538) - ConvertRowBatchTime: 109.017ms - DeserializeRowBatchTimer: 565.832ms - FirstBatchArrivalWaitTime: 9s382ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741079) - RowsReturnedRate: 295.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1ad (host=d2412.halxg.cloudera.com:22000):(Total: 15s802ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.35 MB, 138.23 MB, 138.12 MB, 266.06 MB, 266.06 MB, 394.12 MB, 394.15 MB, 426.06 MB, 522.06 MB, 522.12 MB, 522.06 MB, 522.09 MB, 522.09 MB, 522.09 MB, 570.04 MB, 602.04 MB, 650.04 MB, 682.04 MB, 714.04 MB, 762.04 MB, 790.95 MB, 777.14 MB, 777.16 MB, 778.47 MB, 777.20 MB, 777.20 MB, 777.16 MB, 777.16 MB, 777.14 MB, 777.14 MB, 777.15 MB, 777.16 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 791.73 MB (830192136) - PerHostPeakMemUsage: 2.85 GB (3061095816) - PrepareTime: 199.489ms - RowsProduced: 1 (1) - TotalCpuTime: 9s875ms - TotalNetworkReceiveTime: 17s500ms - TotalNetworkSendTime: 207.268us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 695.818ms, non-child: 695.818ms, % non-child: 100.00%) - CodegenTime: 1.928ms - CompileTime: 105.934ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 396.679ms - PrepareTime: 188.533ms DataStreamSender (dst_id=6):(Total: 25.580us, non-child: 25.580us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 287.94 KB/sec - OverallThroughput: 1.57 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 7.900us - ThriftTransmitTime(*): 142.446us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s801ms, non-child: 1s095ms, % non-child: 6.93%) ExecOption: Codegen Enabled - BuildTime: 888.340ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 113.18 KB (115896) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s706ms, non-child: 2s332ms, % non-child: 15.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 931.658ms - BuildRows: 10.00M (9995884) - BuildRowsPartitioned: 10.00M (9995884) - BuildTime: 3s055ms - GetNewBlockTime: 12.352ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3741013) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s802ms - RowsReturned: 3.74M (3741013) - RowsReturnedRate: 254.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.094us EXCHANGE_NODE (id=5):(Total: 5s448ms, non-child: 410.907ms, % non-child: 7.54%) BytesReceived(500.000ms): 10.21 MB, 17.55 MB, 54.28 MB, 92.06 MB, 128.97 MB, 161.66 MB, 193.25 MB, 221.60 MB, 238.80 MB, 253.35 MB, 265.11 MB, 274.35 MB, 282.20 MB, 284.86 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB, 285.06 MB - BytesReceived: 285.06 MB (298907345) - ConvertRowBatchTime: 183.409ms - DeserializeRowBatchTimer: 958.985ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9995884) - RowsReturnedRate: 1.83 M/sec - SendersBlockedTimer: 278.569ms - SendersBlockedTotalTimer(*): 4s977ms EXCHANGE_NODE (id=4):(Total: 12s380ms, non-child: 261.894ms, % non-child: 2.12%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.84 MB, 15.50 MB, 25.95 MB, 38.55 MB, 53.71 MB, 65.24 MB, 78.19 MB, 91.50 MB, 104.74 MB, 117.56 MB, 123.78 MB, 124.59 MB - BytesReceived: 124.73 MB (130791168) - ConvertRowBatchTime: 110.653ms - DeserializeRowBatchTimer: 563.968ms - FirstBatchArrivalWaitTime: 9s366ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741013) - RowsReturnedRate: 302.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b2 (host=d2404.halxg.cloudera.com:22000):(Total: 15s799ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.32 MB, 138.09 MB, 138.09 MB, 266.09 MB, 266.09 MB, 394.09 MB, 394.06 MB, 394.09 MB, 522.09 MB, 522.09 MB, 522.09 MB, 522.09 MB, 522.09 MB, 522.09 MB, 570.04 MB, 618.04 MB, 682.04 MB, 730.04 MB, 778.04 MB, 777.03 MB, 777.20 MB, 777.37 MB, 777.12 MB, 777.28 MB, 777.14 MB, 777.14 MB, 777.12 MB, 777.26 MB, 777.22 MB, 777.20 MB, 777.13 MB, 777.16 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.89 MB (816729960) - PerHostPeakMemUsage: 2.82 GB (3029398320) - PrepareTime: 190.477ms - RowsProduced: 1 (1) - TotalCpuTime: 9s004ms - TotalNetworkReceiveTime: 17s884ms - TotalNetworkSendTime: 228.790us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 691.866ms, non-child: 691.866ms, % non-child: 100.00%) - CodegenTime: 1.832ms - CompileTime: 105.244ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 401.639ms - PrepareTime: 183.277ms DataStreamSender (dst_id=6):(Total: 35.639us, non-child: 35.639us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 273.25 KB/sec - OverallThroughput: 1.12 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 18.143us - ThriftTransmitTime(*): 150.103us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s798ms, non-child: 1s205ms, % non-child: 7.63%) ExecOption: Codegen Enabled - BuildTime: 1s004ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 151.25 KB (154880) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s593ms, non-child: 1s749ms, % non-child: 11.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 978.398ms - BuildRows: 10.00M (9998576) - BuildRowsPartitioned: 10.00M (9998576) - BuildTime: 2s204ms - GetNewBlockTime: 17.913ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3740573) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s726ms - RowsReturned: 3.74M (3740573) - RowsReturnedRate: 256.32 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.275us EXCHANGE_NODE (id=5):(Total: 5s408ms, non-child: 406.037ms, % non-child: 7.51%) BytesReceived(500.000ms): 10.20 MB, 16.18 MB, 52.86 MB, 90.65 MB, 127.74 MB, 160.38 MB, 192.11 MB, 220.73 MB, 238.15 MB, 252.94 MB, 264.74 MB, 274.15 MB, 281.94 MB, 284.85 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB, 285.13 MB - BytesReceived: 285.13 MB (298979942) - ConvertRowBatchTime: 191.046ms - DeserializeRowBatchTimer: 932.460ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9998576) - RowsReturnedRate: 1.85 M/sec - SendersBlockedTimer: 272.014ms - SendersBlockedTotalTimer(*): 4s855ms EXCHANGE_NODE (id=4):(Total: 12s852ms, non-child: 341.013ms, % non-child: 2.65%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.34 MB, 15.02 MB, 25.58 MB, 37.89 MB, 53.25 MB, 64.70 MB, 77.64 MB, 91.00 MB, 104.21 MB, 117.05 MB, 123.71 MB, 124.56 MB - BytesReceived: 124.72 MB (130781834) - ConvertRowBatchTime: 146.201ms - DeserializeRowBatchTimer: 499.193ms - FirstBatchArrivalWaitTime: 9s367ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740573) - RowsReturnedRate: 291.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1a8 (host=d2419.halxg.cloudera.com:22000):(Total: 15s794ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.35 MB, 138.06 MB, 138.09 MB, 266.06 MB, 266.12 MB, 394.12 MB, 394.12 MB, 394.15 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 570.04 MB, 602.04 MB, 650.04 MB, 698.04 MB, 746.04 MB, 778.04 MB, 778.31 MB, 777.80 MB, 777.43 MB, 780.23 MB, 779.69 MB, 777.22 MB, 777.18 MB, 777.16 MB, 777.28 MB, 777.16 MB, 777.14 MB, 777.12 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 786.75 MB (824969352) - PerHostPeakMemUsage: 2.85 GB (3058446320) - PrepareTime: 197.895ms - RowsProduced: 1 (1) - TotalCpuTime: 9s423ms - TotalNetworkReceiveTime: 17s712ms - TotalNetworkSendTime: 520.587us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 701.754ms, non-child: 701.754ms, % non-child: 100.00%) - CodegenTime: 2.832ms - CompileTime: 104.358ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 406.064ms - PrepareTime: 189.838ms DataStreamSender (dst_id=6):(Total: 44.177us, non-child: 44.177us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 123.00 KB/sec - OverallThroughput: 928.44 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 23.853us - ThriftTransmitTime(*): 333.458us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s793ms, non-child: 1s119ms, % non-child: 7.09%) ExecOption: Codegen Enabled - BuildTime: 911.208ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 132.61 KB (135792) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s673ms, non-child: 2s052ms, % non-child: 13.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 920.344ms - BuildRows: 10.00M (10000017) - BuildRowsPartitioned: 10.00M (10000017) - BuildTime: 2s631ms - GetNewBlockTime: 21.052ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3743446) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s974ms - RowsReturned: 3.74M (3743446) - RowsReturnedRate: 255.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.211us EXCHANGE_NODE (id=5):(Total: 5s453ms, non-child: 404.948ms, % non-child: 7.43%) BytesReceived(500.000ms): 10.24 MB, 15.36 MB, 51.98 MB, 89.77 MB, 127.06 MB, 159.73 MB, 191.48 MB, 220.18 MB, 237.69 MB, 252.69 MB, 264.47 MB, 273.96 MB, 281.79 MB, 284.83 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB - BytesReceived: 285.15 MB (299001089) - ConvertRowBatchTime: 187.658ms - DeserializeRowBatchTimer: 923.272ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10000017) - RowsReturnedRate: 1.83 M/sec - SendersBlockedTimer: 284.685ms - SendersBlockedTotalTimer(*): 5s638ms EXCHANGE_NODE (id=4):(Total: 12s626ms, non-child: 547.395ms, % non-child: 4.34%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.11 MB, 14.80 MB, 25.38 MB, 37.47 MB, 52.96 MB, 64.58 MB, 77.43 MB, 90.82 MB, 104.04 MB, 116.92 MB, 123.78 MB, 124.65 MB - BytesReceived: 124.83 MB (130891245) - ConvertRowBatchTime: 144.463ms - DeserializeRowBatchTimer: 471.342ms - FirstBatchArrivalWaitTime: 9s364ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3743446) - RowsReturnedRate: 296.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b1 (host=d2415.halxg.cloudera.com:22000):(Total: 15s779ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.32 MB, 138.06 MB, 138.12 MB, 266.06 MB, 266.12 MB, 394.12 MB, 394.09 MB, 410.12 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.09 MB, 522.06 MB, 522.09 MB, 570.04 MB, 618.04 MB, 650.04 MB, 698.04 MB, 746.04 MB, 778.04 MB, 781.79 MB, 777.18 MB, 777.14 MB, 779.19 MB, 777.16 MB, 777.20 MB, 777.20 MB, 777.16 MB, 777.16 MB, 777.20 MB, 777.14 MB, 777.12 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 784.91 MB (823033320) - PerHostPeakMemUsage: 2.83 GB (3042352552) - PrepareTime: 186.586ms - RowsProduced: 1 (1) - TotalCpuTime: 9s725ms - TotalNetworkReceiveTime: 17s260ms - TotalNetworkSendTime: 344.026us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 678.130ms, non-child: 678.130ms, % non-child: 100.00%) - CodegenTime: 1.883ms - CompileTime: 107.004ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 390.974ms - PrepareTime: 176.133ms DataStreamSender (dst_id=6):(Total: 25.730us, non-child: 25.730us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 201.20 KB/sec - OverallThroughput: 1.56 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.130us - ThriftTransmitTime(*): 203.854us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s778ms, non-child: 1s268ms, % non-child: 8.04%) ExecOption: Codegen Enabled - BuildTime: 1s074ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 132.10 KB (135272) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s509ms, non-child: 2s300ms, % non-child: 15.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 981.406ms - BuildRows: 10.01M (10005568) - BuildRowsPartitioned: 10.01M (10005568) - BuildTime: 2s757ms - GetNewBlockTime: 17.953ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3743372) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s911ms - RowsReturned: 3.74M (3743372) - RowsReturnedRate: 258.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.690us EXCHANGE_NODE (id=5):(Total: 5s386ms, non-child: 402.159ms, % non-child: 7.47%) BytesReceived(500.000ms): 10.23 MB, 17.05 MB, 53.91 MB, 91.65 MB, 128.73 MB, 161.34 MB, 193.07 MB, 221.52 MB, 238.82 MB, 253.45 MB, 265.26 MB, 274.56 MB, 282.36 MB, 285.12 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB, 285.34 MB - BytesReceived: 285.34 MB (299199948) - ConvertRowBatchTime: 187.721ms - DeserializeRowBatchTimer: 933.346ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.01M (10005568) - RowsReturnedRate: 1.86 M/sec - SendersBlockedTimer: 291.725ms - SendersBlockedTotalTimer(*): 5s794ms EXCHANGE_NODE (id=4):(Total: 12s215ms, non-child: 368.947ms, % non-child: 3.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.69 MB, 15.30 MB, 25.84 MB, 38.32 MB, 53.60 MB, 65.11 MB, 78.12 MB, 91.43 MB, 104.68 MB, 117.45 MB, 123.85 MB, 124.69 MB - BytesReceived: 124.82 MB (130884404) - ConvertRowBatchTime: 115.798ms - DeserializeRowBatchTimer: 578.347ms - FirstBatchArrivalWaitTime: 9s357ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3743372) - RowsReturnedRate: 306.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b7 (host=d2405.halxg.cloudera.com:22000):(Total: 15s778ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 931.99 KB, 138.17 MB, 138.09 MB, 138.12 MB, 266.06 MB, 266.09 MB, 394.09 MB, 394.09 MB, 522.09 MB, 522.09 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.06 MB, 538.04 MB, 586.04 MB, 634.04 MB, 666.04 MB, 714.04 MB, 746.04 MB, 780.60 MB, 777.14 MB, 777.48 MB, 778.01 MB, 777.22 MB, 780.10 MB, 777.86 MB, 777.22 MB, 777.18 MB, 777.20 MB, 777.14 MB, 777.14 MB, 777.12 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 783.68 MB (821750136) - PerHostPeakMemUsage: 2.87 GB (3077819768) - PrepareTime: 191.967ms - RowsProduced: 1 (1) - TotalCpuTime: 9s661ms - TotalNetworkReceiveTime: 17s068ms - TotalNetworkSendTime: 261.473us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 674.924ms, non-child: 674.924ms, % non-child: 100.00%) - CodegenTime: 2.199ms - CompileTime: 103.905ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 385.706ms - PrepareTime: 183.093ms DataStreamSender (dst_id=6):(Total: 27.588us, non-child: 27.588us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 269.52 KB/sec - OverallThroughput: 1.45 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.901us - ThriftTransmitTime(*): 152.178us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s776ms, non-child: 1s190ms, % non-child: 7.54%) ExecOption: Codegen Enabled - BuildTime: 982.743ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 114.26 KB (117000) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s586ms, non-child: 2s578ms, % non-child: 17.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 975.474ms - BuildRows: 10.00M (10001295) - BuildRowsPartitioned: 10.00M (10001295) - BuildTime: 2s879ms - GetNewBlockTime: 16.269ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3742969) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s238ms - RowsReturned: 3.74M (3742969) - RowsReturnedRate: 256.60 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.280us EXCHANGE_NODE (id=5):(Total: 5s387ms, non-child: 424.088ms, % non-child: 7.87%) BytesReceived(500.000ms): 405.79 KB, 10.37 MB, 34.64 MB, 72.09 MB, 110.15 MB, 144.45 MB, 177.08 MB, 207.81 MB, 228.08 MB, 246.60 MB, 259.09 MB, 270.08 MB, 278.24 MB, 284.01 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB - BytesReceived: 285.23 MB (299087195) - ConvertRowBatchTime: 179.523ms - DeserializeRowBatchTimer: 954.459ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001295) - RowsReturnedRate: 1.86 M/sec - SendersBlockedTimer: 301.504ms - SendersBlockedTotalTimer(*): 5s978ms EXCHANGE_NODE (id=4):(Total: 12s015ms, non-child: 510.792ms, % non-child: 4.25%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.35 MB, 10.33 MB, 20.56 MB, 30.75 MB, 46.49 MB, 59.37 MB, 71.10 MB, 84.57 MB, 97.80 MB, 111.10 MB, 121.92 MB, 124.36 MB, 124.79 MB - BytesReceived: 124.80 MB (130864933) - ConvertRowBatchTime: 117.845ms - DeserializeRowBatchTimer: 574.667ms - FirstBatchArrivalWaitTime: 9s343ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3742969) - RowsReturnedRate: 311.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b3 (host=d2410.halxg.cloudera.com:22000):(Total: 15s778ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 21.98 MB, 138.06 MB, 138.09 MB, 266.09 MB, 266.12 MB, 394.12 MB, 394.09 MB, 394.09 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.09 MB, 554.04 MB, 602.04 MB, 650.04 MB, 682.04 MB, 730.04 MB, 762.04 MB, 781.60 MB, 777.16 MB, 777.18 MB, 777.28 MB, 777.18 MB, 777.99 MB, 778.16 MB, 777.16 MB, 777.18 MB, 777.18 MB, 777.13 MB, 777.17 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 782.85 MB (820879048) - PerHostPeakMemUsage: 2.86 GB (3069176904) - PrepareTime: 183.487ms - RowsProduced: 1 (1) - TotalCpuTime: 9s672ms - TotalNetworkReceiveTime: 17s529ms - TotalNetworkSendTime: 153.358us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 660.824ms, non-child: 660.824ms, % non-child: 100.00%) - CodegenTime: 1.872ms - CompileTime: 103.618ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 380.671ms - PrepareTime: 175.105ms DataStreamSender (dst_id=6):(Total: 26.635us, non-child: 26.635us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 344.40 KB/sec - OverallThroughput: 1.50 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.196us - ThriftTransmitTime(*): 119.094us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s776ms, non-child: 1s160ms, % non-child: 7.36%) ExecOption: Codegen Enabled - BuildTime: 971.345ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 111.93 KB (114616) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s615ms, non-child: 2s224ms, % non-child: 15.22%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 910.944ms - BuildRows: 10.00M (10001270) - BuildRowsPartitioned: 10.00M (10001270) - BuildTime: 2s830ms - GetNewBlockTime: 19.162ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3743193) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s884ms - RowsReturned: 3.74M (3743193) - RowsReturnedRate: 256.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.221us EXCHANGE_NODE (id=5):(Total: 5s460ms, non-child: 401.427ms, % non-child: 7.35%) BytesReceived(500.000ms): 9.03 MB, 10.32 MB, 44.62 MB, 82.28 MB, 120.20 MB, 153.27 MB, 185.38 MB, 215.21 MB, 233.89 MB, 250.43 MB, 262.21 MB, 272.46 MB, 280.30 MB, 284.51 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB, 285.20 MB - BytesReceived: 285.20 MB (299054731) - ConvertRowBatchTime: 182.421ms - DeserializeRowBatchTimer: 920.465ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001270) - RowsReturnedRate: 1.83 M/sec - SendersBlockedTimer: 291.137ms - SendersBlockedTotalTimer(*): 5s499ms EXCHANGE_NODE (id=4):(Total: 12s398ms, non-child: 415.086ms, % non-child: 3.35%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.52 MB, 12.27 MB, 23.40 MB, 35.46 MB, 50.34 MB, 62.24 MB, 74.77 MB, 88.19 MB, 101.45 MB, 114.56 MB, 123.23 MB, 124.56 MB - BytesReceived: 124.81 MB (130874418) - ConvertRowBatchTime: 111.266ms - DeserializeRowBatchTimer: 561.091ms - FirstBatchArrivalWaitTime: 9s354ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3743193) - RowsReturnedRate: 301.91 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b8 (host=d2406.halxg.cloudera.com:22000):(Total: 15s776ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.32 MB, 138.09 MB, 138.12 MB, 266.12 MB, 266.09 MB, 394.06 MB, 394.06 MB, 402.09 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.09 MB, 522.09 MB, 570.04 MB, 618.04 MB, 650.04 MB, 698.04 MB, 730.04 MB, 778.04 MB, 781.11 MB, 777.65 MB, 777.14 MB, 777.24 MB, 777.37 MB, 777.20 MB, 777.20 MB, 777.18 MB, 777.20 MB, 777.22 MB, 777.13 MB, 777.16 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 784.43 MB (822538056) - PerHostPeakMemUsage: 2.89 GB (3107866488) - PrepareTime: 188.629ms - RowsProduced: 1 (1) - TotalCpuTime: 9s709ms - TotalNetworkReceiveTime: 17s420ms - TotalNetworkSendTime: 193.116us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 670.236ms, non-child: 670.236ms, % non-child: 100.00%) - CodegenTime: 2.023ms - CompileTime: 105.472ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 382.396ms - PrepareTime: 180.931ms DataStreamSender (dst_id=6):(Total: 28.389us, non-child: 28.389us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 293.94 KB/sec - OverallThroughput: 1.41 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 9.181us - ThriftTransmitTime(*): 139.539us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s774ms, non-child: 1s169ms, % non-child: 7.41%) ExecOption: Codegen Enabled - BuildTime: 973.692ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 105.28 KB (107808) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s605ms, non-child: 2s170ms, % non-child: 14.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 1s050ms - BuildRows: 10.00M (9996685) - BuildRowsPartitioned: 10.00M (9996685) - BuildTime: 2s855ms - GetNewBlockTime: 18.693ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3737768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s781ms - RowsReturned: 3.74M (3737768) - RowsReturnedRate: 255.92 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.263us EXCHANGE_NODE (id=5):(Total: 5s312ms, non-child: 385.760ms, % non-child: 7.26%) BytesReceived(500.000ms): 10.21 MB, 17.50 MB, 54.30 MB, 92.05 MB, 128.87 MB, 161.61 MB, 193.23 MB, 221.53 MB, 238.74 MB, 253.33 MB, 265.08 MB, 274.36 MB, 282.18 MB, 284.88 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB, 285.08 MB - BytesReceived: 285.08 MB (298923024) - ConvertRowBatchTime: 184.590ms - DeserializeRowBatchTimer: 898.067ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9996685) - RowsReturnedRate: 1.88 M/sec - SendersBlockedTimer: 298.170ms - SendersBlockedTotalTimer(*): 5s332ms EXCHANGE_NODE (id=4):(Total: 12s443ms, non-child: 441.745ms, % non-child: 3.55%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.80 MB, 15.44 MB, 25.88 MB, 38.50 MB, 53.65 MB, 65.16 MB, 78.17 MB, 91.49 MB, 104.72 MB, 117.49 MB, 123.69 MB, 124.52 MB - BytesReceived: 124.64 MB (130696952) - ConvertRowBatchTime: 113.327ms - DeserializeRowBatchTimer: 589.747ms - FirstBatchArrivalWaitTime: 9s344ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3737768) - RowsReturnedRate: 300.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1aa (host=d2411.halxg.cloudera.com:22000):(Total: 15s769ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 20.77 MB, 138.09 MB, 138.09 MB, 266.09 MB, 266.23 MB, 394.06 MB, 394.06 MB, 394.06 MB, 522.06 MB, 522.14 MB, 522.12 MB, 522.09 MB, 522.06 MB, 522.09 MB, 554.04 MB, 586.04 MB, 634.04 MB, 666.04 MB, 714.04 MB, 746.04 MB, 768.31 MB, 785.72 MB, 777.18 MB, 780.65 MB, 783.83 MB, 777.26 MB, 777.14 MB, 777.16 MB, 777.14 MB, 777.14 MB, 777.14 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 796.94 MB (835646920) - PerHostPeakMemUsage: 2.89 GB (3100278008) - PrepareTime: 200.560ms - RowsProduced: 1 (1) - TotalCpuTime: 10s011ms - TotalNetworkReceiveTime: 16s905ms - TotalNetworkSendTime: 318.504us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 691.322ms, non-child: 691.322ms, % non-child: 100.00%) - CodegenTime: 1.926ms - CompileTime: 102.761ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 393.745ms - PrepareTime: 193.401ms DataStreamSender (dst_id=6):(Total: 28.390us, non-child: 28.390us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 149.36 KB/sec - OverallThroughput: 1.41 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 10.438us - ThriftTransmitTime(*): 274.612us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s767ms, non-child: 1s159ms, % non-child: 7.36%) ExecOption: Codegen Enabled - BuildTime: 952.213ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 105.28 KB (107808) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s607ms, non-child: 2s555ms, % non-child: 17.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 1s147ms - BuildRows: 10.01M (10009823) - BuildRowsPartitioned: 10.01M (10009823) - BuildTime: 3s085ms - GetNewBlockTime: 17.833ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3744080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s851ms - RowsReturned: 3.74M (3744080) - RowsReturnedRate: 256.30 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.103us EXCHANGE_NODE (id=5):(Total: 5s191ms, non-child: 409.814ms, % non-child: 7.89%) BytesReceived(500.000ms): 8.54 MB, 10.40 MB, 44.17 MB, 81.83 MB, 119.80 MB, 152.95 MB, 185.15 MB, 215.04 MB, 233.81 MB, 250.48 MB, 262.26 MB, 272.61 MB, 280.41 MB, 284.70 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB, 285.43 MB - BytesReceived: 285.43 MB (299296928) - ConvertRowBatchTime: 197.844ms - DeserializeRowBatchTimer: 919.711ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.01M (10009823) - RowsReturnedRate: 1.93 M/sec - SendersBlockedTimer: 319.756ms - SendersBlockedTotalTimer(*): 6s333ms EXCHANGE_NODE (id=4):(Total: 12s059ms, non-child: 584.336ms, % non-child: 4.85%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.32 MB, 12.14 MB, 23.25 MB, 35.22 MB, 50.16 MB, 62.09 MB, 74.56 MB, 87.98 MB, 101.21 MB, 114.35 MB, 123.20 MB, 124.58 MB - BytesReceived: 124.84 MB (130903194) - ConvertRowBatchTime: 109.230ms - DeserializeRowBatchTimer: 502.830ms - FirstBatchArrivalWaitTime: 9s328ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3744080) - RowsReturnedRate: 310.47 K/sec - SendersBlockedTimer: 82.534ms - SendersBlockedTotalTimer(*): 1s499ms Instance d4651cba0a55add:45db634c6f70b1ae (host=d2421.halxg.cloudera.com:22000):(Total: 15s764ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.35 MB, 138.12 MB, 138.12 MB, 266.12 MB, 266.12 MB, 394.06 MB, 394.09 MB, 522.07 MB, 522.06 MB, 522.09 MB, 522.12 MB, 522.06 MB, 522.06 MB, 538.04 MB, 586.04 MB, 634.04 MB, 682.04 MB, 746.04 MB, 777.03 MB, 777.16 MB, 777.16 MB, 778.38 MB, 777.16 MB, 786.00 MB, 781.43 MB, 777.18 MB, 777.39 MB, 777.33 MB, 777.18 MB, 777.12 MB, 777.11 MB, 777.12 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 789.87 MB (828233592) - PerHostPeakMemUsage: 2.86 GB (3069496600) - PrepareTime: 196.713ms - RowsProduced: 1 (1) - TotalCpuTime: 8s940ms - TotalNetworkReceiveTime: 17s581ms - TotalNetworkSendTime: 201.669us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 688.775ms, non-child: 688.775ms, % non-child: 100.00%) - CodegenTime: 1.829ms - CompileTime: 104.144ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 394.798ms - PrepareTime: 188.411ms DataStreamSender (dst_id=6):(Total: 39.470us, non-child: 39.470us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 358.78 KB/sec - OverallThroughput: 1.01 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 19.900us - ThriftTransmitTime(*): 114.320us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s763ms, non-child: 1s082ms, % non-child: 6.87%) ExecOption: Codegen Enabled - BuildTime: 877.647ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 101.28 KB (103712) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s681ms, non-child: 2s235ms, % non-child: 15.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 880.958ms - BuildRows: 10.00M (10001120) - BuildRowsPartitioned: 10.00M (10001120) - BuildTime: 2s190ms - GetNewBlockTime: 16.428ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3742988) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s214ms - RowsReturned: 3.74M (3742988) - RowsReturnedRate: 254.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.217us EXCHANGE_NODE (id=5):(Total: 5s467ms, non-child: 418.889ms, % non-child: 7.66%) BytesReceived(500.000ms): 10.23 MB, 28.80 MB, 66.06 MB, 104.03 MB, 139.22 MB, 172.10 MB, 203.02 MB, 224.27 MB, 244.06 MB, 257.17 MB, 268.51 MB, 276.96 MB, 283.70 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB, 285.21 MB - BytesReceived: 285.21 MB (299064839) - ConvertRowBatchTime: 179.787ms - DeserializeRowBatchTimer: 941.562ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001120) - RowsReturnedRate: 1.83 M/sec - SendersBlockedTimer: 313.086ms - SendersBlockedTotalTimer(*): 5s913ms EXCHANGE_NODE (id=4):(Total: 12s451ms, non-child: 567.294ms, % non-child: 4.56%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 984.08 KB, 10.28 MB, 18.83 MB, 29.11 MB, 44.04 MB, 57.53 MB, 69.03 MB, 82.47 MB, 95.74 MB, 108.98 MB, 120.77 MB, 124.24 MB, 124.78 MB - BytesReceived: 124.82 MB (130886261) - ConvertRowBatchTime: 119.215ms - DeserializeRowBatchTimer: 474.166ms - FirstBatchArrivalWaitTime: 9s328ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3742988) - RowsReturnedRate: 300.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance d4651cba0a55add:45db634c6f70b1b9 (host=d2402.halxg.cloudera.com:22000):(Total: 15s747ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.35 MB, 138.20 MB, 138.06 MB, 266.06 MB, 266.06 MB, 394.12 MB, 394.12 MB, 394.09 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.06 MB, 522.09 MB, 522.09 MB, 554.04 MB, 602.04 MB, 634.04 MB, 666.04 MB, 714.04 MB, 746.04 MB, 771.27 MB, 796.50 MB, 777.16 MB, 777.26 MB, 777.14 MB, 777.22 MB, 777.18 MB, 777.12 MB, 777.16 MB, 777.22 MB, 777.16 MB, 777.16 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 796.94 MB (835646920) - PerHostPeakMemUsage: 2.32 GB (2489226872) - PrepareTime: 189.276ms - RowsProduced: 1 (1) - TotalCpuTime: 10s091ms - TotalNetworkReceiveTime: 17s104ms - TotalNetworkSendTime: 108.990us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 747.401ms, non-child: 747.401ms, % non-child: 100.00%) - CodegenTime: 1.957ms - CompileTime: 111.951ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 452.420ms - PrepareTime: 181.562ms DataStreamSender (dst_id=6):(Total: 25.434us, non-child: 25.434us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 495.84 KB/sec - OverallThroughput: 1.57 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 8.616us - ThriftTransmitTime(*): 82.719us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s746ms, non-child: 1s042ms, % non-child: 6.62%) ExecOption: Codegen Enabled - BuildTime: 844.804ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 144.62 KB (148096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s703ms, non-child: 2s673ms, % non-child: 18.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 943.726ms - BuildRows: 10.00M (10001762) - BuildRowsPartitioned: 10.00M (10001762) - BuildTime: 3s179ms - GetNewBlockTime: 14.210ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3740641) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s873ms - RowsReturned: 3.74M (3740641) - RowsReturnedRate: 254.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.207us EXCHANGE_NODE (id=5):(Total: 5s392ms, non-child: 532.247ms, % non-child: 9.87%) BytesReceived(500.000ms): 10.23 MB, 12.35 MB, 48.57 MB, 86.34 MB, 123.90 MB, 156.82 MB, 188.77 MB, 217.95 MB, 236.05 MB, 251.80 MB, 263.55 MB, 273.35 MB, 281.18 MB, 284.73 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB, 285.23 MB - BytesReceived: 285.23 MB (299085552) - ConvertRowBatchTime: 185.001ms - DeserializeRowBatchTimer: 1s067ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001762) - RowsReturnedRate: 1.85 M/sec - SendersBlockedTimer: 327.697ms - SendersBlockedTotalTimer(*): 6s181ms EXCHANGE_NODE (id=4):(Total: 12s038ms, non-child: 225.571ms, % non-child: 1.87%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.89 MB, 13.67 MB, 24.38 MB, 36.17 MB, 51.63 MB, 63.35 MB, 76.09 MB, 89.43 MB, 102.71 MB, 115.76 MB, 123.46 MB, 124.54 MB - BytesReceived: 124.73 MB (130793057) - ConvertRowBatchTime: 105.378ms - DeserializeRowBatchTimer: 524.516ms - FirstBatchArrivalWaitTime: 9s314ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740641) - RowsReturnedRate: 310.73 K/sec - SendersBlockedTimer: 309.282ms - SendersBlockedTotalTimer(*): 5s208ms Instance d4651cba0a55add:45db634c6f70b1b4 (host=d2420.halxg.cloudera.com:22000):(Total: 15s628ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 24.32 MB, 161.53 MB, 140.19 MB, 266.35 MB, 266.09 MB, 394.15 MB, 394.09 MB, 426.20 MB, 522.09 MB, 522.15 MB, 522.06 MB, 522.06 MB, 522.09 MB, 522.09 MB, 554.04 MB, 602.04 MB, 634.04 MB, 682.04 MB, 714.04 MB, 762.04 MB, 791.07 MB, 793.51 MB, 777.24 MB, 778.59 MB, 777.18 MB, 778.36 MB, 777.18 MB, 777.20 MB, 777.20 MB, 777.14 MB, 777.16 MB, 777.12 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 796.94 MB (835646920) - PerHostPeakMemUsage: 2.96 GB (3181654960) - PrepareTime: 247.704ms - RowsProduced: 1 (1) - TotalCpuTime: 10s354ms - TotalNetworkReceiveTime: 15s744ms - TotalNetworkSendTime: 274.723us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 873.937ms, non-child: 873.937ms, % non-child: 100.00%) - CodegenTime: 2.288ms - CompileTime: 134.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 499.354ms - PrepareTime: 238.537ms DataStreamSender (dst_id=6):(Total: 38.642us, non-child: 38.642us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 218.78 KB/sec - OverallThroughput: 1.04 MB/sec - PeakMemoryUsage: 3.20 KB (3272) - SerializeBatchTime: 13.171us - ThriftTransmitTime(*): 187.472us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 15s626ms, non-child: 1s239ms, % non-child: 7.93%) ExecOption: Codegen Enabled - BuildTime: 985.657ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 127.17 KB (130224) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s387ms, non-child: 2s615ms, % non-child: 18.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Produced - BuildPartitionTime: 1s661ms - BuildRows: 10.00M (9999435) - BuildRowsPartitioned: 10.00M (9999435) - BuildTime: 3s222ms - GetNewBlockTime: 32.773ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.02 MB (815816704) - PinTime: 0.000ns - ProbeRows: 3.74M (3740314) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s889ms - RowsReturned: 3.74M (3740314) - RowsReturnedRate: 259.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.361us EXCHANGE_NODE (id=5):(Total: 4s481ms, non-child: 1s184ms, % non-child: 26.43%) BytesReceived(500.000ms): 10.23 MB, 17.74 MB, 54.50 MB, 92.32 MB, 129.16 MB, 161.85 MB, 193.47 MB, 221.86 MB, 238.98 MB, 253.50 MB, 265.28 MB, 274.50 MB, 282.33 MB, 284.96 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB, 285.15 MB - BytesReceived: 285.15 MB (299006218) - ConvertRowBatchTime: 358.825ms - DeserializeRowBatchTimer: 1s775ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9999435) - RowsReturnedRate: 2.23 M/sec - SendersBlockedTimer: 528.149ms - SendersBlockedTotalTimer(*): 10s273ms EXCHANGE_NODE (id=4):(Total: 11s785ms, non-child: 290.433ms, % non-child: 2.46%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.90 MB, 15.54 MB, 25.97 MB, 38.66 MB, 53.75 MB, 65.21 MB, 78.24 MB, 91.56 MB, 104.85 MB, 117.64 MB, 123.80 MB, 124.62 MB - BytesReceived: 124.75 MB (130811102) - ConvertRowBatchTime: 110.005ms - DeserializeRowBatchTimer: 547.671ms - FirstBatchArrivalWaitTime: 9s139ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740314) - RowsReturnedRate: 317.36 K/sec - SendersBlockedTimer: 101.700ms - SendersBlockedTotalTimer(*): 1s788ms Fragment F01: Instance d4651cba0a55add:45db634c6f70b1c5 (host=d2418.halxg.cloudera.com:22000):(Total: 7s079ms, non-child: 28.863ms, % non-child: 0.41%) Hdfs split stats (:<# splits>/): 3:1/253.69 MB 2:1/253.71 MB MemoryUsage(500.000ms): 94.12 MB, 94.41 MB, 94.36 MB, 94.43 MB, 94.32 MB, 78.55 MB, 78.61 MB, 78.53 MB, 70.53 MB, 62.62 MB, 62.63 MB, 62.59 MB, 46.59 MB, 46.53 MB, 5.09 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.70 MB (99302440) - PerHostPeakMemUsage: 608.92 MB (638496560) - PrepareTime: 109.162us - RowsProduced: 15.47M (15472879) - TotalCpuTime: 20s162ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 880.836ms - TotalStorageWaitTime: 27.653ms DataStreamSender (dst_id=5):(Total: 6s955ms, non-child: 6s955ms, % non-child: 100.00%) - BytesSent: 445.08 MB (466703396) - NetworkThroughput(*): 30.75 MB/sec - OverallThroughput: 63.99 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 3s879ms - ThriftTransmitTime(*): 14s474ms - UncompressedRowBatchSize: 835.30 MB (875879620) HDFS_SCAN_NODE (id=1):(Total: 94.685ms, non-child: 94.685ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 3:1/253.69 MB 2:1/253.71 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.87 - BytesRead: 74.37 MB (77981177) - BytesReadDataNodeCache: 0 - BytesReadLocal: 74.37 MB (77981177) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74.37 MB (77981177) - DecompressionTime: 230.994ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 94.05 MB (98622504) - PerReadThreadRawHdfsThroughput: 1.82 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 15.47M (15472879) - RowsReturned: 15.47M (15472879) - RowsReturnedRate: 163.41 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 811 (811) - ScannerThreadsTotalWallClockTime: 13s962ms - MaterializeTupleTime(*): 13s683ms - ScannerThreadsSysTime: 27.995ms - ScannerThreadsUserTime: 1s362ms - ScannerThreadsVoluntaryContextSwitches: 14.90K (14901) - TotalRawHdfsReadTime(*): 39.881ms - TotalReadThroughput: 9.92 MB/sec Instance d4651cba0a55add:45db634c6f70b1bf (host=d2404.halxg.cloudera.com:22000):(Total: 6s611ms, non-child: 20.992ms, % non-child: 0.32%) Hdfs split stats (:<# splits>/): 5:1/253.67 MB 7:1/253.71 MB MemoryUsage(500.000ms): 92.32 MB, 94.50 MB, 94.31 MB, 94.38 MB, 94.46 MB, 78.55 MB, 78.62 MB, 78.52 MB, 62.60 MB, 62.53 MB, 62.55 MB, 46.66 MB, 46.57 MB, 13.30 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.73 MB (99335208) - PerHostPeakMemUsage: 601.00 MB (630189656) - PrepareTime: 85.999us - RowsProduced: 15.51M (15510434) - TotalCpuTime: 18s752ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 877.640ms - TotalStorageWaitTime: 24.327ms DataStreamSender (dst_id=5):(Total: 6s511ms, non-child: 6s511ms, % non-child: 100.00%) - BytesSent: 448.57 MB (470362158) - NetworkThroughput(*): 29.17 MB/sec - OverallThroughput: 68.88 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 3s659ms - ThriftTransmitTime(*): 15s376ms - UncompressedRowBatchSize: 837.34 MB (878015544) HDFS_SCAN_NODE (id=1):(Total: 78.852ms, non-child: 78.852ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/253.67 MB 7:1/253.71 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB, 74.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 74.55 MB (78171198) - BytesReadDataNodeCache: 0 - BytesReadLocal: 74.55 MB (78171198) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74.55 MB (78171198) - DecompressionTime: 232.348ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 93.99 MB (98557256) - PerReadThreadRawHdfsThroughput: 1.89 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 15.51M (15510434) - RowsReturned: 15.51M (15510434) - RowsReturnedRate: 196.70 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 664 (664) - ScannerThreadsTotalWallClockTime: 13s021ms - MaterializeTupleTime(*): 12s743ms - ScannerThreadsSysTime: 28.994ms - ScannerThreadsUserTime: 1s392ms - ScannerThreadsVoluntaryContextSwitches: 14.88K (14881) - TotalRawHdfsReadTime(*): 38.500ms - TotalReadThroughput: 10.65 MB/sec Instance d4651cba0a55add:45db634c6f70b1c9 (host=d2408.halxg.cloudera.com:22000):(Total: 6s566ms, non-child: 21.090ms, % non-child: 0.32%) Hdfs split stats (:<# splits>/): 2:1/253.75 MB 5:1/253.67 MB MemoryUsage(500.000ms): 94.26 MB, 94.43 MB, 94.43 MB, 94.36 MB, 86.46 MB, 78.59 MB, 78.54 MB, 78.63 MB, 62.56 MB, 62.56 MB, 62.62 MB, 46.48 MB, 46.55 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.69 MB (99288952) - PerHostPeakMemUsage: 600.98 MB (630169272) - PrepareTime: 86.146us - RowsProduced: 15.47M (15473316) - TotalCpuTime: 18s618ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 884.445ms - TotalStorageWaitTime: 22.685ms DataStreamSender (dst_id=5):(Total: 6s463ms, non-child: 6s463ms, % non-child: 100.00%) - BytesSent: 441.92 MB (463391056) - NetworkThroughput(*): 29.43 MB/sec - OverallThroughput: 68.37 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 3s626ms - ThriftTransmitTime(*): 15s013ms - UncompressedRowBatchSize: 835.33 MB (875902122) HDFS_SCAN_NODE (id=1):(Total: 81.695ms, non-child: 81.695ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 2:1/253.75 MB 5:1/253.67 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB, 74.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 74.37 MB (77983887) - BytesReadDataNodeCache: 0 - BytesReadLocal: 74.37 MB (77983887) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74.37 MB (77983887) - DecompressionTime: 222.656ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 94.01 MB (98576240) - PerReadThreadRawHdfsThroughput: 1.96 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 15.47M (15473316) - RowsReturned: 15.47M (15473316) - RowsReturnedRate: 189.40 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 605 (605) - ScannerThreadsTotalWallClockTime: 12s939ms - MaterializeTupleTime(*): 12s676ms - ScannerThreadsSysTime: 24.995ms - ScannerThreadsUserTime: 1s317ms - ScannerThreadsVoluntaryContextSwitches: 14.84K (14839) - TotalRawHdfsReadTime(*): 37.016ms - TotalReadThroughput: 11.44 MB/sec Instance d4651cba0a55add:45db634c6f70b1c2 (host=d2402.halxg.cloudera.com:22000):(Total: 6s505ms, non-child: 22.529ms, % non-child: 0.35%) Hdfs split stats (:<# splits>/): 9:1/253.68 MB 10:1/253.70 MB MemoryUsage(500.000ms): 94.47 MB, 94.44 MB, 94.34 MB, 94.35 MB, 78.45 MB, 78.55 MB, 78.46 MB, 62.49 MB, 62.50 MB, 62.51 MB, 46.61 MB, 46.54 MB, 46.70 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.69 MB (99286344) - PerHostPeakMemUsage: 601.39 MB (630598696) - PrepareTime: 111.100us - RowsProduced: 15.50M (15497124) - TotalCpuTime: 18s884ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 778.596ms - TotalStorageWaitTime: 19.461ms DataStreamSender (dst_id=5):(Total: 6s411ms, non-child: 6s411ms, % non-child: 100.00%) - BytesSent: 449.92 MB (471780118) - NetworkThroughput(*): 30.59 MB/sec - OverallThroughput: 70.17 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 3s710ms - ThriftTransmitTime(*): 14s707ms - UncompressedRowBatchSize: 836.61 MB (877254376) HDFS_SCAN_NODE (id=1):(Total: 70.724ms, non-child: 70.724ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 9:1/253.68 MB 10:1/253.70 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB, 74.49 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 74.49 MB (78105804) - BytesReadDataNodeCache: 0 - BytesReadLocal: 74.49 MB (78105804) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74.49 MB (78105804) - DecompressionTime: 225.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 94.01 MB (98574856) - PerReadThreadRawHdfsThroughput: 2.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 15.50M (15497124) - RowsReturned: 15.50M (15497124) - RowsReturnedRate: 219.12 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 576 (576) - ScannerThreadsTotalWallClockTime: 13s043ms - MaterializeTupleTime(*): 12s781ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 1s250ms - ScannerThreadsVoluntaryContextSwitches: 14.90K (14897) - TotalRawHdfsReadTime(*): 34.249ms - TotalReadThroughput: 11.46 MB/sec Instance d4651cba0a55add:45db634c6f70b1c8 (host=d2415.halxg.cloudera.com:22000):(Total: 5s821ms, non-child: 20.326ms, % non-child: 0.35%) Hdfs split stats (:<# splits>/): 3:1/253.73 MB 5:1/104.03 MB 4:1/71.21 MB MemoryUsage(500.000ms): 40.78 MB, 88.03 MB, 87.77 MB, 87.86 MB, 88.00 MB, 87.84 MB, 87.95 MB, 58.53 MB, 46.44 MB, 38.07 MB, 37.99 MB, 30.01 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 4, 3, 2, 2, 2, 2 - AverageThreadTokens: 3.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 88.23 MB (92515608) - PerHostPeakMemUsage: 584.74 MB (613144248) - PrepareTime: 158.607us - RowsProduced: 13.13M (13128300) - TotalCpuTime: 17s871ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 856.203ms - TotalStorageWaitTime: 25.034ms DataStreamSender (dst_id=5):(Total: 5s734ms, non-child: 5s734ms, % non-child: 100.00%) - BytesSent: 378.98 MB (397386167) - NetworkThroughput(*): 26.98 MB/sec - OverallThroughput: 66.09 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - SerializeBatchTime: 3s168ms - ThriftTransmitTime(*): 14s046ms - UncompressedRowBatchSize: 708.75 MB (743175591) HDFS_SCAN_NODE (id=1):(Total: 67.048ms, non-child: 67.048ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 3:1/253.73 MB 5:1/104.03 MB 4:1/71.21 MB Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:0% 2:0% 3:8.333% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 12.85 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB, 63.33 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 2.25 - BytesRead: 63.33 MB (66406942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 63.33 MB (66406942) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 63.33 MB (66406942) - DecompressionTime: 201.382ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 87.59 MB (91843864) - PerReadThreadRawHdfsThroughput: 2.00 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 13.13M (13128300) - RowsReturned: 13.13M (13128300) - RowsReturnedRate: 195.80 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 517 (517) - ScannerThreadsTotalWallClockTime: 12s910ms - MaterializeTupleTime(*): 12s663ms - ScannerThreadsSysTime: 15.996ms - ScannerThreadsUserTime: 1s227ms - ScannerThreadsVoluntaryContextSwitches: 12.49K (12494) - TotalRawHdfsReadTime(*): 30.985ms - TotalReadThroughput: 10.56 MB/sec Instance d4651cba0a55add:45db634c6f70b1cd (host=d2414.halxg.cloudera.com:22000):(Total: 5s572ms, non-child: 19.766ms, % non-child: 0.35%) Hdfs split stats (:<# splits>/): 3:1/253.71 MB 4:1/69.92 MB 5:1/78.03 MB MemoryUsage(500.000ms): 80.76 MB, 81.39 MB, 81.44 MB, 81.33 MB, 81.40 MB, 81.39 MB, 52.99 MB, 45.97 MB, 37.98 MB, 38.03 MB, 30.08 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 3, 2, 2, 2, 2 - AverageThreadTokens: 3.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 81.62 MB (85585456) - PerHostPeakMemUsage: 576.38 MB (604380520) - PrepareTime: 126.264us - RowsProduced: 12.38M (12375235) - TotalCpuTime: 16s775ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 885.992ms - TotalStorageWaitTime: 25.216ms DataStreamSender (dst_id=5):(Total: 5s495ms, non-child: 5s495ms, % non-child: 100.00%) - BytesSent: 359.67 MB (377142392) - NetworkThroughput(*): 26.38 MB/sec - OverallThroughput: 65.45 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 2s995ms - ThriftTransmitTime(*): 13s633ms - UncompressedRowBatchSize: 668.08 MB (700532797) HDFS_SCAN_NODE (id=1):(Total: 57.479ms, non-child: 57.479ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 3:1/253.71 MB 4:1/69.92 MB 5:1/78.03 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB, 59.73 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.18 - BytesRead: 59.73 MB (62626354) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.73 MB (62626354) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.73 MB (62626354) - DecompressionTime: 189.085ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 81.03 MB (84962872) - PerReadThreadRawHdfsThroughput: 2.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 12.38M (12375235) - RowsReturned: 12.38M (12375235) - RowsReturnedRate: 215.30 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 493 (493) - ScannerThreadsTotalWallClockTime: 12s095ms - MaterializeTupleTime(*): 11s862ms - ScannerThreadsSysTime: 12.997ms - ScannerThreadsUserTime: 1s062ms - ScannerThreadsVoluntaryContextSwitches: 11.76K (11757) - TotalRawHdfsReadTime(*): 26.081ms - TotalReadThroughput: 10.86 MB/sec Instance d4651cba0a55add:45db634c6f70b1c7 (host=d2409.halxg.cloudera.com:22000):(Total: 4s891ms, non-child: 19.325ms, % non-child: 0.40%) Hdfs split stats (:<# splits>/): 5:1/97.12 MB 2:1/253.58 MB MemoryUsage(500.000ms): 70.14 MB, 70.31 MB, 70.44 MB, 70.38 MB, 70.51 MB, 54.63 MB, 46.03 MB, 37.97 MB, 38.07 MB, 29.96 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 2, 2, 2, 2 - AverageThreadTokens: 2.60 - BloomFilterBytes: 0 - PeakMemoryUsage: 70.70 MB (74136904) - PerHostPeakMemUsage: 576.34 MB (604332920) - PrepareTime: 91.575us - RowsProduced: 10.75M (10749666) - TotalCpuTime: 11s734ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 887.902ms - TotalStorageWaitTime: 18.022ms DataStreamSender (dst_id=5):(Total: 4s812ms, non-child: 4s812ms, % non-child: 100.00%) - BytesSent: 306.48 MB (321362578) - NetworkThroughput(*): 22.12 MB/sec - OverallThroughput: 63.68 MB/sec - PeakMemoryUsage: 688.00 KB (704512) - SerializeBatchTime: 2s537ms - ThriftTransmitTime(*): 13s853ms - UncompressedRowBatchSize: 580.33 MB (608520420) HDFS_SCAN_NODE (id=1):(Total: 59.494ms, non-child: 59.494ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/97.12 MB 2:1/253.58 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB, 51.78 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.60 - BytesRead: 51.78 MB (54293412) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.78 MB (54293412) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.78 MB (54293412) - DecompressionTime: 151.196ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 69.99 MB (73391432) - PerReadThreadRawHdfsThroughput: 2.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.75M (10749666) - RowsReturned: 10.75M (10749666) - RowsReturnedRate: 180.68 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 398 (398) - ScannerThreadsTotalWallClockTime: 7s733ms - MaterializeTupleTime(*): 7s550ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 938.857ms - ScannerThreadsVoluntaryContextSwitches: 10.16K (10161) - TotalRawHdfsReadTime(*): 22.310ms - TotalReadThroughput: 10.36 MB/sec Instance d4651cba0a55add:45db634c6f70b1ca (host=d2421.halxg.cloudera.com:22000):(Total: 4s794ms, non-child: 17.631ms, % non-child: 0.37%) Hdfs split stats (:<# splits>/): 6:1/253.55 MB 1:1/104.81 MB MemoryUsage(500.000ms): 74.34 MB, 74.52 MB, 74.36 MB, 74.34 MB, 58.65 MB, 58.47 MB, 46.04 MB, 38.02 MB, 29.98 MB, 30.02 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 2, 2, 2, 2 - AverageThreadTokens: 2.60 - BloomFilterBytes: 0 - PeakMemoryUsage: 74.65 MB (78273864) - PerHostPeakMemUsage: 576.29 MB (604287432) - PrepareTime: 433.550us - RowsProduced: 10.96M (10964920) - TotalCpuTime: 11s576ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 839.010ms - TotalStorageWaitTime: 18.635ms DataStreamSender (dst_id=5):(Total: 4s717ms, non-child: 4s717ms, % non-child: 100.00%) - BytesSent: 312.40 MB (327570651) - NetworkThroughput(*): 24.05 MB/sec - OverallThroughput: 66.22 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 2s527ms - ThriftTransmitTime(*): 12s989ms - UncompressedRowBatchSize: 591.95 MB (620704199) HDFS_SCAN_NODE (id=1):(Total: 59.354ms, non-child: 59.354ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 6:1/253.55 MB 1:1/104.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.60 - BytesRead: 52.81 MB (55370287) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.81 MB (55370287) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.81 MB (55370287) - DecompressionTime: 154.516ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 73.99 MB (77585736) - PerReadThreadRawHdfsThroughput: 2.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.96M (10964920) - RowsReturned: 10.96M (10964920) - RowsReturnedRate: 184.74 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 396 (396) - ScannerThreadsTotalWallClockTime: 7s624ms - MaterializeTupleTime(*): 7s437ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 928.857ms - ScannerThreadsVoluntaryContextSwitches: 10.36K (10362) - TotalRawHdfsReadTime(*): 25.150ms - TotalReadThroughput: 10.56 MB/sec Instance d4651cba0a55add:45db634c6f70b1bc (host=d2411.halxg.cloudera.com:22000):(Total: 4s538ms, non-child: 18.800ms, % non-child: 0.41%) Hdfs split stats (:<# splits>/): 1:1/74.41 MB 10:1/253.63 MB MemoryUsage(500.000ms): 67.50 MB, 67.50 MB, 67.42 MB, 67.44 MB, 46.01 MB, 46.04 MB, 38.00 MB, 30.03 MB, 29.99 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 67.66 MB (70942024) - PerHostPeakMemUsage: 568.38 MB (595988072) - PrepareTime: 106.787us - RowsProduced: 10.06M (10058574) - TotalCpuTime: 10s398ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 846.931ms - TotalStorageWaitTime: 17.985ms DataStreamSender (dst_id=5):(Total: 4s470ms, non-child: 4s470ms, % non-child: 100.00%) - BytesSent: 282.37 MB (296083102) - NetworkThroughput(*): 23.01 MB/sec - OverallThroughput: 63.16 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 2s315ms - ThriftTransmitTime(*): 12s270ms - UncompressedRowBatchSize: 543.01 MB (569384720) HDFS_SCAN_NODE (id=1):(Total: 49.108ms, non-child: 49.108ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 1:1/74.41 MB 10:1/253.63 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 48.46 MB, 48.46 MB, 48.46 MB, 48.46 MB, 48.46 MB, 48.46 MB, 48.46 MB, 48.46 MB, 48.46 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.44 - BytesRead: 48.46 MB (50819167) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.46 MB (50819167) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.46 MB (50819167) - DecompressionTime: 154.967ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 66.99 MB (70245712) - PerReadThreadRawHdfsThroughput: 2.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.06M (10058574) - RowsReturned: 10.06M (10058574) - RowsReturnedRate: 204.82 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 358 (358) - ScannerThreadsTotalWallClockTime: 6s709ms - MaterializeTupleTime(*): 6s522ms - ScannerThreadsSysTime: 27.995ms - ScannerThreadsUserTime: 849.870ms - ScannerThreadsVoluntaryContextSwitches: 9.46K (9464) - TotalRawHdfsReadTime(*): 20.651ms - TotalReadThroughput: 10.77 MB/sec Instance d4651cba0a55add:45db634c6f70b1be (host=d2410.halxg.cloudera.com:22000):(Total: 4s478ms, non-child: 16.928ms, % non-child: 0.38%) Hdfs split stats (:<# splits>/): 5:1/66.53 MB 3:1/253.60 MB MemoryUsage(500.000ms): 64.32 MB, 64.43 MB, 64.40 MB, 64.40 MB, 46.01 MB, 45.97 MB, 37.94 MB, 30.01 MB, 30.02 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.63 MB (67771720) - PerHostPeakMemUsage: 568.37 MB (595983584) - PrepareTime: 140.305us - RowsProduced: 9.83M (9829511) - TotalCpuTime: 10s162ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 838.940ms - TotalStorageWaitTime: 17.872ms DataStreamSender (dst_id=5):(Total: 4s413ms, non-child: 4s413ms, % non-child: 100.00%) - BytesSent: 280.47 MB (294091643) - NetworkThroughput(*): 22.15 MB/sec - OverallThroughput: 63.55 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 2s324ms - ThriftTransmitTime(*): 12s663ms - UncompressedRowBatchSize: 530.65 MB (556422172) HDFS_SCAN_NODE (id=1):(Total: 48.665ms, non-child: 48.665ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/66.53 MB 3:1/253.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 47.37 MB, 47.37 MB, 47.37 MB, 47.37 MB, 47.37 MB, 47.37 MB, 47.37 MB, 47.37 MB, 47.37 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.44 - BytesRead: 47.37 MB (49672293) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.37 MB (49672293) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.37 MB (49672293) - DecompressionTime: 145.750ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 63.99 MB (67099976) - PerReadThreadRawHdfsThroughput: 2.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.83M (9829511) - RowsReturned: 9.83M (9829511) - RowsReturnedRate: 201.98 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 336 (336) - ScannerThreadsTotalWallClockTime: 6s526ms - MaterializeTupleTime(*): 6s349ms - ScannerThreadsSysTime: 25.995ms - ScannerThreadsUserTime: 852.869ms - ScannerThreadsVoluntaryContextSwitches: 9.25K (9247) - TotalRawHdfsReadTime(*): 21.410ms - TotalReadThroughput: 10.53 MB/sec Instance d4651cba0a55add:45db634c6f70b1cb (host=d2403.halxg.cloudera.com:22000):(Total: 4s358ms, non-child: 17.077ms, % non-child: 0.39%) Hdfs split stats (:<# splits>/): 0:1/54.11 MB 10:1/253.68 MB MemoryUsage(500.000ms): 64.42 MB, 64.44 MB, 64.41 MB, 64.44 MB, 46.00 MB, 38.02 MB, 38.00 MB, 30.02 MB, 2.96 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.65 MB (67788104) - PerHostPeakMemUsage: 568.35 MB (595963384) - PrepareTime: 108.181us - RowsProduced: 9.41M (9408348) - TotalCpuTime: 9s634ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 885.446ms - TotalStorageWaitTime: 16.299ms DataStreamSender (dst_id=5):(Total: 4s290ms, non-child: 4s290ms, % non-child: 100.00%) - BytesSent: 270.68 MB (283832028) - NetworkThroughput(*): 21.07 MB/sec - OverallThroughput: 63.09 MB/sec - PeakMemoryUsage: 712.00 KB (729088) - SerializeBatchTime: 2s211ms - ThriftTransmitTime(*): 12s846ms - UncompressedRowBatchSize: 507.91 MB (532586420) HDFS_SCAN_NODE (id=1):(Total: 51.369ms, non-child: 51.369ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 0:1/54.11 MB 10:1/253.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.33 - BytesRead: 45.36 MB (47563382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 45.36 MB (47563382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 45.36 MB (47563382) - DecompressionTime: 136.043ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 63.99 MB (67099976) - PerReadThreadRawHdfsThroughput: 2.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.41M (9408348) - RowsReturned: 9.41M (9408348) - RowsReturnedRate: 183.15 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 343 (343) - ScannerThreadsTotalWallClockTime: 6s163ms - MaterializeTupleTime(*): 5s999ms - ScannerThreadsSysTime: 12.997ms - ScannerThreadsUserTime: 810.876ms - ScannerThreadsVoluntaryContextSwitches: 8.83K (8830) - TotalRawHdfsReadTime(*): 20.549ms - TotalReadThroughput: 10.08 MB/sec Instance d4651cba0a55add:45db634c6f70b1cc (host=d2416.halxg.cloudera.com:22000):(Total: 4s337ms, non-child: 16.674ms, % non-child: 0.38%) Hdfs split stats (:<# splits>/): 8:1/253.73 MB 10:1/53.57 MB MemoryUsage(500.000ms): 64.28 MB, 64.51 MB, 64.38 MB, 64.38 MB, 45.89 MB, 45.97 MB, 38.03 MB, 29.99 MB, 30.03 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.63 MB (67771720) - PerHostPeakMemUsage: 568.34 MB (595951216) - PrepareTime: 83.040us - RowsProduced: 9.41M (9407563) - TotalCpuTime: 9s543ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 887.882ms - TotalStorageWaitTime: 15.833ms DataStreamSender (dst_id=5):(Total: 4s271ms, non-child: 4s271ms, % non-child: 100.00%) - BytesSent: 273.62 MB (286916002) - NetworkThroughput(*): 20.82 MB/sec - OverallThroughput: 64.06 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - SerializeBatchTime: 2s211ms - ThriftTransmitTime(*): 13s143ms - UncompressedRowBatchSize: 507.87 MB (532543818) HDFS_SCAN_NODE (id=1):(Total: 48.917ms, non-child: 48.917ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 8:1/253.73 MB 10:1/53.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.44 - BytesRead: 45.36 MB (47560208) - BytesReadDataNodeCache: 0 - BytesReadLocal: 45.36 MB (47560208) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 45.36 MB (47560208) - DecompressionTime: 134.008ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 63.99 MB (67099976) - PerReadThreadRawHdfsThroughput: 2.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.41M (9407563) - RowsReturned: 9.41M (9407563) - RowsReturnedRate: 192.32 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 19 (19) - ScannerThreadsTotalWallClockTime: 6s097ms - MaterializeTupleTime(*): 5s934ms - ScannerThreadsSysTime: 12.997ms - ScannerThreadsUserTime: 827.873ms - ScannerThreadsVoluntaryContextSwitches: 8.81K (8815) - TotalRawHdfsReadTime(*): 20.309ms - TotalReadThroughput: 10.08 MB/sec Instance d4651cba0a55add:45db634c6f70b1c3 (host=d2406.halxg.cloudera.com:22000):(Total: 4s151ms, non-child: 17.881ms, % non-child: 0.43%) Hdfs split stats (:<# splits>/): 2:1/48.89 MB 9:1/253.68 MB MemoryUsage(500.000ms): 64.44 MB, 64.36 MB, 64.37 MB, 46.04 MB, 46.07 MB, 38.10 MB, 29.99 MB, 6.77 MB ThreadUsage(500.000ms): 3, 3, 3, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.65 MB (67788104) - PerHostPeakMemUsage: 541.97 MB (568297672) - PrepareTime: 147.409us - RowsProduced: 9.26M (9256253) - TotalCpuTime: 8s896ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 840.049ms - TotalStorageWaitTime: 29.765ms DataStreamSender (dst_id=5):(Total: 4s087ms, non-child: 4s087ms, % non-child: 100.00%) - BytesSent: 259.93 MB (272559856) - NetworkThroughput(*): 21.64 MB/sec - OverallThroughput: 63.59 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 2s082ms - ThriftTransmitTime(*): 12s013ms - UncompressedRowBatchSize: 499.70 MB (523976325) HDFS_SCAN_NODE (id=1):(Total: 45.620ms, non-child: 45.620ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 2:1/48.89 MB 9:1/253.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.25 - BytesRead: 44.63 MB (46800551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 44.63 MB (46800551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 44.63 MB (46800551) - DecompressionTime: 135.326ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 63.99 MB (67099976) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.26M (9256253) - RowsReturned: 9.26M (9256253) - RowsReturnedRate: 202.90 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 322 (322) - ScannerThreadsTotalWallClockTime: 5s601ms - MaterializeTupleTime(*): 5s422ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 746.885ms - ScannerThreadsVoluntaryContextSwitches: 8.69K (8690) - TotalRawHdfsReadTime(*): 23.159ms - TotalReadThroughput: 11.16 MB/sec Instance d4651cba0a55add:45db634c6f70b1ce (host=d2405.halxg.cloudera.com:22000):(Total: 3s837ms, non-child: 19.649ms, % non-child: 0.51%) Hdfs split stats (:<# splits>/): 4:1/253.73 MB MemoryUsage(500.000ms): 53.64 MB, 53.95 MB, 54.00 MB, 46.08 MB, 46.02 MB, 37.92 MB, 29.97 MB, 12.68 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 54.15 MB (56781912) - PerHostPeakMemUsage: 448.44 MB (470228184) - PrepareTime: 101.334us - RowsProduced: 7.75M (7745611) - TotalCpuTime: 6s836ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 736.173ms - TotalStorageWaitTime: 10.018ms DataStreamSender (dst_id=5):(Total: 3s770ms, non-child: 3s770ms, % non-child: 100.00%) - BytesSent: 215.74 MB (226217999) - NetworkThroughput(*): 18.26 MB/sec - OverallThroughput: 57.22 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 1s913ms - ThriftTransmitTime(*): 11s813ms - UncompressedRowBatchSize: 418.15 MB (438463771) HDFS_SCAN_NODE (id=1):(Total: 47.632ms, non-child: 47.632ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/253.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.88 - BytesRead: 37.23 MB (39039260) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.23 MB (39039260) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.23 MB (39039260) - DecompressionTime: 115.361ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 53.47 MB (56069080) - PerReadThreadRawHdfsThroughput: 2.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.75M (7745611) - RowsReturned: 7.75M (7745611) - RowsReturnedRate: 162.61 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 254 (254) - ScannerThreadsTotalWallClockTime: 3s729ms - MaterializeTupleTime(*): 3s595ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 622.905ms - ScannerThreadsVoluntaryContextSwitches: 7.14K (7143) - TotalRawHdfsReadTime(*): 16.088ms - TotalReadThroughput: 9.31 MB/sec Instance d4651cba0a55add:45db634c6f70b1c4 (host=d2412.halxg.cloudera.com:22000):(Total: 3s824ms, non-child: 16.568ms, % non-child: 0.43%) Hdfs split stats (:<# splits>/): 3:1/253.72 MB MemoryUsage(500.000ms): 53.60 MB, 53.88 MB, 53.89 MB, 46.05 MB, 46.06 MB, 38.10 MB, 37.97 MB, 30.06 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 54.15 MB (56781912) - PerHostPeakMemUsage: 448.42 MB (470203160) - PrepareTime: 80.540us - RowsProduced: 7.72M (7724097) - TotalCpuTime: 6s773ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 777.665ms - TotalStorageWaitTime: 9.988ms DataStreamSender (dst_id=5):(Total: 3s760ms, non-child: 3s760ms, % non-child: 100.00%) - BytesSent: 213.12 MB (223469477) - NetworkThroughput(*): 16.90 MB/sec - OverallThroughput: 56.68 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - SerializeBatchTime: 1s869ms - ThriftTransmitTime(*): 12s612ms - UncompressedRowBatchSize: 416.99 MB (437242139) HDFS_SCAN_NODE (id=1):(Total: 48.097ms, non-child: 48.097ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/253.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 37.13 MB, 37.13 MB, 37.13 MB, 37.13 MB, 37.13 MB, 37.13 MB, 37.13 MB, 37.13 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 37.13 MB (38932607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.13 MB (38932607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.13 MB (38932607) - DecompressionTime: 117.251ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 53.47 MB (56068576) - PerReadThreadRawHdfsThroughput: 2.48 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.72M (7724097) - RowsReturned: 7.72M (7724097) - RowsReturnedRate: 160.59 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 244 (244) - ScannerThreadsTotalWallClockTime: 3s719ms - MaterializeTupleTime(*): 3s582ms - ScannerThreadsSysTime: 16.997ms - ScannerThreadsUserTime: 635.903ms - ScannerThreadsVoluntaryContextSwitches: 7.14K (7136) - TotalRawHdfsReadTime(*): 14.648ms - TotalReadThroughput: 9.28 MB/sec Instance d4651cba0a55add:45db634c6f70b1c0 (host=d2407.halxg.cloudera.com:22000):(Total: 3s746ms, non-child: 16.312ms, % non-child: 0.44%) Hdfs split stats (:<# splits>/): 6:1/253.72 MB MemoryUsage(500.000ms): 53.95 MB, 53.82 MB, 53.91 MB, 46.12 MB, 38.04 MB, 38.08 MB, 30.03 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 54.15 MB (56781912) - PerHostPeakMemUsage: 448.41 MB (470188808) - PrepareTime: 121.353us - RowsProduced: 7.74M (7743716) - TotalCpuTime: 6s614ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 774.265ms - TotalStorageWaitTime: 8.942ms DataStreamSender (dst_id=5):(Total: 3s683ms, non-child: 3s683ms, % non-child: 100.00%) - BytesSent: 221.95 MB (232735219) - NetworkThroughput(*): 17.58 MB/sec - OverallThroughput: 60.26 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - SerializeBatchTime: 1s821ms - ThriftTransmitTime(*): 12s623ms - UncompressedRowBatchSize: 418.05 MB (438357746) HDFS_SCAN_NODE (id=1):(Total: 46.502ms, non-child: 46.502ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/253.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 37.22 MB, 37.22 MB, 37.22 MB, 37.22 MB, 37.22 MB, 37.22 MB, 37.22 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 37.22 MB (39028197) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.22 MB (39028197) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.22 MB (39028197) - DecompressionTime: 108.144ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 53.47 MB (56070832) - PerReadThreadRawHdfsThroughput: 2.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.74M (7743716) - RowsReturned: 7.74M (7743716) - RowsReturnedRate: 166.52 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 284 (284) - ScannerThreadsTotalWallClockTime: 3s639ms - MaterializeTupleTime(*): 3s513ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 683.896ms - ScannerThreadsVoluntaryContextSwitches: 7.14K (7137) - TotalRawHdfsReadTime(*): 15.584ms - TotalReadThroughput: 10.63 MB/sec Instance d4651cba0a55add:45db634c6f70b1c6 (host=d2419.halxg.cloudera.com:22000):(Total: 3s215ms, non-child: 18.213ms, % non-child: 0.57%) Hdfs split stats (:<# splits>/): 8:1/72.33 MB 0:1/67.68 MB 7:1/78.55 MB MemoryUsage(500.000ms): 43.06 MB, 54.25 MB, 54.25 MB, 54.16 MB, 54.09 MB, 54.22 MB, 25.78 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 3.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 54.47 MB (57115128) - PerHostPeakMemUsage: 464.62 MB (487192152) - PrepareTime: 106.818us - RowsProduced: 6.78M (6775579) - TotalCpuTime: 11s498ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 776.866ms - TotalStorageWaitTime: 24.704ms DataStreamSender (dst_id=5):(Total: 3s161ms, non-child: 3s161ms, % non-child: 100.00%) - BytesSent: 188.65 MB (197809725) - NetworkThroughput(*): 15.83 MB/sec - OverallThroughput: 59.66 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 1s544ms - ThriftTransmitTime(*): 11s913ms - UncompressedRowBatchSize: 365.78 MB (383548726) HDFS_SCAN_NODE (id=1):(Total: 35.589ms, non-child: 35.589ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 8:1/72.33 MB 0:1/67.68 MB 7:1/78.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB, 32.94 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.86 - BytesRead: 32.94 MB (34539309) - BytesReadDataNodeCache: 0 - BytesReadLocal: 32.94 MB (34539309) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 32.94 MB (34539309) - DecompressionTime: 97.543ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 53.81 MB (56418800) - PerReadThreadRawHdfsThroughput: 1.96 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 6.78M (6775579) - RowsReturned: 6.78M (6775579) - RowsReturnedRate: 190.38 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 263 (263) - ScannerThreadsTotalWallClockTime: 9s073ms - MaterializeTupleTime(*): 8s938ms - ScannerThreadsSysTime: 16.996ms - ScannerThreadsUserTime: 558.914ms - ScannerThreadsVoluntaryContextSwitches: 6.36K (6355) - TotalRawHdfsReadTime(*): 16.436ms - TotalReadThroughput: 9.41 MB/sec Instance d4651cba0a55add:45db634c6f70b1bb (host=d2413.halxg.cloudera.com:22000):(Total: 2s529ms, non-child: 14.000ms, % non-child: 0.55%) Hdfs split stats (:<# splits>/): 9:1/103.98 MB 8:1/53.15 MB MemoryUsage(500.000ms): 44.18 MB, 44.42 MB, 44.44 MB, 44.34 MB, 25.99 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2 - AverageThreadTokens: 2.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 44.72 MB (46889952) - PerHostPeakMemUsage: 326.77 MB (342641664) - PrepareTime: 90.272us - RowsProduced: 4.84M (4840445) - TotalCpuTime: 6s025ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 777.488ms - TotalStorageWaitTime: 16.623ms DataStreamSender (dst_id=5):(Total: 2s488ms, non-child: 2s488ms, % non-child: 100.00%) - BytesSent: 132.56 MB (138996565) - NetworkThroughput(*): 11.57 MB/sec - OverallThroughput: 53.27 MB/sec - PeakMemoryUsage: 704.00 KB (720896) - SerializeBatchTime: 1s095ms - ThriftTransmitTime(*): 11s456ms - UncompressedRowBatchSize: 261.31 MB (274003587) HDFS_SCAN_NODE (id=1):(Total: 26.623ms, non-child: 26.623ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 9:1/103.98 MB 8:1/53.15 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 23.51 MB, 23.51 MB, 23.51 MB, 23.51 MB, 23.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.80 - BytesRead: 23.51 MB (24647969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 23.51 MB (24647969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23.51 MB (24647969) - DecompressionTime: 75.972ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 44.05 MB (46193704) - PerReadThreadRawHdfsThroughput: 1.81 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.84M (4840445) - RowsReturned: 4.84M (4840445) - RowsReturnedRate: 181.81 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 185 (185) - ScannerThreadsTotalWallClockTime: 4s281ms - MaterializeTupleTime(*): 4s180ms - ScannerThreadsSysTime: 9.997ms - ScannerThreadsUserTime: 438.932ms - ScannerThreadsVoluntaryContextSwitches: 4.43K (4428) - TotalRawHdfsReadTime(*): 12.661ms - TotalReadThroughput: 9.40 MB/sec Instance d4651cba0a55add:45db634c6f70b1bd (host=d2420.halxg.cloudera.com:22000):(Total: 2s391ms, non-child: 18.396ms, % non-child: 0.77%) Hdfs split stats (:<# splits>/): 8:1/57.03 MB 9:1/67.01 MB MemoryUsage(500.000ms): 424.00 KB, 34.49 MB, 34.48 MB, 34.37 MB, 34.59 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 34.75 MB (36437288) - PerHostPeakMemUsage: 317.69 MB (333122584) - PrepareTime: 208.294us - RowsProduced: 3.84M (3842976) - TotalCpuTime: 6s082ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 732.545ms - TotalStorageWaitTime: 20.147ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 256.00 MB (268435456) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 2s342ms, non-child: 2s342ms, % non-child: 100.00%) - BytesSent: 107.42 MB (112636655) - NetworkThroughput(*): 10.26 MB/sec - OverallThroughput: 45.85 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - SerializeBatchTime: 1s045ms - ThriftTransmitTime(*): 10s466ms - UncompressedRowBatchSize: 207.47 MB (217544273) HDFS_SCAN_NODE (id=1):(Total: 29.773ms, non-child: 29.773ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 8:1/57.03 MB 9:1/67.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 18.73 MB, 18.73 MB, 18.73 MB, 18.73 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 18.73 MB (19644417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.73 MB (19644417) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.73 MB (19644417) - DecompressionTime: 71.986ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 34.05 MB (35708232) - PerReadThreadRawHdfsThroughput: 1.80 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 3.84M (3842976) - RowsReturned: 3.84M (3842976) - RowsReturnedRate: 129.07 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 201 (201) - ScannerThreadsTotalWallClockTime: 4s385ms - MaterializeTupleTime(*): 4s283ms - ScannerThreadsSysTime: 22.996ms - ScannerThreadsUserTime: 438.932ms - ScannerThreadsVoluntaryContextSwitches: 3.48K (3480) - TotalRawHdfsReadTime(*): 10.160ms - TotalReadThroughput: 7.49 MB/sec Instance d4651cba0a55add:45db634c6f70b1c1 (host=d2417.halxg.cloudera.com:22000):(Total: 2s348ms, non-child: 20.154ms, % non-child: 0.86%) Hdfs split stats (:<# splits>/): 6:1/38.92 MB 10:1/96.50 MB MemoryUsage(500.000ms): 39.93 MB, 40.27 MB, 40.34 MB, 29.96 MB, 13.65 MB ThreadUsage(500.000ms): 3, 3, 3, 2, 1 - AverageThreadTokens: 2.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 40.67 MB (42646832) - PerHostPeakMemUsage: 312.32 MB (327489488) - PrepareTime: 102.539us - RowsProduced: 4.20M (4195453) - TotalCpuTime: 5s368ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 781.353ms - TotalStorageWaitTime: 13.127ms DataStreamSender (dst_id=5):(Total: 2s306ms, non-child: 2s306ms, % non-child: 100.00%) - BytesSent: 113.84 MB (119365533) - NetworkThroughput(*): 10.36 MB/sec - OverallThroughput: 49.36 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - SerializeBatchTime: 965.765ms - ThriftTransmitTime(*): 10s988ms - UncompressedRowBatchSize: 226.48 MB (237483598) HDFS_SCAN_NODE (id=1):(Total: 22.432ms, non-child: 22.432ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 6:1/38.92 MB 10:1/96.50 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 20.42 MB, 20.42 MB, 20.42 MB, 20.42 MB, 20.42 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.40 - BytesRead: 20.42 MB (21413137) - BytesReadDataNodeCache: 0 - BytesReadLocal: 20.42 MB (21413137) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 20.42 MB (21413137) - DecompressionTime: 66.083ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 39.99 MB (41934152) - PerReadThreadRawHdfsThroughput: 2.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.20M (4195453) - RowsReturned: 4.20M (4195453) - RowsReturnedRate: 187.02 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 155 (155) - ScannerThreadsTotalWallClockTime: 3s806ms - MaterializeTupleTime(*): 3s718ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 383.941ms - ScannerThreadsVoluntaryContextSwitches: 3.81K (3809) - TotalRawHdfsReadTime(*): 9.113ms - TotalReadThroughput: 8.17 MB/sec Fragment F00: Instance d4651cba0a55add:45db634c6f70b1e1 (host=d2402.halxg.cloudera.com:22000):(Total: 15s910ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.21 MB 9:5/1.24 GB 1:2/506.45 MB 5:7/1.73 GB 7:4/1012.85 MB 3:5/1.24 GB 4:3/759.76 MB 2:6/1.48 GB 10:2/506.38 MB 6:5/1.24 GB 0:4/1012.86 MB Filter 0 arrival: 10s890ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.52 GB, 1.27 GB, 1.00 GB, 724.33 MB, 836.72 MB, 1.31 GB, 1.09 GB, 812.02 MB, 747.41 MB, 858.33 MB, 583.78 MB, 227.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 12, 11, 8 - AverageThreadTokens: 10.38 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 1.53 GB (1647936088) - PerHostPeakMemUsage: 2.32 GB (2489226872) - PrepareTime: 175.701ms - RowsProduced: 3.76M (3756480) - TotalCpuTime: 2m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 597.132ms - TotalStorageWaitTime: 1s846ms CodeGen:(Total: 426.349ms, non-child: 426.349ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 245.187ms - PrepareTime: 173.380ms DataStreamSender (dst_id=4):(Total: 2s807ms, non-child: 2s807ms, % non-child: 100.00%) - BytesSent: 122.70 MB (128661469) - NetworkThroughput(*): 23.63 MB/sec - OverallThroughput: 43.70 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s312ms - ThriftTransmitTime(*): 5s193ms - UncompressedRowBatchSize: 222.15 MB (232945864) HDFS_SCAN_NODE (id=0):(Total: 13s258ms, non-child: 13s258ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 8:1/253.21 MB 9:5/1.24 GB 1:2/506.45 MB 5:7/1.73 GB 7:4/1012.85 MB 3:5/1.24 GB 4:3/759.76 MB 2:6/1.48 GB 10:2/506.38 MB 6:5/1.24 GB 0:4/1012.86 MB Runtime filters: Only following filters arrived: , waited 9s572ms Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:3.125% 2:0% 3:3.125% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.43 GB, 1.43 GB, 1.43 GB, 1.43 GB, 1.98 GB, 2.78 GB, 2.86 GB, 2.86 GB, 3.23 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 9.38 - BytesRead: 3.71 GB (3979897336) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3979897336) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3979897336) - DecompressionTime: 11s692ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 1.53 GB (1646275848) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.38M (301383618) - RowsReturned: 3.76M (3756480) - RowsReturnedRate: 283.32 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 18.06K (18063) - ScannerThreadsTotalWallClockTime: 2m31s - MaterializeTupleTime(*): 1m19s - ScannerThreadsSysTime: 667.892ms - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 4.34K (4337) - TotalRawHdfsReadTime(*): 2s737ms - TotalReadThroughput: 237.22 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1da (host=d2404.halxg.cloudera.com:22000):(Total: 15s644ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:3/759.65 MB 4:1/253.19 MB 8:5/1.19 GB 5:4/1012.88 MB 9:3/759.74 MB 1:5/1.24 GB 0:5/1.24 GB 10:5/1.24 GB 2:6/1.43 GB 6:4/1012.86 MB 7:4/1012.76 MB Filter 0 arrival: 11s053ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 297.19 MB, 2.03 GB, 1.83 GB, 1.51 GB, 1.15 GB, 741.58 MB, 1.86 GB, 1.65 GB, 1.36 GB, 1.05 GB, 564.19 MB, 51.73 MB, 20.98 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 23, 20, 2, 2 - AverageThreadTokens: 12.70 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.05 GB (2197751456) - PerHostPeakMemUsage: 2.82 GB (3029398320) - PrepareTime: 193.729ms - RowsProduced: 3.81M (3813505) - TotalCpuTime: 3m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 920.004ms - TotalStorageWaitTime: 2s070ms CodeGen:(Total: 468.644ms, non-child: 468.644ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.633ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 269.113ms - PrepareTime: 191.278ms DataStreamSender (dst_id=4):(Total: 3s448ms, non-child: 3s448ms, % non-child: 100.00%) - BytesSent: 126.22 MB (132355277) - NetworkThroughput(*): 26.74 MB/sec - OverallThroughput: 36.60 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s410ms - ThriftTransmitTime(*): 4s720ms - UncompressedRowBatchSize: 225.53 MB (236482074) HDFS_SCAN_NODE (id=0):(Total: 12s368ms, non-child: 12s368ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 3:3/759.65 MB 4:1/253.19 MB 8:5/1.19 GB 5:4/1012.88 MB 9:3/759.74 MB 1:5/1.24 GB 0:5/1.24 GB 10:5/1.24 GB 2:6/1.43 GB 6:4/1012.86 MB 7:4/1012.76 MB Runtime filters: Only following filters arrived: , waited 9s528ms Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:3.125% 2:0% 3:0% 4:0% 5:3.125% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:180 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 189.78 MB, 1.91 GB, 1.91 GB, 1.91 GB, 1.91 GB, 2.07 GB, 3.60 GB, 3.75 GB, 3.75 GB, 3.75 GB, 3.76 GB, 3.76 GB, 3.76 GB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 12.06 - BytesRead: 3.76 GB (4037054463) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.76 GB (4037054463) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.76 GB (4037054463) - DecompressionTime: 14s988ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.05 GB (2196115776) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 305.70M (305704052) - RowsReturned: 3.81M (3813505) - RowsReturnedRate: 308.32 K/sec - ScanRangesComplete: 45 (45) - ScannerThreadsInvoluntaryContextSwitches: 49.17K (49168) - ScannerThreadsTotalWallClockTime: 3m17s - MaterializeTupleTime(*): 1m41s - ScannerThreadsSysTime: 910.851ms - ScannerThreadsUserTime: 1m48s - ScannerThreadsVoluntaryContextSwitches: 5.51K (5512) - TotalRawHdfsReadTime(*): 3s186ms - TotalReadThroughput: 240.63 MB/sec Filter 0: - Rows processed: 737.24K (737235) - Rows rejected: 0 (0) - Rows total: 737.28K (737280) Instance d4651cba0a55add:45db634c6f70b1d7 (host=d2408.halxg.cloudera.com:22000):(Total: 15s411ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:4/1012.87 MB 6:4/1012.88 MB 0:5/1.24 GB 9:5/1.24 GB 7:2/506.45 MB 10:5/1.24 GB 5:3/759.69 MB 2:3/759.71 MB 1:6/1.48 GB 3:3/759.70 MB 4:4/1012.95 MB Filter 0 arrival: 11s154ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.22 GB, 2.05 GB, 1.77 GB, 1.43 GB, 1010.12 MB, 717.62 MB, 1.78 GB, 1.60 GB, 1.32 GB, 1.02 GB, 589.13 MB, 48.62 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 22, 22, 22, 20, 3 - AverageThreadTokens: 13.66 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.08 GB (2228061744) - PerHostPeakMemUsage: 2.85 GB (3060465832) - PrepareTime: 183.577ms - RowsProduced: 3.76M (3762743) - TotalCpuTime: 3m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 704.549ms - TotalStorageWaitTime: 2s616ms CodeGen:(Total: 433.947ms, non-child: 433.947ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 244.633ms - PrepareTime: 181.458ms DataStreamSender (dst_id=4):(Total: 3s237ms, non-child: 3s237ms, % non-child: 100.00%) - BytesSent: 126.17 MB (132298300) - NetworkThroughput(*): 29.65 MB/sec - OverallThroughput: 38.97 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s387ms - ThriftTransmitTime(*): 4s255ms - UncompressedRowBatchSize: 222.52 MB (233334238) HDFS_SCAN_NODE (id=0):(Total: 12s337ms, non-child: 12s337ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 8:4/1012.87 MB 6:4/1012.88 MB 0:5/1.24 GB 9:5/1.24 GB 7:2/506.45 MB 10:5/1.24 GB 5:3/759.69 MB 2:3/759.71 MB 1:6/1.48 GB 3:3/759.70 MB 4:4/1012.95 MB Runtime filters: Only following filters arrived: , waited 9s570ms Hdfs Read Thread Concurrency Bucket: 0:93.55% 1:3.226% 2:3.226% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.14 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.11 GB, 3.60 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 13.06 - BytesRead: 3.71 GB (3980077766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3980077766) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3980077766) - DecompressionTime: 15s398ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.07 GB (2226278608) - PerReadThreadRawHdfsThroughput: 1006.52 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.40M (301397952) - RowsReturned: 3.76M (3762743) - RowsReturnedRate: 304.98 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 37.95K (37953) - ScannerThreadsTotalWallClockTime: 3m19s - MaterializeTupleTime(*): 1m41s - ScannerThreadsSysTime: 943.845ms - ScannerThreadsUserTime: 1m48s - ScannerThreadsVoluntaryContextSwitches: 5.88K (5877) - TotalRawHdfsReadTime(*): 3s771ms - TotalReadThroughput: 237.23 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1dd (host=d2416.halxg.cloudera.com:22000):(Total: 15s320ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:4/1012.95 MB 5:4/1012.80 MB 9:5/1.24 GB 2:4/1012.83 MB 1:4/1012.93 MB 10:3/759.67 MB 7:5/1.24 GB 4:3/759.62 MB 8:3/759.66 MB 6:4/1012.92 MB 3:5/1.24 GB Filter 0 arrival: 10s966ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 918.10 MB, 2.06 GB, 1.87 GB, 1.60 GB, 1.18 GB, 773.13 MB, 1.81 GB, 1.54 GB, 1.22 GB, 856.44 MB, 216.46 MB, 28.75 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 21, 9, 2 - AverageThreadTokens: 16.16 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.07 GB (2226907592) - PerHostPeakMemUsage: 2.86 GB (3067393488) - PrepareTime: 174.496ms - RowsProduced: 3.76M (3759441) - TotalCpuTime: 4m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 743.580ms - TotalStorageWaitTime: 2s457ms CodeGen:(Total: 438.029ms, non-child: 438.029ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.306ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 258.007ms - PrepareTime: 172.422ms DataStreamSender (dst_id=4):(Total: 3s405ms, non-child: 3s405ms, % non-child: 100.00%) - BytesSent: 124.95 MB (131015783) - NetworkThroughput(*): 29.04 MB/sec - OverallThroughput: 36.69 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s449ms - ThriftTransmitTime(*): 4s302ms - UncompressedRowBatchSize: 222.33 MB (233129478) HDFS_SCAN_NODE (id=0):(Total: 12s071ms, non-child: 12s071ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 0:4/1012.95 MB 5:4/1012.80 MB 9:5/1.24 GB 2:4/1012.83 MB 1:4/1012.93 MB 10:3/759.67 MB 7:5/1.24 GB 4:3/759.62 MB 8:3/759.66 MB 6:4/1012.92 MB 3:5/1.24 GB Runtime filters: Only following filters arrived: , waited 9s570ms Hdfs Read Thread Concurrency Bucket: 0:90.32% 1:3.226% 2:3.226% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:3.226% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 778.52 MB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.17 GB, 3.62 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.39 - AverageScannerThreadConcurrency: 15.65 - BytesRead: 3.71 GB (3979995731) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3979995731) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3979995731) - DecompressionTime: 15s832ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.07 GB (2225009984) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.39M (301391906) - RowsReturned: 3.76M (3759441) - RowsReturnedRate: 311.44 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 25.80K (25805) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 1m34s - ScannerThreadsSysTime: 869.860ms - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 8.25K (8247) - TotalRawHdfsReadTime(*): 2s838ms - TotalReadThroughput: 244.88 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1e0 (host=d2406.halxg.cloudera.com:22000):(Total: 15s297ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:3/759.65 MB 3:3/759.72 MB 7:4/1012.90 MB 8:6/1.48 GB 2:3/759.60 MB 1:4/1012.84 MB 5:4/950.49 MB 0:5/1.24 GB 10:3/759.61 MB 6:5/1.24 GB 4:4/1012.94 MB Filter 0 arrival: 10s982ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.04 GB, 1.83 GB, 1.55 GB, 1.22 GB, 766.34 MB, 1.63 GB, 1.67 GB, 1.34 GB, 1.06 GB, 596.51 MB, 28.40 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 20, 2 - AverageThreadTokens: 17.03 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.12 GB (2276199840) - PerHostPeakMemUsage: 2.89 GB (3107866488) - PrepareTime: 182.691ms - RowsProduced: 3.74M (3737582) - TotalCpuTime: 4m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 760.770ms - TotalStorageWaitTime: 2s461ms CodeGen:(Total: 412.883ms, non-child: 412.883ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 225.034ms - PrepareTime: 180.483ms DataStreamSender (dst_id=4):(Total: 3s253ms, non-child: 3s253ms, % non-child: 100.00%) - BytesSent: 123.94 MB (129963224) - NetworkThroughput(*): 29.04 MB/sec - OverallThroughput: 38.10 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s364ms - ThriftTransmitTime(*): 4s268ms - UncompressedRowBatchSize: 221.04 MB (231773968) HDFS_SCAN_NODE (id=0):(Total: 12s207ms, non-child: 12s207ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 9:3/759.65 MB 3:3/759.72 MB 7:4/1012.90 MB 8:6/1.48 GB 2:3/759.60 MB 1:4/1012.84 MB 5:4/950.49 MB 0:5/1.24 GB 10:3/759.61 MB 6:5/1.24 GB 4:4/1012.94 MB Runtime filters: Only following filters arrived: , waited 9s590ms Hdfs Read Thread Concurrency Bucket: 0:96.77% 1:0% 2:0% 3:3.226% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 2.00 GB, 3.36 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 16.03 - BytesRead: 3.69 GB (3957749248) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3957749248) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3957749248) - DecompressionTime: 15s676ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.12 GB (2274408504) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.70M (299702704) - RowsReturned: 3.74M (3737582) - RowsReturnedRate: 306.18 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 37.40K (37400) - ScannerThreadsTotalWallClockTime: 4m11s - MaterializeTupleTime(*): 1m37s - ScannerThreadsSysTime: 1s156ms - ScannerThreadsUserTime: 1m45s - ScannerThreadsVoluntaryContextSwitches: 8.47K (8467) - TotalRawHdfsReadTime(*): 3s601ms - TotalReadThroughput: 243.51 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1de (host=d2414.halxg.cloudera.com:22000):(Total: 15s179ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/506.45 MB 7:5/1.24 GB 9:3/759.72 MB 4:4/1012.84 MB 3:5/1.24 GB 0:4/1012.78 MB 1:3/710.41 MB 2:4/1012.88 MB 10:2/506.37 MB 5:5/1.24 GB 8:7/1.73 GB Filter 0 arrival: 10s979ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.54 GB, 2.09 GB, 1.83 GB, 1.55 GB, 1004.22 MB, 724.68 MB, 1.87 GB, 1.55 GB, 1.28 GB, 1000.44 MB, 528.11 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 19 - AverageThreadTokens: 15.48 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.10 GB (2255045264) - PerHostPeakMemUsage: 2.89 GB (3100663896) - PrepareTime: 180.072ms - RowsProduced: 3.74M (3735793) - TotalCpuTime: 3m54s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 730.165ms - TotalStorageWaitTime: 2s655ms CodeGen:(Total: 417.463ms, non-child: 417.463ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 231.789ms - PrepareTime: 177.977ms DataStreamSender (dst_id=4):(Total: 3s161ms, non-child: 3s161ms, % non-child: 100.00%) - BytesSent: 124.48 MB (130529131) - NetworkThroughput(*): 29.61 MB/sec - OverallThroughput: 39.37 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s382ms - ThriftTransmitTime(*): 4s203ms - UncompressedRowBatchSize: 220.93 MB (231663026) HDFS_SCAN_NODE (id=0):(Total: 12s179ms, non-child: 12s179ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 6:2/506.45 MB 7:5/1.24 GB 9:3/759.72 MB 4:4/1012.84 MB 3:5/1.24 GB 0:4/1012.78 MB 1:3/710.41 MB 2:4/1012.88 MB 10:2/506.37 MB 5:5/1.24 GB 8:7/1.73 GB Runtime filters: Only following filters arrived: , waited 9s590ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:6.667% 2:0% 3:3.333% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.44 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.15 GB, 3.67 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 14.97 - BytesRead: 3.69 GB (3962331655) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3962331655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3962331655) - DecompressionTime: 16s656ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.10 GB (2253172232) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.05M (300050286) - RowsReturned: 3.74M (3735793) - RowsReturnedRate: 306.73 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 37.78K (37780) - ScannerThreadsTotalWallClockTime: 3m42s - MaterializeTupleTime(*): 1m39s - ScannerThreadsSysTime: 853.860ms - ScannerThreadsUserTime: 1m46s - ScannerThreadsVoluntaryContextSwitches: 7.24K (7242) - TotalRawHdfsReadTime(*): 3s128ms - TotalReadThroughput: 243.79 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1df (host=d2405.halxg.cloudera.com:22000):(Total: 15s160ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:3/706.78 MB 7:4/1012.88 MB 0:2/506.42 MB 8:5/1.20 GB 3:3/759.54 MB 6:7/1.69 GB 9:4/1012.90 MB 2:6/1.48 GB 4:2/506.34 MB 1:4/1012.89 MB 10:5/1.20 GB Filter 0 arrival: 10s961ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.51 GB, 2.06 GB, 1.74 GB, 1.39 GB, 812.98 MB, 1.07 GB, 1.83 GB, 1.48 GB, 1.14 GB, 704.41 MB, 115.70 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 19, 5 - AverageThreadTokens: 17.23 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.09 GB (2246046016) - PerHostPeakMemUsage: 2.87 GB (3077819768) - PrepareTime: 185.794ms - RowsProduced: 3.79M (3789454) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 711.186ms - TotalStorageWaitTime: 2s501ms CodeGen:(Total: 413.016ms, non-child: 413.016ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 221.936ms - PrepareTime: 182.828ms DataStreamSender (dst_id=4):(Total: 3s284ms, non-child: 3s284ms, % non-child: 100.00%) - BytesSent: 129.99 MB (136308241) - NetworkThroughput(*): 30.45 MB/sec - OverallThroughput: 39.58 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s445ms - ThriftTransmitTime(*): 4s269ms - UncompressedRowBatchSize: 224.10 MB (234990640) HDFS_SCAN_NODE (id=0):(Total: 12s039ms, non-child: 12s039ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 5:3/706.78 MB 7:4/1012.88 MB 0:2/506.42 MB 8:5/1.20 GB 3:3/759.54 MB 6:7/1.69 GB 9:4/1012.90 MB 2:6/1.48 GB 4:2/506.34 MB 1:4/1012.89 MB 10:5/1.20 GB Runtime filters: Only following filters arrived: , waited 9s591ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:0% 2:3.333% 3:3.333% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:180 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.40 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 2.68 GB, 3.73 GB, 3.73 GB, 3.73 GB, 3.73 GB, 3.73 GB - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 16.77 - BytesRead: 3.73 GB (4010254972) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.73 GB (4010254972) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.73 GB (4010254972) - DecompressionTime: 15s085ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.09 GB (2244189368) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 303.67M (303669080) - RowsReturned: 3.79M (3789454) - RowsReturnedRate: 314.74 K/sec - ScanRangesComplete: 45 (45) - ScannerThreadsInvoluntaryContextSwitches: 38.79K (38789) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 780.870ms - ScannerThreadsUserTime: 1m42s - ScannerThreadsVoluntaryContextSwitches: 8.61K (8605) - TotalRawHdfsReadTime(*): 3s443ms - TotalReadThroughput: 246.74 MB/sec Filter 0: - Rows processed: 737.24K (737235) - Rows rejected: 0 (0) - Rows total: 737.28K (737280) Instance d4651cba0a55add:45db634c6f70b1d4 (host=d2407.halxg.cloudera.com:22000):(Total: 15s098ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:3/759.72 MB 9:3/759.59 MB 10:2/506.45 MB 7:4/1012.87 MB 0:6/1.48 GB 4:6/1.48 GB 5:3/759.69 MB 1:5/1.24 GB 2:6/1.48 GB 8:4/1012.80 MB 3:2/506.47 MB Filter 0 arrival: 11s186ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.06 GB, 1.90 GB, 1.68 GB, 1.33 GB, 891.29 MB, 1.39 GB, 1.72 GB, 1.39 GB, 1.05 GB, 615.15 MB, 68.20 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 22, 22, 19, 4 - AverageThreadTokens: 17.84 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.06 GB (2215545712) - PerHostPeakMemUsage: 2.84 GB (3047296952) - PrepareTime: 185.850ms - RowsProduced: 3.76M (3756967) - TotalCpuTime: 4m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 729.973ms - TotalStorageWaitTime: 2s129ms CodeGen:(Total: 434.545ms, non-child: 434.545ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 242.741ms - PrepareTime: 183.641ms DataStreamSender (dst_id=4):(Total: 3s269ms, non-child: 3s269ms, % non-child: 100.00%) - BytesSent: 123.83 MB (129844573) - NetworkThroughput(*): 28.82 MB/sec - OverallThroughput: 37.87 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s385ms - ThriftTransmitTime(*): 4s296ms - UncompressedRowBatchSize: 222.18 MB (232976074) HDFS_SCAN_NODE (id=0):(Total: 11s997ms, non-child: 11s997ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 6:3/759.72 MB 9:3/759.59 MB 10:2/506.45 MB 7:4/1012.87 MB 0:6/1.48 GB 4:6/1.48 GB 5:3/759.69 MB 1:5/1.24 GB 2:6/1.48 GB 8:4/1012.80 MB 3:2/506.47 MB Runtime filters: Only following filters arrived: , waited 9s572ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:3.333% 2:3.333% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.04 GB, 3.02 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 17.40 - BytesRead: 3.70 GB (3976707080) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.70 GB (3976707080) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.70 GB (3976707080) - DecompressionTime: 15s800ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.06 GB (2214430352) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.14M (301141503) - RowsReturned: 3.76M (3756967) - RowsReturnedRate: 313.15 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 38.23K (38231) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 737.877ms - ScannerThreadsUserTime: 1m42s - ScannerThreadsVoluntaryContextSwitches: 9.48K (9481) - TotalRawHdfsReadTime(*): 3s235ms - TotalReadThroughput: 244.68 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1cf (host=d2413.halxg.cloudera.com:22000):(Total: 15s078ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:5/1.24 GB 2:2/506.43 MB 1:3/759.63 MB 3:4/1012.84 MB 6:5/1.24 GB 10:6/1.48 GB 0:3/759.60 MB 7:5/1.24 GB 5:4/1012.84 MB 9:3/759.67 MB 8:4/1012.88 MB Filter 0 arrival: 11s197ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 823.15 MB, 2.06 GB, 1.91 GB, 1.61 GB, 1.22 GB, 875.36 MB, 1.77 GB, 1.56 GB, 1.22 GB, 828.67 MB, 209.64 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 9 - AverageThreadTokens: 19.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.07 GB (2227349896) - PerHostPeakMemUsage: 2.86 GB (3067441152) - PrepareTime: 176.792ms - RowsProduced: 3.76M (3756773) - TotalCpuTime: 4m57s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 775.362ms - TotalStorageWaitTime: 2s443ms CodeGen:(Total: 397.525ms, non-child: 397.525ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 215.136ms - PrepareTime: 174.726ms DataStreamSender (dst_id=4):(Total: 3s580ms, non-child: 3s580ms, % non-child: 100.00%) - BytesSent: 122.94 MB (128914456) - NetworkThroughput(*): 29.42 MB/sec - OverallThroughput: 34.33 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s523ms - ThriftTransmitTime(*): 4s179ms - UncompressedRowBatchSize: 222.17 MB (232964026) HDFS_SCAN_NODE (id=0):(Total: 11s656ms, non-child: 11s656ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 4:5/1.24 GB 2:2/506.43 MB 1:3/759.63 MB 3:4/1012.84 MB 6:5/1.24 GB 10:6/1.48 GB 0:3/759.60 MB 7:5/1.24 GB 5:4/1012.84 MB 9:3/759.67 MB 8:4/1012.88 MB Runtime filters: Only following filters arrived: , waited 9s615ms Hdfs Read Thread Concurrency Bucket: 0:90% 1:0% 2:3.333% 3:0% 4:0% 5:3.333% 6:3.333% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 699.57 MB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.24 GB, 3.53 GB, 3.70 GB, 3.70 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 19.23 - BytesRead: 3.71 GB (3979918671) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3979918671) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3979918671) - DecompressionTime: 16s148ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.07 GB (2225591560) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.38M (301384995) - RowsReturned: 3.76M (3756773) - RowsReturnedRate: 322.29 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 41.57K (41573) - ScannerThreadsTotalWallClockTime: 4m44s - MaterializeTupleTime(*): 1m33s - ScannerThreadsSysTime: 1s169ms - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 11.22K (11224) - TotalRawHdfsReadTime(*): 3s623ms - TotalReadThroughput: 253.04 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1dc (host=d2420.halxg.cloudera.com:22000):(Total: 15s056ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:3/759.66 MB 2:4/1012.91 MB 9:2/506.51 MB 4:4/1012.89 MB 0:4/1012.99 MB 6:4/1012.90 MB 8:4/1012.83 MB 5:5/1.24 GB 1:3/759.56 MB 10:5/1.24 GB 3:6/1.48 GB Filter 0 arrival: 10s965ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.06 GB, 1.88 GB, 1.66 GB, 1.39 GB, 842.89 MB, 1.55 GB, 1.73 GB, 1.42 GB, 1.11 GB, 705.76 MB, 57.47 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 20, 3 - AverageThreadTokens: 19.44 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.17 GB (2331308808) - PerHostPeakMemUsage: 2.96 GB (3181654960) - PrepareTime: 236.803ms - RowsProduced: 3.76M (3760065) - TotalCpuTime: 5m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 806.756ms - TotalStorageWaitTime: 2s423ms CodeGen:(Total: 564.615ms, non-child: 564.615ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 321.235ms - PrepareTime: 234.014ms DataStreamSender (dst_id=4):(Total: 3s504ms, non-child: 3s504ms, % non-child: 100.00%) - BytesSent: 128.83 MB (135086779) - NetworkThroughput(*): 30.33 MB/sec - OverallThroughput: 36.76 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s524ms - ThriftTransmitTime(*): 4s247ms - UncompressedRowBatchSize: 222.37 MB (233168182) HDFS_SCAN_NODE (id=0):(Total: 11s767ms, non-child: 11s767ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 7:3/759.66 MB 2:4/1012.91 MB 9:2/506.51 MB 4:4/1012.89 MB 0:4/1012.99 MB 6:4/1012.90 MB 8:4/1012.83 MB 5:5/1.24 GB 1:3/759.56 MB 10:5/1.24 GB 3:6/1.48 GB Runtime filters: Only following filters arrived: , waited 9s435ms Hdfs Read Thread Concurrency Bucket: 0:96.67% 1:0% 2:0% 3:3.333% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.02 GB, 3.26 GB, 3.69 GB, 3.69 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 19.67 - BytesRead: 3.71 GB (3980064416) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3980064416) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3980064416) - DecompressionTime: 15s565ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.17 GB (2329542280) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.39M (301394323) - RowsReturned: 3.76M (3760065) - RowsReturnedRate: 319.54 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 37.69K (37690) - ScannerThreadsTotalWallClockTime: 4m53s - MaterializeTupleTime(*): 1m39s - ScannerThreadsSysTime: 958.843ms - ScannerThreadsUserTime: 1m46s - ScannerThreadsVoluntaryContextSwitches: 10.82K (10816) - TotalRawHdfsReadTime(*): 3s339ms - TotalReadThroughput: 244.88 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1d5 (host=d2412.halxg.cloudera.com:22000):(Total: 15s053ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:3/759.73 MB 10:3/759.66 MB 6:4/1012.86 MB 1:3/759.70 MB 0:4/1012.89 MB 9:6/1.48 GB 8:2/506.42 MB 5:6/1.48 GB 7:5/1.24 GB 4:5/1.24 GB 3:3/759.72 MB Filter 0 arrival: 11s082ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 370.06 MB, 2.06 GB, 1.86 GB, 1.54 GB, 1.16 GB, 726.69 MB, 1.77 GB, 1.64 GB, 1.35 GB, 1.05 GB, 568.15 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 19 - AverageThreadTokens: 17.71 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.06 GB (2214751056) - PerHostPeakMemUsage: 2.85 GB (3061095816) - PrepareTime: 189.498ms - RowsProduced: 3.76M (3761061) - TotalCpuTime: 4m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 824.886ms - TotalStorageWaitTime: 2s343ms CodeGen:(Total: 436.814ms, non-child: 436.814ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.805ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 241.571ms - PrepareTime: 183.746ms DataStreamSender (dst_id=4):(Total: 3s379ms, non-child: 3s379ms, % non-child: 100.00%) - BytesSent: 122.48 MB (128432202) - NetworkThroughput(*): 27.78 MB/sec - OverallThroughput: 36.24 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s459ms - ThriftTransmitTime(*): 4s409ms - UncompressedRowBatchSize: 222.43 MB (233229938) HDFS_SCAN_NODE (id=0):(Total: 11s846ms, non-child: 11s846ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 2:3/759.73 MB 10:3/759.66 MB 6:4/1012.86 MB 1:3/759.70 MB 0:4/1012.89 MB 9:6/1.48 GB 8:2/506.42 MB 5:6/1.48 GB 7:5/1.24 GB 4:5/1.24 GB 3:3/759.72 MB Runtime filters: Only following filters arrived: , waited 9s570ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:0% 2:3.333% 3:0% 4:0% 5:3.333% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 262.34 MB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.02 GB, 3.52 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 17.27 - BytesRead: 3.71 GB (3980089998) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3980089998) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3980089998) - DecompressionTime: 14s925ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.06 GB (2213647456) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.40M (301398222) - RowsReturned: 3.76M (3761061) - RowsReturnedRate: 317.50 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 35.73K (35728) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 1m39s - ScannerThreadsSysTime: 1s183ms - ScannerThreadsUserTime: 1m46s - ScannerThreadsVoluntaryContextSwitches: 9.03K (9026) - TotalRawHdfsReadTime(*): 3s417ms - TotalReadThroughput: 253.05 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1d1 (host=d2409.halxg.cloudera.com:22000):(Total: 15s000ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:4/1012.79 MB 10:7/1.73 GB 1:4/1012.75 MB 7:3/759.75 MB 9:5/1.24 GB 2:4/1012.93 MB 5:4/1012.95 MB 4:5/1.24 GB 6:4/1012.94 MB 3:4/1012.89 MB Filter 0 arrival: 11s160ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.47 GB, 1.96 GB, 1.79 GB, 1.51 GB, 899.10 MB, 1.07 GB, 1.85 GB, 1.52 GB, 1.18 GB, 817.22 MB, 183.37 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 9 - AverageThreadTokens: 15.84 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.09 GB (2243027352) - PerHostPeakMemUsage: 2.86 GB (3074694000) - PrepareTime: 177.245ms - RowsProduced: 3.76M (3757986) - TotalCpuTime: 4m3s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 812.623ms - TotalStorageWaitTime: 2s184ms CodeGen:(Total: 402.613ms, non-child: 402.613ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 219.670ms - PrepareTime: 175.055ms DataStreamSender (dst_id=4):(Total: 3s404ms, non-child: 3s404ms, % non-child: 100.00%) - BytesSent: 131.54 MB (137933517) - NetworkThroughput(*): 28.54 MB/sec - OverallThroughput: 38.64 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s489ms - ThriftTransmitTime(*): 4s608ms - UncompressedRowBatchSize: 222.24 MB (233039248) HDFS_SCAN_NODE (id=0):(Total: 11s755ms, non-child: 11s755ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 0:4/1012.79 MB 10:7/1.73 GB 1:4/1012.75 MB 7:3/759.75 MB 9:5/1.24 GB 2:4/1012.93 MB 5:4/1012.95 MB 4:5/1.24 GB 6:4/1012.94 MB 3:4/1012.89 MB Runtime filters: Only following filters arrived: , waited 9s595ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:0% 2:0% 3:3.333% 4:3.333% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.37 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.68 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 15.33 - BytesRead: 3.71 GB (3980092936) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3980092936) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3980092936) - DecompressionTime: 14s039ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.09 GB (2241375288) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.40M (301398285) - RowsReturned: 3.76M (3757986) - RowsReturnedRate: 319.68 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 36.06K (36057) - ScannerThreadsTotalWallClockTime: 3m50s - MaterializeTupleTime(*): 1m36s - ScannerThreadsSysTime: 734.878ms - ScannerThreadsUserTime: 1m44s - ScannerThreadsVoluntaryContextSwitches: 7.82K (7817) - TotalRawHdfsReadTime(*): 3s145ms - TotalReadThroughput: 244.88 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1d3 (host=d2418.halxg.cloudera.com:22000):(Total: 14s937ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.50 MB 0:4/1012.89 MB 7:4/938.99 MB 10:2/506.50 MB 4:6/1.48 GB 3:4/943.12 MB 9:4/949.14 MB 6:7/1.73 GB 1:5/1.24 GB 5:4/1012.82 MB 2:2/506.51 MB Filter 0 arrival: 11s103ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 363.93 MB, 2.01 GB, 1.80 GB, 1.53 GB, 1.27 GB, 733.56 MB, 1.69 GB, 1.56 GB, 1.26 GB, 954.99 MB, 435.91 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 22, 22, 21, 16 - AverageThreadTokens: 12.35 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.04 GB (2187597736) - PerHostPeakMemUsage: 2.83 GB (3040021872) - PrepareTime: 188.294ms - RowsProduced: 3.69M (3688608) - TotalCpuTime: 3m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 739.390ms - TotalStorageWaitTime: 2s468ms CodeGen:(Total: 439.244ms, non-child: 439.244ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 245.136ms - PrepareTime: 186.162ms DataStreamSender (dst_id=4):(Total: 3s326ms, non-child: 3s326ms, % non-child: 100.00%) - BytesSent: 128.02 MB (134242060) - NetworkThroughput(*): 30.26 MB/sec - OverallThroughput: 38.48 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s492ms - ThriftTransmitTime(*): 4s231ms - UncompressedRowBatchSize: 218.14 MB (228737004) HDFS_SCAN_NODE (id=0):(Total: 11s782ms, non-child: 11s782ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 8:2/506.50 MB 0:4/1012.89 MB 7:4/938.99 MB 10:2/506.50 MB 4:6/1.48 GB 3:4/943.12 MB 9:4/949.14 MB 6:7/1.73 GB 1:5/1.24 GB 5:4/1012.82 MB 2:2/506.51 MB Runtime filters: Only following filters arrived: , waited 9s574ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:3.333% 2:3.333% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 262.34 MB, 1.89 GB, 1.89 GB, 1.89 GB, 2.03 GB, 2.06 GB, 3.49 GB, 3.64 GB, 3.64 GB, 3.64 GB, 3.64 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 11.73 - BytesRead: 3.64 GB (3906035673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.64 GB (3906035673) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.64 GB (3906035673) - DecompressionTime: 14s582ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.04 GB (2185904712) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 295.77M (295773417) - RowsReturned: 3.69M (3688608) - RowsReturnedRate: 313.05 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 33.73K (33733) - ScannerThreadsTotalWallClockTime: 3m - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 619.893ms - ScannerThreadsUserTime: 1m42s - ScannerThreadsVoluntaryContextSwitches: 5.46K (5459) - TotalRawHdfsReadTime(*): 3s117ms - TotalReadThroughput: 248.34 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1db (host=d2410.halxg.cloudera.com:22000):(Total: 14s925ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/506.48 MB 9:5/1.24 GB 8:5/1.24 GB 10:5/1.24 GB 7:5/1.22 GB 4:6/1.48 GB 5:3/759.67 MB 6:5/1.18 GB 3:5/1.24 GB 0:3/759.64 MB Filter 0 arrival: 10s995ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.07 GB, 1.90 GB, 1.63 GB, 1.44 GB, 988.39 MB, 1.74 GB, 1.65 GB, 1.35 GB, 1.01 GB, 471.64 MB, 49.22 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 23, 17, 3 - AverageThreadTokens: 16.32 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.08 GB (2232518048) - PerHostPeakMemUsage: 2.86 GB (3069176904) - PrepareTime: 177.166ms - RowsProduced: 3.73M (3730143) - TotalCpuTime: 4m12s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 784.271ms - TotalStorageWaitTime: 2s264ms CodeGen:(Total: 399.168ms, non-child: 399.168ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.263ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 216.611ms - PrepareTime: 175.024ms DataStreamSender (dst_id=4):(Total: 3s587ms, non-child: 3s587ms, % non-child: 100.00%) - BytesSent: 125.91 MB (132022169) - NetworkThroughput(*): 28.55 MB/sec - OverallThroughput: 35.09 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s546ms - ThriftTransmitTime(*): 4s410ms - UncompressedRowBatchSize: 220.60 MB (231312666) HDFS_SCAN_NODE (id=0):(Total: 11s496ms, non-child: 11s496ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 2:2/506.48 MB 9:5/1.24 GB 8:5/1.24 GB 10:5/1.24 GB 7:5/1.22 GB 4:6/1.48 GB 5:3/759.67 MB 6:5/1.18 GB 3:5/1.24 GB 0:3/759.64 MB Runtime filters: Only following filters arrived: , waited 9s612ms Hdfs Read Thread Concurrency Bucket: 0:96.67% 1:3.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.02 GB, 3.40 GB, 3.67 GB, 3.68 GB, 3.68 GB, 3.68 GB, 3.68 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 15.83 - BytesRead: 3.68 GB (3951730981) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.68 GB (3951730981) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.68 GB (3951730981) - DecompressionTime: 15s889ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.08 GB (2230513936) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.24M (299244560) - RowsReturned: 3.73M (3730143) - RowsReturnedRate: 324.46 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 39.32K (39316) - ScannerThreadsTotalWallClockTime: 4m - MaterializeTupleTime(*): 1m34s - ScannerThreadsSysTime: 854.859ms - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 8.13K (8133) - TotalRawHdfsReadTime(*): 2s958ms - TotalReadThroughput: 243.14 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1d2 (host=d2411.halxg.cloudera.com:22000):(Total: 14s894ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:4/1012.94 MB 8:2/506.39 MB 4:4/1012.86 MB 0:3/759.56 MB 5:3/759.66 MB 3:5/1.21 GB 1:5/1.24 GB 6:6/1.48 GB 2:5/1.19 GB 9:3/759.64 MB 10:4/1013.04 MB Filter 0 arrival: 11s120ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.96 GB, 1.96 GB, 1.68 GB, 1.31 GB, 798.52 MB, 1.18 GB, 1.73 GB, 1.41 GB, 1.08 GB, 603.87 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 18 - AverageThreadTokens: 16.70 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.10 GB (2251755328) - PerHostPeakMemUsage: 2.89 GB (3100278008) - PrepareTime: 188.669ms - RowsProduced: 3.73M (3733481) - TotalCpuTime: 4m11s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 742.233ms - TotalStorageWaitTime: 2s355ms CodeGen:(Total: 429.346ms, non-child: 429.346ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.650ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 234.829ms - PrepareTime: 185.984ms DataStreamSender (dst_id=4):(Total: 3s291ms, non-child: 3s291ms, % non-child: 100.00%) - BytesSent: 124.36 MB (130398467) - NetworkThroughput(*): 28.91 MB/sec - OverallThroughput: 37.78 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s409ms - ThriftTransmitTime(*): 4s301ms - UncompressedRowBatchSize: 220.79 MB (231519650) HDFS_SCAN_NODE (id=0):(Total: 11s772ms, non-child: 11s772ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 7:4/1012.94 MB 8:2/506.39 MB 4:4/1012.86 MB 0:3/759.56 MB 5:3/759.66 MB 3:5/1.21 GB 1:5/1.24 GB 6:6/1.48 GB 2:5/1.19 GB 9:3/759.64 MB 10:4/1013.04 MB Runtime filters: Only following filters arrived: , waited 9s571ms Hdfs Read Thread Concurrency Bucket: 0:93.1% 1:0% 2:0% 3:0% 4:0% 5:6.897% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.80 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.83 GB, 3.67 GB, 3.68 GB, 3.68 GB, 3.68 GB - AverageHdfsReadThreadConcurrency: 0.34 - AverageScannerThreadConcurrency: 16.24 - BytesRead: 3.68 GB (3953916641) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.68 GB (3953916641) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.68 GB (3953916641) - DecompressionTime: 15s056ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.10 GB (2249939640) - PerReadThreadRawHdfsThroughput: 987.51 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.41M (299410770) - RowsReturned: 3.73M (3733481) - RowsReturnedRate: 317.12 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 35.21K (35213) - ScannerThreadsTotalWallClockTime: 3m58s - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 854.859ms - ScannerThreadsUserTime: 1m41s - ScannerThreadsVoluntaryContextSwitches: 7.77K (7766) - TotalRawHdfsReadTime(*): 3s818ms - TotalReadThroughput: 251.38 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1d6 (host=d2421.halxg.cloudera.com:22000):(Total: 14s813ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.41 MB 8:5/1.24 GB 5:7/1.73 GB 1:5/1.24 GB 3:5/1.24 GB 9:2/506.35 MB 4:4/1012.87 MB 2:2/426.44 MB 6:4/1012.90 MB 7:4/1012.96 MB 10:4/1012.96 MB Filter 0 arrival: 11s108ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.12 GB, 2.05 GB, 1.91 GB, 1.63 GB, 1.16 GB, 610.49 MB, 1.85 GB, 1.52 GB, 1.18 GB, 801.90 MB, 105.58 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 20, 5 - AverageThreadTokens: 15.65 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.08 GB (2237810168) - PerHostPeakMemUsage: 2.86 GB (3069496600) - PrepareTime: 187.521ms - RowsProduced: 3.73M (3729583) - TotalCpuTime: 4m3s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 760.253ms - TotalStorageWaitTime: 2s528ms CodeGen:(Total: 438.787ms, non-child: 438.787ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 245.873ms - PrepareTime: 185.232ms DataStreamSender (dst_id=4):(Total: 3s360ms, non-child: 3s360ms, % non-child: 100.00%) - BytesSent: 129.88 MB (136191048) - NetworkThroughput(*): 30.47 MB/sec - OverallThroughput: 38.65 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s447ms - ThriftTransmitTime(*): 4s263ms - UncompressedRowBatchSize: 220.56 MB (231277934) HDFS_SCAN_NODE (id=0):(Total: 11s620ms, non-child: 11s620ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 0:2/506.41 MB 8:5/1.24 GB 5:7/1.73 GB 1:5/1.24 GB 3:5/1.24 GB 9:2/506.35 MB 4:4/1012.87 MB 2:2/426.44 MB 6:4/1012.90 MB 7:4/1012.96 MB 10:4/1012.96 MB Runtime filters: Only following filters arrived: , waited 9s573ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:3.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:3.333% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1002.13 MB, 1.91 GB, 1.91 GB, 1.91 GB, 2.00 GB, 2.12 GB, 3.68 GB, 3.68 GB, 3.68 GB, 3.68 GB, 3.68 GB - AverageHdfsReadThreadConcurrency: 0.37 - AverageScannerThreadConcurrency: 15.13 - BytesRead: 3.68 GB (3951476289) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.68 GB (3951476289) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.68 GB (3951476289) - DecompressionTime: 15s253ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.08 GB (2235961488) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.23M (299226521) - RowsReturned: 3.73M (3729583) - RowsReturnedRate: 320.95 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 37.16K (37164) - ScannerThreadsTotalWallClockTime: 3m51s - MaterializeTupleTime(*): 1m33s - ScannerThreadsSysTime: 818.864ms - ScannerThreadsUserTime: 1m39s - ScannerThreadsVoluntaryContextSwitches: 8.06K (8065) - TotalRawHdfsReadTime(*): 3s319ms - TotalReadThroughput: 251.23 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1e2 (host=d2417.halxg.cloudera.com:22000):(Total: 14s759ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.27 MB 7:2/506.45 MB 9:4/1012.87 MB 5:5/1.24 GB 6:2/506.51 MB 0:3/759.50 MB 1:4/1012.94 MB 3:6/1.48 GB 4:3/759.68 MB 2:7/1.73 GB 8:6/1.48 GB Filter 0 arrival: 10s944ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.27 GB, 2.07 GB, 1.84 GB, 1.62 GB, 1.11 GB, 969.31 MB, 1.72 GB, 1.36 GB, 1.01 GB, 567.42 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 21, 21, 20 - AverageThreadTokens: 19.77 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.08 GB (2236169472) - PerHostPeakMemUsage: 2.86 GB (3067836120) - PrepareTime: 177.311ms - RowsProduced: 3.67M (3673351) - TotalCpuTime: 4m55s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 823.654ms - TotalStorageWaitTime: 3s135ms CodeGen:(Total: 414.272ms, non-child: 414.272ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 231.455ms - PrepareTime: 175.191ms DataStreamSender (dst_id=4):(Total: 3s402ms, non-child: 3s402ms, % non-child: 100.00%) - BytesSent: 125.17 MB (131246961) - NetworkThroughput(*): 29.26 MB/sec - OverallThroughput: 36.79 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s503ms - ThriftTransmitTime(*): 4s277ms - UncompressedRowBatchSize: 217.24 MB (227790898) HDFS_SCAN_NODE (id=0):(Total: 11s511ms, non-child: 11s511ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 43 Hdfs split stats (:<# splits>/): 10:1/253.27 MB 7:2/506.45 MB 9:4/1012.87 MB 5:5/1.24 GB 6:2/506.51 MB 0:3/759.50 MB 1:4/1012.94 MB 3:6/1.48 GB 4:3/759.68 MB 2:7/1.73 GB 8:6/1.48 GB Runtime filters: Only following filters arrived: , waited 9s592ms Hdfs Read Thread Concurrency Bucket: 0:89.66% 1:3.448% 2:0% 3:0% 4:3.448% 5:0% 6:0% 7:3.448% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:172 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.14 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.56 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 19.41 - BytesRead: 3.62 GB (3889664497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.62 GB (3889664497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.62 GB (3889664497) - DecompressionTime: 14s441ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 43 (43) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.08 GB (2234280048) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 294.55M (294550435) - RowsReturned: 3.67M (3673351) - RowsReturnedRate: 319.11 K/sec - ScanRangesComplete: 43 (43) - ScannerThreadsInvoluntaryContextSwitches: 33.83K (33832) - ScannerThreadsTotalWallClockTime: 4m44s - MaterializeTupleTime(*): 1m28s - ScannerThreadsSysTime: 766.874ms - ScannerThreadsUserTime: 1m36s - ScannerThreadsVoluntaryContextSwitches: 10.69K (10693) - TotalRawHdfsReadTime(*): 3s035ms - TotalReadThroughput: 247.23 MB/sec Filter 0: - Rows processed: 704.47K (704469) - Rows rejected: 0 (0) - Rows total: 704.51K (704512) Instance d4651cba0a55add:45db634c6f70b1d0 (host=d2419.halxg.cloudera.com:22000):(Total: 14s751ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:4/1012.87 MB 1:3/759.50 MB 5:5/1.24 GB 10:5/1.24 GB 9:2/506.46 MB 6:5/1.24 GB 0:2/506.43 MB 2:5/1.24 GB 3:8/1.98 GB 7:4/1012.78 MB Filter 0 arrival: 11s187ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.06 GB, 1.91 GB, 1.63 GB, 1.30 GB, 813.29 MB, 1.76 GB, 1.49 GB, 1.17 GB, 847.86 MB, 173.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 22, 21, 21, 8 - AverageThreadTokens: 18.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.07 GB (2226627544) - PerHostPeakMemUsage: 2.85 GB (3058446320) - PrepareTime: 190.983ms - RowsProduced: 3.67M (3673152) - TotalCpuTime: 4m37s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 819.611ms - TotalStorageWaitTime: 2s333ms CodeGen:(Total: 459.199ms, non-child: 459.199ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.356ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 262.754ms - PrepareTime: 188.789ms DataStreamSender (dst_id=4):(Total: 3s455ms, non-child: 3s455ms, % non-child: 100.00%) - BytesSent: 122.28 MB (128220706) - NetworkThroughput(*): 27.48 MB/sec - OverallThroughput: 35.39 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s449ms - ThriftTransmitTime(*): 4s449ms - UncompressedRowBatchSize: 217.23 MB (227778552) HDFS_SCAN_NODE (id=0):(Total: 11s468ms, non-child: 11s468ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 43 Hdfs split stats (:<# splits>/): 8:4/1012.87 MB 1:3/759.50 MB 5:5/1.24 GB 10:5/1.24 GB 9:2/506.46 MB 6:5/1.24 GB 0:2/506.43 MB 2:5/1.24 GB 3:8/1.98 GB 7:4/1012.78 MB Runtime filters: Only following filters arrived: , waited 9s552ms Hdfs Read Thread Concurrency Bucket: 0:96.67% 1:3.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:172 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.20 GB, 3.53 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 17.57 - BytesRead: 3.62 GB (3889362559) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.62 GB (3889362559) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.62 GB (3889362559) - DecompressionTime: 14s937ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 43 (43) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.07 GB (2224975480) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 294.53M (294527944) - RowsReturned: 3.67M (3673152) - RowsReturnedRate: 320.29 K/sec - ScanRangesComplete: 43 (43) - ScannerThreadsInvoluntaryContextSwitches: 33.84K (33843) - ScannerThreadsTotalWallClockTime: 4m25s - MaterializeTupleTime(*): 1m31s - ScannerThreadsSysTime: 762.876ms - ScannerThreadsUserTime: 1m38s - ScannerThreadsVoluntaryContextSwitches: 9.64K (9644) - TotalRawHdfsReadTime(*): 3s065ms - TotalReadThroughput: 247.28 MB/sec Filter 0: - Rows processed: 704.47K (704469) - Rows rejected: 0 (0) - Rows total: 704.51K (704512) Instance d4651cba0a55add:45db634c6f70b1d8 (host=d2403.halxg.cloudera.com:22000):(Total: 14s747ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:4/1012.97 MB 7:3/759.64 MB 8:2/506.48 MB 9:3/759.69 MB 3:4/1012.96 MB 1:6/1.38 GB 4:5/1.24 GB 2:1/253.22 MB 10:6/1.48 GB 0:5/1.24 GB 6:5/1.24 GB Filter 0 arrival: 11s088ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.00 GB, 1.93 GB, 1.65 GB, 1.44 GB, 721.75 MB, 1.52 GB, 1.82 GB, 1.46 GB, 1.10 GB, 685.61 MB, 325.28 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 21, 20, 1 - AverageThreadTokens: 16.29 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.08 GB (2235393232) - PerHostPeakMemUsage: 2.86 GB (3067212008) - PrepareTime: 189.138ms - RowsProduced: 3.72M (3717845) - TotalCpuTime: 4m16s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 796.746ms - TotalStorageWaitTime: 2s545ms CodeGen:(Total: 463.336ms, non-child: 463.336ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 268.955ms - PrepareTime: 187.025ms DataStreamSender (dst_id=4):(Total: 3s399ms, non-child: 3s399ms, % non-child: 100.00%) - BytesSent: 119.92 MB (125740926) - NetworkThroughput(*): 27.31 MB/sec - OverallThroughput: 35.28 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s440ms - ThriftTransmitTime(*): 4s390ms - UncompressedRowBatchSize: 219.87 MB (230550038) HDFS_SCAN_NODE (id=0):(Total: 11s519ms, non-child: 11s519ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 5:4/1012.97 MB 7:3/759.64 MB 8:2/506.48 MB 9:3/759.69 MB 3:4/1012.96 MB 1:6/1.38 GB 4:5/1.24 GB 2:1/253.22 MB 10:6/1.48 GB 0:5/1.24 GB 6:5/1.24 GB Runtime filters: Only following filters arrived: , waited 9s550ms Hdfs Read Thread Concurrency Bucket: 0:96.55% 1:0% 2:3.448% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.85 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.23 GB, 3.67 GB, 3.67 GB, 3.67 GB, 3.67 GB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 16.34 - BytesRead: 3.67 GB (3940640662) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.67 GB (3940640662) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.67 GB (3940640662) - DecompressionTime: 17s118ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.08 GB (2233806936) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 298.40M (298401783) - RowsReturned: 3.72M (3717845) - RowsReturnedRate: 322.74 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 40.19K (40189) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 1m33s - ScannerThreadsSysTime: 764.876ms - ScannerThreadsUserTime: 1m40s - ScannerThreadsVoluntaryContextSwitches: 8.59K (8594) - TotalRawHdfsReadTime(*): 3s382ms - TotalReadThroughput: 250.54 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance d4651cba0a55add:45db634c6f70b1d9 (host=d2415.halxg.cloudera.com:22000):(Total: 14s731ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:4/1012.84 MB 9:3/759.65 MB 8:3/759.62 MB 7:5/1.17 GB 3:4/1012.80 MB 10:4/982.72 MB 6:5/1.24 GB 0:6/1.48 GB 1:3/759.53 MB 2:3/759.69 MB 4:4/1012.83 MB Filter 0 arrival: 11s046ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.04 GB, 1.84 GB, 1.52 GB, 1.15 GB, 759.77 MB, 1.83 GB, 1.54 GB, 1.21 GB, 902.61 MB, 329.26 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 22, 21, 15 - AverageThreadTokens: 14.61 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 2.06 GB (2210666120) - PerHostPeakMemUsage: 2.83 GB (3042352552) - PrepareTime: 180.164ms - RowsProduced: 3.72M (3724891) - TotalCpuTime: 3m39s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 791.110ms - TotalStorageWaitTime: 2s783ms CodeGen:(Total: 411.830ms, non-child: 411.830ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939948) - OptimizationTime: 226.203ms - PrepareTime: 175.376ms DataStreamSender (dst_id=4):(Total: 3s129ms, non-child: 3s129ms, % non-child: 100.00%) - BytesSent: 111.24 MB (116643419) - NetworkThroughput(*): 26.46 MB/sec - OverallThroughput: 35.55 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - SerializeBatchTime: 1s233ms - ThriftTransmitTime(*): 4s204ms - UncompressedRowBatchSize: 220.29 MB (230986978) HDFS_SCAN_NODE (id=0):(Total: 11s763ms, non-child: 11s763ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 5:4/1012.84 MB 9:3/759.65 MB 8:3/759.62 MB 7:5/1.17 GB 3:4/1012.80 MB 10:4/982.72 MB 6:5/1.24 GB 0:6/1.48 GB 1:3/759.53 MB 2:3/759.69 MB 4:4/1012.83 MB Runtime filters: Only following filters arrived: , waited 9s594ms Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:6.667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 2.09 GB, 3.58 GB, 3.66 GB, 3.68 GB, 3.68 GB, 3.68 GB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 14.07 - BytesRead: 3.68 GB (3946384577) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.68 GB (3946384577) - BytesReadRemoteUnexpected: 0 - BytesRGoodbye mmokhtar eadShortCircuit: 3.68 GB (3946384577) - DecompressionTime: 15s073ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 2.06 GB (2208817664) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 298.84M (298837353) - RowsReturned: 3.72M (3724891) - RowsReturnedRate: 316.64 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 41.30K (41296) - ScannerThreadsTotalWallClockTime: 3m27s - MaterializeTupleTime(*): 1m32s - ScannerThreadsSysTime: 945.846ms - ScannerThreadsUserTime: 1m40s - ScannerThreadsVoluntaryContextSwitches: 6.58K (6579) - TotalRawHdfsReadTime(*): 3s624ms - TotalReadThroughput: 250.90 MB/sec Filter 0: - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896)