Starting Impala Shell without Kerberos authentication Connected to d2402.halxg.cloudera.com:21000 Server version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build c8d3fb34614dc7507a7209471c0f7102bf025b70) Query: use `tpch_1000_decimal_parquet` Query: use tpch_1000_decimal_parquet MAX_NUM_RUNTIME_FILTERS set to 50 PREFETCH_MODE set to 1 RUNTIME_FILTER_WAIT_TIME_MS set to 10000 Query: select 100.00 * sum(case when p_type like 'PROMO%' then l_extendedprice * (1 - l_discount) else 0.0 end) / sum(l_extendedprice * (1 - l_discount)) as promo_revenue from lineitem, part where l_partkey = p_partkey and l_shipdate >= '1995-09-01' and l_shipdate < '1995-10-01' 16.674226 Fetched 1 row(s) in 15.58s Query Runtime Profile: Query (id=294637ca32dfdd77:639d51f80b2e7087): Summary: Session ID: b49ffcef815c05a:a35d1f1848a53c80 Session Type: BEESWAX Start Time: 2016-05-19 20:02:26.655984000 End Time: 2016-05-19 20:02:42.232484000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.6.0-cdh5-INTERNAL RELEASE (build c8d3fb34614dc7507a7209471c0f7102bf025b70) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.20.122.102:46355 Default Db: tpch_1000_decimal_parquet Sql Statement: select 100.00 * sum(case when p_type like 'PROMO%' then l_extendedprice * (1 - l_discount) else 0.0 end) / sum(l_extendedprice * (1 - l_discount)) as promo_revenue from lineitem, part where l_partkey = p_partkey and l_shipdate >= '1995-09-01' and l_shipdate < '1995-10-01' Coordinator: d2402.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=24,RUNTIME_FILTER_WAIT_TIME_MS=10000,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=829.87MB VCores=2 07:AGGREGATE [FINALIZE] | output: sum:merge(CASE WHEN p_type LIKE 'PROMO%' THEN l_extendedprice * (1 - l_discount) ELSE 0.0 END), sum:merge(l_extendedprice * (1 - l_discount)) | hosts=20 per-host-mem=unavailable | tuple-ids=2 row-size=32B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=20 per-host-mem=unavailable | tuple-ids=2 row-size=32B cardinality=1 | 03:AGGREGATE | output: sum(CASE WHEN p_type LIKE 'PROMO%' THEN l_extendedprice * (1 - l_discount) ELSE 0.0 END), sum(l_extendedprice * (1 - l_discount)) | hosts=20 per-host-mem=10.00MB | tuple-ids=2 row-size=32B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_partkey = p_partkey | runtime filters: RF000 <- p_partkey | hosts=20 per-host-mem=467.87MB | tuple-ids=0,1 row-size=95B cardinality=599842820 | |--05:EXCHANGE [HASH(p_partkey)] | | hosts=20 per-host-mem=0B | | tuple-ids=1 row-size=45B cardinality=200000000 | | | 01:SCAN HDFS [tpch_1000_decimal_parquet.part, RANDOM] | partitions=1/1 files=40 size=6.38GB | table stats: 200000000 rows total | column stats: all | hosts=20 per-host-mem=176.00MB | tuple-ids=1 row-size=45B cardinality=200000000 | 04:EXCHANGE [HASH(l_partkey)] | hosts=20 per-host-mem=0B | tuple-ids=0 row-size=50B cardinality=599998971 | 00:SCAN HDFS [tpch_1000_decimal_parquet.lineitem, RANDOM] partitions=1/1 files=880 size=216.61GB predicates: l_shipdate >= '1995-09-01', l_shipdate < '1995-10-01' runtime filters: RF000 -> l_partkey table stats: 5999989709 rows total column stats: all hosts=20 per-host-mem=352.00MB tuple-ids=0 row-size=50B cardinality=599998971 ---------------- Estimated Per-Host Mem: 870183413 Estimated Per-Host VCores: 2 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------ 07:AGGREGATE 1 446.320ms 446.320ms 1 1 92.00 KB -1.00 B FINALIZE 06:EXCHANGE 1 109.909us 109.909us 20 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 20 834.533ms 950.206ms 20 1 154.31 KB 10.00 MB 02:HASH JOIN 20 2s087ms 2s617ms 74.82M 599.84M 778.04 MB 467.87 MB INNER JOIN, PARTITIONED |--05:EXCHANGE 20 397.417ms 602.863ms 200.00M 200.00M 0 0 HASH(p_partkey) | 01:SCAN HDFS 20 54.481ms 80.651ms 200.00M 200.00M 113.09 MB 176.00 MB tpch_1000_decimal_parquet.part 04:EXCHANGE 20 311.077ms 407.810ms 74.82M 600.00M 0 0 HASH(l_partkey) 00:SCAN HDFS 20 8s122ms 8s240ms 74.82M 600.00M 3.30 GB 352.00 MB tpch_1000_decimal_parquet.l... Planner Timeline: 11.719ms - Analysis finished: 3.070ms (3.070ms) - Equivalence classes computed: 3.327ms (256.721us) - Single node plan created: 7.102ms (3.774ms) - Runtime filters computed: 7.224ms (121.950us) - Distributed plan created: 9.447ms (2.223ms) - Lineage info computed: 9.882ms (435.225us) - Planning finished: 11.719ms (1.837ms) Query Timeline: 15s608ms - Start execution: 124.665us (124.665us) - Planning finished: 16.403ms (16.279ms) - Submit for admission: 19.189ms (2.786ms) - Completed admission: 19.767ms (577.262us) - Ready to start 60 remote fragments: 470.728ms (450.960ms) - All 60 remote fragments started: 482.318ms (11.590ms) - First dynamic filter received: 7s511ms (7s029ms) - Rows available: 15s263ms (7s751ms) - First row fetched: 15s569ms (306.390ms) - Unregister query: 15s576ms (6.905ms) ImpalaServer: - ClientFetchWaitTimer: 307.914ms - RowMaterializationTimer: 38.226us Execution Profile 294637ca32dfdd77:639d51f80b2e7087:(Total: 15s247ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- 0 2 0 20 REMOTE false 20 (20) N/A N/A Fragment start latencies: Count: 60, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 3ms Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- 0 2 0 20 REMOTE false 0 (20) 7s511ms 8s099ms Per Node Peak Memory Usage: d2416.halxg.cloudera.com:22000(3.95 GB) d2405.halxg.cloudera.com:22000(4.03 GB) d2414.halxg.cloudera.com:22000(4.04 GB) d2406.halxg.cloudera.com:22000(4.04 GB) d2413.halxg.cloudera.com:22000(4.03 GB) d2410.halxg.cloudera.com:22000(4.08 GB) d2420.halxg.cloudera.com:22000(4.00 GB) d2404.halxg.cloudera.com:22000(4.09 GB) d2415.halxg.cloudera.com:22000(4.00 GB) d2408.halxg.cloudera.com:22000(4.04 GB) d2421.halxg.cloudera.com:22000(3.95 GB) d2403.halxg.cloudera.com:22000(4.00 GB) d2407.halxg.cloudera.com:22000(4.02 GB) d2411.halxg.cloudera.com:22000(4.00 GB) d2418.halxg.cloudera.com:22000(3.93 GB) d2419.halxg.cloudera.com:22000(3.95 GB) d2409.halxg.cloudera.com:22000(4.02 GB) d2412.halxg.cloudera.com:22000(4.00 GB) d2402.halxg.cloudera.com:22000(3.92 GB) d2417.halxg.cloudera.com:22000(4.02 GB) - FiltersReceived: 20 (20) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 14s491ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 100.02 KB (102416) - PerHostPeakMemUsage: 0 - PrepareTime: 445.967ms - RowsProduced: 1 (1) - TotalCpuTime: 1s505ms - TotalNetworkReceiveTime: 14s044ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 1s173ms, non-child: 1s173ms, % non-child: 100.00%) - CodegenTime: 3.973ms - CompileTime: 190.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 125 (125) - NumInstructions: 4.81K (4812) - OptimizationTime: 539.826ms - PrepareTime: 441.291ms AGGREGATION_NODE (id=7):(Total: 14s490ms, non-child: 446.320ms, % non-child: 3.08%) ExecOption: Codegen Enabled - BuildTime: 8.289us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 92.00 KB (94208) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6):(Total: 14s044ms, non-child: 109.909us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 840.00 B (840) - ConvertRowBatchTime: 17.014us - DeserializeRowBatchTimer: 112.153us - FirstBatchArrivalWaitTime: 14s019ms - PeakMemoryUsage: 0 - RowsReturned: 20 (20) - RowsReturnedRate: 1.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 14s312ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:14s768ms max:14s788ms mean: 14s783ms stddev:4.255ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 20 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 780.53 MB (818447684) - PerHostPeakMemUsage: 4.00 GB (4300158773) - PrepareTime: 224.810ms - RowsProduced: 1 (1) - TotalCpuTime: 7s408ms - TotalNetworkReceiveTime: 14s920ms - TotalNetworkSendTime: 236.658us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 680.451ms, non-child: 680.451ms, % non-child: 100.00%) - CodegenTime: 798.275us - CompileTime: 121.376ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 341.567ms - PrepareTime: 216.696ms DataStreamSender (dst_id=6):(Total: 62.548us, non-child: 62.548us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.72 MB/sec - OverallThroughput: 692.00 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 13.889us - TransmitDataRPCTime: 24.818us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s311ms, non-child: 834.533ms, % non-child: 5.83%) - BuildTime: 596.461ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 124.95 KB (127946) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s476ms, non-child: 2s087ms, % non-child: 15.49%) - BuildPartitionTime: 2s402ms - BuildRows: 10.00M (10000000) - BuildRowsPartitioned: 10.00M (10000000) - BuildTime: 483.575ms - GetNewBlockTime: 1.632ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3740945) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s802ms - RowsReturned: 3.74M (3740945) - RowsReturnedRate: 277.60 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.174us EXCHANGE_NODE (id=5):(Total: 3s863ms, non-child: 3s863ms, % non-child: 100.00%) - BytesReceived: 257.47 MB (269974287) - ConvertRowBatchTime: 182.396ms - DeserializeRowBatchTimer: 939.863ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10000000) - RowsReturnedRate: 2.60 M/sec - SendersBlockedTimer: 319.427ms - SendersBlockedTotalTimer(*): 5s813ms EXCHANGE_NODE (id=4):(Total: 11s399ms, non-child: 11s399ms, % non-child: 100.00%) - BytesReceived: 101.47 MB (106401801) - ConvertRowBatchTime: 123.249ms - DeserializeRowBatchTimer: 590.869ms - FirstBatchArrivalWaitTime: 7s083ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740945) - RowsReturnedRate: 328.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 4s479ms, non-child: 1s648ms, % non-child: 36.81%) split sizes: min: 71.21 MB, max: 560.43 MB, avg: 326.57 MB, stddev: 98.09 MB completion times: min:1s630ms max:6s989ms mean: 4s511ms stddev:1s095ms execution rates: min:43.67 MB/sec max:80.18 MB/sec mean:71.04 MB/sec stddev:7.59 MB/sec num instances: 20 - AverageThreadTokens: 2.59 - BloomFilterBytes: 0 - PeakMemoryUsage: 76.42 MB (80128442) - PerHostPeakMemUsage: 541.94 MB (568269091) - PrepareTime: 114.158us - RowsProduced: 10.00M (10000000) - TotalCpuTime: 11s022ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 855.637ms - TotalStorageWaitTime: 18.493ms DataStreamSender (dst_id=5):(Total: 2s776ms, non-child: 2s776ms, % non-child: 100.00%) - BytesSent: 257.47 MB (269974287) - NetworkThroughput(*): 456.30 MB/sec - OverallThroughput: 92.43 MB/sec - PeakMemoryUsage: 677.20 KB (693452) - RowsReturned: 10.00M (10000000) - SerializeBatchTime: 2s214ms - TransmitDataRPCTime: 559.136ms - UncompressedRowBatchSize: 539.85 MB (566077097) HDFS_SCAN_NODE (id=1):(Total: 54.481ms, non-child: 54.481ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.59 - BytesRead: 48.19 MB (50529977) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.19 MB (50529977) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.19 MB (50529977) - DecompressionTime: 171.903ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 75.74 MB (79415060) - PerReadThreadRawHdfsThroughput: 2.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.00M (10000000) - RowsReturned: 10.00M (10000000) - RowsReturnedRate: 181.87 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 321 (321) - ScannerThreadsTotalWallClockTime: 7s385ms - MaterializeTupleTime(*): 7s179ms - ScannerThreadsSysTime: 49.291ms - ScannerThreadsUserTime: 627.253ms - ScannerThreadsVoluntaryContextSwitches: 9.42K (9424) - TotalRawHdfsReadTime(*): 22.701ms - TotalReadThroughput: 10.61 MB/sec Averaged Fragment F00:(Total: 11s077ms, non-child: 897.664ms, % non-child: 8.10%) split sizes: min: 10.63 GB, max: 11.07 GB, avg: 10.83 GB, stddev: 111.72 MB completion times: min:12s433ms max:14s780ms mean: 13s662ms stddev:392.745ms execution rates: min:753.82 MB/sec max:896.14 MB/sec mean:812.42 MB/sec stddev:24.83 MB/sec num instances: 20 - AverageThreadTokens: 15.30 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.21 GB (3451648803) - PerHostPeakMemUsage: 4.00 GB (4300158773) - PrepareTime: 211.999ms - RowsProduced: 3.74M (3740945) - TotalCpuTime: 3m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17.254ms - TotalStorageWaitTime: 2s377ms CodeGen:(Total: 301.805ms, non-child: 301.805ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.194ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 79.512ms - PrepareTime: 210.330ms DataStreamSender (dst_id=4):(Total: 1s756ms, non-child: 1s756ms, % non-child: 100.00%) - BytesSent: 101.47 MB (106401801) - NetworkThroughput(*): 230.25 MB/sec - OverallThroughput: 58.05 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.74M (3740945) - SerializeBatchTime: 1s309ms - TransmitDataRPCTime: 443.040ms - UncompressedRowBatchSize: 221.24 MB (231982523) HDFS_SCAN_NODE (id=0):(Total: 8s122ms, non-child: 8s122ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 14.75 - BytesRead: 3.69 GB (3961672307) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3961672307) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3961672307) - DecompressionTime: 16s009ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.21 GB (3446086632) - PerReadThreadRawHdfsThroughput: 889.86 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00M (299999485) - RowsReturned: 3.74M (3740945) - RowsReturnedRate: 460.61 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 23.01K (23007) - ScannerThreadsTotalWallClockTime: 3m15s - MaterializeTupleTime(*): 1m38s - ScannerThreadsSysTime: 6s683ms - ScannerThreadsUserTime: 1m12s - ScannerThreadsVoluntaryContextSwitches: 21.35K (21354) - TotalRawHdfsReadTime(*): 4s262ms - TotalReadThroughput: 281.30 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Fragment F02: Instance 294637ca32dfdd77:639d51f80b2e709c (host=d2416.halxg.cloudera.com:22000):(Total: 14s334ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 27.23 MB, 138.13 MB, 138.10 MB, 266.08 MB, 266.10 MB, 394.13 MB, 394.13 MB, 522.13 MB, 522.13 MB, 522.10 MB, 522.08 MB, 522.08 MB, 522.08 MB, 538.06 MB, 682.06 MB, 777.15 MB, 777.17 MB, 777.17 MB, 777.15 MB, 777.32 MB, 777.15 MB, 777.21 MB, 777.17 MB, 777.17 MB, 777.15 MB, 777.19 MB, 777.21 MB, 777.15 MB, 777.13 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.74 MB (816570184) - PerHostPeakMemUsage: 3.95 GB (4239850616) - PrepareTime: 219.096ms - RowsProduced: 1 (1) - TotalCpuTime: 7s249ms - TotalNetworkReceiveTime: 15s977ms - TotalNetworkSendTime: 261.666us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 656.550ms, non-child: 656.550ms, % non-child: 100.00%) - CodegenTime: 678.463us - CompileTime: 117.157ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 327.093ms - PrepareTime: 211.559ms DataStreamSender (dst_id=6):(Total: 44.796us, non-child: 44.796us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.96 MB/sec - OverallThroughput: 915.61 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 8.156us - TransmitDataRPCTime: 20.488us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s333ms, non-child: 725.245ms, % non-child: 5.06%) ExecOption: Codegen Enabled - BuildTime: 496.020ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 106.95 KB (109512) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s607ms, non-child: 1s507ms, % non-child: 11.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s127ms - BuildRows: 9.99M (9992762) - BuildRowsPartitioned: 9.99M (9992762) - BuildTime: 427.382ms - GetNewBlockTime: 1.542ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3737705) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s312ms - RowsReturned: 3.74M (3737705) - RowsReturnedRate: 274.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.166us EXCHANGE_NODE (id=5):(Total: 4s168ms, non-child: 386.663ms, % non-child: 9.28%) BytesReceived(500.000ms): 10.18 MB, 18.50 MB, 43.06 MB, 74.30 MB, 107.91 MB, 142.36 MB, 176.95 MB, 205.76 MB, 229.03 MB, 241.53 MB, 247.84 MB, 251.69 MB, 255.48 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB, 257.29 MB - BytesReceived: 257.29 MB (269785677) - ConvertRowBatchTime: 174.399ms - DeserializeRowBatchTimer: 924.939ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 9.99M (9992762) - RowsReturnedRate: 2.40 M/sec - SendersBlockedTimer: 254.899ms - SendersBlockedTotalTimer(*): 4s287ms EXCHANGE_NODE (id=4):(Total: 12s110ms, non-child: 205.920ms, % non-child: 1.70%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 871.43 KB, 9.75 MB, 20.44 MB, 29.87 MB, 38.50 MB, 46.53 MB, 54.78 MB, 63.76 MB, 72.57 MB, 81.34 MB, 89.44 MB, 97.90 MB, 100.84 MB, 101.22 MB - BytesReceived: 101.39 MB (106310777) - ConvertRowBatchTime: 91.915ms - DeserializeRowBatchTimer: 405.178ms - FirstBatchArrivalWaitTime: 7s106ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3737705) - RowsReturnedRate: 308.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e708c (host=d2418.halxg.cloudera.com:22000):(Total: 14s334ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 945.25 KB, 149.88 MB, 138.22 MB, 138.28 MB, 266.19 MB, 266.19 MB, 394.10 MB, 394.10 MB, 522.08 MB, 522.13 MB, 522.10 MB, 522.10 MB, 522.13 MB, 522.08 MB, 602.06 MB, 746.06 MB, 777.17 MB, 777.21 MB, 777.17 MB, 777.28 MB, 777.19 MB, 777.21 MB, 777.19 MB, 777.24 MB, 777.25 MB, 777.21 MB, 777.15 MB, 777.17 MB, 777.15 MB, 681.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 779.99 MB (817875880) - PerHostPeakMemUsage: 3.93 GB (4221827768) - PrepareTime: 221.248ms - RowsProduced: 1 (1) - TotalCpuTime: 7s349ms - TotalNetworkReceiveTime: 14s904ms - TotalNetworkSendTime: 239.375us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 658.794ms, non-child: 658.794ms, % non-child: 100.00%) - CodegenTime: 700.868us - CompileTime: 119.956ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 324.497ms - PrepareTime: 213.673ms DataStreamSender (dst_id=6):(Total: 54.515us, non-child: 54.515us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 2.64 MB/sec - OverallThroughput: 752.37 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 23.238us - TransmitDataRPCTime: 15.144us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s332ms, non-child: 781.414ms, % non-child: 5.45%) ExecOption: Codegen Enabled - BuildTime: 546.326ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 105.28 KB (107808) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s551ms, non-child: 2s240ms, % non-child: 16.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s356ms - BuildRows: 10.01M (10009823) - BuildRowsPartitioned: 10.01M (10009823) - BuildTime: 506.048ms - GetNewBlockTime: 1.618ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3744080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s928ms - RowsReturned: 3.74M (3744080) - RowsReturnedRate: 276.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.089us EXCHANGE_NODE (id=5):(Total: 3s927ms, non-child: 390.567ms, % non-child: 9.95%) BytesReceived(500.000ms): 336.26 KB, 10.32 MB, 29.65 MB, 56.74 MB, 89.99 MB, 124.04 MB, 158.67 MB, 191.25 MB, 218.16 MB, 236.80 MB, 245.44 MB, 250.04 MB, 253.88 MB, 256.83 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB, 257.71 MB - BytesReceived: 257.71 MB (270223375) - ConvertRowBatchTime: 180.120ms - DeserializeRowBatchTimer: 947.410ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.01M (10009823) - RowsReturnedRate: 2.55 M/sec - SendersBlockedTimer: 256.318ms - SendersBlockedTotalTimer(*): 4s313ms EXCHANGE_NODE (id=4):(Total: 11s322ms, non-child: 317.330ms, % non-child: 2.80%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.19 MB, 14.71 MB, 25.16 MB, 33.98 MB, 42.55 MB, 50.40 MB, 59.00 MB, 67.94 MB, 76.86 MB, 85.28 MB, 93.48 MB, 100.52 MB, 101.18 MB, 101.56 MB - BytesReceived: 101.56 MB (106496360) - ConvertRowBatchTime: 127.577ms - DeserializeRowBatchTimer: 614.933ms - FirstBatchArrivalWaitTime: 7s106ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3744080) - RowsReturnedRate: 330.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e709a (host=d2414.halxg.cloudera.com:22000):(Total: 14s333ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 7.97 MB, 138.10 MB, 138.08 MB, 138.10 MB, 266.16 MB, 378.22 MB, 394.13 MB, 394.11 MB, 522.13 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.08 MB, 522.10 MB, 618.06 MB, 746.14 MB, 777.21 MB, 777.17 MB, 777.17 MB, 777.19 MB, 777.19 MB, 777.18 MB, 777.17 MB, 777.19 MB, 777.19 MB, 777.17 MB, 777.19 MB, 777.15 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 779.54 MB (817403128) - PerHostPeakMemUsage: 4.04 GB (4338607336) - PrepareTime: 223.322ms - RowsProduced: 1 (1) - TotalCpuTime: 7s309ms - TotalNetworkReceiveTime: 14s848ms - TotalNetworkSendTime: 198.345us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 667.714ms, non-child: 667.714ms, % non-child: 100.00%) - CodegenTime: 780.615us - CompileTime: 121.149ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 330.535ms - PrepareTime: 215.133ms DataStreamSender (dst_id=6):(Total: 57.949us, non-child: 57.949us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.28 MB/sec - OverallThroughput: 707.79 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.535us - TransmitDataRPCTime: 31.382us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s332ms, non-child: 788.280ms, % non-child: 5.50%) ExecOption: Codegen Enabled - BuildTime: 551.914ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 108.08 KB (110672) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s543ms, non-child: 2s117ms, % non-child: 15.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s505ms - BuildRows: 10.00M (9996685) - BuildRowsPartitioned: 10.00M (9996685) - BuildTime: 449.399ms - GetNewBlockTime: 1.715ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3737768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s838ms - RowsReturned: 3.74M (3737768) - RowsReturnedRate: 275.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.057us EXCHANGE_NODE (id=5):(Total: 3s772ms, non-child: 395.841ms, % non-child: 10.49%) BytesReceived(500.000ms): 2.92 MB, 10.30 MB, 32.58 MB, 60.64 MB, 93.91 MB, 128.00 MB, 162.60 MB, 194.51 MB, 220.56 MB, 237.83 MB, 245.84 MB, 250.17 MB, 254.00 MB, 256.74 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB, 257.37 MB - BytesReceived: 257.37 MB (269872200) - ConvertRowBatchTime: 196.921ms - DeserializeRowBatchTimer: 912.652ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9996685) - RowsReturnedRate: 2.65 M/sec - SendersBlockedTimer: 267.162ms - SendersBlockedTotalTimer(*): 4s496ms EXCHANGE_NODE (id=4):(Total: 11s437ms, non-child: 289.394ms, % non-child: 2.53%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 37.87 KB, 5.34 MB, 15.99 MB, 26.26 MB, 34.94 MB, 43.38 MB, 51.26 MB, 60.07 MB, 68.97 MB, 77.83 MB, 86.15 MB, 94.35 MB, 100.54 MB, 101.05 MB - BytesReceived: 101.39 MB (106313282) - ConvertRowBatchTime: 127.588ms - DeserializeRowBatchTimer: 574.535ms - FirstBatchArrivalWaitTime: 7s096ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3737768) - RowsReturnedRate: 326.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7097 (host=d2404.halxg.cloudera.com:22000):(Total: 14s329ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 854.45 KB, 151.33 MB, 138.13 MB, 138.22 MB, 266.10 MB, 266.13 MB, 394.16 MB, 394.16 MB, 522.13 MB, 522.08 MB, 522.10 MB, 522.13 MB, 522.10 MB, 522.08 MB, 602.06 MB, 746.06 MB, 777.19 MB, 777.17 MB, 777.19 MB, 777.17 MB, 777.19 MB, 777.21 MB, 777.15 MB, 777.21 MB, 777.23 MB, 777.21 MB, 777.21 MB, 777.21 MB, 777.17 MB, 713.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 779.28 MB (817132984) - PerHostPeakMemUsage: 4.09 GB (4395328000) - PrepareTime: 226.162ms - RowsProduced: 1 (1) - TotalCpuTime: 7s286ms - TotalNetworkReceiveTime: 14s787ms - TotalNetworkSendTime: 196.742us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 669.190ms, non-child: 669.190ms, % non-child: 100.00%) - CodegenTime: 719.290us - CompileTime: 117.879ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 332.691ms - PrepareTime: 217.771ms DataStreamSender (dst_id=6):(Total: 68.129us, non-child: 68.129us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.83 MB/sec - OverallThroughput: 602.03 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.033us - TransmitDataRPCTime: 21.909us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s328ms, non-child: 896.203ms, % non-child: 6.25%) ExecOption: Codegen Enabled - BuildTime: 657.308ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 101.28 KB (103712) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s431ms, non-child: 2s146ms, % non-child: 15.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s451ms - BuildRows: 10.00M (9997550) - BuildRowsPartitioned: 10.00M (9997550) - BuildTime: 462.536ms - GetNewBlockTime: 1.579ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3738866) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s890ms - RowsReturned: 3.74M (3738866) - RowsReturnedRate: 278.36 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.444us EXCHANGE_NODE (id=5):(Total: 3s831ms, non-child: 382.412ms, % non-child: 9.98%) BytesReceived(500.000ms): 302.24 KB, 10.36 MB, 29.69 MB, 56.66 MB, 89.90 MB, 123.92 MB, 158.50 MB, 191.08 MB, 217.89 MB, 236.51 MB, 245.14 MB, 249.75 MB, 253.56 MB, 256.53 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB, 257.40 MB - BytesReceived: 257.40 MB (269905555) - ConvertRowBatchTime: 175.850ms - DeserializeRowBatchTimer: 933.841ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9997550) - RowsReturnedRate: 2.61 M/sec - SendersBlockedTimer: 266.763ms - SendersBlockedTotalTimer(*): 5s276ms EXCHANGE_NODE (id=4):(Total: 11s294ms, non-child: 283.266ms, % non-child: 2.51%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.20 MB, 14.71 MB, 25.13 MB, 33.96 MB, 42.49 MB, 50.31 MB, 58.95 MB, 67.90 MB, 76.80 MB, 85.20 MB, 93.37 MB, 100.40 MB, 101.02 MB, 101.42 MB - BytesReceived: 101.42 MB (106344513) - ConvertRowBatchTime: 122.162ms - DeserializeRowBatchTimer: 574.732ms - FirstBatchArrivalWaitTime: 7s092ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3738866) - RowsReturnedRate: 331.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7095 (host=d2410.halxg.cloudera.com:22000):(Total: 14s323ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 5.24 MB, 138.10 MB, 138.22 MB, 138.28 MB, 266.13 MB, 274.13 MB, 394.08 MB, 394.11 MB, 522.16 MB, 522.08 MB, 522.10 MB, 522.10 MB, 522.08 MB, 522.10 MB, 602.06 MB, 746.10 MB, 777.13 MB, 777.19 MB, 777.34 MB, 777.32 MB, 777.25 MB, 777.28 MB, 777.21 MB, 777.25 MB, 777.30 MB, 777.17 MB, 777.13 MB, 777.15 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.96 MB (816795304) - PerHostPeakMemUsage: 4.08 GB (4377449744) - PrepareTime: 217.287ms - RowsProduced: 1 (1) - TotalCpuTime: 7s269ms - TotalNetworkReceiveTime: 14s863ms - TotalNetworkSendTime: 206.485us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 658.831ms, non-child: 658.831ms, % non-child: 100.00%) - CodegenTime: 740.334us - CompileTime: 118.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 329.634ms - PrepareTime: 209.670ms DataStreamSender (dst_id=6):(Total: 84.023us, non-child: 84.023us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 2.38 MB/sec - OverallThroughput: 488.15 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.878us - TransmitDataRPCTime: 16.831us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s322ms, non-child: 799.900ms, % non-child: 5.58%) ExecOption: Codegen Enabled - BuildTime: 570.322ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 124.85 KB (127848) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s522ms, non-child: 2s177ms, % non-child: 16.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s450ms - BuildRows: 10.00M (10001270) - BuildRowsPartitioned: 10.00M (10001270) - BuildTime: 435.523ms - GetNewBlockTime: 1.618ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3743193) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s962ms - RowsReturned: 3.74M (3743193) - RowsReturnedRate: 276.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.187us EXCHANGE_NODE (id=5):(Total: 3s838ms, non-child: 377.213ms, % non-child: 9.83%) BytesReceived(500.000ms): 1.92 MB, 10.30 MB, 31.86 MB, 59.60 MB, 92.90 MB, 127.01 MB, 161.65 MB, 193.68 MB, 219.99 MB, 237.67 MB, 245.78 MB, 250.16 MB, 254.00 MB, 256.79 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB - BytesReceived: 257.49 MB (269992725) - ConvertRowBatchTime: 176.681ms - DeserializeRowBatchTimer: 921.941ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001270) - RowsReturnedRate: 2.61 M/sec - SendersBlockedTimer: 256.157ms - SendersBlockedTotalTimer(*): 4s063ms EXCHANGE_NODE (id=4):(Total: 11s355ms, non-child: 280.466ms, % non-child: 2.47%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.93 KB, 5.06 MB, 15.67 MB, 26.00 MB, 34.77 MB, 43.24 MB, 51.11 MB, 59.81 MB, 68.74 MB, 77.65 MB, 85.98 MB, 94.19 MB, 100.64 MB, 101.18 MB - BytesReceived: 101.53 MB (106460059) - ConvertRowBatchTime: 114.722ms - DeserializeRowBatchTimer: 570.454ms - FirstBatchArrivalWaitTime: 7s105ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3743193) - RowsReturnedRate: 329.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e708e (host=d2407.halxg.cloudera.com:22000):(Total: 14s322ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 18.53 MB, 138.10 MB, 138.13 MB, 266.08 MB, 266.22 MB, 394.14 MB, 394.16 MB, 522.13 MB, 522.10 MB, 522.08 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.10 MB, 634.06 MB, 762.40 MB, 777.19 MB, 777.32 MB, 777.24 MB, 777.17 MB, 777.47 MB, 777.28 MB, 777.28 MB, 777.28 MB, 777.21 MB, 777.13 MB, 777.15 MB, 777.17 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 779.79 MB (817673272) - PerHostPeakMemUsage: 4.02 GB (4321457080) - PrepareTime: 222.004ms - RowsProduced: 1 (1) - TotalCpuTime: 7s327ms - TotalNetworkReceiveTime: 14s959ms - TotalNetworkSendTime: 339.230us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 672.527ms, non-child: 672.527ms, % non-child: 100.00%) - CodegenTime: 758.519us - CompileTime: 120.058ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 337.681ms - PrepareTime: 214.011ms DataStreamSender (dst_id=6):(Total: 92.445us, non-child: 92.445us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.66 MB/sec - OverallThroughput: 443.68 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 22.790us - TransmitDataRPCTime: 24.060us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s321ms, non-child: 904.042ms, % non-child: 6.31%) ExecOption: Codegen Enabled - BuildTime: 668.872ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 124.60 KB (127592) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s417ms, non-child: 2s158ms, % non-child: 16.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s240ms - BuildRows: 10.00M (9998747) - BuildRowsPartitioned: 10.00M (9998747) - BuildTime: 511.740ms - GetNewBlockTime: 1.518ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3741079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s858ms - RowsReturned: 3.74M (3741079) - RowsReturnedRate: 278.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.050us EXCHANGE_NODE (id=5):(Total: 4s031ms, non-child: 372.291ms, % non-child: 9.23%) BytesReceived(500.000ms): 6.80 MB, 11.17 MB, 35.50 MB, 64.63 MB, 98.12 MB, 132.32 MB, 166.98 MB, 198.03 MB, 223.35 MB, 239.08 MB, 246.61 MB, 250.69 MB, 254.56 MB, 257.05 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB, 257.45 MB - BytesReceived: 257.45 MB (269952123) - ConvertRowBatchTime: 175.818ms - DeserializeRowBatchTimer: 947.832ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9998747) - RowsReturnedRate: 2.48 M/sec - SendersBlockedTimer: 269.808ms - SendersBlockedTotalTimer(*): 5s336ms EXCHANGE_NODE (id=4):(Total: 11s269ms, non-child: 358.993ms, % non-child: 3.19%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 151.45 KB, 6.64 MB, 17.36 MB, 27.38 MB, 35.99 MB, 44.45 MB, 52.36 MB, 61.23 MB, 70.09 MB, 78.92 MB, 87.16 MB, 95.47 MB, 100.79 MB, 101.18 MB - BytesReceived: 101.47 MB (106401877) - ConvertRowBatchTime: 128.988ms - DeserializeRowBatchTimer: 597.670ms - FirstBatchArrivalWaitTime: 7s092ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741079) - RowsReturnedRate: 331.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7098 (host=d2413.halxg.cloudera.com:22000):(Total: 14s322ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.67 MB, 138.16 MB, 138.08 MB, 266.10 MB, 266.10 MB, 394.13 MB, 394.16 MB, 522.10 MB, 522.08 MB, 522.11 MB, 522.08 MB, 522.13 MB, 522.10 MB, 586.06 MB, 730.06 MB, 777.25 MB, 777.19 MB, 777.28 MB, 777.23 MB, 777.28 MB, 777.30 MB, 777.24 MB, 777.28 MB, 777.19 MB, 777.19 MB, 777.17 MB, 777.17 MB, 777.17 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.81 MB (816637720) - PerHostPeakMemUsage: 4.03 GB (4323512416) - PrepareTime: 221.878ms - RowsProduced: 1 (1) - TotalCpuTime: 7s235ms - TotalNetworkReceiveTime: 15s163ms - TotalNetworkSendTime: 197.826us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 676.646ms, non-child: 676.646ms, % non-child: 100.00%) - CodegenTime: 770.008us - CompileTime: 117.562ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 344.503ms - PrepareTime: 213.842ms DataStreamSender (dst_id=6):(Total: 62.340us, non-child: 62.340us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.27 MB/sec - OverallThroughput: 657.93 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 12.469us - TransmitDataRPCTime: 31.420us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s321ms, non-child: 876.295ms, % non-child: 6.12%) ExecOption: Codegen Enabled - BuildTime: 640.494ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 105.28 KB (107808) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s444ms, non-child: 2s049ms, % non-child: 15.24%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s174ms - BuildRows: 10.00M (9997738) - BuildRowsPartitioned: 10.00M (9997738) - BuildTime: 424.741ms - GetNewBlockTime: 1.435ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3739824) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s834ms - RowsReturned: 3.74M (3739824) - RowsReturnedRate: 278.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.123us EXCHANGE_NODE (id=5):(Total: 4s098ms, non-child: 402.862ms, % non-child: 9.83%) BytesReceived(500.000ms): 10.30 MB, 27.54 MB, 53.61 MB, 86.74 MB, 120.65 MB, 155.26 MB, 188.28 MB, 215.50 MB, 235.31 MB, 244.44 MB, 249.39 MB, 253.21 MB, 256.33 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB - BytesReceived: 257.39 MB (269893216) - ConvertRowBatchTime: 175.137ms - DeserializeRowBatchTimer: 963.895ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9997738) - RowsReturnedRate: 2.44 M/sec - SendersBlockedTimer: 278.030ms - SendersBlockedTotalTimer(*): 5s493ms EXCHANGE_NODE (id=4):(Total: 11s405ms, non-child: 407.810ms, % non-child: 3.58%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.39 MB, 13.64 MB, 24.28 MB, 33.21 MB, 41.78 MB, 49.57 MB, 58.18 MB, 67.12 MB, 75.97 MB, 84.44 MB, 92.60 MB, 100.07 MB, 101.01 MB, 101.41 MB - BytesReceived: 101.44 MB (106366028) - ConvertRowBatchTime: 122.764ms - DeserializeRowBatchTimer: 640.067ms - FirstBatchArrivalWaitTime: 7s085ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3739824) - RowsReturnedRate: 327.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7094 (host=d2415.halxg.cloudera.com:22000):(Total: 14s321ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 11.99 MB, 138.08 MB, 138.19 MB, 250.19 MB, 266.22 MB, 394.13 MB, 394.16 MB, 394.08 MB, 522.10 MB, 522.13 MB, 522.10 MB, 522.10 MB, 522.08 MB, 522.08 MB, 634.06 MB, 762.18 MB, 777.17 MB, 777.37 MB, 777.21 MB, 777.21 MB, 777.32 MB, 777.19 MB, 777.17 MB, 777.17 MB, 777.21 MB, 777.25 MB, 777.15 MB, 777.19 MB, 777.15 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.91 MB (816750280) - PerHostPeakMemUsage: 4.00 GB (4295089648) - PrepareTime: 214.738ms - RowsProduced: 1 (1) - TotalCpuTime: 7s263ms - TotalNetworkReceiveTime: 15s159ms - TotalNetworkSendTime: 201.891us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 662.993ms, non-child: 662.993ms, % non-child: 100.00%) - CodegenTime: 702.020us - CompileTime: 120.665ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 334.205ms - PrepareTime: 207.387ms DataStreamSender (dst_id=6):(Total: 49.901us, non-child: 49.901us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.72 MB/sec - OverallThroughput: 821.94 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.777us - TransmitDataRPCTime: 23.297us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s319ms, non-child: 759.155ms, % non-child: 5.30%) ExecOption: Codegen Enabled - BuildTime: 529.733ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 144.52 KB (147984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s560ms, non-child: 2s008ms, % non-child: 14.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s354ms - BuildRows: 10.00M (9998576) - BuildRowsPartitioned: 10.00M (9998576) - BuildTime: 447.453ms - GetNewBlockTime: 1.622ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3740573) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s789ms - RowsReturned: 3.74M (3740573) - RowsReturnedRate: 275.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.261us EXCHANGE_NODE (id=5):(Total: 3s936ms, non-child: 372.725ms, % non-child: 9.47%) BytesReceived(500.000ms): 4.40 MB, 10.29 MB, 33.65 MB, 62.19 MB, 95.59 MB, 129.66 MB, 164.28 MB, 195.91 MB, 221.65 MB, 238.32 MB, 246.13 MB, 250.40 MB, 254.24 MB, 256.88 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB - BytesReceived: 257.43 MB (269934537) - ConvertRowBatchTime: 179.710ms - DeserializeRowBatchTimer: 884.349ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9998576) - RowsReturnedRate: 2.54 M/sec - SendersBlockedTimer: 257.400ms - SendersBlockedTotalTimer(*): 4s836ms EXCHANGE_NODE (id=4):(Total: 11s560ms, non-child: 264.266ms, % non-child: 2.29%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 56.87 KB, 5.83 MB, 16.52 MB, 26.70 MB, 35.34 MB, 43.77 MB, 51.63 MB, 60.46 MB, 69.41 MB, 78.29 MB, 86.58 MB, 94.82 MB, 100.69 MB, 101.15 MB - BytesReceived: 101.46 MB (106391750) - ConvertRowBatchTime: 121.097ms - DeserializeRowBatchTimer: 553.670ms - FirstBatchArrivalWaitTime: 7s101ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740573) - RowsReturnedRate: 323.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7092 (host=d2421.halxg.cloudera.com:22000):(Total: 14s319ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 5.48 MB, 138.63 MB, 138.08 MB, 138.28 MB, 266.10 MB, 274.19 MB, 394.22 MB, 394.08 MB, 522.10 MB, 522.10 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.08 MB, 618.06 MB, 762.10 MB, 777.17 MB, 777.15 MB, 777.19 MB, 777.19 MB, 777.15 MB, 777.43 MB, 777.23 MB, 777.17 MB, 777.21 MB, 777.13 MB, 777.19 MB, 777.13 MB, 777.15 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.89 MB (816727768) - PerHostPeakMemUsage: 3.95 GB (4244592616) - PrepareTime: 217.128ms - RowsProduced: 1 (1) - TotalCpuTime: 7s265ms - TotalNetworkReceiveTime: 14s936ms - TotalNetworkSendTime: 236.233us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 662.401ms, non-child: 662.401ms, % non-child: 100.00%) - CodegenTime: 976.025us - CompileTime: 117.134ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 335.515ms - PrepareTime: 208.956ms DataStreamSender (dst_id=6):(Total: 54.647us, non-child: 54.647us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.59 MB/sec - OverallThroughput: 750.56 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 10.814us - TransmitDataRPCTime: 25.161us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s317ms, non-child: 889.751ms, % non-child: 6.21%) ExecOption: Codegen Enabled - BuildTime: 657.306ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 152.73 KB (156392) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s428ms, non-child: 2s130ms, % non-child: 15.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s309ms - BuildRows: 10.00M (10004990) - BuildRowsPartitioned: 10.00M (10004990) - BuildTime: 471.455ms - GetNewBlockTime: 1.466ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3741647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s908ms - RowsReturned: 3.74M (3741647) - RowsReturnedRate: 278.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.197us EXCHANGE_NODE (id=5):(Total: 3s973ms, non-child: 368.187ms, % non-child: 9.27%) BytesReceived(500.000ms): 2.00 MB, 10.35 MB, 31.96 MB, 59.76 MB, 93.06 MB, 127.19 MB, 161.87 MB, 193.88 MB, 220.17 MB, 237.83 MB, 245.89 MB, 250.30 MB, 254.11 MB, 256.90 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB - BytesReceived: 257.60 MB (270114721) - ConvertRowBatchTime: 178.520ms - DeserializeRowBatchTimer: 899.220ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10004990) - RowsReturnedRate: 2.52 M/sec - SendersBlockedTimer: 262.141ms - SendersBlockedTotalTimer(*): 5s181ms EXCHANGE_NODE (id=4):(Total: 11s307ms, non-child: 315.308ms, % non-child: 2.79%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.99 KB, 5.08 MB, 15.65 MB, 25.97 MB, 34.69 MB, 43.20 MB, 51.04 MB, 59.82 MB, 68.68 MB, 77.59 MB, 85.94 MB, 94.16 MB, 100.61 MB, 101.14 MB - BytesReceived: 101.49 MB (106422917) - ConvertRowBatchTime: 132.753ms - DeserializeRowBatchTimer: 626.432ms - FirstBatchArrivalWaitTime: 7s099ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741647) - RowsReturnedRate: 330.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e708b (host=d2409.halxg.cloudera.com:22000):(Total: 14s317ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 885.27 KB, 91.71 MB, 138.08 MB, 138.13 MB, 266.13 MB, 266.16 MB, 394.11 MB, 394.25 MB, 522.16 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.10 MB, 522.10 MB, 602.06 MB, 746.06 MB, 777.13 MB, 777.15 MB, 777.21 MB, 777.19 MB, 777.17 MB, 777.15 MB, 777.17 MB, 777.13 MB, 777.23 MB, 777.19 MB, 777.13 MB, 777.15 MB, 777.17 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.51 MB (816322552) - PerHostPeakMemUsage: 4.02 GB (4313020144) - PrepareTime: 225.908ms - RowsProduced: 1 (1) - TotalCpuTime: 7s218ms - TotalNetworkReceiveTime: 15s217ms - TotalNetworkSendTime: 258.099us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 667.753ms, non-child: 667.753ms, % non-child: 100.00%) - CodegenTime: 686.807us - CompileTime: 118.836ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 330.282ms - PrepareTime: 217.907ms DataStreamSender (dst_id=6):(Total: 56.423us, non-child: 56.423us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.29 MB/sec - OverallThroughput: 726.93 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.218us - TransmitDataRPCTime: 31.102us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s316ms, non-child: 867.270ms, % non-child: 6.06%) ExecOption: Codegen Enabled - BuildTime: 629.171ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 127.85 KB (130920) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s448ms, non-child: 1s833ms, % non-child: 13.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s328ms - BuildRows: 10.00M (9999165) - BuildRowsPartitioned: 10.00M (9999165) - BuildTime: 443.578ms - GetNewBlockTime: 1.589ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3741194) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s657ms - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 278.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.172us EXCHANGE_NODE (id=5):(Total: 3s946ms, non-child: 388.819ms, % non-child: 9.85%) BytesReceived(500.000ms): 314.16 KB, 10.29 MB, 28.77 MB, 55.39 MB, 88.55 MB, 122.55 MB, 157.09 MB, 189.86 MB, 216.87 MB, 236.01 MB, 244.85 MB, 249.61 MB, 253.43 MB, 256.47 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB - BytesReceived: 257.43 MB (269934259) - ConvertRowBatchTime: 181.874ms - DeserializeRowBatchTimer: 931.309ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9999165) - RowsReturnedRate: 2.53 M/sec - SendersBlockedTimer: 266.922ms - SendersBlockedTotalTimer(*): 5s269ms EXCHANGE_NODE (id=4):(Total: 11s626ms, non-child: 341.586ms, % non-child: 2.94%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.84 MB, 14.23 MB, 24.76 MB, 33.58 MB, 42.10 MB, 49.92 MB, 58.57 MB, 67.53 MB, 76.41 MB, 84.86 MB, 93.02 MB, 100.31 MB, 101.07 MB, 101.47 MB - BytesReceived: 101.48 MB (106408481) - ConvertRowBatchTime: 139.968ms - DeserializeRowBatchTimer: 579.773ms - FirstBatchArrivalWaitTime: 7s096ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 321.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7093 (host=d2403.halxg.cloudera.com:22000):(Total: 14s316ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 27.24 MB, 138.16 MB, 138.25 MB, 266.08 MB, 266.16 MB, 394.25 MB, 394.13 MB, 522.16 MB, 522.12 MB, 522.08 MB, 522.10 MB, 522.10 MB, 522.10 MB, 570.06 MB, 714.06 MB, 777.15 MB, 777.17 MB, 777.15 MB, 777.15 MB, 777.21 MB, 777.15 MB, 777.17 MB, 777.28 MB, 777.17 MB, 777.30 MB, 777.30 MB, 777.16 MB, 777.17 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 780.67 MB (818596264) - PerHostPeakMemUsage: 4.00 GB (4290273712) - PrepareTime: 223.380ms - RowsProduced: 1 (1) - TotalCpuTime: 7s435ms - TotalNetworkReceiveTime: 14s704ms - TotalNetworkSendTime: 179.241us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 672.793ms, non-child: 672.793ms, % non-child: 100.00%) - CodegenTime: 777.340us - CompileTime: 120.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 335.671ms - PrepareTime: 215.485ms DataStreamSender (dst_id=6):(Total: 53.926us, non-child: 53.926us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 2.45 MB/sec - OverallThroughput: 760.59 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.234us - TransmitDataRPCTime: 16.367us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s315ms, non-child: 788.969ms, % non-child: 5.51%) ExecOption: Codegen Enabled - BuildTime: 554.647ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 135.95 KB (139216) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s526ms, non-child: 2s186ms, % non-child: 16.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s592ms - BuildRows: 10.01M (10005568) - BuildRowsPartitioned: 10.01M (10005568) - BuildTime: 498.422ms - GetNewBlockTime: 1.567ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3743372) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s861ms - RowsReturned: 3.74M (3743372) - RowsReturnedRate: 276.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.086us EXCHANGE_NODE (id=5):(Total: 3s681ms, non-child: 388.866ms, % non-child: 10.56%) BytesReceived(500.000ms): 10.18 MB, 26.67 MB, 52.52 MB, 85.61 MB, 119.51 MB, 154.12 MB, 187.37 MB, 214.72 MB, 235.01 MB, 244.32 MB, 249.43 MB, 253.25 MB, 256.48 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB, 257.61 MB - BytesReceived: 257.61 MB (270124846) - ConvertRowBatchTime: 177.962ms - DeserializeRowBatchTimer: 919.644ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.01M (10005568) - RowsReturnedRate: 2.72 M/sec - SendersBlockedTimer: 271.437ms - SendersBlockedTotalTimer(*): 4s579ms EXCHANGE_NODE (id=4):(Total: 11s350ms, non-child: 277.889ms, % non-child: 2.45%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.04 MB, 13.38 MB, 23.90 MB, 32.87 MB, 41.51 MB, 49.29 MB, 57.91 MB, 66.93 MB, 75.76 MB, 84.29 MB, 92.40 MB, 100.01 MB, 101.10 MB, 101.50 MB - BytesReceived: 101.54 MB (106472837) - ConvertRowBatchTime: 110.420ms - DeserializeRowBatchTimer: 585.397ms - FirstBatchArrivalWaitTime: 7s092ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3743372) - RowsReturnedRate: 329.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e708a (host=d2419.halxg.cloudera.com:22000):(Total: 14s314ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 35.46 MB, 138.13 MB, 138.19 MB, 266.13 MB, 266.22 MB, 394.10 MB, 394.13 MB, 522.16 MB, 522.10 MB, 522.10 MB, 522.10 MB, 522.10 MB, 522.10 MB, 586.06 MB, 746.06 MB, 777.17 MB, 777.17 MB, 777.17 MB, 777.19 MB, 777.17 MB, 777.25 MB, 777.25 MB, 777.25 MB, 777.17 MB, 777.19 MB, 777.17 MB, 777.17 MB, 777.13 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.89 MB (816727768) - PerHostPeakMemUsage: 3.95 GB (4245907616) - PrepareTime: 221.170ms - RowsProduced: 1 (1) - TotalCpuTime: 7s262ms - TotalNetworkReceiveTime: 15s210ms - TotalNetworkSendTime: 297.065us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 662.835ms, non-child: 662.835ms, % non-child: 100.00%) - CodegenTime: 884.055us - CompileTime: 118.533ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 329.940ms - PrepareTime: 213.514ms DataStreamSender (dst_id=6):(Total: 103.437us, non-child: 103.437us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.71 MB/sec - OverallThroughput: 396.53 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 50.811us - TransmitDataRPCTime: 23.434us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s312ms, non-child: 776.318ms, % non-child: 5.42%) ExecOption: Codegen Enabled - BuildTime: 541.285ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 124.60 KB (127592) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s536ms, non-child: 1s938ms, % non-child: 14.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s342ms - BuildRows: 10.00M (10000017) - BuildRowsPartitioned: 10.00M (10000017) - BuildTime: 465.554ms - GetNewBlockTime: 1.633ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3743446) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s733ms - RowsReturned: 3.74M (3743446) - RowsReturnedRate: 276.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.055us EXCHANGE_NODE (id=5):(Total: 3s937ms, non-child: 386.060ms, % non-child: 9.80%) BytesReceived(500.000ms): 10.25 MB, 27.06 MB, 52.95 MB, 86.09 MB, 120.04 MB, 154.57 MB, 187.67 MB, 214.94 MB, 235.07 MB, 244.34 MB, 249.36 MB, 253.18 MB, 256.37 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB - BytesReceived: 257.47 MB (269978177) - ConvertRowBatchTime: 178.864ms - DeserializeRowBatchTimer: 939.290ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10000017) - RowsReturnedRate: 2.54 M/sec - SendersBlockedTimer: 260.912ms - SendersBlockedTotalTimer(*): 5s162ms EXCHANGE_NODE (id=4):(Total: 11s608ms, non-child: 274.242ms, % non-child: 2.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.16 MB, 13.55 MB, 24.02 MB, 32.97 MB, 41.63 MB, 49.44 MB, 58.02 MB, 67.02 MB, 75.85 MB, 84.33 MB, 92.49 MB, 100.07 MB, 101.11 MB, 101.50 MB - BytesReceived: 101.54 MB (106469235) - ConvertRowBatchTime: 120.055ms - DeserializeRowBatchTimer: 587.430ms - FirstBatchArrivalWaitTime: 7s106ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3743446) - RowsReturnedRate: 322.49 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7090 (host=d2417.halxg.cloudera.com:22000):(Total: 14s314ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 27.23 MB, 138.08 MB, 138.16 MB, 266.22 MB, 266.14 MB, 394.19 MB, 394.22 MB, 522.16 MB, 522.08 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.10 MB, 570.06 MB, 714.06 MB, 777.21 MB, 777.19 MB, 777.24 MB, 777.19 MB, 777.23 MB, 777.21 MB, 777.23 MB, 777.19 MB, 777.15 MB, 777.24 MB, 777.21 MB, 777.17 MB, 777.15 MB, 777.17 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 780.37 MB (818281096) - PerHostPeakMemUsage: 4.02 GB (4312124920) - PrepareTime: 225.894ms - RowsProduced: 1 (1) - TotalCpuTime: 7s626ms - TotalNetworkReceiveTime: 14s496ms - TotalNetworkSendTime: 314.066us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 675.097ms, non-child: 675.097ms, % non-child: 100.00%) - CodegenTime: 771.886us - CompileTime: 121.457ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 335.062ms - PrepareTime: 217.815ms DataStreamSender (dst_id=6):(Total: 51.138us, non-child: 51.138us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.83 MB/sec - OverallThroughput: 802.06 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.314us - TransmitDataRPCTime: 21.879us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s312ms, non-child: 878.901ms, % non-child: 6.14%) ExecOption: Codegen Enabled - BuildTime: 639.589ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 110.52 KB (113168) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s433ms, non-child: 2s141ms, % non-child: 15.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s746ms - BuildRows: 10.00M (10001120) - BuildRowsPartitioned: 10.00M (10001120) - BuildTime: 508.921ms - GetNewBlockTime: 1.574ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3742988) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s827ms - RowsReturned: 3.74M (3742988) - RowsReturnedRate: 278.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.196us EXCHANGE_NODE (id=5):(Total: 3s524ms, non-child: 380.501ms, % non-child: 10.80%) BytesReceived(500.000ms): 10.20 MB, 24.71 MB, 49.95 MB, 83.01 MB, 116.89 MB, 151.41 MB, 185.07 MB, 212.64 MB, 233.78 MB, 243.62 MB, 248.99 MB, 252.83 MB, 256.20 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB, 257.49 MB - BytesReceived: 257.49 MB (270000311) - ConvertRowBatchTime: 175.181ms - DeserializeRowBatchTimer: 935.172ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001120) - RowsReturnedRate: 2.84 M/sec - SendersBlockedTimer: 275.263ms - SendersBlockedTotalTimer(*): 5s168ms EXCHANGE_NODE (id=4):(Total: 11s301ms, non-child: 284.807ms, % non-child: 2.52%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.49 MB, 12.62 MB, 23.16 MB, 32.22 MB, 40.85 MB, 48.62 MB, 57.15 MB, 66.16 MB, 74.97 MB, 83.57 MB, 91.67 MB, 99.60 MB, 101.06 MB, 101.46 MB - BytesReceived: 101.53 MB (106459204) - ConvertRowBatchTime: 118.731ms - DeserializeRowBatchTimer: 607.497ms - FirstBatchArrivalWaitTime: 7s088ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3742988) - RowsReturnedRate: 331.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7091 (host=d2408.halxg.cloudera.com:22000):(Total: 14s313ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 27.23 MB, 138.08 MB, 138.16 MB, 266.19 MB, 266.19 MB, 394.16 MB, 394.16 MB, 522.10 MB, 522.10 MB, 522.08 MB, 522.13 MB, 522.10 MB, 522.08 MB, 570.06 MB, 714.06 MB, 777.17 MB, 777.19 MB, 777.58 MB, 777.17 MB, 777.17 MB, 777.21 MB, 777.15 MB, 777.21 MB, 777.17 MB, 777.21 MB, 777.19 MB, 777.17 MB, 777.17 MB, 777.15 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 780.33 MB (818236072) - PerHostPeakMemUsage: 4.04 GB (4336667704) - PrepareTime: 221.031ms - RowsProduced: 1 (1) - TotalCpuTime: 7s356ms - TotalNetworkReceiveTime: 14s874ms - TotalNetworkSendTime: 217.735us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 672.665ms, non-child: 672.665ms, % non-child: 100.00%) - CodegenTime: 689.702us - CompileTime: 120.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 337.981ms - PrepareTime: 212.963ms DataStreamSender (dst_id=6):(Total: 44.872us, non-child: 44.872us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 2.13 MB/sec - OverallThroughput: 914.06 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 8.629us - TransmitDataRPCTime: 18.830us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s312ms, non-child: 860.534ms, % non-child: 6.01%) ExecOption: Codegen Enabled - BuildTime: 626.970ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 128.93 KB (132024) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s452ms, non-child: 2s038ms, % non-child: 15.15%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s492ms - BuildRows: 10.00M (10000886) - BuildRowsPartitioned: 10.00M (10000886) - BuildTime: 500.276ms - GetNewBlockTime: 1.562ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3741194) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s723ms - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 278.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.140us EXCHANGE_NODE (id=5):(Total: 3s783ms, non-child: 400.160ms, % non-child: 10.58%) BytesReceived(500.000ms): 10.21 MB, 23.64 MB, 48.80 MB, 81.68 MB, 115.51 MB, 150.06 MB, 183.97 MB, 211.64 MB, 233.21 MB, 243.33 MB, 248.89 MB, 252.70 MB, 256.13 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB - BytesReceived: 257.50 MB (270004713) - ConvertRowBatchTime: 179.122ms - DeserializeRowBatchTimer: 973.978ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10000886) - RowsReturnedRate: 2.64 M/sec - SendersBlockedTimer: 270.232ms - SendersBlockedTotalTimer(*): 5s335ms EXCHANGE_NODE (id=4):(Total: 11s422ms, non-child: 326.386ms, % non-child: 2.86%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.22 MB, 12.14 MB, 22.78 MB, 31.88 MB, 40.52 MB, 48.31 MB, 56.78 MB, 65.81 MB, 74.65 MB, 83.26 MB, 91.35 MB, 99.35 MB, 101.01 MB, 101.39 MB - BytesReceived: 101.48 MB (106408686) - ConvertRowBatchTime: 115.519ms - DeserializeRowBatchTimer: 592.423ms - FirstBatchArrivalWaitTime: 7s091ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741194) - RowsReturnedRate: 327.51 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e708f (host=d2402.halxg.cloudera.com:22000):(Total: 14s310ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 27.23 MB, 138.10 MB, 138.16 MB, 266.08 MB, 266.10 MB, 394.10 MB, 394.08 MB, 522.10 MB, 522.16 MB, 522.10 MB, 522.10 MB, 522.08 MB, 522.10 MB, 538.06 MB, 634.06 MB, 732.31 MB, 795.22 MB, 779.23 MB, 777.19 MB, 777.15 MB, 777.19 MB, 777.19 MB, 777.21 MB, 777.13 MB, 777.15 MB, 777.17 MB, 777.17 MB, 777.17 MB, 777.15 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 798.13 MB (836898520) - PerHostPeakMemUsage: 3.92 GB (4206189848) - PrepareTime: 231.563ms - RowsProduced: 1 (1) - TotalCpuTime: 8s015ms - TotalNetworkReceiveTime: 14s534ms - TotalNetworkSendTime: 149.674us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 695.730ms, non-child: 695.730ms, % non-child: 100.00%) - CodegenTime: 799.444us - CompileTime: 125.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 345.969ms - PrepareTime: 223.409ms DataStreamSender (dst_id=6):(Total: 67.508us, non-child: 67.508us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.20 MB/sec - OverallThroughput: 607.57 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 17.277us - TransmitDataRPCTime: 33.444us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s309ms, non-child: 901.223ms, % non-child: 6.30%) ExecOption: Codegen Enabled - BuildTime: 656.371ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 111.31 KB (113984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s408ms, non-child: 2s557ms, % non-child: 19.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s229ms - BuildRows: 10.00M (9995884) - BuildRowsPartitioned: 10.00M (9995884) - BuildTime: 721.576ms - GetNewBlockTime: 2.259ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3741013) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s796ms - RowsReturned: 3.74M (3741013) - RowsReturnedRate: 279.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.147us EXCHANGE_NODE (id=5):(Total: 4s019ms, non-child: 403.533ms, % non-child: 10.04%) BytesReceived(500.000ms): 10.21 MB, 19.11 MB, 43.62 MB, 75.17 MB, 108.81 MB, 143.24 MB, 177.83 MB, 206.45 MB, 229.57 MB, 241.80 MB, 248.03 MB, 251.87 MB, 255.62 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB, 257.39 MB - BytesReceived: 257.39 MB (269888041) - ConvertRowBatchTime: 178.524ms - DeserializeRowBatchTimer: 938.623ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9995884) - RowsReturnedRate: 2.49 M/sec - SendersBlockedTimer: 295.172ms - SendersBlockedTotalTimer(*): 5s573ms EXCHANGE_NODE (id=4):(Total: 10s861ms, non-child: 317.995ms, % non-child: 2.93%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 994.32 KB, 10.05 MB, 20.77 MB, 30.17 MB, 38.79 MB, 46.77 MB, 55.04 MB, 64.08 MB, 72.88 MB, 81.61 MB, 89.74 MB, 98.15 MB, 100.93 MB, 101.31 MB - BytesReceived: 101.47 MB (106403085) - ConvertRowBatchTime: 127.435ms - DeserializeRowBatchTimer: 630.850ms - FirstBatchArrivalWaitTime: 7s072ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3741013) - RowsReturnedRate: 344.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e708d (host=d2411.halxg.cloudera.com:22000):(Total: 14s309ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 5.07 MB, 139.93 MB, 138.13 MB, 138.22 MB, 266.16 MB, 266.08 MB, 394.16 MB, 394.13 MB, 522.13 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.08 MB, 522.10 MB, 618.06 MB, 762.10 MB, 777.19 MB, 777.19 MB, 777.15 MB, 777.15 MB, 777.19 MB, 777.15 MB, 777.19 MB, 777.23 MB, 777.17 MB, 777.15 MB, 777.19 MB, 777.17 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 779.82 MB (817695784) - PerHostPeakMemUsage: 4.00 GB (4295906576) - PrepareTime: 222.788ms - RowsProduced: 1 (1) - TotalCpuTime: 7s325ms - TotalNetworkReceiveTime: 14s965ms - TotalNetworkSendTime: 278.863us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 675.210ms, non-child: 675.210ms, % non-child: 100.00%) - CodegenTime: 962.827us - CompileTime: 119.909ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 339.804ms - PrepareTime: 214.740ms DataStreamSender (dst_id=6):(Total: 74.033us, non-child: 74.033us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.35 MB/sec - OverallThroughput: 554.02 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 11.397us - TransmitDataRPCTime: 29.725us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s308ms, non-child: 761.379ms, % non-child: 5.32%) ExecOption: Codegen Enabled - BuildTime: 525.741ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 145.30 KB (148792) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s546ms, non-child: 2s101ms, % non-child: 15.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s418ms - BuildRows: 9.99M (9992941) - BuildRowsPartitioned: 9.99M (9992941) - BuildTime: 485.697ms - GetNewBlockTime: 1.460ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3736416) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s810ms - RowsReturned: 3.74M (3736416) - RowsReturnedRate: 275.82 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.394us EXCHANGE_NODE (id=5):(Total: 3s854ms, non-child: 395.468ms, % non-child: 10.26%) BytesReceived(500.000ms): 1.85 MB, 10.32 MB, 31.82 MB, 59.51 MB, 92.78 MB, 126.87 MB, 161.44 MB, 193.48 MB, 219.80 MB, 237.47 MB, 245.53 MB, 249.93 MB, 253.76 MB, 256.59 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB, 257.28 MB - BytesReceived: 257.28 MB (269775090) - ConvertRowBatchTime: 183.128ms - DeserializeRowBatchTimer: 925.783ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 9.99M (9992941) - RowsReturnedRate: 2.59 M/sec - SendersBlockedTimer: 269.606ms - SendersBlockedTotalTimer(*): 4s548ms EXCHANGE_NODE (id=4):(Total: 11s455ms, non-child: 296.866ms, % non-child: 2.59%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.98 KB, 5.06 MB, 15.64 MB, 25.95 MB, 34.67 MB, 43.19 MB, 50.97 MB, 59.69 MB, 68.60 MB, 77.46 MB, 85.78 MB, 93.96 MB, 100.45 MB, 100.99 MB - BytesReceived: 101.34 MB (106267037) - ConvertRowBatchTime: 122.315ms - DeserializeRowBatchTimer: 589.438ms - FirstBatchArrivalWaitTime: 7s089ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3736416) - RowsReturnedRate: 326.17 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7099 (host=d2406.halxg.cloudera.com:22000):(Total: 14s307ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 884.84 KB, 154.46 MB, 138.19 MB, 138.16 MB, 266.10 MB, 266.08 MB, 394.31 MB, 394.16 MB, 522.08 MB, 522.13 MB, 522.10 MB, 522.10 MB, 522.10 MB, 522.10 MB, 602.06 MB, 746.06 MB, 777.28 MB, 777.19 MB, 777.17 MB, 777.28 MB, 777.32 MB, 777.28 MB, 777.21 MB, 777.17 MB, 777.56 MB, 777.25 MB, 777.21 MB, 777.19 MB, 777.15 MB, 713.14 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.40 MB (816209992) - PerHostPeakMemUsage: 4.04 GB (4332919304) - PrepareTime: 220.314ms - RowsProduced: 1 (1) - TotalCpuTime: 7s190ms - TotalNetworkReceiveTime: 15s059ms - TotalNetworkSendTime: 328.084us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 679.199ms, non-child: 679.199ms, % non-child: 100.00%) - CodegenTime: 855.015us - CompileTime: 120.587ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 345.540ms - PrepareTime: 212.319ms DataStreamSender (dst_id=6):(Total: 54.879us, non-child: 54.879us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.87 MB/sec - OverallThroughput: 747.38 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 17.667us - TransmitDataRPCTime: 21.428us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s305ms, non-child: 846.033ms, % non-child: 5.91%) ExecOption: Codegen Enabled - BuildTime: 607.795ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 108.37 KB (110968) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s459ms, non-child: 1s872ms, % non-child: 13.91%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s455ms - BuildRows: 10.00M (10001295) - BuildRowsPartitioned: 10.00M (10001295) - BuildTime: 422.005ms - GetNewBlockTime: 1.643ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3742969) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s713ms - RowsReturned: 3.74M (3742969) - RowsReturnedRate: 278.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.250us EXCHANGE_NODE (id=5):(Total: 3s808ms, non-child: 383.108ms, % non-child: 10.06%) BytesReceived(500.000ms): 313.99 KB, 10.34 MB, 29.72 MB, 56.74 MB, 90.09 MB, 124.04 MB, 158.68 MB, 191.12 MB, 218.01 MB, 236.67 MB, 245.30 MB, 249.87 MB, 253.70 MB, 256.65 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB, 257.52 MB - BytesReceived: 257.52 MB (270034184) - ConvertRowBatchTime: 189.365ms - DeserializeRowBatchTimer: 893.929ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001295) - RowsReturnedRate: 2.63 M/sec - SendersBlockedTimer: 281.361ms - SendersBlockedTotalTimer(*): 4s749ms EXCHANGE_NODE (id=4):(Total: 11s599ms, non-child: 339.812ms, % non-child: 2.93%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.21 MB, 14.72 MB, 25.13 MB, 34.01 MB, 42.55 MB, 50.34 MB, 59.04 MB, 67.97 MB, 76.80 MB, 85.25 MB, 93.46 MB, 100.50 MB, 101.15 MB, 101.54 MB - BytesReceived: 101.54 MB (106467432) - ConvertRowBatchTime: 121.069ms - DeserializeRowBatchTimer: 592.142ms - FirstBatchArrivalWaitTime: 7s088ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3742969) - RowsReturnedRate: 322.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e709b (host=d2405.halxg.cloudera.com:22000):(Total: 14s306ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 29.29 MB, 138.16 MB, 138.16 MB, 266.25 MB, 266.19 MB, 394.10 MB, 394.10 MB, 522.08 MB, 522.10 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.10 MB, 586.06 MB, 730.06 MB, 777.13 MB, 777.17 MB, 777.45 MB, 777.17 MB, 777.15 MB, 777.23 MB, 777.21 MB, 777.15 MB, 777.19 MB, 777.15 MB, 777.13 MB, 777.17 MB, 777.15 MB, 777.17 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 778.40 MB (816209992) - PerHostPeakMemUsage: 4.03 GB (4322109320) - PrepareTime: 219.336ms - RowsProduced: 1 (1) - TotalCpuTime: 7s185ms - TotalNetworkReceiveTime: 15s203ms - TotalNetworkSendTime: 201.013us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 679.186ms, non-child: 679.186ms, % non-child: 100.00%) - CodegenTime: 776.836us - CompileTime: 119.256ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 347.795ms - PrepareTime: 211.115ms DataStreamSender (dst_id=6):(Total: 47.479us, non-child: 47.479us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.75 MB/sec - OverallThroughput: 863.87 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 8.746us - TransmitDataRPCTime: 22.908us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s305ms, non-child: 834.562ms, % non-child: 5.83%) ExecOption: Codegen Enabled - BuildTime: 602.052ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 153.63 KB (157320) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s471ms, non-child: 1s812ms, % non-child: 13.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s392ms - BuildRows: 10.00M (10001762) - BuildRowsPartitioned: 10.00M (10001762) - BuildTime: 418.409ms - GetNewBlockTime: 1.649ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3740641) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s656ms - RowsReturned: 3.74M (3740641) - RowsReturnedRate: 277.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.025us EXCHANGE_NODE (id=5):(Total: 3s877ms, non-child: 388.931ms, % non-child: 10.03%) BytesReceived(500.000ms): 10.24 MB, 27.36 MB, 53.35 MB, 86.59 MB, 120.54 MB, 155.10 MB, 188.17 MB, 215.40 MB, 235.36 MB, 244.49 MB, 249.46 MB, 253.27 MB, 256.42 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB, 257.50 MB - BytesReceived: 257.50 MB (270012069) - ConvertRowBatchTime: 181.868ms - DeserializeRowBatchTimer: 941.736ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10001762) - RowsReturnedRate: 2.58 M/sec - SendersBlockedTimer: 280.140ms - SendersBlockedTotalTimer(*): 5s536ms EXCHANGE_NODE (id=4):(Total: 11s669ms, non-child: 322.006ms, % non-child: 2.76%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.31 MB, 13.60 MB, 24.16 MB, 33.10 MB, 41.64 MB, 49.46 MB, 58.03 MB, 66.98 MB, 75.86 MB, 84.33 MB, 92.49 MB, 100.04 MB, 101.03 MB, 101.43 MB - BytesReceived: 101.46 MB (106390538) - ConvertRowBatchTime: 126.746ms - DeserializeRowBatchTimer: 540.340ms - FirstBatchArrivalWaitTime: 7s083ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740641) - RowsReturnedRate: 320.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7089 (host=d2412.halxg.cloudera.com:22000):(Total: 14s272ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 27.20 MB, 138.08 MB, 138.10 MB, 266.13 MB, 266.11 MB, 394.19 MB, 394.10 MB, 522.08 MB, 522.19 MB, 522.08 MB, 522.08 MB, 522.10 MB, 522.08 MB, 522.05 MB, 666.06 MB, 779.58 MB, 777.21 MB, 777.25 MB, 777.21 MB, 777.23 MB, 777.13 MB, 777.17 MB, 777.25 MB, 777.19 MB, 777.15 MB, 777.19 MB, 777.17 MB, 777.17 MB, 777.13 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.52 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 780.18 MB (818078488) - PerHostPeakMemUsage: 4.00 GB (4299381520) - PrepareTime: 226.655ms - RowsProduced: 1 (1) - TotalCpuTime: 7s301ms - TotalNetworkReceiveTime: 15s130ms - TotalNetworkSendTime: 180.168us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 716.789ms, non-child: 716.789ms, % non-child: 100.00%) - CodegenTime: 761.678us - CompileTime: 125.272ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 373.335ms - PrepareTime: 217.281ms DataStreamSender (dst_id=6):(Total: 51.730us, non-child: 51.730us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 1.57 MB/sec - OverallThroughput: 792.88 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 9.154us - TransmitDataRPCTime: 25.592us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s271ms, non-child: 804.988ms, % non-child: 5.64%) ExecOption: Codegen Enabled - BuildTime: 567.227ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 154.31 KB (158016) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s466ms, non-child: 2s106ms, % non-child: 15.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s125ms - BuildRows: 10.00M (10003786) - BuildRowsPartitioned: 10.00M (10003786) - BuildTime: 495.281ms - GetNewBlockTime: 1.533ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3740622) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s791ms - RowsReturned: 3.74M (3740622) - RowsReturnedRate: 277.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.170us EXCHANGE_NODE (id=5):(Total: 4s102ms, non-child: 381.266ms, % non-child: 9.29%) BytesReceived(500.000ms): 10.20 MB, 16.72 MB, 41.68 MB, 72.20 MB, 105.70 MB, 140.13 MB, 174.84 MB, 204.23 MB, 228.02 MB, 241.26 MB, 247.84 MB, 251.71 MB, 255.55 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB, 257.57 MB - BytesReceived: 257.57 MB (270080679) - ConvertRowBatchTime: 171.903ms - DeserializeRowBatchTimer: 915.995ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (10003786) - RowsReturnedRate: 2.44 M/sec - SendersBlockedTimer: 317.538ms - SendersBlockedTotalTimer(*): 6s007ms EXCHANGE_NODE (id=4):(Total: 11s368ms, non-child: 317.065ms, % non-child: 2.79%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 672.54 KB, 9.03 MB, 19.75 MB, 29.34 MB, 37.95 MB, 46.05 MB, 54.15 MB, 63.19 MB, 72.05 MB, 80.81 MB, 88.94 MB, 97.38 MB, 100.90 MB, 101.27 MB - BytesReceived: 101.46 MB (106392492) - ConvertRowBatchTime: 128.227ms - DeserializeRowBatchTimer: 617.921ms - FirstBatchArrivalWaitTime: 7s044ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740622) - RowsReturnedRate: 329.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 294637ca32dfdd77:639d51f80b2e7096 (host=d2420.halxg.cloudera.com:22000):(Total: 14s225ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 27.23 MB, 164.85 MB, 162.78 MB, 281.84 MB, 270.84 MB, 394.13 MB, 394.17 MB, 522.10 MB, 522.13 MB, 522.08 MB, 522.10 MB, 522.10 MB, 522.10 MB, 554.06 MB, 682.06 MB, 781.98 MB, 777.23 MB, 777.17 MB, 777.17 MB, 777.23 MB, 777.28 MB, 777.19 MB, 777.34 MB, 777.36 MB, 777.36 MB, 777.28 MB, 777.19 MB, 777.19 MB, 777.15 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 784.04 MB (822130648) - PerHostPeakMemUsage: 4.00 GB (4290959584) - PrepareTime: 275.302ms - RowsProduced: 1 (1) - TotalCpuTime: 8s698ms - TotalNetworkReceiveTime: 13s406ms - TotalNetworkSendTime: 251.369us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 112 (112) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 768.00 MB (805306368) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 826.113ms, non-child: 826.113ms, % non-child: 100.00%) - CodegenTime: 1.173ms - CompileTime: 146.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 141 (141) - NumInstructions: 5.07K (5072) - OptimizationTime: 413.606ms - PrepareTime: 265.362ms DataStreamSender (dst_id=6):(Total: 76.802us, non-child: 76.802us, % non-child: 100.00%) - BytesSent: 42.00 B (42) - NetworkThroughput(*): 977.49 KB/sec - OverallThroughput: 534.04 KB/sec - PeakMemoryUsage: 3.20 KB (3272) - RowsReturned: 1 (1) - SerializeBatchTime: 10.661us - TransmitDataRPCTime: 41.960us - UncompressedRowBatchSize: 48.00 B (48) AGGREGATION_NODE (id=3):(Total: 14s223ms, non-child: 950.206ms, % non-child: 6.68%) ExecOption: Codegen Enabled - BuildTime: 660.074ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 124.60 KB (127592) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 13s273ms, non-child: 2s617ms, % non-child: 19.72%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 2s945ms - BuildRows: 10.00M (9999435) - BuildRowsPartitioned: 10.00M (9999435) - BuildTime: 575.495ms - GetNewBlockTime: 2.064ms - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 778.04 MB (815830144) - PinTime: 0.000ns - ProbeRows: 3.74M (3740314) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s163ms - RowsReturned: 3.74M (3740314) - RowsReturnedRate: 281.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.290us EXCHANGE_NODE (id=5):(Total: 3s163ms, non-child: 602.863ms, % non-child: 19.05%) BytesReceived(500.000ms): 10.20 MB, 21.68 MB, 46.44 MB, 79.13 MB, 112.84 MB, 147.36 MB, 181.63 MB, 209.64 MB, 231.83 MB, 242.75 MB, 248.57 MB, 252.39 MB, 255.96 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB, 257.47 MB - BytesReceived: 257.47 MB (269979242) - ConvertRowBatchTime: 236.983ms - DeserializeRowBatchTimer: 1s145ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 10.00M (9999435) - RowsReturnedRate: 3.16 M/sec - SendersBlockedTimer: 1s231ms - SendersBlockedTotalTimer(*): 21s058ms EXCHANGE_NODE (id=4):(Total: 10s669ms, non-child: 400.133ms, % non-child: 3.75%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.69 MB, 11.36 MB, 22.02 MB, 31.22 MB, 39.86 MB, 47.68 MB, 56.05 MB, 65.12 MB, 73.91 MB, 82.54 MB, 90.65 MB, 98.87 MB, 100.98 MB, 101.35 MB - BytesReceived: 101.46 MB (106389447) - ConvertRowBatchTime: 144.938ms - DeserializeRowBatchTimer: 736.505ms - FirstBatchArrivalWaitTime: 6s936ms - PeakMemoryUsage: 0 - RowsReturned: 3.74M (3740314) - RowsReturnedRate: 350.55 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F01: Instance 294637ca32dfdd77:639d51f80b2e709f (host=d2402.halxg.cloudera.com:22000):(Total: 6s943ms, non-child: 2s133ms, % non-child: 30.73%) Hdfs split stats (:<# splits>/): 9:1/253.68 MB 1:1/53.15 MB 0:1/253.60 MB MemoryUsage(500.000ms): 113.14 MB, 113.60 MB, 113.52 MB, 113.50 MB, 113.63 MB, 103.42 MB, 87.12 MB, 87.12 MB, 87.20 MB, 71.12 MB, 71.14 MB, 71.07 MB, 55.09 MB, 55.05 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 113.76 MB (119283256) - PerHostPeakMemUsage: 625.63 MB (656020072) - PrepareTime: 137.247us - RowsProduced: 17.17M (17165575) - TotalCpuTime: 22s275ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 861.110ms - TotalStorageWaitTime: 26.830ms DataStreamSender (dst_id=5):(Total: 4s732ms, non-child: 4s732ms, % non-child: 100.00%) - BytesSent: 462.32 MB (484779384) - NetworkThroughput(*): 506.32 MB/sec - OverallThroughput: 97.69 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 17.17M (17165575) - SerializeBatchTime: 3s814ms - TransmitDataRPCTime: 913.106ms - UncompressedRowBatchSize: 926.68 MB (971692468) HDFS_SCAN_NODE (id=1):(Total: 77.055ms, non-child: 77.055ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 9:1/253.68 MB 1:1/53.15 MB 0:1/253.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB, 82.64 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.36 - BytesRead: 82.64 MB (86658413) - BytesReadDataNodeCache: 0 - BytesReadLocal: 82.64 MB (86658413) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 82.64 MB (86658413) - DecompressionTime: 277.508ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 113.09 MB (118586936) - PerReadThreadRawHdfsThroughput: 2.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 17.17M (17165575) - RowsReturned: 17.17M (17165575) - RowsReturnedRate: 222.77 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 591 (591) - ScannerThreadsTotalWallClockTime: 16s174ms - MaterializeTupleTime(*): 15s844ms - ScannerThreadsSysTime: 70.988ms - ScannerThreadsUserTime: 1s024ms - ScannerThreadsVoluntaryContextSwitches: 16.53K (16526) - TotalRawHdfsReadTime(*): 38.789ms - TotalReadThroughput: 11.81 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a1 (host=d2404.halxg.cloudera.com:22000):(Total: 6s474ms, non-child: 2s079ms, % non-child: 32.11%) Hdfs split stats (:<# splits>/): 5:1/253.67 MB 6:1/253.58 MB MemoryUsage(500.000ms): 102.50 MB, 102.93 MB, 102.97 MB, 103.03 MB, 87.12 MB, 87.01 MB, 87.09 MB, 71.20 MB, 71.08 MB, 71.07 MB, 71.08 MB, 55.20 MB, 55.19 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.26 MB (108272680) - PerHostPeakMemUsage: 609.68 MB (639293760) - PrepareTime: 88.162us - RowsProduced: 15.54M (15535001) - TotalCpuTime: 18s412ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 868.383ms - TotalStorageWaitTime: 21.809ms DataStreamSender (dst_id=5):(Total: 4s314ms, non-child: 4s314ms, % non-child: 100.00%) - BytesSent: 414.95 MB (435105825) - NetworkThroughput(*): 503.50 MB/sec - OverallThroughput: 96.17 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 15.54M (15535001) - SerializeBatchTime: 3s486ms - TransmitDataRPCTime: 824.131ms - UncompressedRowBatchSize: 838.67 MB (879409301) HDFS_SCAN_NODE (id=1):(Total: 80.651ms, non-child: 80.651ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/253.67 MB 6:1/253.58 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB, 74.67 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 74.67 MB (78299561) - BytesReadDataNodeCache: 0 - BytesReadLocal: 74.67 MB (78299561) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74.67 MB (78299561) - DecompressionTime: 278.466ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 102.58 MB (107559976) - PerReadThreadRawHdfsThroughput: 1.91 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 15.54M (15535001) - RowsReturned: 15.54M (15535001) - RowsReturnedRate: 192.62 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 619 (619) - ScannerThreadsTotalWallClockTime: 12s785ms - MaterializeTupleTime(*): 12s463ms - ScannerThreadsSysTime: 60.989ms - ScannerThreadsUserTime: 1s046ms - ScannerThreadsVoluntaryContextSwitches: 14.91K (14912) - TotalRawHdfsReadTime(*): 38.115ms - TotalReadThroughput: 11.49 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a3 (host=d2414.halxg.cloudera.com:22000):(Total: 5s410ms, non-child: 1s784ms, % non-child: 32.99%) Hdfs split stats (:<# splits>/): 3:1/253.71 MB 6:1/104.03 MB 4:1/69.92 MB MemoryUsage(500.000ms): 95.86 MB, 96.03 MB, 96.03 MB, 96.09 MB, 95.86 MB, 95.83 MB, 67.10 MB, 54.46 MB, 46.54 MB, 38.43 MB, 38.58 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 3, 2, 2, 2, 2 - AverageThreadTokens: 3.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 96.26 MB (100933176) - PerHostPeakMemUsage: 592.92 MB (621726440) - PrepareTime: 92.493us - RowsProduced: 13.16M (13160713) - TotalCpuTime: 16s489ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 869.417ms - TotalStorageWaitTime: 29.279ms DataStreamSender (dst_id=5):(Total: 3s570ms, non-child: 3s570ms, % non-child: 100.00%) - BytesSent: 343.38 MB (360055300) - NetworkThroughput(*): 470.17 MB/sec - OverallThroughput: 96.18 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - RowsReturned: 13.16M (13160713) - SerializeBatchTime: 2s836ms - TransmitDataRPCTime: 730.325ms - UncompressedRowBatchSize: 710.49 MB (745004147) HDFS_SCAN_NODE (id=1):(Total: 55.079ms, non-child: 55.079ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 3:1/253.71 MB 6:1/104.03 MB 4:1/69.92 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB, 63.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.18 - BytesRead: 63.48 MB (66568598) - BytesReadDataNodeCache: 0 - BytesReadLocal: 63.48 MB (66568598) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 63.48 MB (66568598) - DecompressionTime: 224.939ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 95.59 MB (100236856) - PerReadThreadRawHdfsThroughput: 2.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 13.16M (13160713) - RowsReturned: 13.16M (13160713) - RowsReturnedRate: 238.94 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 356 (356) - ScannerThreadsTotalWallClockTime: 11s945ms - MaterializeTupleTime(*): 11s669ms - ScannerThreadsSysTime: 54.990ms - ScannerThreadsUserTime: 792.878ms - ScannerThreadsVoluntaryContextSwitches: 12.53K (12525) - TotalRawHdfsReadTime(*): 28.726ms - TotalReadThroughput: 11.54 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70ad (host=d2408.halxg.cloudera.com:22000):(Total: 5s226ms, non-child: 1s878ms, % non-child: 35.94%) Hdfs split stats (:<# splits>/): 7:1/72.33 MB 6:1/54.11 MB 5:1/253.67 MB MemoryUsage(500.000ms): 86.24 MB, 86.63 MB, 86.54 MB, 86.53 MB, 86.41 MB, 76.42 MB, 54.92 MB, 54.60 MB, 46.56 MB, 38.56 MB, 38.57 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 86.76 MB (90971696) - PerHostPeakMemUsage: 584.96 MB (613377720) - PrepareTime: 141.905us - RowsProduced: 11.65M (11650725) - TotalCpuTime: 15s122ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 900.135ms - TotalStorageWaitTime: 24.891ms DataStreamSender (dst_id=5):(Total: 3s277ms, non-child: 3s277ms, % non-child: 100.00%) - BytesSent: 304.55 MB (319344405) - NetworkThroughput(*): 475.63 MB/sec - OverallThroughput: 92.92 MB/sec - PeakMemoryUsage: 712.00 KB (729088) - RowsReturned: 11.65M (11650725) - SerializeBatchTime: 2s633ms - TransmitDataRPCTime: 640.303ms - UncompressedRowBatchSize: 628.97 MB (659519298) HDFS_SCAN_NODE (id=1):(Total: 70.697ms, non-child: 70.697ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 7:1/72.33 MB 6:1/54.11 MB 5:1/253.67 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB, 56.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 56.26 MB (58992540) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.26 MB (58992540) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.26 MB (58992540) - DecompressionTime: 192.696ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 86.09 MB (90275384) - PerReadThreadRawHdfsThroughput: 2.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 11.65M (11650725) - RowsReturned: 11.65M (11650725) - RowsReturnedRate: 164.80 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 407 (407) - ScannerThreadsTotalWallClockTime: 10s781ms - MaterializeTupleTime(*): 10s543ms - ScannerThreadsSysTime: 66.988ms - ScannerThreadsUserTime: 713.890ms - ScannerThreadsVoluntaryContextSwitches: 11.08K (11076) - TotalRawHdfsReadTime(*): 26.199ms - TotalReadThroughput: 10.23 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a0 (host=d2420.halxg.cloudera.com:22000):(Total: 4s949ms, non-child: 1s647ms, % non-child: 33.28%) Hdfs split stats (:<# splits>/): 9:1/67.01 MB 8:1/253.63 MB MemoryUsage(500.000ms): 72.86 MB, 73.13 MB, 73.04 MB, 73.07 MB, 73.01 MB, 54.54 MB, 54.59 MB, 46.46 MB, 46.56 MB, 38.54 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.26 MB (76823880) - PerHostPeakMemUsage: 584.95 MB (613363080) - PrepareTime: 179.056us - RowsProduced: 9.85M (9852971) - TotalCpuTime: 11s408ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 807.892ms - TotalStorageWaitTime: 23.636ms DataStreamSender (dst_id=5):(Total: 3s246ms, non-child: 3s246ms, % non-child: 100.00%) - BytesSent: 261.72 MB (274436475) - NetworkThroughput(*): 393.18 MB/sec - OverallThroughput: 80.62 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 9.85M (9852971) - SerializeBatchTime: 2s577ms - TransmitDataRPCTime: 665.657ms - UncompressedRowBatchSize: 531.91 MB (557749620) HDFS_SCAN_NODE (id=1):(Total: 55.402ms, non-child: 55.402ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 9:1/67.01 MB 8:1/253.63 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.50 - BytesRead: 47.48 MB (49789090) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.48 MB (49789090) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.48 MB (49789090) - DecompressionTime: 229.691ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 72.59 MB (76112576) - PerReadThreadRawHdfsThroughput: 1.73 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.85M (9852971) - RowsReturned: 9.85M (9852971) - RowsReturnedRate: 177.84 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 386 (386) - ScannerThreadsTotalWallClockTime: 7s246ms - MaterializeTupleTime(*): 6s972ms - ScannerThreadsSysTime: 68.989ms - ScannerThreadsUserTime: 813.875ms - ScannerThreadsVoluntaryContextSwitches: 9.22K (9224) - TotalRawHdfsReadTime(*): 26.859ms - TotalReadThroughput: 9.50 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70b0 (host=d2418.halxg.cloudera.com:22000):(Total: 4s761ms, non-child: 1s736ms, % non-child: 36.48%) Hdfs split stats (:<# splits>/): 3:1/253.69 MB 5:1/78.03 MB MemoryUsage(500.000ms): 76.77 MB, 77.03 MB, 77.03 MB, 76.84 MB, 76.97 MB, 54.52 MB, 54.47 MB, 46.44 MB, 38.53 MB, 8.37 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 77.24 MB (80993560) - PerHostPeakMemUsage: 584.94 MB (613353144) - PrepareTime: 93.338us - RowsProduced: 10.15M (10151872) - TotalCpuTime: 11s162ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 856.061ms - TotalStorageWaitTime: 17.660ms DataStreamSender (dst_id=5):(Total: 2s966ms, non-child: 2s966ms, % non-child: 100.00%) - BytesSent: 262.63 MB (275388050) - NetworkThroughput(*): 435.16 MB/sec - OverallThroughput: 88.52 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 10.15M (10151872) - SerializeBatchTime: 2s359ms - TransmitDataRPCTime: 603.526ms - UncompressedRowBatchSize: 548.05 MB (574674090) HDFS_SCAN_NODE (id=1):(Total: 57.348ms, non-child: 57.348ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 3:1/253.69 MB 5:1/78.03 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB, 48.91 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.40 - BytesRead: 48.91 MB (51287113) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.91 MB (51287113) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.91 MB (51287113) - DecompressionTime: 177.444ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 76.59 MB (80305480) - PerReadThreadRawHdfsThroughput: 2.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.15M (10151872) - RowsReturned: 10.15M (10151872) - RowsReturnedRate: 177.02 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 345 (345) - ScannerThreadsTotalWallClockTime: 7s239ms - MaterializeTupleTime(*): 7s028ms - ScannerThreadsSysTime: 52.990ms - ScannerThreadsUserTime: 615.906ms - ScannerThreadsVoluntaryContextSwitches: 9.58K (9576) - TotalRawHdfsReadTime(*): 21.918ms - TotalReadThroughput: 9.78 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70ae (host=d2421.halxg.cloudera.com:22000):(Total: 4s756ms, non-child: 1s734ms, % non-child: 36.47%) Hdfs split stats (:<# splits>/): 6:1/253.55 MB 1:1/104.81 MB MemoryUsage(500.000ms): 83.04 MB, 83.01 MB, 83.00 MB, 82.91 MB, 67.04 MB, 67.14 MB, 54.61 MB, 46.53 MB, 38.55 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 2, 2, 2 - AverageThreadTokens: 2.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 83.23 MB (87276568) - PerHostPeakMemUsage: 584.93 MB (613345752) - PrepareTime: 90.248us - RowsProduced: 10.96M (10964920) - TotalCpuTime: 11s606ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 843.700ms - TotalStorageWaitTime: 18.775ms DataStreamSender (dst_id=5):(Total: 2s960ms, non-child: 2s960ms, % non-child: 100.00%) - BytesSent: 282.45 MB (296168456) - NetworkThroughput(*): 477.00 MB/sec - OverallThroughput: 95.41 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 10.96M (10964920) - SerializeBatchTime: 2s364ms - TransmitDataRPCTime: 592.133ms - UncompressedRowBatchSize: 591.95 MB (620704199) HDFS_SCAN_NODE (id=1):(Total: 61.320ms, non-child: 61.320ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 6:1/253.55 MB 1:1/104.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB, 52.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.67 - BytesRead: 52.81 MB (55370287) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.81 MB (55370287) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.81 MB (55370287) - DecompressionTime: 170.919ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 82.58 MB (86596640) - PerReadThreadRawHdfsThroughput: 2.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.96M (10964920) - RowsReturned: 10.96M (10964920) - RowsReturnedRate: 178.81 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 352 (352) - ScannerThreadsTotalWallClockTime: 7s683ms - MaterializeTupleTime(*): 7s480ms - ScannerThreadsSysTime: 49.992ms - ScannerThreadsUserTime: 667.898ms - ScannerThreadsVoluntaryContextSwitches: 10.37K (10373) - TotalRawHdfsReadTime(*): 24.919ms - TotalReadThroughput: 11.73 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a7 (host=d2413.halxg.cloudera.com:22000):(Total: 4s660ms, non-child: 1s680ms, % non-child: 36.05%) Hdfs split stats (:<# splits>/): 9:1/103.98 MB 7:1/253.72 MB MemoryUsage(500.000ms): 82.80 MB, 83.05 MB, 83.05 MB, 82.95 MB, 67.11 MB, 67.17 MB, 54.42 MB, 46.59 MB, 38.55 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 2, 2, 2 - AverageThreadTokens: 2.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 83.22 MB (87260488) - PerHostPeakMemUsage: 584.90 MB (613315632) - PrepareTime: 82.905us - RowsProduced: 10.91M (10910714) - TotalCpuTime: 11s354ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 857.011ms - TotalStorageWaitTime: 18.159ms DataStreamSender (dst_id=5):(Total: 2s928ms, non-child: 2s928ms, % non-child: 100.00%) - BytesSent: 279.87 MB (293464281) - NetworkThroughput(*): 475.79 MB/sec - OverallThroughput: 95.56 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - RowsReturned: 10.91M (10910714) - SerializeBatchTime: 2s337ms - TransmitDataRPCTime: 588.216ms - UncompressedRowBatchSize: 589.02 MB (617628921) HDFS_SCAN_NODE (id=1):(Total: 51.483ms, non-child: 51.483ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 9:1/103.98 MB 7:1/253.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 52.55 MB, 52.55 MB, 52.55 MB, 52.55 MB, 52.55 MB, 52.55 MB, 52.55 MB, 52.55 MB, 52.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.67 - BytesRead: 52.55 MB (55101627) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.55 MB (55101627) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.55 MB (55101627) - DecompressionTime: 188.852ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 82.51 MB (86523208) - PerReadThreadRawHdfsThroughput: 2.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.91M (10910714) - RowsReturned: 10.91M (10910714) - RowsReturnedRate: 211.93 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 304 (304) - ScannerThreadsTotalWallClockTime: 7s538ms - MaterializeTupleTime(*): 7s316ms - ScannerThreadsSysTime: 51.991ms - ScannerThreadsUserTime: 685.894ms - ScannerThreadsVoluntaryContextSwitches: 10.30K (10302) - TotalRawHdfsReadTime(*): 22.914ms - TotalReadThroughput: 11.68 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70aa (host=d2409.halxg.cloudera.com:22000):(Total: 4s605ms, non-child: 1s705ms, % non-child: 37.04%) Hdfs split stats (:<# splits>/): 4:1/67.68 MB 1:1/253.73 MB MemoryUsage(500.000ms): 74.70 MB, 75.25 MB, 75.22 MB, 75.31 MB, 75.15 MB, 54.56 MB, 46.62 MB, 46.56 MB, 38.58 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 2, 2, 2, 2 - AverageThreadTokens: 2.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 75.48 MB (79142216) - PerHostPeakMemUsage: 584.93 MB (613344832) - PrepareTime: 83.221us - RowsProduced: 9.85M (9848453) - TotalCpuTime: 10s674ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 796.543ms - TotalStorageWaitTime: 18.169ms DataStreamSender (dst_id=5):(Total: 2s833ms, non-child: 2s833ms, % non-child: 100.00%) - BytesSent: 253.39 MB (265700519) - NetworkThroughput(*): 442.79 MB/sec - OverallThroughput: 89.44 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 9.85M (9848453) - SerializeBatchTime: 2s256ms - TransmitDataRPCTime: 572.265ms - UncompressedRowBatchSize: 531.68 MB (557508433) HDFS_SCAN_NODE (id=1):(Total: 66.481ms, non-child: 66.481ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 4:1/67.68 MB 1:1/253.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 47.47 MB, 47.47 MB, 47.47 MB, 47.47 MB, 47.47 MB, 47.47 MB, 47.47 MB, 47.47 MB, 47.47 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.56 - BytesRead: 47.47 MB (49771657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.47 MB (49771657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.47 MB (49771657) - DecompressionTime: 157.493ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 74.78 MB (78412304) - PerReadThreadRawHdfsThroughput: 2.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.85M (9848453) - RowsReturned: 9.85M (9848453) - RowsReturnedRate: 148.14 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 343 (343) - ScannerThreadsTotalWallClockTime: 6s848ms - MaterializeTupleTime(*): 6s659ms - ScannerThreadsSysTime: 44.993ms - ScannerThreadsUserTime: 613.906ms - ScannerThreadsVoluntaryContextSwitches: 9.29K (9285) - TotalRawHdfsReadTime(*): 21.700ms - TotalReadThroughput: 10.55 MB/sec Instance 294637ca32dfdd77:639d51f80b2e709e (host=d2417.halxg.cloudera.com:22000):(Total: 4s589ms, non-child: 1s599ms, % non-child: 34.86%) Hdfs split stats (:<# splits>/): 5:1/253.71 MB 10:1/96.50 MB MemoryUsage(500.000ms): 78.77 MB, 78.92 MB, 78.85 MB, 78.93 MB, 78.87 MB, 63.13 MB, 54.54 MB, 46.45 MB, 38.38 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 2, 2, 2 - AverageThreadTokens: 2.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 79.24 MB (83090760) - PerHostPeakMemUsage: 584.92 MB (613330320) - PrepareTime: 82.746us - RowsProduced: 10.71M (10708065) - TotalCpuTime: 11s076ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 834.398ms - TotalStorageWaitTime: 19.595ms DataStreamSender (dst_id=5):(Total: 2s933ms, non-child: 2s933ms, % non-child: 100.00%) - BytesSent: 277.58 MB (291062143) - NetworkThroughput(*): 459.64 MB/sec - OverallThroughput: 94.61 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 10.71M (10708065) - SerializeBatchTime: 2s326ms - TransmitDataRPCTime: 603.898ms - UncompressedRowBatchSize: 578.07 MB (606151401) HDFS_SCAN_NODE (id=1):(Total: 55.334ms, non-child: 55.334ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/253.71 MB 10:1/96.50 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 51.57 MB, 51.57 MB, 51.57 MB, 51.57 MB, 51.57 MB, 51.57 MB, 51.57 MB, 51.57 MB, 51.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.67 - BytesRead: 51.57 MB (54078712) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.57 MB (54078712) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.57 MB (54078712) - DecompressionTime: 184.361ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 78.53 MB (82342664) - PerReadThreadRawHdfsThroughput: 2.01 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.71M (10708065) - RowsReturned: 10.71M (10708065) - RowsReturnedRate: 193.52 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 319 (319) - ScannerThreadsTotalWallClockTime: 7s309ms - MaterializeTupleTime(*): 7s088ms - ScannerThreadsSysTime: 62.990ms - ScannerThreadsUserTime: 670.897ms - ScannerThreadsVoluntaryContextSwitches: 10.12K (10119) - TotalRawHdfsReadTime(*): 25.016ms - TotalReadThroughput: 11.46 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70ab (host=d2419.halxg.cloudera.com:22000):(Total: 4s452ms, non-child: 1s675ms, % non-child: 37.64%) Hdfs split stats (:<# splits>/): 9:1/57.03 MB 5:1/253.73 MB MemoryUsage(500.000ms): 72.80 MB, 73.01 MB, 72.89 MB, 72.91 MB, 54.47 MB, 54.50 MB, 46.44 MB, 46.55 MB, 38.53 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.23 MB (76782632) - PerHostPeakMemUsage: 576.94 MB (604968048) - PrepareTime: 128.570us - RowsProduced: 9.51M (9509045) - TotalCpuTime: 10s020ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 854.421ms - TotalStorageWaitTime: 17.516ms DataStreamSender (dst_id=5):(Total: 2s716ms, non-child: 2s716ms, % non-child: 100.00%) - BytesSent: 241.04 MB (252748893) - NetworkThroughput(*): 446.39 MB/sec - OverallThroughput: 88.75 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 9.51M (9509045) - SerializeBatchTime: 2s172ms - TransmitDataRPCTime: 539.979ms - UncompressedRowBatchSize: 513.35 MB (538289000) HDFS_SCAN_NODE (id=1):(Total: 60.263ms, non-child: 60.263ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 9:1/57.03 MB 5:1/253.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 45.84 MB, 45.84 MB, 45.84 MB, 45.84 MB, 45.84 MB, 45.84 MB, 45.84 MB, 45.84 MB, 45.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.44 - BytesRead: 45.84 MB (48067884) - BytesReadDataNodeCache: 0 - BytesReadLocal: 45.84 MB (48067884) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 45.84 MB (48067884) - DecompressionTime: 165.875ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 72.58 MB (76102696) - PerReadThreadRawHdfsThroughput: 2.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.51M (9509045) - RowsReturned: 9.51M (9509045) - RowsReturnedRate: 157.79 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 395 (395) - ScannerThreadsTotalWallClockTime: 6s406ms - MaterializeTupleTime(*): 6s208ms - ScannerThreadsSysTime: 36.994ms - ScannerThreadsUserTime: 620.905ms - ScannerThreadsVoluntaryContextSwitches: 8.95K (8953) - TotalRawHdfsReadTime(*): 21.619ms - TotalReadThroughput: 10.19 MB/sec Instance 294637ca32dfdd77:639d51f80b2e709d (host=d2407.halxg.cloudera.com:22000):(Total: 4s341ms, non-child: 1s683ms, % non-child: 38.77%) Hdfs split stats (:<# splits>/): 8:1/253.75 MB 10:1/38.92 MB MemoryUsage(500.000ms): 72.95 MB, 73.02 MB, 73.09 MB, 62.36 MB, 54.51 MB, 46.53 MB, 46.44 MB, 38.52 MB ThreadUsage(500.000ms): 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.25 MB (76807208) - PerHostPeakMemUsage: 576.90 MB (604927040) - PrepareTime: 82.936us - RowsProduced: 8.95M (8947011) - TotalCpuTime: 9s362ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 852.271ms - TotalStorageWaitTime: 18.045ms DataStreamSender (dst_id=5):(Total: 2s596ms, non-child: 2s596ms, % non-child: 100.00%) - BytesSent: 227.47 MB (238516944) - NetworkThroughput(*): 437.02 MB/sec - OverallThroughput: 87.61 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 8.95M (8947011) - SerializeBatchTime: 2s072ms - TransmitDataRPCTime: 520.496ms - UncompressedRowBatchSize: 483.00 MB (506463662) HDFS_SCAN_NODE (id=1):(Total: 62.001ms, non-child: 62.001ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 8:1/253.75 MB 10:1/38.92 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 43.15 MB, 43.15 MB, 43.15 MB, 43.15 MB, 43.15 MB, 43.15 MB, 43.15 MB, 43.15 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.38 - BytesRead: 43.15 MB (45249246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 43.15 MB (45249246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 43.15 MB (45249246) - DecompressionTime: 137.247ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 72.58 MB (76102696) - PerReadThreadRawHdfsThroughput: 1.91 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 8.95M (8947011) - RowsReturned: 8.95M (8947011) - RowsReturnedRate: 144.30 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 314 (314) - ScannerThreadsTotalWallClockTime: 5s858ms - MaterializeTupleTime(*): 5s691ms - ScannerThreadsSysTime: 45.992ms - ScannerThreadsUserTime: 515.919ms - ScannerThreadsVoluntaryContextSwitches: 8.40K (8397) - TotalRawHdfsReadTime(*): 22.009ms - TotalReadThroughput: 10.79 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a5 (host=d2416.halxg.cloudera.com:22000):(Total: 4s241ms, non-child: 1s659ms, % non-child: 39.13%) Hdfs split stats (:<# splits>/): 8:1/253.73 MB 10:1/53.57 MB MemoryUsage(500.000ms): 52.00 MB, 72.99 MB, 72.79 MB, 73.00 MB, 62.80 MB, 54.46 MB, 46.51 MB, 46.51 MB, 38.51 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.18 MB (76733768) - PerHostPeakMemUsage: 576.93 MB (604952448) - PrepareTime: 85.954us - RowsProduced: 9.41M (9407563) - TotalCpuTime: 9s468ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 883.215ms - TotalStorageWaitTime: 16.065ms DataStreamSender (dst_id=5):(Total: 2s536ms, non-child: 2s536ms, % non-child: 100.00%) - BytesSent: 236.57 MB (248061902) - NetworkThroughput(*): 463.14 MB/sec - OverallThroughput: 93.26 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - RowsReturned: 9.41M (9407563) - SerializeBatchTime: 2s022ms - TransmitDataRPCTime: 510.796ms - UncompressedRowBatchSize: 507.87 MB (532543818) HDFS_SCAN_NODE (id=1):(Total: 45.268ms, non-child: 45.268ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 8:1/253.73 MB 10:1/53.57 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 31.63 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB, 45.36 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 1.44 - BytesRead: 45.36 MB (47560208) - BytesReadDataNodeCache: 0 - BytesReadLocal: 45.36 MB (47560208) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 45.36 MB (47560208) - DecompressionTime: 156.022ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 72.51 MB (76037448) - PerReadThreadRawHdfsThroughput: 2.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.41M (9407563) - RowsReturned: 9.41M (9407563) - RowsReturnedRate: 207.82 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 32 (32) - ScannerThreadsTotalWallClockTime: 6s098ms - MaterializeTupleTime(*): 5s912ms - ScannerThreadsSysTime: 33.994ms - ScannerThreadsUserTime: 570.912ms - ScannerThreadsVoluntaryContextSwitches: 8.83K (8832) - TotalRawHdfsReadTime(*): 19.426ms - TotalReadThroughput: 10.08 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a2 (host=d2410.halxg.cloudera.com:22000):(Total: 4s239ms, non-child: 1s576ms, % non-child: 37.20%) Hdfs split stats (:<# splits>/): 5:1/66.53 MB 2:1/253.72 MB MemoryUsage(500.000ms): 73.04 MB, 73.04 MB, 73.00 MB, 72.95 MB, 54.60 MB, 54.49 MB, 46.56 MB, 38.57 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 2, 2, 2, 2 - AverageThreadTokens: 2.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.24 MB (76799304) - PerHostPeakMemUsage: 576.93 MB (604950512) - PrepareTime: 91.079us - RowsProduced: 9.81M (9809931) - TotalCpuTime: 9s715ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 855.455ms - TotalStorageWaitTime: 17.181ms DataStreamSender (dst_id=5):(Total: 2s615ms, non-child: 2s615ms, % non-child: 100.00%) - BytesSent: 247.84 MB (259877094) - NetworkThroughput(*): 460.92 MB/sec - OverallThroughput: 94.74 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 9.81M (9809931) - SerializeBatchTime: 2s075ms - TransmitDataRPCTime: 537.700ms - UncompressedRowBatchSize: 529.60 MB (555322385) HDFS_SCAN_NODE (id=1):(Total: 46.284ms, non-child: 46.284ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 5:1/66.53 MB 2:1/253.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 47.28 MB, 47.28 MB, 47.28 MB, 47.28 MB, 47.28 MB, 47.28 MB, 47.28 MB, 47.28 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.50 - BytesRead: 47.28 MB (49575867) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.28 MB (49575867) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.28 MB (49575867) - DecompressionTime: 179.286ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 72.51 MB (76037448) - PerReadThreadRawHdfsThroughput: 2.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.81M (9809931) - RowsReturned: 9.81M (9809931) - RowsReturnedRate: 211.95 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 292 (292) - ScannerThreadsTotalWallClockTime: 6s319ms - MaterializeTupleTime(*): 6s107ms - ScannerThreadsSysTime: 46.991ms - ScannerThreadsUserTime: 626.903ms - ScannerThreadsVoluntaryContextSwitches: 9.22K (9217) - TotalRawHdfsReadTime(*): 19.954ms - TotalReadThroughput: 11.82 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a6 (host=d2406.halxg.cloudera.com:22000):(Total: 3s916ms, non-child: 1s485ms, % non-child: 37.94%) Hdfs split stats (:<# splits>/): 2:1/48.89 MB 9:1/253.68 MB MemoryUsage(500.000ms): 72.65 MB, 72.89 MB, 73.08 MB, 62.90 MB, 54.47 MB, 46.44 MB, 46.54 MB, 38.55 MB ThreadUsage(500.000ms): 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.24 MB (76799016) - PerHostPeakMemUsage: 553.39 MB (580271160) - PrepareTime: 88.886us - RowsProduced: 9.26M (9256253) - TotalCpuTime: 8s619ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 876.515ms - TotalStorageWaitTime: 16.392ms DataStreamSender (dst_id=5):(Total: 2s388ms, non-child: 2s388ms, % non-child: 100.00%) - BytesSent: 231.28 MB (242514867) - NetworkThroughput(*): 443.51 MB/sec - OverallThroughput: 96.85 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 9.26M (9256253) - SerializeBatchTime: 1s864ms - TransmitDataRPCTime: 521.471ms - UncompressedRowBatchSize: 499.70 MB (523976325) HDFS_SCAN_NODE (id=1):(Total: 42.438ms, non-child: 42.438ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 2:1/48.89 MB 9:1/253.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB, 44.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.38 - BytesRead: 44.63 MB (46800551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 44.63 MB (46800551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 44.63 MB (46800551) - DecompressionTime: 145.455ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 72.58 MB (76102696) - PerReadThreadRawHdfsThroughput: 2.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 9.26M (9256253) - RowsReturned: 9.26M (9256253) - RowsReturnedRate: 218.11 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 301 (301) - ScannerThreadsTotalWallClockTime: 5s570ms - MaterializeTupleTime(*): 5s396ms - ScannerThreadsSysTime: 42.993ms - ScannerThreadsUserTime: 521.919ms - ScannerThreadsVoluntaryContextSwitches: 8.70K (8695) - TotalRawHdfsReadTime(*): 19.070ms - TotalReadThroughput: 11.16 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a4 (host=d2405.halxg.cloudera.com:22000):(Total: 3s806ms, non-child: 1s490ms, % non-child: 39.16%) Hdfs split stats (:<# splits>/): 3:1/253.70 MB MemoryUsage(500.000ms): 62.46 MB, 62.48 MB, 62.47 MB, 54.53 MB, 54.60 MB, 46.53 MB, 38.59 MB, 38.52 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 62.65 MB (65690712) - PerHostPeakMemUsage: 457.02 MB (479225376) - PrepareTime: 91.034us - RowsProduced: 7.75M (7748673) - TotalCpuTime: 6s724ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 808.444ms - TotalStorageWaitTime: 10.025ms DataStreamSender (dst_id=5):(Total: 2s265ms, non-child: 2s265ms, % non-child: 100.00%) - BytesSent: 197.21 MB (206793732) - NetworkThroughput(*): 432.37 MB/sec - OverallThroughput: 87.07 MB/sec - PeakMemoryUsage: 688.00 KB (704512) - RowsReturned: 7.75M (7748673) - SerializeBatchTime: 1s806ms - TransmitDataRPCTime: 456.118ms - UncompressedRowBatchSize: 418.32 MB (438636206) HDFS_SCAN_NODE (id=1):(Total: 50.868ms, non-child: 50.868ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 3:1/253.70 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 37.24 MB, 37.24 MB, 37.24 MB, 37.24 MB, 37.24 MB, 37.24 MB, 37.24 MB, 37.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 37.24 MB (39050963) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.24 MB (39050963) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.24 MB (39050963) - DecompressionTime: 131.872ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 61.95 MB (64962840) - PerReadThreadRawHdfsThroughput: 2.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.75M (7748673) - RowsReturned: 7.75M (7748673) - RowsReturnedRate: 152.33 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 234 (234) - ScannerThreadsTotalWallClockTime: 3s707ms - MaterializeTupleTime(*): 3s556ms - ScannerThreadsSysTime: 35.994ms - ScannerThreadsUserTime: 492.925ms - ScannerThreadsVoluntaryContextSwitches: 7.17K (7166) - TotalRawHdfsReadTime(*): 17.851ms - TotalReadThroughput: 9.31 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a9 (host=d2411.halxg.cloudera.com:22000):(Total: 3s575ms, non-child: 1s483ms, % non-child: 41.48%) Hdfs split stats (:<# splits>/): 1:1/74.41 MB 2:1/97.12 MB 0:1/78.55 MB MemoryUsage(500.000ms): 66.35 MB, 66.48 MB, 66.55 MB, 66.40 MB, 66.24 MB, 66.55 MB, 30.87 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 3.71 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.85 MB (70098200) - PerHostPeakMemUsage: 477.08 MB (500253912) - PrepareTime: 88.846us - RowsProduced: 7.71M (7708318) - TotalCpuTime: 12s579ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 883.405ms - TotalStorageWaitTime: 27.221ms DataStreamSender (dst_id=5):(Total: 2s046ms, non-child: 2s046ms, % non-child: 100.00%) - BytesSent: 192.79 MB (202153634) - NetworkThroughput(*): 466.44 MB/sec - OverallThroughput: 94.21 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - RowsReturned: 7.71M (7708318) - SerializeBatchTime: 1s630ms - TransmitDataRPCTime: 413.323ms - UncompressedRowBatchSize: 416.13 MB (436346288) HDFS_SCAN_NODE (id=1):(Total: 46.078ms, non-child: 46.078ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 3 Hdfs split stats (:<# splits>/): 1:1/74.41 MB 2:1/97.12 MB 0:1/78.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB, 37.40 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.71 - BytesRead: 37.40 MB (39218687) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.40 MB (39218687) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.40 MB (39218687) - DecompressionTime: 140.940ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 66.16 MB (69369112) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.71M (7708318) - RowsReturned: 7.71M (7708318) - RowsReturnedRate: 167.29 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 368 (368) - ScannerThreadsTotalWallClockTime: 9s890ms - MaterializeTupleTime(*): 9s704ms - ScannerThreadsSysTime: 60.990ms - ScannerThreadsUserTime: 531.918ms - ScannerThreadsVoluntaryContextSwitches: 7.27K (7266) - TotalRawHdfsReadTime(*): 19.430ms - TotalReadThroughput: 10.69 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70a8 (host=d2412.halxg.cloudera.com:22000):(Total: 3s529ms, non-child: 1s457ms, % non-child: 41.30%) Hdfs split stats (:<# splits>/): 2:1/253.71 MB MemoryUsage(500.000ms): 62.48 MB, 62.40 MB, 54.58 MB, 54.44 MB, 46.54 MB, 38.49 MB, 12.80 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 62.66 MB (65707096) - PerHostPeakMemUsage: 456.95 MB (479149392) - PrepareTime: 394.066us - RowsProduced: 7.72M (7722333) - TotalCpuTime: 6s089ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 888.777ms - TotalStorageWaitTime: 10.073ms DataStreamSender (dst_id=5):(Total: 2s032ms, non-child: 2s032ms, % non-child: 100.00%) - BytesSent: 193.32 MB (202714265) - NetworkThroughput(*): 465.60 MB/sec - OverallThroughput: 95.13 MB/sec - PeakMemoryUsage: 672.00 KB (688128) - RowsReturned: 7.72M (7722333) - SerializeBatchTime: 1s614ms - TransmitDataRPCTime: 415.212ms - UncompressedRowBatchSize: 416.89 MB (437138221) HDFS_SCAN_NODE (id=1):(Total: 39.652ms, non-child: 39.652ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/253.71 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 37.12 MB, 37.12 MB, 37.12 MB, 37.12 MB, 37.12 MB, 37.12 MB, 37.12 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.86 - BytesRead: 37.12 MB (38921898) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.12 MB (38921898) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.12 MB (38921898) - DecompressionTime: 134.747ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 61.95 MB (64962048) - PerReadThreadRawHdfsThroughput: 2.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.72M (7722333) - RowsReturned: 7.72M (7722333) - RowsReturnedRate: 194.75 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 208 (208) - ScannerThreadsTotalWallClockTime: 3s437ms - MaterializeTupleTime(*): 3s283ms - ScannerThreadsSysTime: 38.994ms - ScannerThreadsUserTime: 455.930ms - ScannerThreadsVoluntaryContextSwitches: 7.10K (7101) - TotalRawHdfsReadTime(*): 16.777ms - TotalReadThroughput: 10.61 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70af (host=d2403.halxg.cloudera.com:22000):(Total: 3s492ms, non-child: 1s432ms, % non-child: 41.02%) Hdfs split stats (:<# splits>/): 10:1/253.68 MB MemoryUsage(500.000ms): 62.46 MB, 62.55 MB, 62.37 MB, 54.46 MB, 46.50 MB, 46.46 MB, 38.59 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 62.66 MB (65707096) - PerHostPeakMemUsage: 457.01 MB (479208776) - PrepareTime: 86.622us - RowsProduced: 7.73M (7733001) - TotalCpuTime: 6s041ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 869.506ms - TotalStorageWaitTime: 10.077ms DataStreamSender (dst_id=5):(Total: 2s015ms, non-child: 2s015ms, % non-child: 100.00%) - BytesSent: 189.73 MB (198942379) - NetworkThroughput(*): 456.98 MB/sec - OverallThroughput: 94.12 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - RowsReturned: 7.73M (7733001) - SerializeBatchTime: 1s598ms - TransmitDataRPCTime: 415.177ms - UncompressedRowBatchSize: 417.47 MB (437748595) HDFS_SCAN_NODE (id=1):(Total: 44.155ms, non-child: 44.155ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 10:1/253.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 37.17 MB, 37.17 MB, 37.17 MB, 37.17 MB, 37.17 MB, 37.17 MB, 37.17 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 37.17 MB (38974709) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.17 MB (38974709) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.17 MB (38974709) - DecompressionTime: 129.755ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 62.01 MB (65018968) - PerReadThreadRawHdfsThroughput: 2.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.73M (7733001) - RowsReturned: 7.73M (7733001) - RowsReturnedRate: 175.13 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 203 (203) - ScannerThreadsTotalWallClockTime: 3s404ms - MaterializeTupleTime(*): 3s256ms - ScannerThreadsSysTime: 40.993ms - ScannerThreadsUserTime: 436.933ms - ScannerThreadsVoluntaryContextSwitches: 7.11K (7107) - TotalRawHdfsReadTime(*): 16.912ms - TotalReadThroughput: 10.62 MB/sec Instance 294637ca32dfdd77:639d51f80b2e70ac (host=d2415.halxg.cloudera.com:22000):(Total: 1s617ms, non-child: 1s046ms, % non-child: 64.72%) Hdfs split stats (:<# splits>/): 4:1/71.21 MB MemoryUsage(500.000ms): 35.44 MB, 35.42 MB, 35.58 MB ThreadUsage(500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 35.66 MB (37395544) - PerHostPeakMemUsage: 206.95 MB (217004416) - PrepareTime: 73.848us - RowsProduced: 2.21M (2208863) - TotalCpuTime: 2s234ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 846.080ms - TotalStorageWaitTime: 8.459ms DataStreamSender (dst_id=5):(Total: 548.816ms, non-child: 548.816ms, % non-child: 100.00%) - BytesSent: 49.26 MB (51657192) - NetworkThroughput(*): 414.37 MB/sec - OverallThroughput: 89.76 MB/sec - PeakMemoryUsage: 680.00 KB (696320) - RowsReturned: 2.21M (2208863) - SerializeBatchTime: 429.184ms - TransmitDataRPCTime: 118.890ms - UncompressedRowBatchSize: 119.24 MB (125035562) HDFS_SCAN_NODE (id=1):(Total: 21.764ms, non-child: 21.764ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/71.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 10.74 MB, 10.74 MB, 10.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 10.74 MB (11261947) - BytesReadDataNodeCache: 0 - BytesReadLocal: 10.74 MB (11261947) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 10.74 MB (11261947) - DecompressionTime: 34.485ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 34.96 MB (36653232) - PerReadThreadRawHdfsThroughput: 1.80 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.21M (2208863) - RowsReturned: 2.21M (2208863) - RowsReturnedRate: 101.49 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 58 (58) - ScannerThreadsTotalWallClockTime: 1s459ms - MaterializeTupleTime(*): 1s412ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 123.981ms - ScannerThreadsVoluntaryContextSwitches: 1.84K (1839) - TotalRawHdfsReadTime(*): 5.824ms - TotalReadThroughput: 7.16 MB/sec Fragment F00: Instance 294637ca32dfdd77:639d51f80b2e70be (host=d2420.halxg.cloudera.com:22000):(Total: 11s659ms, non-child: 1s041ms, % non-child: 8.93%) Hdfs split stats (:<# splits>/): 2:3/759.72 MB 9:3/759.70 MB 4:3/759.69 MB 0:3/759.69 MB 6:3/759.71 MB 10:3/759.63 MB 8:3/759.62 MB 5:5/1.24 GB 1:7/1.73 GB 7:6/1.48 GB 3:5/1.24 GB Filter 0 arrival: 7s858ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.51 GB, 2.48 GB, 2.59 GB, 2.55 GB, 2.28 GB, 1.84 GB, 2.43 GB, 3.07 GB, 2.87 GB, 2.57 GB, 2.39 GB, 2.02 GB, 1.69 GB, 422.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 22, 22, 21, 1 - AverageThreadTokens: 15.07 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.21 GB (3442511864) - PerHostPeakMemUsage: 4.00 GB (4290959584) - PrepareTime: 250.732ms - RowsProduced: 3.76M (3758109) - TotalCpuTime: 3m38s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20.621ms - TotalStorageWaitTime: 3s060ms CodeGen:(Total: 355.175ms, non-child: 355.175ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 93.934ms - PrepareTime: 248.061ms DataStreamSender (dst_id=4):(Total: 2s069ms, non-child: 2s069ms, % non-child: 100.00%) - BytesSent: 101.94 MB (106891722) - NetworkThroughput(*): 187.81 MB/sec - OverallThroughput: 49.25 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.76M (3758109) - SerializeBatchTime: 1s523ms - TransmitDataRPCTime: 542.788ms - UncompressedRowBatchSize: 222.25 MB (233046890) HDFS_SCAN_NODE (id=0):(Total: 8s193ms, non-child: 8s193ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 2:3/759.72 MB 9:3/759.70 MB 4:3/759.69 MB 0:3/759.69 MB 6:3/759.71 MB 10:3/759.63 MB 8:3/759.62 MB 5:5/1.24 GB 1:7/1.73 GB 7:6/1.48 GB 3:5/1.24 GB Runtime filters: All filters arrived. Waited 7s507ms Hdfs Read Thread Concurrency Bucket: 0:93.1% 1:0% 2:0% 3:3.448% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:3.448% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.03 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 14.55 - BytesRead: 3.71 GB (3979953414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3979953414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3979953414) - DecompressionTime: 18s461ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.20 GB (3436906872) - PerReadThreadRawHdfsThroughput: 786.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.39M (301386256) - RowsReturned: 3.76M (3758109) - RowsReturnedRate: 458.68 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 25.26K (25259) - ScannerThreadsTotalWallClockTime: 3m26s - MaterializeTupleTime(*): 1m56s - ScannerThreadsSysTime: 7s903ms - ScannerThreadsUserTime: 1m25s - ScannerThreadsVoluntaryContextSwitches: 23.93K (23930) - TotalRawHdfsReadTime(*): 4s823ms - TotalReadThroughput: 261.76 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70c0 (host=d2413.halxg.cloudera.com:22000):(Total: 11s271ms, non-child: 997.044ms, % non-child: 8.85%) Hdfs split stats (:<# splits>/): 4:3/759.63 MB 2:3/759.65 MB 7:4/1012.86 MB 1:4/1012.85 MB 3:4/1012.84 MB 5:3/759.64 MB 10:6/1.48 GB 0:4/1012.81 MB 9:4/1012.90 MB 8:6/1.47 GB 6:3/759.60 MB Filter 0 arrival: 7s922ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.86 GB, 2.56 GB, 2.66 GB, 2.40 GB, 1.93 GB, 2.41 GB, 3.20 GB, 2.83 GB, 2.54 GB, 2.30 GB, 1.81 GB, 646.67 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 22, 1 - AverageThreadTokens: 15.43 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.24 GB (3474973248) - PerHostPeakMemUsage: 4.03 GB (4323512416) - PrepareTime: 203.107ms - RowsProduced: 3.75M (3751891) - TotalCpuTime: 3m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.472ms - TotalStorageWaitTime: 2s400ms CodeGen:(Total: 293.096ms, non-child: 293.096ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 78.760ms - PrepareTime: 201.633ms DataStreamSender (dst_id=4):(Total: 1s759ms, non-child: 1s759ms, % non-child: 100.00%) - BytesSent: 101.77 MB (106711579) - NetworkThroughput(*): 225.43 MB/sec - OverallThroughput: 57.85 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.75M (3751891) - SerializeBatchTime: 1s304ms - TransmitDataRPCTime: 451.447ms - UncompressedRowBatchSize: 221.88 MB (232661286) HDFS_SCAN_NODE (id=0):(Total: 8s222ms, non-child: 8s222ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 4:3/759.63 MB 2:3/759.65 MB 7:4/1012.86 MB 1:4/1012.85 MB 3:4/1012.84 MB 5:3/759.64 MB 10:6/1.48 GB 0:4/1012.81 MB 9:4/1012.90 MB 8:6/1.47 GB 6:3/759.60 MB Runtime filters: All filters arrived. Waited 7s644ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:0% 2:0% 3:0% 4:0% 5:3.704% 6:0% 7:0% 8:3.704% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.49 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.79 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 14.96 - BytesRead: 3.70 GB (3974133787) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.70 GB (3974133787) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.70 GB (3974133787) - DecompressionTime: 15s987ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.23 GB (3469438168) - PerReadThreadRawHdfsThroughput: 857.52 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.95M (300947124) - RowsReturned: 3.75M (3751891) - RowsReturnedRate: 456.28 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 25.12K (25117) - ScannerThreadsTotalWallClockTime: 3m16s - MaterializeTupleTime(*): 1m41s - ScannerThreadsSysTime: 6s774ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 19.34K (19335) - TotalRawHdfsReadTime(*): 4s419ms - TotalReadThroughput: 280.72 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70ba (host=d2421.halxg.cloudera.com:22000):(Total: 11s187ms, non-child: 1s010ms, % non-child: 9.03%) Hdfs split stats (:<# splits>/): 9:2/506.42 MB 1:3/759.65 MB 6:3/759.68 MB 8:5/1.24 GB 2:5/1.24 GB 3:5/1.24 GB 7:3/759.68 MB 4:5/1.24 GB 5:4/1012.92 MB 0:4/1012.80 MB 10:4/1012.99 MB Filter 0 arrival: 7s824ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.58 GB, 2.69 GB, 2.65 GB, 2.37 GB, 1.90 GB, 2.66 GB, 3.01 GB, 2.77 GB, 2.47 GB, 2.19 GB, 1.73 GB, 370.00 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 21, 21, 21, 21, 21, 1 - AverageThreadTokens: 15.21 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.16 GB (3396095744) - PerHostPeakMemUsage: 3.95 GB (4244592616) - PrepareTime: 208.284ms - RowsProduced: 3.67M (3671187) - TotalCpuTime: 3m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.492ms - TotalStorageWaitTime: 2s520ms CodeGen:(Total: 299.125ms, non-child: 299.125ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 79.241ms - PrepareTime: 206.741ms DataStreamSender (dst_id=4):(Total: 1s772ms, non-child: 1s772ms, % non-child: 100.00%) - BytesSent: 99.58 MB (104415747) - NetworkThroughput(*): 224.33 MB/sec - OverallThroughput: 56.19 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.67M (3671187) - SerializeBatchTime: 1s324ms - TransmitDataRPCTime: 443.894ms - UncompressedRowBatchSize: 217.11 MB (227656706) HDFS_SCAN_NODE (id=0):(Total: 8s105ms, non-child: 8s105ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 43 Hdfs split stats (:<# splits>/): 9:2/506.42 MB 1:3/759.65 MB 6:3/759.68 MB 8:5/1.24 GB 2:5/1.24 GB 3:5/1.24 GB 7:3/759.68 MB 4:5/1.24 GB 5:4/1012.92 MB 0:4/1012.80 MB 10:4/1012.99 MB Runtime filters: All filters arrived. Waited 7s525ms Hdfs Read Thread Concurrency Bucket: 0:96.3% 1:0% 2:3.704% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:172 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.18 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 14.74 - BytesRead: 3.62 GB (3889469029) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.62 GB (3889469029) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.62 GB (3889469029) - DecompressionTime: 16s402ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 43 (43) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.16 GB (3390298744) - PerReadThreadRawHdfsThroughput: 817.51 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 294.54M (294536462) - RowsReturned: 3.67M (3671187) - RowsReturnedRate: 452.90 K/sec - ScanRangesComplete: 43 (43) - ScannerThreadsInvoluntaryContextSwitches: 22.80K (22795) - ScannerThreadsTotalWallClockTime: 3m11s - MaterializeTupleTime(*): 1m41s - ScannerThreadsSysTime: 6s922ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 21.23K (21230) - TotalRawHdfsReadTime(*): 4s537ms - TotalReadThroughput: 264.95 MB/sec Filter 0 (16.00 MB): - Rows processed: 704.47K (704469) - Rows rejected: 0 (0) - Rows total: 704.51K (704512) Instance 294637ca32dfdd77:639d51f80b2e70bd (host=d2410.halxg.cloudera.com:22000):(Total: 11s168ms, non-child: 917.565ms, % non-child: 8.22%) Hdfs split stats (:<# splits>/): 2:1/253.22 MB 9:7/1.73 GB 10:2/506.39 MB 4:4/1012.89 MB 7:5/1.24 GB 5:5/1.24 GB 3:3/759.71 MB 6:4/950.23 MB 8:8/1.98 GB 0:6/1.48 GB Filter 0 arrival: 7s890ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.38 GB, 2.59 GB, 2.53 GB, 2.26 GB, 1.84 GB, 3.09 GB, 2.96 GB, 2.74 GB, 2.51 GB, 2.09 GB, 1.60 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 23, 23, 22, 17 - AverageThreadTokens: 16.70 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.29 GB (3528907848) - PerHostPeakMemUsage: 4.08 GB (4377449744) - PrepareTime: 205.760ms - RowsProduced: 3.82M (3821356) - TotalCpuTime: 3m35s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16.573ms - TotalStorageWaitTime: 3s060ms CodeGen:(Total: 296.791ms, non-child: 296.791ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.719ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 79.358ms - PrepareTime: 203.875ms DataStreamSender (dst_id=4):(Total: 1s748ms, non-child: 1s748ms, % non-child: 100.00%) - BytesSent: 103.65 MB (108682467) - NetworkThroughput(*): 239.82 MB/sec - OverallThroughput: 59.28 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.82M (3821356) - SerializeBatchTime: 1s312ms - TransmitDataRPCTime: 432.184ms - UncompressedRowBatchSize: 225.99 MB (236968936) HDFS_SCAN_NODE (id=0):(Total: 8s206ms, non-child: 8s206ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 2:1/253.22 MB 9:7/1.73 GB 10:2/506.39 MB 4:4/1012.89 MB 7:5/1.24 GB 5:5/1.24 GB 3:3/759.71 MB 6:4/950.23 MB 8:8/1.98 GB 0:6/1.48 GB Runtime filters: All filters arrived. Waited 7s603ms Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:0% 2:3.846% 3:3.846% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:180 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.86 GB, 1.92 GB, 1.92 GB, 2.00 GB, 2.00 GB, 3.55 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 16.31 - BytesRead: 3.77 GB (4048113266) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.77 GB (4048113266) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.77 GB (4048113266) - DecompressionTime: 16s018ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.28 GB (3523438536) - PerReadThreadRawHdfsThroughput: 969.61 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 306.54M (306544069) - RowsReturned: 3.82M (3821356) - RowsReturnedRate: 465.67 K/sec - ScanRangesComplete: 45 (45) - ScannerThreadsInvoluntaryContextSwitches: 22.18K (22176) - ScannerThreadsTotalWallClockTime: 3m25s - MaterializeTupleTime(*): 1m40s - ScannerThreadsSysTime: 6s683ms - ScannerThreadsUserTime: 1m12s - ScannerThreadsVoluntaryContextSwitches: 21.82K (21824) - TotalRawHdfsReadTime(*): 3s981ms - TotalReadThroughput: 285.97 MB/sec Filter 0 (16.00 MB): - Rows processed: 737.24K (737235) - Rows rejected: 0 (0) - Rows total: 737.28K (737280) Instance 294637ca32dfdd77:639d51f80b2e70c1 (host=d2406.halxg.cloudera.com:22000):(Total: 11s167ms, non-child: 881.665ms, % non-child: 7.89%) Hdfs split stats (:<# splits>/): 3:3/759.59 MB 9:4/1012.86 MB 5:4/1012.81 MB 0:5/1.24 GB 7:4/1012.81 MB 8:3/759.63 MB 2:4/1012.89 MB 1:3/759.60 MB 10:3/759.64 MB 6:6/1.48 GB 4:5/1.24 GB Filter 0 arrival: 7s939ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.18 GB, 2.55 GB, 2.68 GB, 2.34 GB, 1.86 GB, 2.76 GB, 3.01 GB, 2.81 GB, 2.53 GB, 2.23 GB, 1.71 GB, 23.50 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 22, 21, 1 - AverageThreadTokens: 16.14 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.25 GB (3484437400) - PerHostPeakMemUsage: 4.04 GB (4332919304) - PrepareTime: 207.235ms - RowsProduced: 3.76M (3760519) - TotalCpuTime: 3m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.255ms - TotalStorageWaitTime: 2s698ms CodeGen:(Total: 300.760ms, non-child: 300.760ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 82.024ms - PrepareTime: 205.755ms DataStreamSender (dst_id=4):(Total: 1s744ms, non-child: 1s744ms, % non-child: 100.00%) - BytesSent: 102.00 MB (106955338) - NetworkThroughput(*): 228.84 MB/sec - OverallThroughput: 58.46 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.76M (3760519) - SerializeBatchTime: 1s296ms - TransmitDataRPCTime: 445.734ms - UncompressedRowBatchSize: 222.39 MB (233196326) HDFS_SCAN_NODE (id=0):(Total: 8s240ms, non-child: 8s240ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 3:3/759.59 MB 9:4/1012.86 MB 5:4/1012.81 MB 0:5/1.24 GB 7:4/1012.81 MB 8:3/759.63 MB 2:4/1012.89 MB 1:3/759.60 MB 10:3/759.64 MB 6:6/1.48 GB 4:5/1.24 GB Runtime filters: All filters arrived. Waited 7s646ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:0% 2:0% 3:0% 4:3.704% 5:0% 6:0% 7:3.704% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.75 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.31 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 15.70 - BytesRead: 3.71 GB (3979876613) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3979876613) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3979876613) - DecompressionTime: 16s099ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.24 GB (3479454192) - PerReadThreadRawHdfsThroughput: 809.21 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.38M (301382626) - RowsReturned: 3.76M (3760519) - RowsReturnedRate: 456.34 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 24.35K (24350) - ScannerThreadsTotalWallClockTime: 3m31s - MaterializeTupleTime(*): 1m38s - ScannerThreadsSysTime: 6s773ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 22.80K (22802) - TotalRawHdfsReadTime(*): 4s690ms - TotalReadThroughput: 271.11 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70bf (host=d2404.halxg.cloudera.com:22000):(Total: 11s163ms, non-child: 884.048ms, % non-child: 7.92%) Hdfs split stats (:<# splits>/): 9:1/253.27 MB 3:3/759.64 MB 4:1/253.19 MB 8:6/1.48 GB 5:3/759.71 MB 0:6/1.42 GB 10:2/506.46 MB 2:5/1.19 GB 6:6/1.48 GB 7:6/1.48 GB 1:6/1.48 GB Filter 0 arrival: 7s859ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.34 GB, 2.59 GB, 2.62 GB, 2.27 GB, 1.78 GB, 3.16 GB, 2.97 GB, 2.82 GB, 2.55 GB, 2.21 GB, 1.72 GB, 4.76 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 23, 23, 23, 21, 1 - AverageThreadTokens: 12.21 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.30 GB (3546808616) - PerHostPeakMemUsage: 4.09 GB (4395328000) - PrepareTime: 215.906ms - RowsProduced: 3.81M (3805797) - TotalCpuTime: 2m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.097ms - TotalStorageWaitTime: 2s221ms CodeGen:(Total: 303.930ms, non-child: 303.930ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.660ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 79.402ms - PrepareTime: 214.229ms DataStreamSender (dst_id=4):(Total: 1s806ms, non-child: 1s806ms, % non-child: 100.00%) - BytesSent: 103.23 MB (108249120) - NetworkThroughput(*): 226.65 MB/sec - OverallThroughput: 57.13 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.81M (3805797) - SerializeBatchTime: 1s347ms - TransmitDataRPCTime: 455.477ms - UncompressedRowBatchSize: 225.07 MB (236004098) HDFS_SCAN_NODE (id=0):(Total: 8s168ms, non-child: 8s168ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 9:1/253.27 MB 3:3/759.64 MB 4:1/253.19 MB 8:6/1.48 GB 5:3/759.71 MB 0:6/1.42 GB 10:2/506.46 MB 2:5/1.19 GB 6:6/1.48 GB 7:6/1.48 GB 1:6/1.48 GB Runtime filters: All filters arrived. Waited 7s565ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:0% 2:7.407% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:180 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.86 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.66 GB, 3.75 GB, 3.75 GB, 3.75 GB, 3.75 GB, 3.75 GB, 3.75 GB - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 11.63 - BytesRead: 3.75 GB (4029757435) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.75 GB (4029757435) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.75 GB (4029757435) - DecompressionTime: 16s258ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.30 GB (3541363880) - PerReadThreadRawHdfsThroughput: 920.80 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 305.15M (305149573) - RowsReturned: 3.81M (3805797) - RowsReturnedRate: 465.89 K/sec - ScanRangesComplete: 45 (45) - ScannerThreadsInvoluntaryContextSwitches: 27.31K (27307) - ScannerThreadsTotalWallClockTime: 2m33s - MaterializeTupleTime(*): 1m42s - ScannerThreadsSysTime: 6s916ms - ScannerThreadsUserTime: 1m12s - ScannerThreadsVoluntaryContextSwitches: 19.03K (19032) - TotalRawHdfsReadTime(*): 4s173ms - TotalReadThroughput: 274.49 MB/sec Filter 0 (16.00 MB): - Rows processed: 737.24K (737235) - Rows rejected: 0 (0) - Rows total: 737.28K (737280) Instance 294637ca32dfdd77:639d51f80b2e70c3 (host=d2405.halxg.cloudera.com:22000):(Total: 11s160ms, non-child: 896.868ms, % non-child: 8.04%) Hdfs split stats (:<# splits>/): 3:2/506.33 MB 8:3/722.83 MB 1:5/1.24 GB 7:6/1.48 GB 5:5/1.18 GB 10:2/465.84 MB 6:5/1.20 GB 9:4/1012.87 MB 2:6/1.48 GB 4:3/759.64 MB 0:4/932.83 MB Filter 0 arrival: 7s915ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.80 GB, 2.31 GB, 2.47 GB, 2.30 GB, 2.13 GB, 2.88 GB, 3.05 GB, 2.79 GB, 2.47 GB, 2.10 GB, 1.53 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 23, 23, 21, 14 - AverageThreadTokens: 16.59 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.24 GB (3473589936) - PerHostPeakMemUsage: 4.03 GB (4322109320) - PrepareTime: 203.976ms - RowsProduced: 3.76M (3757714) - TotalCpuTime: 3m42s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.019ms - TotalStorageWaitTime: 2s999ms CodeGen:(Total: 292.988ms, non-child: 292.988ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 78.005ms - PrepareTime: 202.169ms DataStreamSender (dst_id=4):(Total: 1s745ms, non-child: 1s745ms, % non-child: 100.00%) - BytesSent: 101.93 MB (106882241) - NetworkThroughput(*): 240.94 MB/sec - OverallThroughput: 58.38 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.76M (3757714) - SerializeBatchTime: 1s319ms - TransmitDataRPCTime: 423.054ms - UncompressedRowBatchSize: 222.23 MB (233022388) HDFS_SCAN_NODE (id=0):(Total: 8s224ms, non-child: 8s224ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 3:2/506.33 MB 8:3/722.83 MB 1:5/1.24 GB 7:6/1.48 GB 5:5/1.18 GB 10:2/465.84 MB 6:5/1.20 GB 9:4/1012.87 MB 2:6/1.48 GB 4:3/759.64 MB 0:4/932.83 MB Runtime filters: All filters arrived. Waited 7s624ms Hdfs Read Thread Concurrency Bucket: 0:88.46% 1:3.846% 2:0% 3:3.846% 4:0% 5:0% 6:0% 7:0% 8:3.846% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:180 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.46 GB, 1.88 GB, 1.88 GB, 1.91 GB, 2.22 GB, 3.38 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.46 - AverageScannerThreadConcurrency: 16.19 - BytesRead: 3.71 GB (3981802589) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3981802589) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3981802589) - DecompressionTime: 15s881ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.23 GB (3467858480) - PerReadThreadRawHdfsThroughput: 953.03 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.51M (301506814) - RowsReturned: 3.76M (3757714) - RowsReturnedRate: 456.91 K/sec - ScanRangesComplete: 45 (45) - ScannerThreadsInvoluntaryContextSwitches: 19.59K (19595) - ScannerThreadsTotalWallClockTime: 3m31s - MaterializeTupleTime(*): 1m37s - ScannerThreadsSysTime: 6s423ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 23.32K (23316) - TotalRawHdfsReadTime(*): 3s984ms - TotalReadThroughput: 292.10 MB/sec Filter 0 (16.00 MB): - Rows processed: 737.24K (737235) - Rows rejected: 0 (0) - Rows total: 737.28K (737280) Instance 294637ca32dfdd77:639d51f80b2e70c2 (host=d2414.halxg.cloudera.com:22000):(Total: 11s151ms, non-child: 868.439ms, % non-child: 7.79%) Hdfs split stats (:<# splits>/): 0:3/759.60 MB 6:3/759.69 MB 7:5/1.24 GB 1:5/1.19 GB 4:5/1.24 GB 3:4/1012.95 MB 2:3/759.69 MB 9:5/1.24 GB 10:4/1012.76 MB 8:5/1.24 GB 5:2/506.50 MB Filter 0 arrival: 7s911ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.43 GB, 2.58 GB, 2.62 GB, 2.32 GB, 1.84 GB, 3.16 GB, 2.83 GB, 2.69 GB, 2.42 GB, 2.01 GB, 1.40 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 21, 9 - AverageThreadTokens: 13.67 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.25 GB (3490150032) - PerHostPeakMemUsage: 4.04 GB (4338607336) - PrepareTime: 213.239ms - RowsProduced: 3.74M (3738268) - TotalCpuTime: 3m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.548ms - TotalStorageWaitTime: 2s546ms CodeGen:(Total: 300.384ms, non-child: 300.384ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.503ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 78.426ms - PrepareTime: 211.796ms DataStreamSender (dst_id=4):(Total: 1s775ms, non-child: 1s775ms, % non-child: 100.00%) - BytesSent: 101.40 MB (106325364) - NetworkThroughput(*): 216.13 MB/sec - OverallThroughput: 57.11 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.74M (3738268) - SerializeBatchTime: 1s302ms - TransmitDataRPCTime: 469.166ms - UncompressedRowBatchSize: 221.08 MB (231816500) HDFS_SCAN_NODE (id=0):(Total: 8s207ms, non-child: 8s207ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 0:3/759.60 MB 6:3/759.69 MB 7:5/1.24 GB 1:5/1.19 GB 4:5/1.24 GB 3:4/1012.95 MB 2:3/759.69 MB 9:5/1.24 GB 10:4/1012.76 MB 8:5/1.24 GB 5:2/506.50 MB Runtime filters: All filters arrived. Waited 7s608ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:7.407% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.91 GB, 1.92 GB, 1.92 GB, 1.92 GB, 2.01 GB, 3.67 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 12.67 - BytesRead: 3.69 GB (3962194906) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3962194906) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3962194906) - DecompressionTime: 16s177ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.25 GB (3485093192) - PerReadThreadRawHdfsThroughput: 833.50 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.04M (300039693) - RowsReturned: 3.74M (3738268) - RowsReturnedRate: 455.49 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 20.81K (20814) - ScannerThreadsTotalWallClockTime: 2m54s - MaterializeTupleTime(*): 1m37s - ScannerThreadsSysTime: 6s635ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 22.64K (22635) - TotalRawHdfsReadTime(*): 4s533ms - TotalReadThroughput: 279.90 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b8 (host=d2417.halxg.cloudera.com:22000):(Total: 11s124ms, non-child: 982.300ms, % non-child: 8.83%) Hdfs split stats (:<# splits>/): 0:4/969.90 MB 9:3/759.58 MB 8:4/1012.92 MB 5:5/1.24 GB 7:4/1012.89 MB 1:4/1012.96 MB 4:4/1012.98 MB 3:3/759.74 MB 10:2/506.54 MB 2:5/1.24 GB 6:6/1.48 GB Filter 0 arrival: 7s746ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.48 GB, 2.75 GB, 2.68 GB, 2.34 GB, 1.92 GB, 2.75 GB, 3.11 GB, 2.83 GB, 2.53 GB, 2.21 GB, 1.74 GB, 417.57 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 20, 1 - AverageThreadTokens: 14.54 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.23 GB (3463492976) - PerHostPeakMemUsage: 4.02 GB (4312124920) - PrepareTime: 207.345ms - RowsProduced: 3.74M (3743756) - TotalCpuTime: 3m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18.925ms - TotalStorageWaitTime: 2s067ms CodeGen:(Total: 297.375ms, non-child: 297.375ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.083ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 79.738ms - PrepareTime: 205.846ms DataStreamSender (dst_id=4):(Total: 1s786ms, non-child: 1s786ms, % non-child: 100.00%) - BytesSent: 101.55 MB (106477798) - NetworkThroughput(*): 224.84 MB/sec - OverallThroughput: 56.85 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.74M (3743756) - SerializeBatchTime: 1s331ms - TransmitDataRPCTime: 451.641ms - UncompressedRowBatchSize: 221.40 MB (232156816) HDFS_SCAN_NODE (id=0):(Total: 8s059ms, non-child: 8s059ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 0:4/969.90 MB 9:3/759.58 MB 8:4/1012.92 MB 5:5/1.24 GB 7:4/1012.89 MB 1:4/1012.96 MB 4:4/1012.98 MB 3:3/759.74 MB 10:2/506.54 MB 2:5/1.24 GB 6:6/1.48 GB Runtime filters: All filters arrived. Waited 7s464ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:3.704% 2:0% 3:0% 4:0% 5:3.704% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.90 GB, 1.92 GB, 1.92 GB, 1.92 GB, 2.01 GB, 3.24 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 14.04 - BytesRead: 3.69 GB (3964850130) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3964850130) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3964850130) - DecompressionTime: 16s219ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.22 GB (3457704168) - PerReadThreadRawHdfsThroughput: 865.66 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.24M (300241566) - RowsReturned: 3.74M (3743756) - RowsReturnedRate: 464.54 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 21.68K (21683) - ScannerThreadsTotalWallClockTime: 3m14s - MaterializeTupleTime(*): 1m43s - ScannerThreadsSysTime: 7s009ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 19.32K (19325) - TotalRawHdfsReadTime(*): 4s367ms - TotalReadThroughput: 280.09 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b3 (host=d2409.halxg.cloudera.com:22000):(Total: 11s111ms, non-child: 928.075ms, % non-child: 8.35%) Hdfs split stats (:<# splits>/): 6:3/759.61 MB 7:4/1012.93 MB 10:5/1.18 GB 1:4/1012.82 MB 2:5/1.24 GB 8:2/506.41 MB 5:4/1013.00 MB 0:4/1012.83 MB 4:7/1.73 GB 3:2/506.44 MB 9:4/1012.89 MB Filter 0 arrival: 7s797ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.52 GB, 2.66 GB, 2.58 GB, 2.31 GB, 1.81 GB, 3.03 GB, 2.84 GB, 2.72 GB, 2.47 GB, 2.10 GB, 1.58 GB, 309.28 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 21, 17, 1 - AverageThreadTokens: 15.14 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.23 GB (3464433224) - PerHostPeakMemUsage: 4.02 GB (4313020144) - PrepareTime: 214.412ms - RowsProduced: 3.73M (3734320) - TotalCpuTime: 3m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.243ms - TotalStorageWaitTime: 2s110ms CodeGen:(Total: 301.954ms, non-child: 301.954ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 78.134ms - PrepareTime: 212.706ms DataStreamSender (dst_id=4):(Total: 1s777ms, non-child: 1s777ms, % non-child: 100.00%) - BytesSent: 101.29 MB (106214311) - NetworkThroughput(*): 226.68 MB/sec - OverallThroughput: 56.99 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.73M (3734320) - SerializeBatchTime: 1s327ms - TransmitDataRPCTime: 446.862ms - UncompressedRowBatchSize: 220.84 MB (231571684) HDFS_SCAN_NODE (id=0):(Total: 8s104ms, non-child: 8s104ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 6:3/759.61 MB 7:4/1012.93 MB 10:5/1.18 GB 1:4/1012.82 MB 2:5/1.24 GB 8:2/506.41 MB 5:4/1013.00 MB 0:4/1012.83 MB 4:7/1.73 GB 3:2/506.44 MB 9:4/1012.89 MB Runtime filters: All filters arrived. Waited 7s507ms Hdfs Read Thread Concurrency Bucket: 0:96.15% 1:3.846% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.55 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 15.23 - BytesRead: 3.69 GB (3957671474) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3957671474) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3957671474) - DecompressionTime: 15s852ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.22 GB (3459359984) - PerReadThreadRawHdfsThroughput: 916.44 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.70M (299695277) - RowsReturned: 3.73M (3734320) - RowsReturnedRate: 460.79 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 26.51K (26513) - ScannerThreadsTotalWallClockTime: 3m12s - MaterializeTupleTime(*): 1m40s - ScannerThreadsSysTime: 6s820ms - ScannerThreadsUserTime: 1m16s - ScannerThreadsVoluntaryContextSwitches: 21.14K (21135) - TotalRawHdfsReadTime(*): 4s118ms - TotalReadThroughput: 279.58 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70bb (host=d2403.halxg.cloudera.com:22000):(Total: 11s087ms, non-child: 863.373ms, % non-child: 7.79%) Hdfs split stats (:<# splits>/): 7:5/1.24 GB 8:3/759.75 MB 3:4/1012.96 MB 5:4/1013.02 MB 10:3/759.81 MB 1:6/1.38 GB 4:6/1.48 GB 9:2/506.46 MB 2:4/965.59 MB 0:2/506.40 MB 6:5/1.24 GB Filter 0 arrival: 7s822ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.36 GB, 2.72 GB, 2.64 GB, 2.38 GB, 2.00 GB, 2.65 GB, 3.13 GB, 2.81 GB, 2.51 GB, 2.15 GB, 1.66 GB, 136.99 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 21, 19, 1 - AverageThreadTokens: 16.93 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.21 GB (3441793896) - PerHostPeakMemUsage: 4.00 GB (4290273712) - PrepareTime: 216.441ms - RowsProduced: 3.70M (3699686) - TotalCpuTime: 3m50s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13.719ms - TotalStorageWaitTime: 2s050ms CodeGen:(Total: 304.378ms, non-child: 304.378ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 78.985ms - PrepareTime: 214.807ms DataStreamSender (dst_id=4):(Total: 1s778ms, non-child: 1s778ms, % non-child: 100.00%) - BytesSent: 100.36 MB (105231659) - NetworkThroughput(*): 230.79 MB/sec - OverallThroughput: 56.44 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.70M (3699686) - SerializeBatchTime: 1s340ms - TransmitDataRPCTime: 434.837ms - UncompressedRowBatchSize: 218.80 MB (229423964) HDFS_SCAN_NODE (id=0):(Total: 8s141ms, non-child: 8s141ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 7:5/1.24 GB 8:3/759.75 MB 3:4/1012.96 MB 5:4/1013.02 MB 10:3/759.81 MB 1:6/1.38 GB 4:6/1.48 GB 9:2/506.46 MB 2:4/965.59 MB 0:2/506.40 MB 6:5/1.24 GB Runtime filters: All filters arrived. Waited 7s525ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:3.704% 2:0% 3:0% 4:3.704% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.80 GB, 1.89 GB, 1.89 GB, 1.97 GB, 2.05 GB, 3.12 GB, 3.65 GB, 3.65 GB, 3.65 GB, 3.65 GB, 3.65 GB, 3.65 GB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 16.52 - BytesRead: 3.65 GB (3923845125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.65 GB (3923845125) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.65 GB (3923845125) - DecompressionTime: 15s943ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.20 GB (3436340712) - PerReadThreadRawHdfsThroughput: 889.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 297.13M (297126229) - RowsReturned: 3.70M (3699686) - RowsReturnedRate: 454.41 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 23.75K (23748) - ScannerThreadsTotalWallClockTime: 3m39s - MaterializeTupleTime(*): 1m40s - ScannerThreadsSysTime: 6s913ms - ScannerThreadsUserTime: 1m10s - ScannerThreadsVoluntaryContextSwitches: 22.23K (22231) - TotalRawHdfsReadTime(*): 4s205ms - TotalReadThroughput: 277.19 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b5 (host=d2411.halxg.cloudera.com:22000):(Total: 11s036ms, non-child: 870.272ms, % non-child: 7.89%) Hdfs split stats (:<# splits>/): 4:3/759.60 MB 3:3/734.12 MB 8:5/1.24 GB 7:3/759.71 MB 1:5/1.24 GB 10:3/759.68 MB 2:6/1.48 GB 9:4/943.07 MB 6:6/1.48 GB 5:2/506.46 MB 0:4/1012.87 MB Filter 0 arrival: 7s796ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.60 GB, 2.68 GB, 2.56 GB, 2.21 GB, 1.84 GB, 3.19 GB, 2.81 GB, 2.57 GB, 2.37 GB, 1.87 GB, 986.61 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 21, 1 - AverageThreadTokens: 16.78 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.21 GB (3447429488) - PerHostPeakMemUsage: 4.00 GB (4295906576) - PrepareTime: 208.523ms - RowsProduced: 3.73M (3727628) - TotalCpuTime: 3m45s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.922ms - TotalStorageWaitTime: 2s024ms CodeGen:(Total: 297.934ms, non-child: 297.934ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.699ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 78.500ms - PrepareTime: 207.026ms DataStreamSender (dst_id=4):(Total: 1s761ms, non-child: 1s761ms, % non-child: 100.00%) - BytesSent: 101.12 MB (106026859) - NetworkThroughput(*): 220.84 MB/sec - OverallThroughput: 57.39 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.73M (3727628) - SerializeBatchTime: 1s300ms - TransmitDataRPCTime: 457.869ms - UncompressedRowBatchSize: 220.45 MB (231156708) HDFS_SCAN_NODE (id=0):(Total: 8s106ms, non-child: 8s106ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 4:3/759.60 MB 3:3/734.12 MB 8:5/1.24 GB 7:3/759.71 MB 1:5/1.24 GB 10:3/759.68 MB 2:6/1.48 GB 9:4/943.07 MB 6:6/1.48 GB 5:2/506.46 MB 0:4/1012.87 MB Runtime filters: All filters arrived. Waited 7s504ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.93 GB, 1.93 GB, 1.93 GB, 1.93 GB, 2.01 GB, 3.67 GB, 3.67 GB, 3.67 GB, 3.67 GB, 3.67 GB, 3.67 GB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 16.38 - BytesRead: 3.67 GB (3945864711) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.67 GB (3945864711) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.67 GB (3945864711) - DecompressionTime: 16s086ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.21 GB (3441804520) - PerReadThreadRawHdfsThroughput: 917.98 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 298.80M (298798912) - RowsReturned: 3.73M (3727628) - RowsReturnedRate: 459.84 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 21.44K (21438) - ScannerThreadsTotalWallClockTime: 3m34s - MaterializeTupleTime(*): 1m37s - ScannerThreadsSysTime: 6s688ms - ScannerThreadsUserTime: 1m10s - ScannerThreadsVoluntaryContextSwitches: 20.69K (20688) - TotalRawHdfsReadTime(*): 4s099ms - TotalReadThroughput: 278.75 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70bc (host=d2415.halxg.cloudera.com:22000):(Total: 11s033ms, non-child: 906.848ms, % non-child: 8.22%) Hdfs split stats (:<# splits>/): 9:3/759.71 MB 5:6/1.48 GB 8:3/759.55 MB 10:3/759.68 MB 7:7/1.67 GB 3:6/1.48 GB 6:3/759.73 MB 0:2/506.46 MB 1:3/759.51 MB 2:5/1.24 GB 4:3/759.62 MB Filter 0 arrival: 7s870ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.51 GB, 2.49 GB, 2.45 GB, 2.11 GB, 2.11 GB, 3.19 GB, 2.84 GB, 2.55 GB, 2.28 GB, 1.82 GB, 668.62 MB ThreadUsage(500.000ms): 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 21, 1 - AverageThreadTokens: 20.19 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.21 GB (3446345144) - PerHostPeakMemUsage: 4.00 GB (4295089648) - PrepareTime: 200.681ms - RowsProduced: 3.73M (3733594) - TotalCpuTime: 4m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.715ms - TotalStorageWaitTime: 2s458ms CodeGen:(Total: 286.719ms, non-child: 286.719ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.496ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 74.332ms - PrepareTime: 199.197ms DataStreamSender (dst_id=4):(Total: 1s725ms, non-child: 1s725ms, % non-child: 100.00%) - BytesSent: 101.27 MB (106193106) - NetworkThroughput(*): 244.43 MB/sec - OverallThroughput: 58.70 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.73M (3733594) - SerializeBatchTime: 1s306ms - TransmitDataRPCTime: 414.324ms - UncompressedRowBatchSize: 220.80 MB (231526664) HDFS_SCAN_NODE (id=0):(Total: 8s114ms, non-child: 8s114ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 9:3/759.71 MB 5:6/1.48 GB 8:3/759.55 MB 10:3/759.68 MB 7:7/1.67 GB 3:6/1.48 GB 6:3/759.73 MB 0:2/506.46 MB 1:3/759.51 MB 2:5/1.24 GB 4:3/759.62 MB Runtime filters: All filters arrived. Waited 7s584ms Hdfs Read Thread Concurrency Bucket: 0:96.3% 1:0% 2:0% 3:0% 4:0% 5:0% 6:3.704% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.92 GB, 1.92 GB, 1.92 GB, 2.00 GB, 2.43 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB, 3.69 GB - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 19.19 - BytesRead: 3.69 GB (3957133344) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.69 GB (3957133344) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.69 GB (3957133344) - DecompressionTime: 15s901ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.20 GB (3440318768) - PerReadThreadRawHdfsThroughput: 910.08 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.65M (299654018) - RowsReturned: 3.73M (3733594) - RowsReturnedRate: 460.11 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 22.76K (22759) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 6s365ms - ScannerThreadsUserTime: 1m13s - ScannerThreadsVoluntaryContextSwitches: 25.07K (25065) - TotalRawHdfsReadTime(*): 4s146ms - TotalReadThroughput: 279.54 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b2 (host=d2419.halxg.cloudera.com:22000):(Total: 11s032ms, non-child: 904.733ms, % non-child: 8.20%) Hdfs split stats (:<# splits>/): 8:5/1.24 GB 7:3/759.56 MB 1:7/1.73 GB 5:4/1012.95 MB 9:3/759.70 MB 4:3/759.71 MB 6:3/759.68 MB 0:1/223.08 MB 2:4/1012.93 MB 10:5/1.24 GB 3:6/1.48 GB Filter 0 arrival: 7s762ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.55 GB, 2.69 GB, 2.61 GB, 2.24 GB, 1.85 GB, 2.99 GB, 2.90 GB, 2.68 GB, 2.44 GB, 2.03 GB, 1.28 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 22, 7 - AverageThreadTokens: 15.33 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.16 GB (3397470096) - PerHostPeakMemUsage: 3.95 GB (4245907616) - PrepareTime: 217.325ms - RowsProduced: 3.75M (3749138) - TotalCpuTime: 3m25s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.464ms - TotalStorageWaitTime: 2s207ms CodeGen:(Total: 310.256ms, non-child: 310.256ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 13.472ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 80.444ms - PrepareTime: 215.673ms DataStreamSender (dst_id=4):(Total: 1s763ms, non-child: 1s763ms, % non-child: 100.00%) - BytesSent: 101.70 MB (106636286) - NetworkThroughput(*): 235.38 MB/sec - OverallThroughput: 57.66 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.75M (3749138) - SerializeBatchTime: 1s328ms - TransmitDataRPCTime: 432.049ms - UncompressedRowBatchSize: 221.72 MB (232490572) HDFS_SCAN_NODE (id=0):(Total: 8s054ms, non-child: 8s054ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 8:5/1.24 GB 7:3/759.56 MB 1:7/1.73 GB 5:4/1012.95 MB 9:3/759.70 MB 4:3/759.71 MB 6:3/759.68 MB 0:1/223.08 MB 2:4/1012.93 MB 10:5/1.24 GB 3:6/1.48 GB Runtime filters: All filters arrived. Waited 7s465ms Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:3.846% 2:3.846% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.93 GB, 1.93 GB, 1.93 GB, 1.93 GB, 2.04 GB, 3.48 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB, 3.70 GB - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 14.88 - BytesRead: 3.70 GB (3969057752) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.70 GB (3969057752) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.70 GB (3969057752) - DecompressionTime: 16s117ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.16 GB (3391828744) - PerReadThreadRawHdfsThroughput: 895.16 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.56M (300560870) - RowsReturned: 3.75M (3749138) - RowsReturnedRate: 465.48 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 19.88K (19877) - ScannerThreadsTotalWallClockTime: 3m13s - MaterializeTupleTime(*): 1m38s - ScannerThreadsSysTime: 6s572ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 21.60K (21601) - TotalRawHdfsReadTime(*): 4s228ms - TotalReadThroughput: 291.17 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b9 (host=d2408.halxg.cloudera.com:22000):(Total: 11s029ms, non-child: 923.708ms, % non-child: 8.37%) Hdfs split stats (:<# splits>/): 8:6/1.48 GB 6:4/1012.88 MB 0:5/1.24 GB 7:2/506.45 MB 10:6/1.48 GB 9:5/1.24 GB 5:3/759.72 MB 2:3/759.63 MB 3:5/1.24 GB 1:5/1.24 GB Filter 0 arrival: 7s759ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.35 GB, 2.53 GB, 2.56 GB, 2.25 GB, 1.78 GB, 3.19 GB, 2.84 GB, 2.65 GB, 2.44 GB, 2.03 GB, 1.45 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 22, 12 - AverageThreadTokens: 13.81 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.25 GB (3488148320) - PerHostPeakMemUsage: 4.04 GB (4336667704) - PrepareTime: 208.049ms - RowsProduced: 3.77M (3765054) - TotalCpuTime: 3m6s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17.888ms - TotalStorageWaitTime: 2s268ms CodeGen:(Total: 296.331ms, non-child: 296.331ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 77.676ms - PrepareTime: 206.558ms DataStreamSender (dst_id=4):(Total: 1s749ms, non-child: 1s749ms, % non-child: 100.00%) - BytesSent: 102.13 MB (107089919) - NetworkThroughput(*): 241.75 MB/sec - OverallThroughput: 58.38 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.77M (3765054) - SerializeBatchTime: 1s323ms - TransmitDataRPCTime: 422.451ms - UncompressedRowBatchSize: 222.66 MB (233477552) HDFS_SCAN_NODE (id=0):(Total: 8s060ms, non-child: 8s060ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 8:6/1.48 GB 6:4/1012.88 MB 0:5/1.24 GB 7:2/506.45 MB 10:6/1.48 GB 9:5/1.24 GB 5:3/759.72 MB 2:3/759.63 MB 3:5/1.24 GB 1:5/1.24 GB Runtime filters: All filters arrived. Waited 7s464ms Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:3.846% 2:0% 3:3.846% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.82 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.68 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 13.31 - BytesRead: 3.71 GB (3979986211) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3979986211) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3979986211) - DecompressionTime: 15s649ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.24 GB (3482212264) - PerReadThreadRawHdfsThroughput: 908.59 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.39M (301391554) - RowsReturned: 3.77M (3765054) - RowsReturnedRate: 467.10 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 27.44K (27436) - ScannerThreadsTotalWallClockTime: 2m55s - MaterializeTupleTime(*): 1m38s - ScannerThreadsSysTime: 6s603ms - ScannerThreadsUserTime: 1m14s - ScannerThreadsVoluntaryContextSwitches: 18.61K (18609) - TotalRawHdfsReadTime(*): 4s177ms - TotalReadThroughput: 291.97 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b1 (host=d2412.halxg.cloudera.com:22000):(Total: 11s018ms, non-child: 856.415ms, % non-child: 7.77%) Hdfs split stats (:<# splits>/): 5:2/506.41 MB 6:4/1012.94 MB 3:2/506.44 MB 2:3/759.71 MB 0:4/1012.87 MB 8:4/1012.89 MB 1:4/1012.96 MB 7:5/1.24 GB 4:4/1013.03 MB 10:5/1.24 GB 9:7/1.73 GB Filter 0 arrival: 7s752ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.82 GB, 2.49 GB, 2.65 GB, 2.34 GB, 1.89 GB, 2.37 GB, 3.12 GB, 2.83 GB, 2.56 GB, 2.27 GB, 1.77 GB, 597.43 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 22, 22, 1 - AverageThreadTokens: 16.81 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.21 GB (3450944000) - PerHostPeakMemUsage: 4.00 GB (4299381520) - PrepareTime: 213.729ms - RowsProduced: 3.76M (3760228) - TotalCpuTime: 3m48s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17.611ms - TotalStorageWaitTime: 2s412ms CodeGen:(Total: 297.440ms, non-child: 297.440ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 74.798ms - PrepareTime: 212.261ms DataStreamSender (dst_id=4):(Total: 1s795ms, non-child: 1s795ms, % non-child: 100.00%) - BytesSent: 102.00 MB (106951758) - NetworkThroughput(*): 222.05 MB/sec - OverallThroughput: 56.80 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.76M (3760228) - SerializeBatchTime: 1s332ms - TransmitDataRPCTime: 459.335ms - UncompressedRowBatchSize: 222.38 MB (233178284) HDFS_SCAN_NODE (id=0):(Total: 8s069ms, non-child: 8s069ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 5:2/506.41 MB 6:4/1012.94 MB 3:2/506.44 MB 2:3/759.71 MB 0:4/1012.87 MB 8:4/1012.89 MB 1:4/1012.96 MB 7:5/1.24 GB 4:4/1013.03 MB 10:5/1.24 GB 9:7/1.73 GB Runtime filters: All filters arrived. Waited 7s466ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:0% 2:0% 3:0% 4:0% 5:3.704% 6:0% 7:0% 8:3.704% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.47 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 2.87 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 15.81 - BytesRead: 3.71 GB (3980103753) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3980103753) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3980103753) - DecompressionTime: 16s200ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.21 GB (3445651352) - PerReadThreadRawHdfsThroughput: 870.76 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.40M (301399548) - RowsReturned: 3.76M (3760228) - RowsReturnedRate: 466.00 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 25.19K (25186) - ScannerThreadsTotalWallClockTime: 3m37s - MaterializeTupleTime(*): 1m40s - ScannerThreadsSysTime: 6s465ms - ScannerThreadsUserTime: 1m16s - ScannerThreadsVoluntaryContextSwitches: 20.52K (20518) - TotalRawHdfsReadTime(*): 4s359ms - TotalReadThroughput: 281.16 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70b4 (host=d2418.halxg.cloudera.com:22000):(Total: 10s935ms, non-child: 871.460ms, % non-child: 7.97%) Hdfs split stats (:<# splits>/): 7:3/759.71 MB 3:1/253.25 MB 0:6/1.48 GB 8:4/1012.81 MB 4:7/1.73 GB 10:5/1.24 GB 9:3/759.61 MB 6:5/1.24 GB 1:2/506.46 MB 5:3/759.65 MB 2:4/1013.00 MB Filter 0 arrival: 7s761ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.70 GB, 2.80 GB, 2.59 GB, 2.36 GB, 1.78 GB, 2.91 GB, 2.76 GB, 2.55 GB, 2.34 GB, 1.87 GB, 946.03 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 21, 21, 21, 21, 21, 2 - AverageThreadTokens: 14.11 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.14 GB (3373390248) - PerHostPeakMemUsage: 3.93 GB (4221827768) - PrepareTime: 207.430ms - RowsProduced: 3.67M (3670054) - TotalCpuTime: 3m14s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16.451ms - TotalStorageWaitTime: 2s198ms CodeGen:(Total: 293.757ms, non-child: 293.757ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.390ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 77.814ms - PrepareTime: 205.737ms DataStreamSender (dst_id=4):(Total: 1s751ms, non-child: 1s751ms, % non-child: 100.00%) - BytesSent: 99.55 MB (104380955) - NetworkThroughput(*): 225.23 MB/sec - OverallThroughput: 56.82 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.67M (3670054) - SerializeBatchTime: 1s305ms - TransmitDataRPCTime: 441.968ms - UncompressedRowBatchSize: 217.04 MB (227586440) HDFS_SCAN_NODE (id=0):(Total: 8s018ms, non-child: 8s018ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 43 Hdfs split stats (:<# splits>/): 7:3/759.71 MB 3:1/253.25 MB 0:6/1.48 GB 8:4/1012.81 MB 4:7/1.73 GB 10:5/1.24 GB 9:3/759.61 MB 6:5/1.24 GB 1:2/506.46 MB 5:3/759.65 MB 2:4/1013.00 MB Runtime filters: All filters arrived. Waited 7s468ms Hdfs Read Thread Concurrency Bucket: 0:96.15% 1:0% 2:3.846% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:172 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.43 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 13.62 - BytesRead: 3.62 GB (3889652701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.62 GB (3889652701) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.62 GB (3889652701) - DecompressionTime: 15s829ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 43 (43) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.14 GB (3368153096) - PerReadThreadRawHdfsThroughput: 957.46 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 294.55M (294550376) - RowsReturned: 3.67M (3670054) - RowsReturnedRate: 457.72 K/sec - ScanRangesComplete: 43 (43) - ScannerThreadsInvoluntaryContextSwitches: 23.27K (23267) - ScannerThreadsTotalWallClockTime: 3m3s - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 6s253ms - ScannerThreadsUserTime: 1m10s - ScannerThreadsVoluntaryContextSwitches: 20.62K (20622) - TotalRawHdfsReadTime(*): 3s874ms - TotalReadThroughput: 274.77 MB/sec Filter 0 (16.00 MB): - Rows processed: 704.47K (704469) - Rows rejected: 0 (0) - Rows total: 704.51K (704512) Instance 294637ca32dfdd77:639d51f80b2e70b7 (host=d2402.halxg.cloudera.com:22000):(Total: 10s908ms, non-child: 862.920ms, % non-child: 7.91%) Hdfs split stats (:<# splits>/): 5:4/1012.92 MB 9:6/1.48 GB 1:1/253.21 MB 8:3/759.57 MB 4:4/1012.88 MB 7:2/506.46 MB 3:4/1012.89 MB 0:4/1012.88 MB 10:4/1012.87 MB 6:7/1.73 GB 2:4/1012.98 MB Filter 0 arrival: 7s677ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 2.16 GB, 2.45 GB, 2.56 GB, 2.34 GB, 1.86 GB, 2.48 GB, 2.91 GB, 2.68 GB, 2.44 GB, 2.12 GB, 1.55 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 21, 21, 21, 21, 15 - AverageThreadTokens: 11.30 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.13 GB (3357700472) - PerHostPeakMemUsage: 3.92 GB (4206189848) - PrepareTime: 224.886ms - RowsProduced: 3.68M (3676586) - TotalCpuTime: 2m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.832ms - TotalStorageWaitTime: 2s428ms CodeGen:(Total: 320.803ms, non-child: 320.803ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 86.470ms - PrepareTime: 223.247ms DataStreamSender (dst_id=4):(Total: 1s743ms, non-child: 1s743ms, % non-child: 100.00%) - BytesSent: 99.72 MB (104568282) - NetworkThroughput(*): 225.49 MB/sec - OverallThroughput: 57.21 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.68M (3676586) - SerializeBatchTime: 1s297ms - TransmitDataRPCTime: 442.256ms - UncompressedRowBatchSize: 217.43 MB (227991500) HDFS_SCAN_NODE (id=0):(Total: 7s981ms, non-child: 7s981ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 43 Hdfs split stats (:<# splits>/): 5:4/1012.92 MB 9:6/1.48 GB 1:1/253.21 MB 8:3/759.57 MB 4:4/1012.88 MB 7:2/506.46 MB 3:4/1012.89 MB 0:4/1012.88 MB 10:4/1012.87 MB 6:7/1.73 GB 2:4/1012.98 MB Runtime filters: All filters arrived. Waited 7s364ms Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:0% 2:3.846% 3:0% 4:3.846% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:172 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.76 GB, 1.94 GB, 1.94 GB, 1.94 GB, 1.94 GB, 3.01 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB, 3.62 GB - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 10.69 - BytesRead: 3.62 GB (3889431406) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.62 GB (3889431406) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.62 GB (3889431406) - DecompressionTime: 16s396ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 43 (43) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.12 GB (3351649512) - PerReadThreadRawHdfsThroughput: 867.29 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 294.53M (294532456) - RowsReturned: 3.68M (3676586) - RowsReturnedRate: 460.62 K/sec - ScanRangesComplete: 43 (43) - ScannerThreadsInvoluntaryContextSwitches: 24.78K (24780) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 1m36s - ScannerThreadsSysTime: 6s823ms - ScannerThreadsUserTime: 1m10s - ScannerThreadsVoluntaryContextSwitches: 21.54K (21538) - TotalRawHdfsReadTime(*): 4s276ms - TotalReadThroughput: 285.33 MB/sec Filter 0 (16.00 MB): - Rows processed: 704.47K (704469) - Rows rejected: 0 (0) - Rows total: 704.51K (704512) Instance 294637ca32dfdd77:639d51f80b2e70b6 (host=d2407.halxg.cloudera.com:22000):(Total: 10s890ms, non-child: 906.244ms, % non-child: 8.32%) Hdfs split stats (:<# splits>/): 6:3/759.69 MB 9:4/939.11 MB 1:3/759.63 MB 10:2/506.42 MB 7:4/1012.84 MB 4:4/1012.85 MB 5:4/1012.91 MB 0:6/1.48 GB 2:6/1.48 GB 8:5/1.24 GB 3:3/759.71 MB Filter 0 arrival: 7s712ms MemoryUsage(500.000ms): 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 1.29 GB, 2.43 GB, 2.47 GB, 2.41 GB, 1.96 GB, 2.66 GB, 3.06 GB, 2.79 GB, 2.52 GB, 2.21 GB, 1.69 GB, 135.19 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 21, 21, 1 - AverageThreadTokens: 15.04 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.23 GB (3472960208) - PerHostPeakMemUsage: 4.02 GB (4321457080) - PrepareTime: 207.621ms - RowsProduced: 3.73M (3731596) - TotalCpuTime: 3m23s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16.464ms - TotalStorageWaitTime: 2s221ms CodeGen:(Total: 297.688ms, non-child: 297.688ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 79.232ms - PrepareTime: 205.785ms DataStreamSender (dst_id=4):(Total: 1s693ms, non-child: 1s693ms, % non-child: 100.00%) - BytesSent: 101.22 MB (106134483) - NetworkThroughput(*): 232.51 MB/sec - OverallThroughput: 59.77 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.73M (3731596) - SerializeBatchTime: 1s252ms - TransmitDataRPCTime: 435.329ms - UncompressedRowBatchSize: 220.68 MB (231402756) HDFS_SCAN_NODE (id=0):(Total: 7s993ms, non-child: 7s993ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 6:3/759.69 MB 9:4/939.11 MB 1:3/759.63 MB 10:2/506.42 MB 7:4/1012.84 MB 4:4/1012.85 MB 5:4/1012.91 MB 0:6/1.48 GB 2:6/1.48 GB 8:5/1.24 GB 3:3/759.71 MB Runtime filters: All filters arrived. Waited 7s426ms Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:3.704% 8:3.704% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.08 GB, 1.91 GB, 1.91 GB, 1.99 GB, 1.99 GB, 3.11 GB, 3.68 GB, 3.68 GB, 3.68 GB, 3.68 GB, 3.68 GB, 3.68 GB - AverageHdfsReadThreadConcurrency: 0.56 - AverageScannerThreadConcurrency: 14.04 - BytesRead: 3.68 GB (3950501625) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.68 GB (3950501625) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.68 GB (3950501625) - DecompressionTime: 15s716ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.23 GB (3467138472) - PerReadThreadRawHdfsThroughput: 839.36 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 299.15M (299150895) - RowsReturned: 3.73M (3731596) - RowsReturnedRate: 466.84 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 22.55K (22555) - ScannerThreadsTotalWallClockTime: 3m12s - MaterializeTupleTime(*): 1m35s - ScannerThreadsSysTime: 6s575ms - ScannerThreadsUserTime: 1m10s - ScannerThreadsVoluntaryContextSwitches: 21.80K (21802) - TotalRawHdfsReadTime(*): 4s488ms - TotalReadThroughput: 279.07 MB/sec Filter 0 (16.00 MB): - Rows processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896) Instance 294637ca32dfdd77:639d51f80b2e70c4 (host=d2416.halxg.cloudera.com:22000):(Total: 10s410ms, non-child: 579.736ms, % non-child: 5.57%) Hdfs split stats (:<# splits>/): 2:3/759.67 MB 6:4/1012.91 MB 5:4/1012.85 MB 9:5/1.24 GB 0:6/1.48 GB 1:4/1012.99 MB 3:3/759.62 MB 10:3/759.53 MB 7:5/1.24 GB 8:3/759.60 MB 4:4/1012.92 MB Filter 0 arrival: 7s941ms MemoryUsage(500.000ms): 0, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 61.28 KB, 626.75 MB, 2.45 GB, 2.44 GB, 2.15 GB, 2.42 GB, 2.99 GB, 2.63 GB, 2.23 GB, 1.45 GB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22, 22, 22, 11 - AverageThreadTokens: 14.96 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 3.16 GB (3391393312) - PerHostPeakMemUsage: 3.95 GB (4239850616) - PrepareTime: 205.298ms - RowsProduced: 3.76M (3762423) - TotalCpuTime: 3m5s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.772ms - TotalStorageWaitTime: 1s588ms CodeGen:(Total: 289.224ms, non-child: 289.224ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 9.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.24 MB (2353348) - NumFunctions: 19 (19) - NumInstructions: 261 (261) - OptimizationTime: 74.975ms - PrepareTime: 203.498ms DataStreamSender (dst_id=4):(Total: 1s371ms, non-child: 1s371ms, % non-child: 100.00%) - BytesSent: 102.06 MB (107017043) - NetworkThroughput(*): 284.98 MB/sec - OverallThroughput: 74.39 MB/sec - PeakMemoryUsage: 613.28 KB (628000) - RowsReturned: 3.76M (3762423) - SerializeBatchTime: 1s011ms - TransmitDataRPCTime: 358.133ms - UncompressedRowBatchSize: 222.51 MB (233314402) HDFS_SCAN_NODE (id=0):(Total: 8s169ms, non-child: 8s169ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 44 Hdfs split stats (:<# splits>/): 2:3/759.67 MB 6:4/1012.91 MB 5:4/1012.85 MB 9:5/1.24 GB 0:6/1.48 GB 1:4/1012.99 MB 3:3/759.62 MB 10:3/759.53 MB 7:5/1.24 GB 8:3/759.60 MB 4:4/1012.92 MB Runtime filters: All filters arrived. Waited 7s666ms Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:0% 2:0% 3:4.167% 4:0% 5:4.167% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:176 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 495.16 MB, 1.94 GB, 1.94 GB, 1.94 GB, 2.75 GB, 3.71 GB, 3.71 GB, 3.71 GB, 3.71 GB - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 14.54 - BytesRead: 3.71 GB (3980046880) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 GB (3980046880) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 GB (3980046880) - DecompressionTime: 12s991ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 44 (44) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 3.15 GB (3385718984) - PerReadThreadRawHdfsThroughput: 1010.49 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 301.40M (301395391) - RowsReturned: 3.76M (3762423) - RowsReturnedRate: 460.55 K/sec - ScanRangesComplete: 44 (44) - ScannerThreadsInvoluntaryContextSwitches: 13.49K (13488) - ScannerThreadsTotalWallClockTime: 2m54s - MaterializeTupleTime(*): 1m13s - ScannerThreadsSysTime: 5s544ms - ScannerThreadsUserTime: 59s495ms - ScannerThreadsVoluntaryContextSwitches: 19.85K (19851) - TotalRawHdfsReadTime(*): 3s756ms - TotalReadThroughput: 316.31 MB/sec Filter 0 (16.00 MB): - RoGoodbye mmokhtar ws processed: 720.85K (720852) - Rows rejected: 0 (0) - Rows total: 720.90K (720896)