================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 13:MERGING-EXCHANGE | 1 | 194.48us | 0ns | 194.48us | 10 | 10 | | 06:TOP-N | 15 | 8.50ms | 0ns | 9.67ms | 150 | 10 | | 12:AGGREGATE | 15 | 78.68ms | 0ns | 108.63ms | 3.39M | 5.08M | | 11:EXCHANGE | 15 | 16.25ms | 0ns | 19.27ms | 3.39M | 5.08M | | 05:AGGREGATE | 15 | 223.47ms | 0ns | 259.19ms | 3.39M | 5.08M | | 04:HASH JOIN | 15 | 236.54ms | 0ns | 258.56ms | 8.97M | 5.08M | | |--10:EXCHANGE | 15 | 13.27ms | 0ns | 13.97ms | 9.00M | 9.00M | | | 00:SCAN HDFS | 14 | 22.31ms | 0ns | 43.69ms | 9.00M | 9.00M | | 09:EXCHANGE | 15 | 103.59ms | 0ns | 117.28ms | 22.69M | 18.00M | | 03:HASH JOIN | 15 | 7.04s | 0ns | 7.90s | 22.69M | 18.00M | | |--08:EXCHANGE | 15 | 387.96ms | 0ns | 510.21ms | 110.51M | 45.00M | | | 01:SCAN HDFS | 15 | 614.66ms | 0ns | 650.53ms | 110.51M | 45.00M | | 07:EXCHANGE | 15 | 5.34s | 0ns | 7.17s | 970.31M | 180.00M | | 02:SCAN HDFS | 15 | 1.23s | 0ns | 1.33s | 970.31M | 180.00M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=de4b40c22a7cb446:21cf777600000000): Summary: Session ID: 74f8bdc4ff69908:cfc9898a801c9487 Session Type: BEESWAX Start Time: 2016-11-29 13:08:58.727911000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build f6f910016b442fd621cde4a536c7ce61b02897e0) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:53373 Default Db: tpch_300_parquet Sql Statement: select l_orderkey, sum(l_extendedprice * (1 - l_discount)) as revenue, o_orderdate, o_shippriority from customer, orders, lineitem where c_mktsegment = 'BUILDING' and c_custkey = o_custkey and l_orderkey = o_orderkey and o_orderdate < '1995-03-15' and l_shipdate > '1995-03-15' group by l_orderkey, o_orderdate, o_shippriority order by revenue desc, o_orderdate limit 10 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.12GB VCores=4 PLAN-ROOT SINK | 13:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | limit: 10 | hosts=15 per-host-mem=unavailable | tuple-ids=4 row-size=58B cardinality=10 | 06:TOP-N [LIMIT=10] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | hosts=15 per-host-mem=580B | tuple-ids=4 row-size=58B cardinality=10 | 12:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | hosts=15 per-host-mem=308.87MB | tuple-ids=3 row-size=58B cardinality=5076417 | 11:EXCHANGE [HASH(l_orderkey,o_orderdate,o_shippriority)] | hosts=15 per-host-mem=0B | tuple-ids=3 row-size=58B cardinality=5076417 | 05:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | hosts=15 per-host-mem=308.87MB | tuple-ids=3 row-size=58B cardinality=5076417 | 04:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: o_custkey = c_custkey | runtime filters: RF000 <- c_custkey | hosts=15 per-host-mem=20.77MB | tuple-ids=2,1,0 row-size=133B cardinality=5076417 | |--10:EXCHANGE [HASH(c_custkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=0 row-size=33B cardinality=9000000 | | | 00:SCAN HDFS [tpch_300_parquet.customer, RANDOM] | partitions=1/1 files=18 size=3.52GB | predicates: c_mktsegment = 'BUILDING' | table stats: 45000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=0 row-size=33B cardinality=9000000 | 09:EXCHANGE [HASH(o_custkey)] | hosts=15 per-host-mem=0B | tuple-ids=2,1 row-size=100B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF001 <- o_orderkey | hosts=15 per-host-mem=157.36MB | tuple-ids=2,1 row-size=100B cardinality=17999891 | |--08:EXCHANGE [HASH(o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=50B cardinality=45000000 | | | 01:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o_orderdate < '1995-03-15' | runtime filters: RF000 -> o_custkey | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=50B cardinality=45000000 | 07:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=2 row-size=50B cardinality=179998909 | 02:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate > '1995-03-15' runtime filters: RF001 -> l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=352.00MB tuple-ids=2 row-size=50B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1203629695 Estimated Per-Host VCores: 4 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 17.506ms - Analysis finished: 5.745ms (5.745ms) - Equivalence classes computed: 6.107ms (362.589us) - Single node plan created: 10.790ms (4.682ms) - Runtime filters computed: 11.118ms (327.724us) - Distributed plan created: 13.113ms (1.995ms) - Lineage info computed: 13.982ms (868.391us) - Planning finished: 17.506ms (3.524ms) Query Timeline: 26s789ms - Query submitted: 359.147us (359.147us) - Planning finished: 22.209ms (21.850ms) - Submit for admission: 24.281ms (2.072ms) - Completed admission: 24.372ms (91.176us) - Ready to start 90 fragment instances: 24.692ms (320.260us) - All 90 fragment instances started: 38.696ms (14.003ms) - First dynamic filter received: 558.491ms (519.794ms) - Rows available: 26s734ms (26s176ms) - First row fetched: 26s770ms (35.426ms) - ComputeScanRangeAssignmentTimer: 795.052us ImpalaServer: - ClientFetchWaitTimer: 35.439ms - RowMaterializationTimer: 11.388ms Execution Profile de4b40c22a7cb446:21cf777600000000:(Total: 26s720ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 1 3 2 15 REMOTE false 15 (15) N/A N/A true 0 4 1 15 REMOTE false 15 (15) N/A N/A true Fragment instance start latencies: Count: 90, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 6ms Per Node Peak Memory Usage: vb0232.halxg.cloudera.com:22000(1.60 GB) vb0226.halxg.cloudera.com:22000(1.60 GB) vb0214.halxg.cloudera.com:22000(1.59 GB) vb0216.halxg.cloudera.com:22000(1.60 GB) vb0228.halxg.cloudera.com:22000(1.60 GB) vb0206.halxg.cloudera.com:22000(1.60 GB) vb0220.halxg.cloudera.com:22000(1.60 GB) vb0218.halxg.cloudera.com:22000(1.60 GB) vb0234.halxg.cloudera.com:22000(1.62 GB) vb0222.halxg.cloudera.com:22000(1.60 GB) vb0224.halxg.cloudera.com:22000(1.60 GB) vb0212.halxg.cloudera.com:22000(1.60 GB) vb0208.halxg.cloudera.com:22000(1.59 GB) vb0230.halxg.cloudera.com:22000(1.59 GB) vb0204.halxg.cloudera.com:22000(1.54 GB) - FiltersReceived: 30 (30) - FinalizationTimer: 0.000ns Coordinator Fragment F06: Instance de4b40c22a7cb446:21cf777600000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 26s708ms, non-child: 1.842ms, % non-child: 0.01%) MemoryUsage(500.000ms): 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 6 (6) - PeakMemoryUsage: 304.50 KB (311808) - PerHostPeakMemUsage: 1.54 GB (1653945909) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s715ms - SysTime: 0.000ns - UserTime: 58.991ms - VoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 35.578ms - ExecTreeExecTime: 152.027us - OpenTime: 26s680ms - ExecTreeOpenTime: 26s621ms - PrepareTime: 28.376ms - ExecTreePrepareTime: 43.408us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 85.774ms, non-child: 85.774ms, % non-child: 100.00%) - CodegenTime: 1.238ms - CompileTime: 7.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 29 (29) - NumInstructions: 593 (593) - OptimizationTime: 50.006ms - PeakMemoryUsage: 296.50 KB (303616) - PrepareTime: 27.424ms EXCHANGE_NODE (id=13):(Total: 26s621ms, non-child: 194.482us, % non-child: 0.00%) ExecOption: Codegen Enabled BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 5.21 KB (5331) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 384.156us - FirstBatchArrivalWaitTime: 26s621ms - MergeGetNext: 144.335us - MergeGetNextBatch: 76.263us - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F05:(Total: 26s703ms, non-child: 3.763ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:26s701ms max:26s708ms mean: 26s705ms stddev:2.206ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 46 (46) - PeakMemoryUsage: 146.41 MB (153519717) - PerHostPeakMemUsage: 1.60 GB (1714962635) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s278ms - TotalNetworkSendTime: 330.163us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s657ms - SysTime: 17.263ms - UserTime: 364.677ms - VoluntaryContextSwitches: 375 (375) Fragment Instance Lifecycle Timings: - ExecTime: 589.605us - ExecTreeExecTime: 4.393us - OpenTime: 26s657ms - ExecTreeOpenTime: 26s371ms - PrepareTime: 45.911ms - ExecTreePrepareTime: 754.892us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 83.252us, non-child: 83.252us, % non-child: 100.00%) - BytesSent: 355.00 B (355) - NetworkThroughput(*): 9.16 MB/sec - OverallThroughput: 4.17 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.883us - TransmitDataRPCTime: 39.870us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 327.613ms, non-child: 327.613ms, % non-child: 100.00%) - CodegenTime: 4.831ms - CompileTime: 60.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 224.455ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 41.817ms SORT_NODE (id=6):(Total: 26s371ms, non-child: 8.495ms, % non-child: 0.03%) - InsertBatchTime: 8.265ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s363ms, non-child: 78.681ms, % non-child: 0.30%) - BuildTime: 62.946ms - GetNewBlockTime: 360.649us - GetResultsTime: 10.909ms - HTResizeTime: 15.471ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153466256) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.120us EXCHANGE_NODE (id=11):(Total: 26s284ms, non-child: 26s284ms, % non-child: 100.00%) - BytesReceived: 6.20 MB (6497187) - ConvertRowBatchTime: 5.069ms - DeserializeRowBatchTimer: 33.823ms - FirstBatchArrivalWaitTime: 26s205ms - PeakMemoryUsage: 0 - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F05: Instance de4b40c22a7cb446:59 (host=vb0228.halxg.cloudera.com:22000):(Total: 26s707ms, non-child: 3.212ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 66.41 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1720283702) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s292ms - TotalNetworkSendTime: 231.660us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s667ms - SysTime: 7.999ms - UserTime: 363.944ms - VoluntaryContextSwitches: 380 (380) Fragment Instance Lifecycle Timings: - ExecTime: 473.068us - ExecTreeExecTime: 3.480us - OpenTime: 26s666ms - ExecTreeOpenTime: 26s389ms - PrepareTime: 40.861ms - ExecTreePrepareTime: 710.544us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 73.596us, non-child: 73.596us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 10.77 MB/sec - OverallThroughput: 4.64 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.848us - TransmitDataRPCTime: 31.688us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 313.774ms, non-child: 313.774ms, % non-child: 100.00%) - CodegenTime: 4.035ms - CompileTime: 61.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 214.732ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 37.299ms SORT_NODE (id=6):(Total: 26s390ms, non-child: 9.094ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.864ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s381ms, non-child: 83.267ms, % non-child: 0.32%) ExecOption: Codegen Enabled - BuildTime: 66.613ms - GetNewBlockTime: 250.360us - GetResultsTime: 11.779ms - HTResizeTime: 20.190ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.35K (226347) - RowsReturnedRate: 8.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.524us EXCHANGE_NODE (id=11):(Total: 26s298ms, non-child: 19.269ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.85 MB - BytesReceived: 6.20 MB (6500841) - ConvertRowBatchTime: 4.672ms - DeserializeRowBatchTimer: 38.328ms - FirstBatchArrivalWaitTime: 26s219ms - PeakMemoryUsage: 0 - RowsReturned: 226.35K (226347) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:53 (host=vb0222.halxg.cloudera.com:22000):(Total: 26s706ms, non-child: 4.983ms, % non-child: 0.02%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 74.88 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 49 (49) - PeakMemoryUsage: 146.42 MB (153530432) - PerHostPeakMemUsage: 1.60 GB (1721230764) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s275ms - TotalNetworkSendTime: 344.996us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s661ms - SysTime: 16.997ms - UserTime: 371.944ms - VoluntaryContextSwitches: 304 (304) Fragment Instance Lifecycle Timings: - ExecTime: 590.320us - ExecTreeExecTime: 4.440us - OpenTime: 26s661ms - ExecTreeOpenTime: 26s380ms - PrepareTime: 45.187ms - ExecTreePrepareTime: 719.588us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 80.748us, non-child: 80.748us, % non-child: 100.00%) - BytesSent: 339.00 B (339) - NetworkThroughput(*): 8.32 MB/sec - OverallThroughput: 4.00 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.580us - TransmitDataRPCTime: 38.864us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 320.199ms, non-child: 320.199ms, % non-child: 100.00%) - CodegenTime: 7.126ms - CompileTime: 61.631ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 218.071ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 39.844ms SORT_NODE (id=6):(Total: 26s381ms, non-child: 9.669ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 9.347ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s371ms, non-child: 90.224ms, % non-child: 0.34%) ExecOption: Codegen Enabled - BuildTime: 72.973ms - GetNewBlockTime: 406.228us - GetResultsTime: 11.609ms - HTResizeTime: 15.243ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.84K (226843) - RowsReturnedRate: 8.60 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.144us EXCHANGE_NODE (id=11):(Total: 26s281ms, non-child: 16.910ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.19 MB - BytesReceived: 6.21 MB (6512981) - ConvertRowBatchTime: 5.260ms - DeserializeRowBatchTimer: 37.597ms - FirstBatchArrivalWaitTime: 26s211ms - PeakMemoryUsage: 0 - RowsReturned: 226.84K (226843) - RowsReturnedRate: 8.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:55 (host=vb0206.halxg.cloudera.com:22000):(Total: 26s705ms, non-child: 4.268ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 45 (45) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1720823652) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s232ms - TotalNetworkSendTime: 329.982us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s647ms - SysTime: 21.997ms - UserTime: 393.940ms - VoluntaryContextSwitches: 251 (251) Fragment Instance Lifecycle Timings: - ExecTime: 601.608us - ExecTreeExecTime: 4.096us - OpenTime: 26s647ms - ExecTreeOpenTime: 26s349ms - PrepareTime: 58.508ms - ExecTreePrepareTime: 711.548us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 68.566us, non-child: 68.566us, % non-child: 100.00%) - BytesSent: 346.00 B (346) - NetworkThroughput(*): 11.66 MB/sec - OverallThroughput: 4.81 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.710us - TransmitDataRPCTime: 28.298us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 351.425ms, non-child: 351.425ms, % non-child: 100.00%) - CodegenTime: 5.535ms - CompileTime: 58.817ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 237.709ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 54.221ms SORT_NODE (id=6):(Total: 26s350ms, non-child: 8.992ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.773ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s341ms, non-child: 100.908ms, % non-child: 0.38%) ExecOption: Codegen Enabled - BuildTime: 84.466ms - GetNewBlockTime: 280.964us - GetResultsTime: 11.490ms - HTResizeTime: 20.965ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 227.03K (227034) - RowsReturnedRate: 8.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.032us EXCHANGE_NODE (id=11):(Total: 26s240ms, non-child: 14.771ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.22 MB (6517846) - ConvertRowBatchTime: 7.213ms - DeserializeRowBatchTimer: 26.743ms - FirstBatchArrivalWaitTime: 26s181ms - PeakMemoryUsage: 0 - RowsReturned: 227.03K (227034) - RowsReturnedRate: 8.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:56 (host=vb0214.halxg.cloudera.com:22000):(Total: 26s705ms, non-child: 3.318ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 46 (46) - PeakMemoryUsage: 146.42 MB (153534528) - PerHostPeakMemUsage: 1.59 GB (1707342219) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s292ms - TotalNetworkSendTime: 340.945us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s655ms - SysTime: 17.997ms - UserTime: 347.947ms - VoluntaryContextSwitches: 450 (450) Fragment Instance Lifecycle Timings: - ExecTime: 652.171us - ExecTreeExecTime: 4.558us - OpenTime: 26s654ms - ExecTreeOpenTime: 26s377ms - PrepareTime: 50.322ms - ExecTreePrepareTime: 671.061us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 66.529us, non-child: 66.529us, % non-child: 100.00%) - BytesSent: 361.00 B (361) - NetworkThroughput(*): 13.17 MB/sec - OverallThroughput: 5.17 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.631us - TransmitDataRPCTime: 26.149us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 323.841ms, non-child: 323.841ms, % non-child: 100.00%) - CodegenTime: 3.982ms - CompileTime: 61.394ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 215.156ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 46.677ms SORT_NODE (id=6):(Total: 26s378ms, non-child: 8.764ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.541ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s369ms, non-child: 71.738ms, % non-child: 0.27%) ExecOption: Codegen Enabled - BuildTime: 55.856ms - GetNewBlockTime: 536.233us - GetResultsTime: 11.202ms - HTResizeTime: 14.300ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153469806) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.91K (225907) - RowsReturnedRate: 8.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.975us EXCHANGE_NODE (id=11):(Total: 26s297ms, non-child: 15.478ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.19 MB (6486475) - ConvertRowBatchTime: 4.371ms - DeserializeRowBatchTimer: 38.917ms - FirstBatchArrivalWaitTime: 26s209ms - PeakMemoryUsage: 0 - RowsReturned: 225.91K (225907) - RowsReturnedRate: 8.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:58 (host=vb0232.halxg.cloudera.com:22000):(Total: 26s705ms, non-child: 3.679ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 47 (47) - PeakMemoryUsage: 146.40 MB (153512150) - PerHostPeakMemUsage: 1.60 GB (1720365752) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s306ms - TotalNetworkSendTime: 335.108us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s663ms - SysTime: 17.997ms - UserTime: 342.948ms - VoluntaryContextSwitches: 431 (431) Fragment Instance Lifecycle Timings: - ExecTime: 655.944us - ExecTreeExecTime: 3.328us - OpenTime: 26s663ms - ExecTreeOpenTime: 26s388ms - PrepareTime: 41.959ms - ExecTreePrepareTime: 748.124us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 109.716us, non-child: 109.716us, % non-child: 100.00%) - BytesSent: 337.00 B (337) - NetworkThroughput(*): 4.90 MB/sec - OverallThroughput: 2.93 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 22.708us - TransmitDataRPCTime: 65.548us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 311.631ms, non-child: 311.631ms, % non-child: 100.00%) - CodegenTime: 4.368ms - CompileTime: 61.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 211.071ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 38.124ms SORT_NODE (id=6):(Total: 26s389ms, non-child: 8.029ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.818ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s381ms, non-child: 70.414ms, % non-child: 0.27%) ExecOption: Codegen Enabled - BuildTime: 54.975ms - GetNewBlockTime: 414.584us - GetResultsTime: 11.053ms - HTResizeTime: 13.991ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153469806) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.89K (225894) - RowsReturnedRate: 8.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.604us EXCHANGE_NODE (id=11):(Total: 26s311ms, non-child: 11.409ms, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6484575) - ConvertRowBatchTime: 4.339ms - DeserializeRowBatchTimer: 26.926ms - FirstBatchArrivalWaitTime: 26s220ms - PeakMemoryUsage: 0 - RowsReturned: 225.89K (225894) - RowsReturnedRate: 8.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:57 (host=vb0226.halxg.cloudera.com:22000):(Total: 26s703ms, non-child: 4.282ms, % non-child: 0.02%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 127.82 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 63 (63) - PeakMemoryUsage: 146.41 MB (153518171) - PerHostPeakMemUsage: 1.60 GB (1720782789) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s247ms - TotalNetworkSendTime: 257.680us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s655ms - SysTime: 14.998ms - UserTime: 393.940ms - VoluntaryContextSwitches: 375 (375) Fragment Instance Lifecycle Timings: - ExecTime: 516.740us - ExecTreeExecTime: 5.424us - OpenTime: 26s655ms - ExecTreeOpenTime: 26s343ms - PrepareTime: 48.356ms - ExecTreePrepareTime: 758.236us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 94.424us, non-child: 94.424us, % non-child: 100.00%) - BytesSent: 365.00 B (365) - NetworkThroughput(*): 7.01 MB/sec - OverallThroughput: 3.69 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.248us - TransmitDataRPCTime: 49.636us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 354.512ms, non-child: 354.512ms, % non-child: 100.00%) - CodegenTime: 5.616ms - CompileTime: 60.095ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 249.693ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 44.041ms SORT_NODE (id=6):(Total: 26s344ms, non-child: 8.865ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.599ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s335ms, non-child: 82.851ms, % non-child: 0.31%) ExecOption: Codegen Enabled - BuildTime: 69.120ms - GetNewBlockTime: 468.956us - GetResultsTime: 9.206ms - HTResizeTime: 17.753ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.04K (226044) - RowsReturnedRate: 8.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.068us EXCHANGE_NODE (id=11):(Total: 26s253ms, non-child: 17.172ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.19 MB (6490506) - ConvertRowBatchTime: 4.893ms - DeserializeRowBatchTimer: 38.946ms - FirstBatchArrivalWaitTime: 26s177ms - PeakMemoryUsage: 0 - RowsReturned: 226.04K (226044) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:4e (host=vb0234.halxg.cloudera.com:22000):(Total: 26s703ms, non-child: 4.012ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 54 (54) - PeakMemoryUsage: 146.42 MB (153530432) - PerHostPeakMemUsage: 1.62 GB (1742277852) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s161ms - TotalNetworkSendTime: 352.096us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s657ms - SysTime: 19.997ms - UserTime: 479.928ms - VoluntaryContextSwitches: 218 (218) Fragment Instance Lifecycle Timings: - ExecTime: 594.496us - ExecTreeExecTime: 4.612us - OpenTime: 26s656ms - ExecTreeOpenTime: 26s286ms - PrepareTime: 46.489ms - ExecTreePrepareTime: 987.412us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 82.164us, non-child: 82.164us, % non-child: 100.00%) - BytesSent: 354.00 B (354) - NetworkThroughput(*): 6.70 MB/sec - OverallThroughput: 4.11 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.172us - TransmitDataRPCTime: 50.356us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 411.725ms, non-child: 411.725ms, % non-child: 100.00%) - CodegenTime: 5.866ms - CompileTime: 62.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 306.785ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 42.081ms SORT_NODE (id=6):(Total: 26s287ms, non-child: 8.871ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.656ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s278ms, non-child: 108.629ms, % non-child: 0.41%) ExecOption: Codegen Enabled - BuildTime: 90.963ms - GetNewBlockTime: 280.468us - GetResultsTime: 12.188ms - HTResizeTime: 21.791ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.51K (226511) - RowsReturnedRate: 8.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.736us EXCHANGE_NODE (id=11):(Total: 26s170ms, non-child: 15.204ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6502309) - ConvertRowBatchTime: 7.639ms - DeserializeRowBatchTimer: 24.745ms - FirstBatchArrivalWaitTime: 26s120ms - PeakMemoryUsage: 0 - RowsReturned: 226.51K (226511) - RowsReturnedRate: 8.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:51 (host=vb0220.halxg.cloudera.com:22000):(Total: 26s703ms, non-child: 3.687ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 49 (49) - PeakMemoryUsage: 146.42 MB (153530432) - PerHostPeakMemUsage: 1.60 GB (1720580914) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s308ms - TotalNetworkSendTime: 421.988us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s663ms - SysTime: 14.997ms - UserTime: 345.947ms - VoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 710.224us - ExecTreeExecTime: 4.544us - OpenTime: 26s663ms - ExecTreeOpenTime: 26s388ms - PrepareTime: 40.379ms - ExecTreePrepareTime: 736.764us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 77.996us, non-child: 77.996us, % non-child: 100.00%) - BytesSent: 368.00 B (368) - NetworkThroughput(*): 9.93 MB/sec - OverallThroughput: 4.50 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 19.112us - TransmitDataRPCTime: 35.332us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 310.980ms, non-child: 310.980ms, % non-child: 100.00%) - CodegenTime: 4.172ms - CompileTime: 61.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.052ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 36.266ms SORT_NODE (id=6):(Total: 26s388ms, non-child: 8.165ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.932ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s380ms, non-child: 67.363ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 50.753ms - GetNewBlockTime: 307.320us - GetResultsTime: 11.255ms - HTResizeTime: 11.785ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.65K (225653) - RowsReturnedRate: 8.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.112us EXCHANGE_NODE (id=11):(Total: 26s313ms, non-child: 18.916ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6479847) - ConvertRowBatchTime: 4.361ms - DeserializeRowBatchTimer: 38.609ms - FirstBatchArrivalWaitTime: 26s222ms - PeakMemoryUsage: 0 - RowsReturned: 225.65K (225653) - RowsReturnedRate: 8.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:52 (host=vb0216.halxg.cloudera.com:22000):(Total: 26s703ms, non-child: 3.331ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1720638349) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s302ms - TotalNetworkSendTime: 433.216us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s658ms - SysTime: 17.997ms - UserTime: 341.948ms - VoluntaryContextSwitches: 431 (431) Fragment Instance Lifecycle Timings: - ExecTime: 659.644us - ExecTreeExecTime: 4.164us - OpenTime: 26s657ms - ExecTreeOpenTime: 26s382ms - PrepareTime: 45.891ms - ExecTreePrepareTime: 861.732us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 64.912us, non-child: 64.912us, % non-child: 100.00%) - BytesSent: 355.00 B (355) - NetworkThroughput(*): 12.68 MB/sec - OverallThroughput: 5.22 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 15.896us - TransmitDataRPCTime: 26.692us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 316.961ms, non-child: 316.961ms, % non-child: 100.00%) - CodegenTime: 3.988ms - CompileTime: 60.160ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 214.186ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 42.033ms SORT_NODE (id=6):(Total: 26s383ms, non-child: 8.163ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.953ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s374ms, non-child: 67.872ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 51.554ms - GetNewBlockTime: 364.444us - GetResultsTime: 11.437ms - HTResizeTime: 12.714ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.39K (226386) - RowsReturnedRate: 8.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.168us EXCHANGE_NODE (id=11):(Total: 26s307ms, non-child: 18.059ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6499160) - ConvertRowBatchTime: 4.367ms - DeserializeRowBatchTimer: 38.358ms - FirstBatchArrivalWaitTime: 26s215ms - PeakMemoryUsage: 0 - RowsReturned: 226.39K (226386) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:54 (host=vb0208.halxg.cloudera.com:22000):(Total: 26s702ms, non-child: 3.336ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 84.66 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.59 GB (1704156328) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s300ms - TotalNetworkSendTime: 342.892us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s652ms - SysTime: 17.998ms - UserTime: 337.948ms - VoluntaryContextSwitches: 428 (428) Fragment Instance Lifecycle Timings: - ExecTime: 598.488us - ExecTreeExecTime: 4.700us - OpenTime: 26s652ms - ExecTreeOpenTime: 26s378ms - PrepareTime: 49.836ms - ExecTreePrepareTime: 710.096us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 99.412us, non-child: 99.412us, % non-child: 100.00%) - BytesSent: 371.00 B (371) - NetworkThroughput(*): 6.98 MB/sec - OverallThroughput: 3.56 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.616us - TransmitDataRPCTime: 50.724us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 319.845ms, non-child: 319.845ms, % non-child: 100.00%) - CodegenTime: 4.072ms - CompileTime: 60.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 212.825ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 46.157ms SORT_NODE (id=6):(Total: 26s378ms, non-child: 7.832ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.636ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s370ms, non-child: 65.063ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 51.135ms - GetNewBlockTime: 340.028us - GetResultsTime: 9.588ms - HTResizeTime: 12.320ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.99K (226986) - RowsReturnedRate: 8.61 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.384us EXCHANGE_NODE (id=11):(Total: 26s305ms, non-child: 18.623ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.72 MB - BytesReceived: 6.22 MB (6518936) - ConvertRowBatchTime: 4.290ms - DeserializeRowBatchTimer: 39.092ms - FirstBatchArrivalWaitTime: 26s213ms - PeakMemoryUsage: 0 - RowsReturned: 226.99K (226986) - RowsReturnedRate: 8.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:4b (host=vb0230.halxg.cloudera.com:22000):(Total: 26s701ms, non-child: 3.280ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.29 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 45 (45) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.59 GB (1709651561) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s253ms - TotalNetworkSendTime: 309.824us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s651ms - SysTime: 24.996ms - UserTime: 374.943ms - VoluntaryContextSwitches: 242 (242) Fragment Instance Lifecycle Timings: - ExecTime: 522.135us - ExecTreeExecTime: 4.540us - OpenTime: 26s651ms - ExecTreeOpenTime: 26s373ms - PrepareTime: 49.699ms - ExecTreePrepareTime: 857.028us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 102.536us, non-child: 102.536us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 6.91 MB/sec - OverallThroughput: 3.33 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 19.676us - TransmitDataRPCTime: 49.416us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 323.747ms, non-child: 323.747ms, % non-child: 100.00%) - CodegenTime: 4.034ms - CompileTime: 62.688ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 214.548ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 45.887ms SORT_NODE (id=6):(Total: 26s373ms, non-child: 8.378ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.127ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s365ms, non-child: 103.567ms, % non-child: 0.39%) ExecOption: Codegen Enabled - BuildTime: 86.825ms - GetNewBlockTime: 383.620us - GetResultsTime: 11.646ms - HTResizeTime: 20.864ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.06K (225064) - RowsReturnedRate: 8.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.048us EXCHANGE_NODE (id=11):(Total: 26s261ms, non-child: 14.516ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.16 MB (6463479) - ConvertRowBatchTime: 7.240ms - DeserializeRowBatchTimer: 24.493ms - FirstBatchArrivalWaitTime: 26s209ms - PeakMemoryUsage: 0 - RowsReturned: 225.06K (225064) - RowsReturnedRate: 8.57 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:4c (host=vb0212.halxg.cloudera.com:22000):(Total: 26s700ms, non-child: 3.316ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 145.87 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 45 (45) - PeakMemoryUsage: 146.44 MB (153552810) - PerHostPeakMemUsage: 1.60 GB (1720527823) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s300ms - TotalNetworkSendTime: 357.309us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s660ms - SysTime: 19.996ms - UserTime: 343.948ms - VoluntaryContextSwitches: 379 (379) Fragment Instance Lifecycle Timings: - ExecTime: 563.699us - ExecTreeExecTime: 4.163us - OpenTime: 26s659ms - ExecTreeOpenTime: 26s390ms - PrepareTime: 40.755ms - ExecTreePrepareTime: 831.652us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 88.163us, non-child: 88.163us, % non-child: 100.00%) - BytesSent: 348.00 B (348) - NetworkThroughput(*): 11.39 MB/sec - OverallThroughput: 3.76 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 31.389us - TransmitDataRPCTime: 29.127us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 305.673ms, non-child: 305.673ms, % non-child: 100.00%) - CodegenTime: 4.045ms - CompileTime: 59.247ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 208.861ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 36.990ms SORT_NODE (id=6):(Total: 26s391ms, non-child: 8.631ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.397ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s383ms, non-child: 76.586ms, % non-child: 0.29%) ExecOption: Codegen Enabled - BuildTime: 60.981ms - GetNewBlockTime: 618.136us - GetResultsTime: 10.904ms - HTResizeTime: 15.498ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.55K (226547) - RowsReturnedRate: 8.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.162us EXCHANGE_NODE (id=11):(Total: 26s306ms, non-child: 11.538ms, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.97 MB - BytesReceived: 6.21 MB (6507927) - ConvertRowBatchTime: 4.902ms - DeserializeRowBatchTimer: 21.571ms - FirstBatchArrivalWaitTime: 26s227ms - PeakMemoryUsage: 0 - RowsReturned: 226.55K (226547) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:4d (host=vb0224.halxg.cloudera.com:22000):(Total: 26s700ms, non-child: 4.688ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1721109855) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s308ms - TotalNetworkSendTime: 333.292us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s661ms - SysTime: 11.998ms - UserTime: 344.948ms - VoluntaryContextSwitches: 451 (451) Fragment Instance Lifecycle Timings: - ExecTime: 576.616us - ExecTreeExecTime: 4.652us - OpenTime: 26s661ms - ExecTreeOpenTime: 26s383ms - PrepareTime: 39.207ms - ExecTreePrepareTime: 710.852us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 82.564us, non-child: 82.564us, % non-child: 100.00%) - BytesSent: 369.00 B (369) - NetworkThroughput(*): 9.71 MB/sec - OverallThroughput: 4.26 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.332us - TransmitDataRPCTime: 36.260us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 311.762ms, non-child: 311.762ms, % non-child: 100.00%) - CodegenTime: 5.442ms - CompileTime: 60.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 216.173ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 34.149ms SORT_NODE (id=6):(Total: 26s384ms, non-child: 7.950ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.711ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s376ms, non-child: 63.211ms, % non-child: 0.24%) ExecOption: Codegen Enabled - BuildTime: 47.536ms - GetNewBlockTime: 254.976us - GetResultsTime: 10.740ms - HTResizeTime: 11.051ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.57K (226574) - RowsReturnedRate: 8.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.840us EXCHANGE_NODE (id=11):(Total: 26s312ms, non-child: 17.605ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6506112) - ConvertRowBatchTime: 4.058ms - DeserializeRowBatchTimer: 37.755ms - FirstBatchArrivalWaitTime: 26s219ms - PeakMemoryUsage: 0 - RowsReturned: 226.57K (226574) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:50 (host=vb0204.halxg.cloudera.com:22000):(Total: 26s700ms, non-child: 3.637ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 42 (42) - PeakMemoryUsage: 146.42 MB (153530432) - PerHostPeakMemUsage: 1.54 GB (1653945909) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s305ms - TotalNetworkSendTime: 205.118us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s660ms - SysTime: 22.996ms - UserTime: 337.948ms - VoluntaryContextSwitches: 429 (429) Fragment Instance Lifecycle Timings: - ExecTime: 395.771us - ExecTreeExecTime: 4.387us - OpenTime: 26s660ms - ExecTreeOpenTime: 26s379ms - PrepareTime: 40.157ms - ExecTreePrepareTime: 553.390us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 81.239us, non-child: 81.239us, % non-child: 100.00%) - BytesSent: 349.00 B (349) - NetworkThroughput(*): 7.12 MB/sec - OverallThroughput: 4.10 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.129us - TransmitDataRPCTime: 46.776us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 317.139ms, non-child: 317.139ms, % non-child: 100.00%) - CodegenTime: 6.066ms - CompileTime: 60.214ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 219.780ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 36.136ms SORT_NODE (id=6):(Total: 26s379ms, non-child: 8.139ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.937ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s371ms, non-child: 61.699ms, % non-child: 0.23%) ExecOption: Codegen Enabled - BuildTime: 48.271ms - GetNewBlockTime: 251.823us - GetResultsTime: 9.438ms - HTResizeTime: 11.415ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.75K (225750) - RowsReturnedRate: 8.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 928.000ns EXCHANGE_NODE (id=11):(Total: 26s309ms, non-child: 17.823ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6481743) - ConvertRowBatchTime: 4.048ms - DeserializeRowBatchTimer: 38.237ms - FirstBatchArrivalWaitTime: 26s216ms - PeakMemoryUsage: 0 - RowsReturned: 225.75K (225750) - RowsReturnedRate: 8.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:4f (host=vb0218.halxg.cloudera.com:22000):(Total: 26s699ms, non-child: 3.414ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.29 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.38 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1720722065) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s295ms - TotalNetworkSendTime: 356.340us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s649ms - SysTime: 9.999ms - UserTime: 347.947ms - VoluntaryContextSwitches: 453 (453) Fragment Instance Lifecycle Timings: - ExecTime: 733.152us - ExecTreeExecTime: 4.820us - OpenTime: 26s648ms - ExecTreeOpenTime: 26s374ms - PrepareTime: 51.054ms - ExecTreePrepareTime: 755.360us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 76.220us, non-child: 76.220us, % non-child: 100.00%) - BytesSent: 353.00 B (353) - NetworkThroughput(*): 10.14 MB/sec - OverallThroughput: 4.42 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.200us - TransmitDataRPCTime: 33.184us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 320.980ms, non-child: 320.980ms, % non-child: 100.00%) - CodegenTime: 4.124ms - CompileTime: 58.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 214.184ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 47.344ms SORT_NODE (id=6):(Total: 26s375ms, non-child: 7.887ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.691ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s367ms, non-child: 66.822ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 52.177ms - GetNewBlockTime: 251.596us - GetResultsTime: 10.097ms - HTResizeTime: 12.185ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.56K (226556) - RowsReturnedRate: 8.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.080us EXCHANGE_NODE (id=11):(Total: 26s300ms, non-child: 16.480ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 28.20 KB - BytesReceived: 6.20 MB (6505080) - ConvertRowBatchTime: 4.389ms - DeserializeRowBatchTimer: 37.035ms - FirstBatchArrivalWaitTime: 26s211ms - PeakMemoryUsage: 0 - RowsReturned: 226.56K (226556) - RowsReturnedRate: 8.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 4s675ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:26s648ms max:26s683ms mean: 26s658ms stddev:10.488ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.01 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 304 (304) - PeakMemoryUsage: 302.81 MB (317516591) - PerHostPeakMemUsage: 1.60 GB (1714962635) - RowsProduced: 226.27K (226273) - TotalNetworkReceiveTime: 25s580ms - TotalNetworkSendTime: 3.799ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s741ms - SysTime: 107.849ms - UserTime: 1s190ms - VoluntaryContextSwitches: 7.55K (7553) Fragment Instance Lifecycle Timings: - ExecTime: 21s981ms - ExecTreeExecTime: 21s873ms - OpenTime: 4s618ms - ExecTreeOpenTime: 4s223ms - PrepareTime: 57.042ms - ExecTreePrepareTime: 875.116us DataStreamSender (dst_id=11):(Total: 67.535ms, non-child: 67.535ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6497187) - NetworkThroughput(*): 314.32 MB/sec - OverallThroughput: 92.66 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.27K (226273) - SerializeBatchTime: 46.525ms - TransmitDataRPCTime: 20.855ms - UncompressedRowBatchSize: 13.60 MB (14257945) CodeGen:(Total: 432.573ms, non-child: 432.573ms, % non-child: 100.00%) - CodegenTime: 7.899ms - CompileTime: 109.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 284.842ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 37.745ms AGGREGATION_NODE (id=5):(Total: 26s097ms, non-child: 223.469ms, % non-child: 0.86%) - GetNewBlockTime: 505.667us - GetResultsTime: 9.947ms - HTResizeTime: 22.716ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.57 MB (152646429) - PinTime: 0.000ns - ReductionFactorEstimate: 17.47 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.67 K/sec - StreamingTime: 204.666ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s874ms, non-child: 236.539ms, % non-child: 0.91%) - BuildRows: 599.72K (599724) - BuildTime: 122.048ms - PeakMemoryUsage: 153.17 MB (160605520) - ProbeRows: 1.51M (1512369) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 222.768ms - RowsReturned: 597.67K (597671) - RowsReturnedRate: 23.10 K/sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 77.689ms - BuildRowsPartitioned: 599.72K (599724) - GetNewBlockTime: 235.447us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.245ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.266ms, non-child: 13.266ms, % non-child: 100.00%) - BytesReceived: 7.42 MB (7784991) - ConvertRowBatchTime: 10.333ms - DeserializeRowBatchTimer: 43.785ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.72K (599724) - RowsReturnedRate: 45.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s638ms, non-child: 25s638ms, % non-child: 100.00%) - BytesReceived: 66.34 MB (69566456) - ConvertRowBatchTime: 47.852ms - DeserializeRowBatchTimer: 376.098ms - FirstBatchArrivalWaitTime: 4s175ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512369) - RowsReturnedRate: 58.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F04: Instance de4b40c22a7cb446:47 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s679ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.88 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.89 MB, 159.26 MB, 159.37 MB, 167.47 MB, 167.43 MB, 167.39 MB, 168.51 MB, 168.53 MB, 168.49 MB, 168.33 MB, 168.45 MB, 168.47 MB, 168.43 MB, 168.29 MB, 168.47 MB, 170.45 MB, 170.29 MB, 170.43 MB, 170.45 MB, 170.49 MB, 170.45 MB, 170.39 MB, 170.49 MB, 170.31 MB, 170.31 MB, 170.56 MB, 170.29 MB, 170.31 MB, 178.51 MB, 298.33 MB, 298.51 MB, 298.54 MB, 299.08 MB, 302.56 MB, 302.49 MB, 302.54 MB, 302.37 MB, 302.41 MB, 302.31 MB, 302.41 MB, 302.45 MB, 302.49 MB, 302.29 MB, 302.43 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 247 (247) - PeakMemoryUsage: 302.78 MB (317489421) - PerHostPeakMemUsage: 1.59 GB (1707342219) - RowsProduced: 226.70K (226701) - TotalNetworkReceiveTime: 25s559ms - TotalNetworkSendTime: 3.797ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s729ms - SysTime: 97.985ms - UserTime: 1s217ms - VoluntaryContextSwitches: 7.51K (7509) Fragment Instance Lifecycle Timings: - ExecTime: 21s978ms - ExecTreeExecTime: 21s872ms - OpenTime: 4s618ms - ExecTreeOpenTime: 4s240ms - PrepareTime: 61.203ms - ExecTreePrepareTime: 770.169us DataStreamSender (dst_id=11):(Total: 69.484ms, non-child: 69.484ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6510094) - NetworkThroughput(*): 270.46 MB/sec - OverallThroughput: 89.35 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.70K (226701) - SerializeBatchTime: 46.389ms - TransmitDataRPCTime: 22.955ms - UncompressedRowBatchSize: 13.62 MB (14284911) CodeGen:(Total: 416.882ms, non-child: 416.882ms, % non-child: 100.00%) - CodegenTime: 7.625ms - CompileTime: 108.608ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 267.990ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 39.799ms AGGREGATION_NODE (id=5):(Total: 26s113ms, non-child: 241.336ms, % non-child: 0.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 483.438us - GetResultsTime: 9.592ms - HTResizeTime: 26.227ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.47 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.70K (226701) - RowsReturnedRate: 8.68 K/sec - StreamingTime: 222.358ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s872ms, non-child: 248.033ms, % non-child: 0.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.40K (599400) - BuildTime: 113.946ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1513156) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 233.862ms - RowsReturned: 598.55K (598547) - RowsReturnedRate: 23.13 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 70.635ms - BuildRowsPartitioned: 599.40K (599400) - GetNewBlockTime: 246.350us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.669ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.960ms, non-child: 12.960ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7782684) - ConvertRowBatchTime: 10.150ms - DeserializeRowBatchTimer: 42.495ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.40K (599400) - RowsReturnedRate: 46.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s624ms, non-child: 110.381ms, % non-child: 0.43%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.08 MB, 2.64 MB, 4.18 MB, 5.75 MB, 7.30 MB, 8.90 MB, 10.48 MB, 12.06 MB, 13.66 MB, 15.30 MB, 16.92 MB, 18.55 MB, 20.19 MB, 21.84 MB, 23.48 MB, 25.10 MB, 26.73 MB, 28.36 MB, 29.98 MB, 31.62 MB, 33.22 MB, 34.85 MB, 36.47 MB, 38.06 MB, 39.67 MB, 41.27 MB, 42.90 MB, 44.48 MB, 46.14 MB, 47.72 MB, 49.38 MB, 51.01 MB, 52.67 MB, 54.30 MB, 55.98 MB, 57.57 MB, 59.20 MB, 60.84 MB, 62.37 MB, 63.88 MB, 65.03 MB, 65.86 MB, 66.13 MB, 66.27 MB - BytesReceived: 66.38 MB (69602700) - ConvertRowBatchTime: 53.620ms - DeserializeRowBatchTimer: 289.953ms - FirstBatchArrivalWaitTime: 4s191ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1513156) - RowsReturnedRate: 59.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:45 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s678ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 4.47 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.83 MB, 159.45 MB, 159.39 MB, 167.51 MB, 167.39 MB, 167.39 MB, 168.33 MB, 168.33 MB, 168.45 MB, 168.45 MB, 168.39 MB, 168.39 MB, 168.29 MB, 168.39 MB, 169.10 MB, 170.45 MB, 170.31 MB, 170.31 MB, 170.39 MB, 170.31 MB, 170.45 MB, 170.29 MB, 170.37 MB, 170.41 MB, 170.56 MB, 170.43 MB, 170.45 MB, 170.45 MB, 210.29 MB, 298.33 MB, 298.29 MB, 298.33 MB, 300.56 MB, 302.58 MB, 302.39 MB, 302.41 MB, 302.58 MB, 302.37 MB, 302.47 MB, 302.37 MB, 302.41 MB, 302.39 MB, 302.37 MB, 58.69 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 378 (378) - PeakMemoryUsage: 302.83 MB (317543947) - PerHostPeakMemUsage: 1.59 GB (1704156328) - RowsProduced: 226.75K (226754) - TotalNetworkReceiveTime: 25s556ms - TotalNetworkSendTime: 3.971ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s731ms - SysTime: 124.981ms - UserTime: 1s198ms - VoluntaryContextSwitches: 7.49K (7489) Fragment Instance Lifecycle Timings: - ExecTime: 21s971ms - ExecTreeExecTime: 21s869ms - OpenTime: 4s621ms - ExecTreeOpenTime: 4s232ms - PrepareTime: 57.053ms - ExecTreePrepareTime: 919.980us DataStreamSender (dst_id=11):(Total: 70.145ms, non-child: 70.145ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6510470) - NetworkThroughput(*): 254.68 MB/sec - OverallThroughput: 88.51 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.75K (226754) - SerializeBatchTime: 45.623ms - TransmitDataRPCTime: 24.378ms - UncompressedRowBatchSize: 13.63 MB (14288258) CodeGen:(Total: 424.229ms, non-child: 424.229ms, % non-child: 100.00%) - CodegenTime: 7.632ms - CompileTime: 109.355ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 278.338ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 35.982ms AGGREGATION_NODE (id=5):(Total: 26s102ms, non-child: 235.482ms, % non-child: 0.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 577.984us - GetResultsTime: 9.300ms - HTResizeTime: 27.983ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.45 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.75K (226754) - RowsReturnedRate: 8.69 K/sec - StreamingTime: 217.539ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s867ms, non-child: 247.615ms, % non-child: 0.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.12K (599125) - BuildTime: 119.620ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510659) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 233.961ms - RowsReturned: 598.24K (598243) - RowsReturnedRate: 23.13 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 74.182ms - BuildRowsPartitioned: 599.12K (599125) - GetNewBlockTime: 241.300us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.159ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.794ms, non-child: 12.794ms, % non-child: 100.00%) BytesReceived(500.000ms): 219.80 KB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7779068) - ConvertRowBatchTime: 9.989ms - DeserializeRowBatchTimer: 42.526ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.12K (599125) - RowsReturnedRate: 46.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s620ms, non-child: 104.871ms, % non-child: 0.41%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.50 MB, 3.04 MB, 4.63 MB, 6.21 MB, 7.77 MB, 9.37 MB, 10.94 MB, 12.52 MB, 14.14 MB, 15.75 MB, 17.39 MB, 19.00 MB, 20.62 MB, 22.23 MB, 23.88 MB, 25.49 MB, 27.14 MB, 28.76 MB, 30.36 MB, 32.03 MB, 33.66 MB, 35.22 MB, 36.86 MB, 38.49 MB, 40.14 MB, 41.74 MB, 43.32 MB, 44.90 MB, 46.53 MB, 48.12 MB, 49.78 MB, 51.41 MB, 53.02 MB, 54.66 MB, 56.29 MB, 57.91 MB, 59.56 MB, 61.18 MB, 62.70 MB, 64.14 MB, 65.19 MB, 65.85 MB, 66.07 MB - BytesReceived: 66.27 MB (69485802) - ConvertRowBatchTime: 51.960ms - DeserializeRowBatchTimer: 291.796ms - FirstBatchArrivalWaitTime: 4s180ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510659) - RowsReturnedRate: 58.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:41 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s678ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.27 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.81 MB, 159.18 MB, 159.41 MB, 167.45 MB, 167.45 MB, 167.43 MB, 168.43 MB, 168.43 MB, 168.33 MB, 168.43 MB, 168.37 MB, 168.43 MB, 168.56 MB, 168.60 MB, 168.43 MB, 170.56 MB, 170.43 MB, 170.37 MB, 170.45 MB, 170.56 MB, 170.39 MB, 170.47 MB, 170.45 MB, 170.31 MB, 170.43 MB, 170.58 MB, 170.39 MB, 170.43 MB, 178.41 MB, 298.49 MB, 298.37 MB, 298.29 MB, 298.91 MB, 302.53 MB, 302.31 MB, 302.43 MB, 302.54 MB, 302.53 MB, 302.39 MB, 302.43 MB, 302.29 MB, 302.35 MB, 302.33 MB, 302.45 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 255 (255) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.54 GB (1653945909) - RowsProduced: 226.01K (226011) - TotalNetworkReceiveTime: 25s611ms - TotalNetworkSendTime: 3.703ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s735ms - SysTime: 87.986ms - UserTime: 1s153ms - VoluntaryContextSwitches: 7.59K (7587) Fragment Instance Lifecycle Timings: - ExecTime: 21s971ms - ExecTreeExecTime: 21s867ms - OpenTime: 4s629ms - ExecTreeOpenTime: 4s244ms - PrepareTime: 49.186ms - ExecTreePrepareTime: 462.052us DataStreamSender (dst_id=11):(Total: 70.922ms, non-child: 70.922ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490700) - NetworkThroughput(*): 252.77 MB/sec - OverallThroughput: 87.28 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226011) - SerializeBatchTime: 46.299ms - TransmitDataRPCTime: 24.488ms - UncompressedRowBatchSize: 13.58 MB (14241429) CodeGen:(Total: 422.558ms, non-child: 422.558ms, % non-child: 100.00%) - CodegenTime: 7.024ms - CompileTime: 108.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 275.125ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 38.696ms AGGREGATION_NODE (id=5):(Total: 26s112ms, non-child: 201.458ms, % non-child: 0.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 372.324us - GetResultsTime: 9.266ms - HTResizeTime: 16.866ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.50 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226011) - RowsReturnedRate: 8.65 K/sec - StreamingTime: 183.453ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s911ms, non-child: 244.030ms, % non-child: 0.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.14K (600137) - BuildTime: 116.442ms - PeakMemoryUsage: 153.17 MB (160605436) - ProbeRows: 1.51M (1511370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 227.909ms - RowsReturned: 597.66K (597663) - RowsReturnedRate: 23.07 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 71.935ms - BuildRowsPartitioned: 600.14K (600137) - GetNewBlockTime: 184.110us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.630ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.810ms, non-child: 12.810ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7789263) - ConvertRowBatchTime: 10.112ms - DeserializeRowBatchTimer: 45.020ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.14K (600137) - RowsReturnedRate: 46.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s667ms, non-child: 106.748ms, % non-child: 0.42%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.05 MB, 2.58 MB, 4.15 MB, 5.74 MB, 7.31 MB, 8.87 MB, 10.44 MB, 12.02 MB, 13.59 MB, 15.20 MB, 16.80 MB, 18.40 MB, 20.07 MB, 21.70 MB, 23.33 MB, 24.97 MB, 26.61 MB, 28.25 MB, 29.85 MB, 31.48 MB, 33.11 MB, 34.72 MB, 36.32 MB, 37.96 MB, 39.60 MB, 41.23 MB, 42.85 MB, 44.48 MB, 46.05 MB, 47.66 MB, 49.31 MB, 50.95 MB, 52.57 MB, 54.19 MB, 55.84 MB, 57.48 MB, 59.14 MB, 60.79 MB, 62.34 MB, 63.80 MB, 64.95 MB, 65.79 MB, 66.06 MB, 66.20 MB - BytesReceived: 66.30 MB (69520250) - ConvertRowBatchTime: 44.882ms - DeserializeRowBatchTimer: 479.788ms - FirstBatchArrivalWaitTime: 4s192ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1511370) - RowsReturnedRate: 58.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:46 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s677ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.45 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.93 MB, 159.48 MB, 159.53 MB, 167.45 MB, 167.41 MB, 167.35 MB, 168.29 MB, 168.53 MB, 168.39 MB, 168.45 MB, 168.43 MB, 168.53 MB, 168.58 MB, 168.35 MB, 168.64 MB, 170.53 MB, 170.31 MB, 170.33 MB, 170.39 MB, 170.43 MB, 170.41 MB, 170.39 MB, 170.49 MB, 170.47 MB, 170.47 MB, 170.45 MB, 170.49 MB, 170.54 MB, 186.43 MB, 298.49 MB, 298.39 MB, 298.43 MB, 299.47 MB, 302.43 MB, 302.58 MB, 302.33 MB, 302.31 MB, 302.51 MB, 302.47 MB, 302.43 MB, 302.53 MB, 302.35 MB, 302.41 MB, 302.43 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 280 (280) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720823652) - RowsProduced: 226.60K (226605) - TotalNetworkReceiveTime: 25s617ms - TotalNetworkSendTime: 3.580ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s751ms - SysTime: 111.982ms - UserTime: 1s148ms - VoluntaryContextSwitches: 7.60K (7601) Fragment Instance Lifecycle Timings: - ExecTime: 21s978ms - ExecTreeExecTime: 21s875ms - OpenTime: 4s625ms - ExecTreeOpenTime: 4s227ms - PrepareTime: 52.213ms - ExecTreePrepareTime: 867.504us DataStreamSender (dst_id=11):(Total: 57.757ms, non-child: 57.757ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6509268) - NetworkThroughput(*): 443.58 MB/sec - OverallThroughput: 107.48 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.60K (226605) - SerializeBatchTime: 43.614ms - TransmitDataRPCTime: 13.994ms - UncompressedRowBatchSize: 13.62 MB (14278859) CodeGen:(Total: 432.900ms, non-child: 432.900ms, % non-child: 100.00%) - CodegenTime: 7.246ms - CompileTime: 109.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 287.818ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 34.876ms AGGREGATION_NODE (id=5):(Total: 26s103ms, non-child: 215.156ms, % non-child: 0.82%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 642.110us - GetResultsTime: 10.683ms - HTResizeTime: 24.993ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.44 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.60K (226605) - RowsReturnedRate: 8.68 K/sec - StreamingTime: 195.691ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s888ms, non-child: 217.222ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.91K (599908) - BuildTime: 126.834ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 203.961ms - RowsReturned: 597.80K (597802) - RowsReturnedRate: 23.09 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.094ms - BuildRowsPartitioned: 599.91K (599908) - GetNewBlockTime: 248.412us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.161ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.973ms, non-child: 13.973ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7786938) - ConvertRowBatchTime: 10.897ms - DeserializeRowBatchTimer: 44.930ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.91K (599908) - RowsReturnedRate: 42.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s671ms, non-child: 102.460ms, % non-child: 0.40%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.19 MB, 2.72 MB, 4.29 MB, 5.83 MB, 7.42 MB, 9.01 MB, 10.57 MB, 12.15 MB, 13.80 MB, 15.40 MB, 17.00 MB, 18.62 MB, 20.27 MB, 21.91 MB, 23.55 MB, 25.14 MB, 26.79 MB, 28.41 MB, 30.02 MB, 31.65 MB, 33.26 MB, 34.82 MB, 36.48 MB, 38.09 MB, 39.75 MB, 41.35 MB, 42.94 MB, 44.54 MB, 46.16 MB, 47.76 MB, 49.37 MB, 51.02 MB, 52.65 MB, 54.34 MB, 55.93 MB, 57.57 MB, 59.22 MB, 60.84 MB, 62.39 MB, 63.86 MB, 65.03 MB, 65.85 MB, 66.10 MB, 66.24 MB - BytesReceived: 66.34 MB (69563781) - ConvertRowBatchTime: 44.618ms - DeserializeRowBatchTimer: 488.144ms - FirstBatchArrivalWaitTime: 4s175ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512100) - RowsReturnedRate: 58.90 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:49 (host=vb0232.halxg.cloudera.com:22000):(Total: 4s677ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 25.95 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.89 MB, 158.95 MB, 159.41 MB, 163.95 MB, 167.49 MB, 167.43 MB, 168.23 MB, 168.29 MB, 168.31 MB, 168.33 MB, 168.35 MB, 168.41 MB, 168.56 MB, 168.49 MB, 168.33 MB, 170.23 MB, 170.33 MB, 170.58 MB, 170.31 MB, 170.51 MB, 170.47 MB, 170.29 MB, 170.41 MB, 170.39 MB, 170.35 MB, 170.49 MB, 170.45 MB, 170.41 MB, 170.51 MB, 258.51 MB, 298.33 MB, 298.45 MB, 298.37 MB, 301.97 MB, 302.37 MB, 302.43 MB, 302.33 MB, 302.33 MB, 302.41 MB, 302.51 MB, 302.43 MB, 302.43 MB, 302.43 MB, 302.41 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 246 (246) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1720365752) - RowsProduced: 226.34K (226342) - TotalNetworkReceiveTime: 25s676ms - TotalNetworkSendTime: 3.799ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s729ms - SysTime: 95.985ms - UserTime: 1s075ms - VoluntaryContextSwitches: 7.58K (7577) Fragment Instance Lifecycle Timings: - ExecTime: 21s972ms - ExecTreeExecTime: 21s873ms - OpenTime: 4s616ms - ExecTreeOpenTime: 4s233ms - PrepareTime: 60.903ms - ExecTreePrepareTime: 1.013ms DataStreamSender (dst_id=11):(Total: 63.270ms, non-child: 63.270ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6499661) - NetworkThroughput(*): 351.70 MB/sec - OverallThroughput: 97.97 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.34K (226342) - SerializeBatchTime: 45.515ms - TransmitDataRPCTime: 17.624ms - UncompressedRowBatchSize: 13.60 MB (14262290) CodeGen:(Total: 424.397ms, non-child: 424.397ms, % non-child: 100.00%) - CodegenTime: 6.952ms - CompileTime: 108.645ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 274.090ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 40.962ms AGGREGATION_NODE (id=5):(Total: 26s107ms, non-child: 183.626ms, % non-child: 0.70%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 440.608us - GetResultsTime: 9.307ms - HTResizeTime: 17.928ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.46 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.34K (226342) - RowsReturnedRate: 8.67 K/sec - StreamingTime: 166.691ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s923ms, non-child: 203.619ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.57K (599574) - BuildTime: 120.433ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510381) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 191.455ms - RowsReturned: 597.67K (597669) - RowsReturnedRate: 23.05 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.425ms - BuildRowsPartitioned: 599.57K (599574) - GetNewBlockTime: 180.980us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.065ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.676ms, non-child: 12.676ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.02 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7782885) - ConvertRowBatchTime: 9.893ms - DeserializeRowBatchTimer: 45.008ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.57K (599574) - RowsReturnedRate: 47.30 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s720ms, non-child: 81.989ms, % non-child: 0.32%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 554.37 KB, 2.14 MB, 3.70 MB, 5.28 MB, 6.87 MB, 8.47 MB, 10.07 MB, 11.68 MB, 13.26 MB, 14.85 MB, 16.44 MB, 18.08 MB, 19.67 MB, 21.30 MB, 22.94 MB, 24.56 MB, 26.16 MB, 27.80 MB, 29.39 MB, 31.05 MB, 32.65 MB, 34.28 MB, 35.90 MB, 37.51 MB, 39.11 MB, 40.74 MB, 42.34 MB, 43.95 MB, 45.56 MB, 47.18 MB, 48.81 MB, 50.44 MB, 52.06 MB, 53.68 MB, 55.35 MB, 56.95 MB, 58.60 MB, 60.23 MB, 61.79 MB, 63.31 MB, 64.62 MB, 65.57 MB, 65.92 MB, 66.14 MB - BytesReceived: 66.26 MB (69480901) - ConvertRowBatchTime: 36.897ms - DeserializeRowBatchTimer: 334.835ms - FirstBatchArrivalWaitTime: 4s184ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510381) - RowsReturnedRate: 58.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:43 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s676ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 25.84 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.91 MB, 158.95 MB, 159.43 MB, 161.89 MB, 167.39 MB, 167.39 MB, 168.08 MB, 168.39 MB, 168.39 MB, 168.37 MB, 168.47 MB, 168.43 MB, 168.56 MB, 168.35 MB, 168.41 MB, 170.23 MB, 170.33 MB, 170.47 MB, 170.54 MB, 170.47 MB, 170.49 MB, 170.33 MB, 170.47 MB, 170.29 MB, 170.45 MB, 170.37 MB, 170.39 MB, 170.56 MB, 170.35 MB, 258.37 MB, 298.51 MB, 298.37 MB, 298.47 MB, 302.29 MB, 302.35 MB, 302.41 MB, 302.43 MB, 302.58 MB, 302.39 MB, 302.41 MB, 302.35 MB, 302.47 MB, 302.31 MB, 302.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 289 (289) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720638349) - RowsProduced: 226.41K (226407) - TotalNetworkReceiveTime: 25s638ms - TotalNetworkSendTime: 3.821ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s731ms - SysTime: 93.986ms - UserTime: 1s142ms - VoluntaryContextSwitches: 7.61K (7612) Fragment Instance Lifecycle Timings: - ExecTime: 21s971ms - ExecTreeExecTime: 21s871ms - OpenTime: 4s622ms - ExecTreeOpenTime: 4s249ms - PrepareTime: 53.962ms - ExecTreePrepareTime: 781.580us DataStreamSender (dst_id=11):(Total: 69.192ms, non-child: 69.192ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6500108) - NetworkThroughput(*): 253.88 MB/sec - OverallThroughput: 89.59 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.41K (226407) - SerializeBatchTime: 44.623ms - TransmitDataRPCTime: 24.417ms - UncompressedRowBatchSize: 13.61 MB (14266377) CodeGen:(Total: 407.443ms, non-child: 407.443ms, % non-child: 100.00%) - CodegenTime: 7.853ms - CompileTime: 108.948ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 263.188ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 34.806ms AGGREGATION_NODE (id=5):(Total: 26s121ms, non-child: 202.520ms, % non-child: 0.78%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 486.956us - GetResultsTime: 9.298ms - HTResizeTime: 19.691ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.55 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.41K (226407) - RowsReturnedRate: 8.67 K/sec - StreamingTime: 185.220ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s919ms, non-child: 230.537ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.69K (600689) - BuildTime: 118.114ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1514342) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 217.922ms - RowsReturned: 599.40K (599405) - RowsReturnedRate: 23.12 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.073ms - BuildRowsPartitioned: 600.69K (600689) - GetNewBlockTime: 228.796us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.770ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.641ms, non-child: 13.641ms, % non-child: 100.00%) BytesReceived(500.000ms): 6.98 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7796195) - ConvertRowBatchTime: 10.148ms - DeserializeRowBatchTimer: 44.057ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.69K (600689) - RowsReturnedRate: 44.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s689ms, non-child: 95.360ms, % non-child: 0.37%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 516.86 KB, 2.14 MB, 3.70 MB, 5.26 MB, 6.83 MB, 8.40 MB, 10.00 MB, 11.64 MB, 13.21 MB, 14.81 MB, 16.43 MB, 18.04 MB, 19.67 MB, 21.27 MB, 22.92 MB, 24.58 MB, 26.20 MB, 27.83 MB, 29.45 MB, 31.11 MB, 32.74 MB, 34.34 MB, 35.97 MB, 37.59 MB, 39.24 MB, 40.82 MB, 42.45 MB, 44.05 MB, 45.66 MB, 47.26 MB, 48.89 MB, 50.53 MB, 52.15 MB, 53.78 MB, 55.42 MB, 57.02 MB, 58.65 MB, 60.29 MB, 61.91 MB, 63.45 MB, 64.77 MB, 65.72 MB, 66.10 MB, 66.32 MB - BytesReceived: 66.44 MB (69666005) - ConvertRowBatchTime: 42.331ms - DeserializeRowBatchTimer: 467.457ms - FirstBatchArrivalWaitTime: 4s203ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1514342) - RowsReturnedRate: 58.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:48 (host=vb0226.halxg.cloudera.com:22000):(Total: 4s676ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 14.97 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.58 MB, 159.01 MB, 159.47 MB, 159.53 MB, 167.49 MB, 167.43 MB, 167.45 MB, 168.45 MB, 168.37 MB, 168.45 MB, 168.43 MB, 168.41 MB, 168.39 MB, 168.35 MB, 168.60 MB, 169.56 MB, 170.35 MB, 170.35 MB, 170.33 MB, 170.47 MB, 170.31 MB, 170.37 MB, 170.54 MB, 170.43 MB, 170.37 MB, 170.31 MB, 170.41 MB, 170.53 MB, 170.55 MB, 210.43 MB, 298.43 MB, 298.29 MB, 298.37 MB, 300.70 MB, 302.56 MB, 302.39 MB, 302.41 MB, 302.37 MB, 302.37 MB, 302.47 MB, 302.37 MB, 302.35 MB, 302.53 MB, 302.49 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 229 (229) - PeakMemoryUsage: 302.76 MB (317465939) - PerHostPeakMemUsage: 1.60 GB (1720782789) - RowsProduced: 226.01K (226010) - TotalNetworkReceiveTime: 25s668ms - TotalNetworkSendTime: 4.226ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s759ms - SysTime: 86.986ms - UserTime: 1s123ms - VoluntaryContextSwitches: 7.62K (7617) Fragment Instance Lifecycle Timings: - ExecTime: 21s998ms - ExecTreeExecTime: 21s878ms - OpenTime: 4s627ms - ExecTreeOpenTime: 4s251ms - PrepareTime: 48.906ms - ExecTreePrepareTime: 835.936us DataStreamSender (dst_id=11):(Total: 77.096ms, non-child: 77.096ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6489678) - NetworkThroughput(*): 261.74 MB/sec - OverallThroughput: 80.28 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226010) - SerializeBatchTime: 53.302ms - TransmitDataRPCTime: 23.645ms - UncompressedRowBatchSize: 13.58 MB (14241366) CodeGen:(Total: 407.113ms, non-child: 407.113ms, % non-child: 100.00%) - CodegenTime: 7.681ms - CompileTime: 108.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 266.105ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 31.566ms AGGREGATION_NODE (id=5):(Total: 26s130ms, non-child: 188.677ms, % non-child: 0.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 426.236us - GetResultsTime: 10.478ms - HTResizeTime: 16.307ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.50 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226010) - RowsReturnedRate: 8.65 K/sec - StreamingTime: 170.085ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s941ms, non-child: 229.146ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.76K (599760) - BuildTime: 115.180ms - PeakMemoryUsage: 153.17 MB (160607530) - ProbeRows: 1.51M (1512321) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 216.197ms - RowsReturned: 597.51K (597507) - RowsReturnedRate: 23.03 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 70.131ms - BuildRowsPartitioned: 599.76K (599760) - GetNewBlockTime: 273.340us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.189ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.314ms, non-child: 13.314ms, % non-child: 100.00%) BytesReceived(500.000ms): 3.55 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7785357) - ConvertRowBatchTime: 10.463ms - DeserializeRowBatchTimer: 44.746ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.76K (599760) - RowsReturnedRate: 45.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s712ms, non-child: 88.273ms, % non-child: 0.34%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 71.64 KB, 1.81 MB, 3.32 MB, 4.91 MB, 6.51 MB, 8.10 MB, 9.66 MB, 11.26 MB, 12.84 MB, 14.44 MB, 16.05 MB, 17.71 MB, 19.31 MB, 20.96 MB, 22.55 MB, 24.22 MB, 25.85 MB, 27.47 MB, 29.08 MB, 30.71 MB, 32.34 MB, 33.94 MB, 35.59 MB, 37.20 MB, 38.79 MB, 40.38 MB, 42.00 MB, 43.63 MB, 45.21 MB, 46.78 MB, 48.39 MB, 50.05 MB, 51.65 MB, 53.30 MB, 54.93 MB, 56.56 MB, 58.22 MB, 59.82 MB, 61.45 MB, 62.96 MB, 64.40 MB, 65.43 MB, 65.96 MB, 66.17 MB - BytesReceived: 66.34 MB (69560320) - ConvertRowBatchTime: 36.690ms - DeserializeRowBatchTimer: 465.476ms - FirstBatchArrivalWaitTime: 4s204ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512321) - RowsReturnedRate: 58.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:3c (host=vb0230.halxg.cloudera.com:22000):(Total: 4s675ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.34 MB, 32.36 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.04 MB, 159.42 MB, 159.39 MB, 167.51 MB, 167.29 MB, 167.51 MB, 168.54 MB, 168.53 MB, 168.33 MB, 168.43 MB, 168.33 MB, 168.37 MB, 168.47 MB, 168.31 MB, 168.43 MB, 170.47 MB, 170.45 MB, 170.45 MB, 170.45 MB, 170.43 MB, 170.35 MB, 170.39 MB, 170.47 MB, 170.54 MB, 170.39 MB, 170.39 MB, 170.54 MB, 170.31 MB, 186.31 MB, 298.33 MB, 298.39 MB, 298.47 MB, 300.06 MB, 302.39 MB, 302.45 MB, 302.51 MB, 302.56 MB, 302.43 MB, 302.51 MB, 302.53 MB, 302.49 MB, 302.49 MB, 302.43 MB, 302.51 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 292 (292) - PeakMemoryUsage: 302.86 MB (317567429) - PerHostPeakMemUsage: 1.59 GB (1709651561) - RowsProduced: 226.57K (226567) - TotalNetworkReceiveTime: 25s605ms - TotalNetworkSendTime: 3.668ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s747ms - SysTime: 103.984ms - UserTime: 1s156ms - VoluntaryContextSwitches: 7.61K (7605) Fragment Instance Lifecycle Timings: - ExecTime: 21s981ms - ExecTreeExecTime: 21s873ms - OpenTime: 4s615ms - ExecTreeOpenTime: 4s199ms - PrepareTime: 59.219ms - ExecTreePrepareTime: 1.051ms DataStreamSender (dst_id=11):(Total: 58.080ms, non-child: 58.080ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6506930) - NetworkThroughput(*): 460.20 MB/sec - OverallThroughput: 106.84 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.57K (226567) - SerializeBatchTime: 44.441ms - TransmitDataRPCTime: 13.484ms - UncompressedRowBatchSize: 13.62 MB (14276469) CodeGen:(Total: 458.260ms, non-child: 458.260ms, % non-child: 100.00%) - CodegenTime: 7.804ms - CompileTime: 109.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 305.133ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 42.857ms AGGREGATION_NODE (id=5):(Total: 26s073ms, non-child: 206.212ms, % non-child: 0.79%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 608.292us - GetResultsTime: 10.868ms - HTResizeTime: 17.794ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.49 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.57K (226567) - RowsReturnedRate: 8.69 K/sec - StreamingTime: 186.276ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s867ms, non-child: 211.601ms, % non-child: 0.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.56K (599564) - BuildTime: 129.945ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1514078) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 198.464ms - RowsReturned: 599.07K (599068) - RowsReturnedRate: 23.16 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.465ms - BuildRowsPartitioned: 599.56K (599564) - GetNewBlockTime: 182.508us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.200ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.285ms, non-child: 13.285ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7784667) - ConvertRowBatchTime: 10.278ms - DeserializeRowBatchTimer: 46.503ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.56K (599564) - RowsReturnedRate: 45.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s656ms, non-child: 96.332ms, % non-child: 0.38%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.24 MB, 2.78 MB, 4.36 MB, 5.89 MB, 7.51 MB, 9.08 MB, 10.68 MB, 12.29 MB, 13.90 MB, 15.51 MB, 17.09 MB, 18.73 MB, 20.38 MB, 22.02 MB, 23.65 MB, 25.28 MB, 26.93 MB, 28.55 MB, 30.21 MB, 31.82 MB, 33.45 MB, 35.04 MB, 36.69 MB, 38.29 MB, 39.93 MB, 41.50 MB, 43.14 MB, 44.74 MB, 46.32 MB, 47.95 MB, 49.55 MB, 51.20 MB, 52.84 MB, 54.45 MB, 56.09 MB, 57.73 MB, 59.38 MB, 60.97 MB, 62.58 MB, 64.07 MB, 65.18 MB, 65.93 MB, 66.18 MB, 66.39 MB - BytesReceived: 66.41 MB (69636256) - ConvertRowBatchTime: 41.187ms - DeserializeRowBatchTimer: 471.619ms - FirstBatchArrivalWaitTime: 4s151ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1514078) - RowsReturnedRate: 59.01 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:40 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.38 MB, 149.42 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.97 MB, 159.33 MB, 159.33 MB, 167.54 MB, 167.39 MB, 167.43 MB, 168.43 MB, 168.39 MB, 168.45 MB, 168.43 MB, 168.54 MB, 168.53 MB, 168.31 MB, 168.45 MB, 168.54 MB, 170.29 MB, 170.56 MB, 170.31 MB, 170.35 MB, 170.45 MB, 170.31 MB, 170.54 MB, 170.37 MB, 170.33 MB, 170.47 MB, 170.45 MB, 170.53 MB, 170.35 MB, 186.43 MB, 290.41 MB, 298.53 MB, 298.41 MB, 299.54 MB, 302.37 MB, 302.41 MB, 302.45 MB, 302.39 MB, 302.53 MB, 302.41 MB, 302.41 MB, 302.41 MB, 302.51 MB, 302.58 MB, 149.26 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 410 (410) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720722065) - RowsProduced: 225.69K (225687) - TotalNetworkReceiveTime: 25s515ms - TotalNetworkSendTime: 3.431ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s727ms - SysTime: 118.981ms - UserTime: 1s253ms - VoluntaryContextSwitches: 7.49K (7489) Fragment Instance Lifecycle Timings: - ExecTime: 21s972ms - ExecTreeExecTime: 21s871ms - OpenTime: 4s613ms - ExecTreeOpenTime: 4s214ms - PrepareTime: 61.408ms - ExecTreePrepareTime: 1.154ms DataStreamSender (dst_id=11):(Total: 68.523ms, non-child: 68.523ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6479844) - NetworkThroughput(*): 264.08 MB/sec - OverallThroughput: 90.18 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.69K (225687) - SerializeBatchTime: 44.950ms - TransmitDataRPCTime: 23.400ms - UncompressedRowBatchSize: 13.56 MB (14221013) CodeGen:(Total: 437.381ms, non-child: 437.381ms, % non-child: 100.00%) - CodegenTime: 7.871ms - CompileTime: 109.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 288.078ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 39.618ms AGGREGATION_NODE (id=5):(Total: 26s087ms, non-child: 249.214ms, % non-child: 0.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 456.556us - GetResultsTime: 9.533ms - HTResizeTime: 25.303ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.49 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.69K (225687) - RowsReturnedRate: 8.65 K/sec - StreamingTime: 230.437ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s838ms, non-child: 255.702ms, % non-child: 0.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 598.38K (598376) - BuildTime: 122.761ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512081) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 241.221ms - RowsReturned: 596.11K (596109) - RowsReturnedRate: 23.07 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.991ms - BuildRowsPartitioned: 598.38K (598376) - GetNewBlockTime: 276.176us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.790ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.954ms, non-child: 12.954ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB - BytesReceived: 7.41 MB (7767126) - ConvertRowBatchTime: 10.070ms - DeserializeRowBatchTimer: 42.858ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 598.38K (598376) - RowsReturnedRate: 46.19 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s583ms, non-child: 114.961ms, % non-child: 0.45%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.33 MB, 2.86 MB, 4.43 MB, 6.00 MB, 7.55 MB, 9.14 MB, 10.76 MB, 12.35 MB, 13.95 MB, 15.57 MB, 17.19 MB, 18.79 MB, 20.41 MB, 22.09 MB, 23.72 MB, 25.34 MB, 26.94 MB, 28.58 MB, 30.21 MB, 31.82 MB, 33.47 MB, 35.06 MB, 36.69 MB, 38.29 MB, 39.93 MB, 41.53 MB, 43.14 MB, 44.76 MB, 46.33 MB, 47.94 MB, 49.57 MB, 51.22 MB, 52.85 MB, 54.49 MB, 56.12 MB, 57.75 MB, 59.35 MB, 60.98 MB, 62.55 MB, 64.03 MB, 65.15 MB, 65.87 MB, 66.12 MB - BytesReceived: 66.34 MB (69558691) - ConvertRowBatchTime: 55.413ms - DeserializeRowBatchTimer: 275.502ms - FirstBatchArrivalWaitTime: 4s167ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512081) - RowsReturnedRate: 59.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:3e (host=vb0224.halxg.cloudera.com:22000):(Total: 4s674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.87 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.87 MB, 158.93 MB, 159.33 MB, 167.35 MB, 167.29 MB, 167.39 MB, 168.54 MB, 168.39 MB, 168.29 MB, 168.51 MB, 168.51 MB, 168.33 MB, 168.47 MB, 168.45 MB, 168.60 MB, 170.33 MB, 170.54 MB, 170.49 MB, 170.45 MB, 170.56 MB, 170.56 MB, 170.41 MB, 170.56 MB, 170.35 MB, 170.47 MB, 170.45 MB, 170.31 MB, 170.29 MB, 170.45 MB, 290.49 MB, 298.31 MB, 298.35 MB, 298.83 MB, 302.37 MB, 302.43 MB, 302.51 MB, 302.29 MB, 302.29 MB, 302.53 MB, 302.31 MB, 302.49 MB, 302.35 MB, 302.33 MB, 302.39 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 370 (370) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1721109855) - RowsProduced: 225.92K (225919) - TotalNetworkReceiveTime: 25s506ms - TotalNetworkSendTime: 4.172ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s744ms - SysTime: 118.981ms - UserTime: 1s264ms - VoluntaryContextSwitches: 7.50K (7503) Fragment Instance Lifecycle Timings: - ExecTime: 21s972ms - ExecTreeExecTime: 21s870ms - OpenTime: 4s623ms - ExecTreeOpenTime: 4s219ms - PrepareTime: 50.672ms - ExecTreePrepareTime: 824.972us DataStreamSender (dst_id=11):(Total: 67.719ms, non-child: 67.719ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6485440) - NetworkThroughput(*): 271.42 MB/sec - OverallThroughput: 91.33 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.92K (225919) - SerializeBatchTime: 44.783ms - TransmitDataRPCTime: 22.787ms - UncompressedRowBatchSize: 13.58 MB (14235637) CodeGen:(Total: 437.188ms, non-child: 437.188ms, % non-child: 100.00%) - CodegenTime: 7.350ms - CompileTime: 108.557ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 294.841ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 33.233ms AGGREGATION_NODE (id=5):(Total: 26s090ms, non-child: 256.784ms, % non-child: 0.98%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 557.584us - GetResultsTime: 9.285ms - HTResizeTime: 27.849ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.46 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.92K (225919) - RowsReturnedRate: 8.66 K/sec - StreamingTime: 238.484ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s833ms, non-child: 258.564ms, % non-child: 1.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.57K (600572) - BuildTime: 128.485ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510897) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 243.521ms - RowsReturned: 596.62K (596623) - RowsReturnedRate: 23.09 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.526ms - BuildRowsPartitioned: 600.57K (600572) - GetNewBlockTime: 243.492us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.353ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.196ms, non-child: 13.196ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7793061) - ConvertRowBatchTime: 10.200ms - DeserializeRowBatchTimer: 42.826ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.57K (600572) - RowsReturnedRate: 45.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s575ms, non-child: 117.279ms, % non-child: 0.46%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 954.68 KB, 2.45 MB, 3.97 MB, 5.56 MB, 7.15 MB, 8.71 MB, 10.31 MB, 11.91 MB, 13.48 MB, 15.10 MB, 16.72 MB, 18.35 MB, 19.98 MB, 21.59 MB, 23.23 MB, 24.86 MB, 26.53 MB, 28.12 MB, 29.77 MB, 31.39 MB, 33.01 MB, 34.65 MB, 36.29 MB, 37.89 MB, 39.52 MB, 41.13 MB, 42.73 MB, 44.34 MB, 45.93 MB, 47.52 MB, 49.16 MB, 50.79 MB, 52.44 MB, 54.09 MB, 55.73 MB, 57.33 MB, 58.95 MB, 60.56 MB, 62.15 MB, 63.62 MB, 64.86 MB, 65.70 MB, 66.01 MB, 66.17 MB - BytesReceived: 66.28 MB (69501076) - ConvertRowBatchTime: 56.922ms - DeserializeRowBatchTimer: 289.221ms - FirstBatchArrivalWaitTime: 4s175ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510897) - RowsReturnedRate: 59.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:3f (host=vb0234.halxg.cloudera.com:22000):(Total: 4s674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.82 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.10 MB, 159.06 MB, 159.51 MB, 167.35 MB, 167.33 MB, 167.33 MB, 168.39 MB, 168.49 MB, 168.53 MB, 168.45 MB, 168.56 MB, 168.33 MB, 168.33 MB, 168.41 MB, 168.35 MB, 170.47 MB, 170.41 MB, 170.43 MB, 170.47 MB, 170.33 MB, 170.39 MB, 170.31 MB, 170.29 MB, 170.41 MB, 170.58 MB, 170.47 MB, 170.45 MB, 170.39 MB, 170.35 MB, 290.43 MB, 298.33 MB, 298.31 MB, 298.83 MB, 302.35 MB, 302.39 MB, 302.51 MB, 302.58 MB, 302.47 MB, 302.37 MB, 302.43 MB, 302.41 MB, 302.33 MB, 302.39 MB, 302.54 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 269 (269) - PeakMemoryUsage: 302.88 MB (317587727) - PerHostPeakMemUsage: 1.62 GB (1742277852) - RowsProduced: 225.71K (225710) - TotalNetworkReceiveTime: 25s603ms - TotalNetworkSendTime: 3.091ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s730ms - SysTime: 100.984ms - UserTime: 1s152ms - VoluntaryContextSwitches: 7.58K (7580) Fragment Instance Lifecycle Timings: - ExecTime: 21s981ms - ExecTreeExecTime: 21s875ms - OpenTime: 4s607ms - ExecTreeOpenTime: 4s202ms - PrepareTime: 67.102ms - ExecTreePrepareTime: 890.680us DataStreamSender (dst_id=11):(Total: 58.015ms, non-child: 58.015ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6479109) - NetworkThroughput(*): 453.64 MB/sec - OverallThroughput: 106.51 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.71K (225710) - SerializeBatchTime: 44.237ms - TransmitDataRPCTime: 13.620ms - UncompressedRowBatchSize: 13.56 MB (14222462) CodeGen:(Total: 449.121ms, non-child: 449.121ms, % non-child: 100.00%) - CodegenTime: 10.540ms - CompileTime: 113.747ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 289.448ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 45.238ms AGGREGATION_NODE (id=5):(Total: 26s077ms, non-child: 202.731ms, % non-child: 0.78%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 401.228us - GetResultsTime: 10.179ms - HTResizeTime: 16.246ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.71K (225710) - RowsReturnedRate: 8.65 K/sec - StreamingTime: 183.467ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s875ms, non-child: 219.669ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.10K (599100) - BuildTime: 121.407ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512589) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 206.036ms - RowsReturned: 597.23K (597231) - RowsReturnedRate: 23.08 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 76.617ms - BuildRowsPartitioned: 599.10K (599100) - GetNewBlockTime: 229.076us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.394ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.600ms, non-child: 13.600ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7777264) - ConvertRowBatchTime: 10.743ms - DeserializeRowBatchTimer: 43.812ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.10K (599100) - RowsReturnedRate: 44.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s656ms, non-child: 95.684ms, % non-child: 0.37%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 974.07 KB, 2.51 MB, 4.05 MB, 5.60 MB, 7.17 MB, 8.78 MB, 10.38 MB, 11.95 MB, 13.58 MB, 15.16 MB, 16.78 MB, 18.39 MB, 20.00 MB, 21.65 MB, 23.29 MB, 24.91 MB, 26.50 MB, 28.13 MB, 29.77 MB, 31.41 MB, 33.00 MB, 34.68 MB, 36.28 MB, 37.91 MB, 39.56 MB, 41.13 MB, 42.78 MB, 44.37 MB, 45.97 MB, 47.58 MB, 49.20 MB, 50.81 MB, 52.42 MB, 54.07 MB, 55.70 MB, 57.32 MB, 58.97 MB, 60.63 MB, 62.20 MB, 63.71 MB, 64.91 MB, 65.78 MB, 66.07 MB, 66.23 MB - BytesReceived: 66.34 MB (69565162) - ConvertRowBatchTime: 43.151ms - DeserializeRowBatchTimer: 468.668ms - FirstBatchArrivalWaitTime: 4s155ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512589) - RowsReturnedRate: 58.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:3d (host=vb0212.halxg.cloudera.com:22000):(Total: 4s674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 10.08 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.44 MB, 158.95 MB, 159.37 MB, 159.49 MB, 167.45 MB, 167.33 MB, 167.37 MB, 168.43 MB, 168.33 MB, 168.39 MB, 168.45 MB, 168.29 MB, 168.47 MB, 168.39 MB, 168.33 MB, 168.68 MB, 170.33 MB, 170.33 MB, 170.49 MB, 170.43 MB, 170.45 MB, 170.45 MB, 170.51 MB, 170.47 MB, 170.31 MB, 170.31 MB, 170.37 MB, 170.31 MB, 170.49 MB, 194.56 MB, 298.58 MB, 298.33 MB, 298.41 MB, 300.56 MB, 302.35 MB, 302.45 MB, 302.37 MB, 302.43 MB, 302.47 MB, 302.56 MB, 302.35 MB, 302.43 MB, 302.56 MB, 302.29 MB, 13.34 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 398 (398) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1720527823) - RowsProduced: 226.01K (226006) - TotalNetworkReceiveTime: 25s551ms - TotalNetworkSendTime: 2.823ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s750ms - SysTime: 133.979ms - UserTime: 1s221ms - VoluntaryContextSwitches: 7.51K (7512) Fragment Instance Lifecycle Timings: - ExecTime: 21s982ms - ExecTreeExecTime: 21s875ms - OpenTime: 4s622ms - ExecTreeOpenTime: 4s234ms - PrepareTime: 51.625ms - ExecTreePrepareTime: 733.894us DataStreamSender (dst_id=11):(Total: 59.479ms, non-child: 59.479ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490905) - NetworkThroughput(*): 412.48 MB/sec - OverallThroughput: 104.07 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226006) - SerializeBatchTime: 44.293ms - TransmitDataRPCTime: 15.007ms - UncompressedRowBatchSize: 13.58 MB (14241118) CodeGen:(Total: 417.092ms, non-child: 417.092ms, % non-child: 100.00%) - CodegenTime: 7.501ms - CompileTime: 109.677ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 277.625ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 29.241ms AGGREGATION_NODE (id=5):(Total: 26s110ms, non-child: 250.822ms, % non-child: 0.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 542.319us - GetResultsTime: 10.352ms - HTResizeTime: 29.277ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.41 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226006) - RowsReturnedRate: 8.65 K/sec - StreamingTime: 231.223ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s859ms, non-child: 242.654ms, % non-child: 0.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.51K (599515) - BuildTime: 125.973ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1509753) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 228.865ms - RowsReturned: 595.84K (595842) - RowsReturnedRate: 23.04 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.042ms - BuildRowsPartitioned: 599.51K (599515) - GetNewBlockTime: 220.343us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.027ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.999ms, non-child: 12.999ms, % non-child: 100.00%) BytesReceived(500.000ms): 2.00 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7780749) - ConvertRowBatchTime: 10.076ms - DeserializeRowBatchTimer: 38.112ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.51K (599515) - RowsReturnedRate: 46.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s616ms, non-child: 111.230ms, % non-child: 0.43%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.68 KB, 1.69 MB, 3.23 MB, 4.81 MB, 6.36 MB, 7.93 MB, 9.52 MB, 11.11 MB, 12.68 MB, 14.29 MB, 15.93 MB, 17.52 MB, 19.13 MB, 20.76 MB, 22.39 MB, 24.00 MB, 25.67 MB, 27.29 MB, 28.88 MB, 30.56 MB, 32.14 MB, 33.76 MB, 35.40 MB, 37.00 MB, 38.60 MB, 40.25 MB, 41.85 MB, 43.48 MB, 45.04 MB, 46.65 MB, 48.23 MB, 49.88 MB, 51.49 MB, 53.13 MB, 54.74 MB, 56.40 MB, 58.02 MB, 59.67 MB, 61.26 MB, 62.79 MB, 64.17 MB, 65.24 MB, 65.84 MB, 66.04 MB - BytesReceived: 66.23 MB (69444584) - ConvertRowBatchTime: 54.129ms - DeserializeRowBatchTimer: 283.178ms - FirstBatchArrivalWaitTime: 4s186ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1509753) - RowsReturnedRate: 58.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:4a (host=vb0228.halxg.cloudera.com:22000):(Total: 4s674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 3.80 MB, 144.03 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.04 MB, 159.53 MB, 159.37 MB, 167.35 MB, 167.51 MB, 167.39 MB, 168.49 MB, 168.54 MB, 168.41 MB, 168.45 MB, 168.43 MB, 168.45 MB, 168.43 MB, 168.39 MB, 168.82 MB, 170.45 MB, 170.33 MB, 170.29 MB, 170.43 MB, 170.37 MB, 170.33 MB, 170.49 MB, 170.60 MB, 170.29 MB, 170.29 MB, 170.45 MB, 170.39 MB, 170.45 MB, 226.43 MB, 298.35 MB, 298.39 MB, 298.49 MB, 300.29 MB, 302.35 MB, 302.56 MB, 302.51 MB, 302.39 MB, 302.51 MB, 302.31 MB, 302.43 MB, 302.39 MB, 302.39 MB, 302.31 MB, 104.02 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 268 (268) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.60 GB (1720283702) - RowsProduced: 226.65K (226646) - TotalNetworkReceiveTime: 25s556ms - TotalNetworkSendTime: 3.841ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s743ms - SysTime: 101.984ms - UserTime: 1s205ms - VoluntaryContextSwitches: 7.57K (7570) Fragment Instance Lifecycle Timings: - ExecTime: 21s998ms - ExecTreeExecTime: 21s880ms - OpenTime: 4s603ms - ExecTreeOpenTime: 4s182ms - PrepareTime: 70.470ms - ExecTreePrepareTime: 957.008us DataStreamSender (dst_id=11):(Total: 74.639ms, non-child: 74.639ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6508318) - NetworkThroughput(*): 256.19 MB/sec - OverallThroughput: 83.16 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.65K (226646) - SerializeBatchTime: 50.229ms - TransmitDataRPCTime: 24.227ms - UncompressedRowBatchSize: 13.62 MB (14281446) CodeGen:(Total: 468.584ms, non-child: 468.584ms, % non-child: 100.00%) - CodegenTime: 10.936ms - CompileTime: 108.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 311.056ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 48.178ms AGGREGATION_NODE (id=5):(Total: 26s063ms, non-child: 217.825ms, % non-child: 0.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 497.876us - GetResultsTime: 10.227ms - HTResizeTime: 21.201ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.40 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.65K (226646) - RowsReturnedRate: 8.70 K/sec - StreamingTime: 198.897ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s845ms, non-child: 233.576ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.85K (600846) - BuildTime: 121.341ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510992) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 220.112ms - RowsReturned: 598.18K (598176) - RowsReturnedRate: 23.14 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 76.952ms - BuildRowsPartitioned: 600.85K (600846) - GetNewBlockTime: 261.248us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.943ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.317ms, non-child: 13.317ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7800113) - ConvertRowBatchTime: 10.334ms - DeserializeRowBatchTimer: 43.372ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.85K (600846) - RowsReturnedRate: 45.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s612ms, non-child: 104.984ms, % non-child: 0.41%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.47 MB, 3.03 MB, 4.58 MB, 6.14 MB, 7.70 MB, 9.26 MB, 10.87 MB, 12.47 MB, 14.03 MB, 15.66 MB, 17.23 MB, 18.85 MB, 20.47 MB, 22.11 MB, 23.71 MB, 25.32 MB, 26.98 MB, 28.62 MB, 30.25 MB, 31.89 MB, 33.49 MB, 35.09 MB, 36.71 MB, 38.33 MB, 39.98 MB, 41.58 MB, 43.17 MB, 44.81 MB, 46.43 MB, 48.06 MB, 49.69 MB, 51.31 MB, 52.93 MB, 54.57 MB, 56.24 MB, 57.88 MB, 59.53 MB, 61.15 MB, 62.68 MB, 64.08 MB, 65.19 MB, 65.86 MB, 66.09 MB - BytesReceived: 66.29 MB (69507006) - ConvertRowBatchTime: 46.962ms - DeserializeRowBatchTimer: 467.123ms - FirstBatchArrivalWaitTime: 4s134ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510992) - RowsReturnedRate: 58.99 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:42 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s673ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 29.49 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.87 MB, 159.21 MB, 159.56 MB, 167.41 MB, 167.29 MB, 167.47 MB, 168.41 MB, 168.35 MB, 168.33 MB, 168.31 MB, 168.35 MB, 168.41 MB, 168.43 MB, 168.58 MB, 168.41 MB, 170.45 MB, 170.43 MB, 170.43 MB, 170.39 MB, 170.53 MB, 170.35 MB, 170.45 MB, 170.53 MB, 170.35 MB, 170.43 MB, 170.31 MB, 170.37 MB, 170.47 MB, 170.37 MB, 298.49 MB, 298.33 MB, 298.54 MB, 299.37 MB, 302.37 MB, 302.33 MB, 302.49 MB, 302.43 MB, 302.35 MB, 302.35 MB, 302.33 MB, 302.29 MB, 302.33 MB, 302.35 MB, 302.29 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 343 (343) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1720580914) - RowsProduced: 226.65K (226652) - TotalNetworkReceiveTime: 25s510ms - TotalNetworkSendTime: 3.655ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s746ms - SysTime: 125.980ms - UserTime: 1s269ms - VoluntaryContextSwitches: 7.51K (7515) Fragment Instance Lifecycle Timings: - ExecTime: 21s976ms - ExecTreeExecTime: 21s874ms - OpenTime: 4s621ms - ExecTreeOpenTime: 4s221ms - PrepareTime: 52.327ms - ExecTreePrepareTime: 1.089ms DataStreamSender (dst_id=11):(Total: 69.959ms, non-child: 69.959ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6508315) - NetworkThroughput(*): 252.51 MB/sec - OverallThroughput: 88.72 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.65K (226652) - SerializeBatchTime: 45.227ms - TransmitDataRPCTime: 24.580ms - UncompressedRowBatchSize: 13.62 MB (14281816) CodeGen:(Total: 435.383ms, non-child: 435.383ms, % non-child: 100.00%) - CodegenTime: 7.513ms - CompileTime: 110.032ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 288.507ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 36.296ms AGGREGATION_NODE (id=5):(Total: 26s097ms, non-child: 259.187ms, % non-child: 0.99%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 718.992us - GetResultsTime: 9.650ms - HTResizeTime: 29.333ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.46 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.65K (226652) - RowsReturnedRate: 8.68 K/sec - StreamingTime: 240.094ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s837ms, non-child: 258.545ms, % non-child: 1.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.59K (599586) - BuildTime: 128.715ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.52M (1515016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 243.960ms - RowsReturned: 597.96K (597959) - RowsReturnedRate: 23.14 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 83.988ms - BuildRowsPartitioned: 599.59K (599586) - GetNewBlockTime: 241.748us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.254ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.597ms, non-child: 13.597ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB, 7.42 MB - BytesReceived: 7.42 MB (7783551) - ConvertRowBatchTime: 10.546ms - DeserializeRowBatchTimer: 44.689ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.59K (599586) - RowsReturnedRate: 44.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s579ms, non-child: 117.249ms, % non-child: 0.46%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.07 MB, 2.63 MB, 4.17 MB, 5.72 MB, 7.33 MB, 8.89 MB, 10.48 MB, 12.07 MB, 13.64 MB, 15.24 MB, 16.88 MB, 18.52 MB, 20.14 MB, 21.79 MB, 23.41 MB, 25.05 MB, 26.70 MB, 28.32 MB, 29.96 MB, 31.60 MB, 33.22 MB, 34.83 MB, 36.44 MB, 38.07 MB, 39.68 MB, 41.33 MB, 42.98 MB, 44.59 MB, 46.17 MB, 47.79 MB, 49.44 MB, 51.10 MB, 52.73 MB, 54.35 MB, 55.99 MB, 57.63 MB, 59.27 MB, 60.90 MB, 62.51 MB, 63.99 MB, 65.14 MB, 65.96 MB, 66.20 MB, 66.40 MB - BytesReceived: 66.46 MB (69688900) - ConvertRowBatchTime: 56.873ms - DeserializeRowBatchTimer: 284.211ms - FirstBatchArrivalWaitTime: 4s174ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1515016) - RowsReturnedRate: 59.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance de4b40c22a7cb446:44 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s673ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 3.90 MB, 148.41 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.87 MB, 159.33 MB, 159.33 MB, 167.39 MB, 167.35 MB, 167.45 MB, 168.39 MB, 168.49 MB, 168.53 MB, 168.53 MB, 168.37 MB, 168.39 MB, 168.45 MB, 168.49 MB, 168.94 MB, 170.29 MB, 170.47 MB, 170.45 MB, 170.35 MB, 170.35 MB, 170.45 MB, 170.54 MB, 170.47 MB, 170.60 MB, 170.41 MB, 170.51 MB, 170.37 MB, 170.54 MB, 194.33 MB, 298.37 MB, 298.45 MB, 298.41 MB, 300.33 MB, 302.31 MB, 302.43 MB, 302.49 MB, 302.39 MB, 302.51 MB, 302.51 MB, 302.39 MB, 302.47 MB, 302.41 MB, 302.39 MB, 95.08 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 294 (294) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.60 GB (1721230764) - RowsProduced: 226.08K (226079) - TotalNetworkReceiveTime: 25s524ms - TotalNetworkSendTime: 5.415ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 26s764ms - SysTime: 112.982ms - UserTime: 1s269ms - VoluntaryContextSwitches: 7.54K (7540) Fragment Instance Lifecycle Timings: - ExecTime: 22s007ms - ExecTreeExecTime: 21s877ms - OpenTime: 4s614ms - ExecTreeOpenTime: 4s198ms - PrepareTime: 59.383ms - ExecTreePrepareTime: 773.224us DataStreamSender (dst_id=11):(Total: 78.746ms, non-child: 78.746ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6488977) - NetworkThroughput(*): 255.48 MB/sec - OverallThroughput: 78.59 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.08K (226079) - SerializeBatchTime: 54.349ms - TransmitDataRPCTime: 24.222ms - UncompressedRowBatchSize: 13.59 MB (14245725) CodeGen:(Total: 450.057ms, non-child: 450.057ms, % non-child: 100.00%) - CodegenTime: 6.954ms - CompileTime: 109.387ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 305.292ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 34.821ms AGGREGATION_NODE (id=5):(Total: 26s076ms, non-child: 241.000ms, % non-child: 0.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 372.508us - GetResultsTime: 11.191ms - HTResizeTime: 23.745ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.48 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.08K (226079) - RowsReturnedRate: 8.67 K/sec - StreamingTime: 220.073ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 25s835ms, non-child: 247.572ms, % non-child: 0.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.72K (599717) - BuildTime: 121.521ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.52M (1515800) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 234.070ms - RowsReturned: 597.23K (597227) - RowsReturnedRate: 23.12 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.274ms - BuildRowsPartitioned: 599.72K (599717) - GetNewBlockTime: 273.836us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.074ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.878ms, non-child: 13.878ms, % non-child: 100.00%) BytesReceived(500.000ms): 33.83 KB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7785951) - ConvertRowBatchTime: 11.099ms - DeserializeRowBatchTimer: 45.813ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.72K (599717) - RowsReturnedRate: 43.21 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 25s588ms, non-child: 106.110ms, % non-child: 0.41%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.52 MB, 3.07 MB, 4.65 MB, 6.24 MB, 7.85 MB, 9.42 MB, 11.01 MB, 12.62 MB, 14.21 MB, 15.82 MB, 17.46 MB, 19.09 MB, 20.73 MB, 22.32 MB, 23.95 MB, 25.56 MB, 27.20 MB, 28.82 MB, 30.47 MB, 32.09 MB, 33.72 MB, 35.37 MB, 37.00 MB, 38.63 MB, 40.25 MB, 41.86 MB, 43.51 MB, 45.07 MB, 46.69 MB, 48.28 MB, 49.93 MB, 51.53 MB, 53.18 MB, 54.81 MB, 56.43 MB, 58.07 MB, 59.74 MB, 61.36 MB, 62.93 MB, 64.36 MB, 65.43 MB, 66.08 MB, 66.29 MB - BytesReceived: 66.49 MB (69715411) - ConvertRowBatchTime: 52.151ms - DeserializeRowBatchTimer: 284.497ms - FirstBatchArrivalWaitTime: 4s150ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1515800) - RowsReturnedRate: 59.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 4s685ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:26s521ms max:26s532ms mean: 26s523ms stddev:2.457ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.25K (3249) - PeakMemoryUsage: 689.83 MB (723338470) - PerHostPeakMemUsage: 1.60 GB (1714962635) - RowsProduced: 1.51M (1512369) - TotalNetworkReceiveTime: 15s525ms - TotalNetworkSendTime: 14.588ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s846ms - SysTime: 969.318ms - UserTime: 11s933ms - VoluntaryContextSwitches: 112.28K (112282) Fragment Instance Lifecycle Timings: - ExecTime: 21s836ms - ExecTreeExecTime: 19s960ms - OpenTime: 4s634ms - ExecTreeOpenTime: 4s375ms - PrepareTime: 50.689ms - ExecTreePrepareTime: 178.196us DataStreamSender (dst_id=9):(Total: 1s141ms, non-child: 1s141ms, % non-child: 100.00%) - BytesSent: 66.34 MB (69566456) - NetworkThroughput(*): 302.57 MB/sec - OverallThroughput: 59.14 MB/sec - PeakMemoryUsage: 463.44 KB (474563) - RowsReturned: 1.51M (1512369) - SerializeBatchTime: 908.123ms - TransmitDataRPCTime: 231.684ms - UncompressedRowBatchSize: 158.71 MB (166421449) CodeGen:(Total: 292.156ms, non-child: 292.156ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.080ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 179.061ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 33.436ms HASH_JOIN_NODE (id=3):(Total: 24s332ms, non-child: 7s041ms, % non-child: 28.94%) - BuildRows: 7.37M (7367283) - BuildTime: 2s793ms - PeakMemoryUsage: 649.10 MB (680635443) - ProbeRows: 64.69M (64687125) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s270ms - RowsReturned: 1.51M (1512369) - RowsReturnedRate: 62.16 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 2s150ms - BuildRowsPartitioned: 7.37M (7367283) - GetNewBlockTime: 555.497us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 608.499ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s555ms, non-child: 1s555ms, % non-child: 100.00%) - BytesReceived: 174.40 MB (182873564) - ConvertRowBatchTime: 173.835ms - DeserializeRowBatchTimer: 690.581ms - FirstBatchArrivalWaitTime: 366.288ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367283) - RowsReturnedRate: 4.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s208ms, non-child: 16s208ms, % non-child: 100.00%) - BytesReceived: 1.46 GB (1569802510) - ConvertRowBatchTime: 1s846ms - DeserializeRowBatchTimer: 7s212ms - FirstBatchArrivalWaitTime: 731.110ms - PeakMemoryUsage: 0 - RowsReturned: 64.69M (64687125) - RowsReturnedRate: 4.00 M/sec - SendersBlockedTimer: 3s453ms - SendersBlockedTotalTimer(*): 42s837ms Fragment F02: Instance de4b40c22a7cb446:2b (host=vb0226.halxg.cloudera.com:22000):(Total: 4s711ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 17.13 MB, 169.27 MB, 177.53 MB, 305.57 MB, 305.51 MB, 433.93 MB, 433.53 MB, 481.45 MB, 689.45 MB, 666.94 MB, 665.94 MB, 666.43 MB, 665.95 MB, 667.38 MB, 665.99 MB, 666.79 MB, 665.68 MB, 666.85 MB, 666.01 MB, 667.56 MB, 667.34 MB, 666.16 MB, 665.77 MB, 667.38 MB, 667.78 MB, 666.24 MB, 667.62 MB, 666.19 MB, 666.02 MB, 667.32 MB, 666.61 MB, 667.16 MB, 666.58 MB, 667.75 MB, 666.39 MB, 666.14 MB, 666.27 MB, 666.87 MB, 665.97 MB, 666.35 MB, 667.32 MB, 666.21 MB, 666.17 MB, 666.20 MB, 666.34 MB, 667.24 MB, 667.28 MB, 665.73 MB, 666.12 MB, 665.81 MB, 666.84 MB, 666.67 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.69K (3689) - PeakMemoryUsage: 690.69 MB (724236961) - PerHostPeakMemUsage: 1.60 GB (1720782789) - RowsProduced: 1.51M (1509614) - TotalNetworkReceiveTime: 15s304ms - TotalNetworkSendTime: 9.580ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s836ms - SysTime: 1s098ms - UserTime: 11s974ms - VoluntaryContextSwitches: 107.51K (107508) Fragment Instance Lifecycle Timings: - ExecTime: 21s812ms - ExecTreeExecTime: 19s889ms - OpenTime: 4s653ms - ExecTreeOpenTime: 4s370ms - PrepareTime: 57.543ms - ExecTreePrepareTime: 190.404us DataStreamSender (dst_id=9):(Total: 1s205ms, non-child: 1s205ms, % non-child: 100.00%) - BytesSent: 66.23 MB (69442492) - NetworkThroughput(*): 235.03 MB/sec - OverallThroughput: 54.95 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1509614) - SerializeBatchTime: 921.171ms - TransmitDataRPCTime: 281.775ms - UncompressedRowBatchSize: 158.42 MB (166118284) CodeGen:(Total: 322.173ms, non-child: 322.173ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 202.856ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 39.663ms HASH_JOIN_NODE (id=3):(Total: 24s256ms, non-child: 7s165ms, % non-child: 29.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.36M (7361508) - BuildTime: 2s800ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.64M (64638813) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s355ms - RowsReturned: 1.51M (1509614) - RowsReturnedRate: 62.24 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s130ms - BuildRowsPartitioned: 7.36M (7361508) - GetNewBlockTime: 521.980us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 633.381ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s542ms, non-child: 354.491ms, % non-child: 22.98%) BytesReceived(500.000ms): 0, 9.66 KB, 26.45 MB, 56.19 MB, 86.73 MB, 117.76 MB, 148.24 MB, 170.40 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB - BytesReceived: 174.27 MB (182732705) - ConvertRowBatchTime: 167.191ms - DeserializeRowBatchTimer: 639.681ms - FirstBatchArrivalWaitTime: 334.096ms - PeakMemoryUsage: 0 - RowsReturned: 7.36M (7361508) - RowsReturnedRate: 4.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s005ms, non-child: 6s727ms, % non-child: 42.04%) BytesReceived(500.000ms): 0, 0, 6.61 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 41.91 MB, 77.15 MB, 112.47 MB, 148.10 MB, 183.80 MB, 219.90 MB, 255.80 MB, 291.76 MB, 327.71 MB, 364.06 MB, 400.33 MB, 436.96 MB, 473.87 MB, 510.57 MB, 547.31 MB, 583.91 MB, 620.63 MB, 657.23 MB, 694.09 MB, 730.62 MB, 767.06 MB, 803.42 MB, 840.10 MB, 876.44 MB, 913.11 MB, 949.37 MB, 985.87 MB, 1021.61 MB, 1.03 GB, 1.07 GB, 1.10 GB, 1.14 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.28 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB - BytesReceived: 1.46 GB (1568649118) - ConvertRowBatchTime: 1s850ms - DeserializeRowBatchTimer: 8s961ms - FirstBatchArrivalWaitTime: 699.412ms - PeakMemoryUsage: 0 - RowsReturned: 64.64M (64638813) - RowsReturnedRate: 4.04 M/sec - SendersBlockedTimer: 3s482ms - SendersBlockedTotalTimer(*): 48s786ms Instance de4b40c22a7cb446:27 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s709ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 157.26 MB, 177.67 MB, 309.93 MB, 312.58 MB, 444.53 MB, 433.49 MB, 449.45 MB, 657.45 MB, 666.31 MB, 667.61 MB, 667.01 MB, 666.48 MB, 666.79 MB, 666.23 MB, 666.99 MB, 666.19 MB, 666.59 MB, 666.23 MB, 667.52 MB, 666.53 MB, 666.93 MB, 666.60 MB, 665.82 MB, 666.19 MB, 666.38 MB, 667.55 MB, 666.89 MB, 666.01 MB, 666.85 MB, 666.61 MB, 667.96 MB, 666.07 MB, 666.48 MB, 666.22 MB, 666.31 MB, 667.65 MB, 665.85 MB, 666.85 MB, 665.76 MB, 667.73 MB, 665.88 MB, 666.90 MB, 666.47 MB, 666.36 MB, 667.48 MB, 667.59 MB, 667.49 MB, 667.76 MB, 667.45 MB, 667.03 MB, 667.08 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.13K (3127) - PeakMemoryUsage: 690.11 MB (723633860) - PerHostPeakMemUsage: 1.60 GB (1721230764) - RowsProduced: 1.52M (1516792) - TotalNetworkReceiveTime: 15s494ms - TotalNetworkSendTime: 14.063ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s822ms - SysTime: 941.856ms - UserTime: 11s945ms - VoluntaryContextSwitches: 115.98K (115983) Fragment Instance Lifecycle Timings: - ExecTime: 21s810ms - ExecTreeExecTime: 19s992ms - OpenTime: 4s646ms - ExecTreeOpenTime: 4s365ms - PrepareTime: 63.024ms - ExecTreePrepareTime: 195.804us DataStreamSender (dst_id=9):(Total: 1s073ms, non-child: 1s073ms, % non-child: 100.00%) - BytesSent: 66.53 MB (69762113) - NetworkThroughput(*): 369.11 MB/sec - OverallThroughput: 62.00 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1516792) - SerializeBatchTime: 891.080ms - TransmitDataRPCTime: 180.246ms - UncompressedRowBatchSize: 159.18 MB (166908168) CodeGen:(Total: 320.156ms, non-child: 320.156ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.121ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 201.775ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 39.505ms HASH_JOIN_NODE (id=3):(Total: 24s354ms, non-child: 7s090ms, % non-child: 29.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367515) - BuildTime: 2s918ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.71M (64705103) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s180ms - RowsReturned: 1.52M (1516792) - RowsReturnedRate: 62.28 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s249ms - BuildRowsPartitioned: 7.37M (7367515) - GetNewBlockTime: 597.832us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 631.853ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s414ms, non-child: 483.377ms, % non-child: 34.18%) BytesReceived(500.000ms): 0, 0, 22.16 MB, 51.13 MB, 81.53 MB, 112.42 MB, 143.37 MB, 167.95 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB - BytesReceived: 174.41 MB (182878016) - ConvertRowBatchTime: 189.808ms - DeserializeRowBatchTimer: 874.523ms - FirstBatchArrivalWaitTime: 331.467ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367515) - RowsReturnedRate: 5.21 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s296ms, non-child: 3s884ms, % non-child: 23.84%) BytesReceived(500.000ms): 0, 0, 1.69 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 35.94 MB, 70.92 MB, 106.18 MB, 141.88 MB, 177.60 MB, 213.49 MB, 249.52 MB, 285.37 MB, 321.34 MB, 357.73 MB, 394.14 MB, 430.76 MB, 467.66 MB, 504.46 MB, 541.28 MB, 578.02 MB, 614.67 MB, 651.45 MB, 688.24 MB, 724.85 MB, 761.40 MB, 797.72 MB, 834.29 MB, 870.79 MB, 907.37 MB, 943.59 MB, 980.07 MB, 1016.20 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.14 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.32 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570203225) - ConvertRowBatchTime: 1s817ms - DeserializeRowBatchTimer: 5s529ms - FirstBatchArrivalWaitTime: 695.410ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64705103) - RowsReturnedRate: 3.97 M/sec - SendersBlockedTimer: 3s479ms - SendersBlockedTotalTimer(*): 52s165ms Instance de4b40c22a7cb446:22 (host=vb0234.halxg.cloudera.com:22000):(Total: 4s706ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.24 MB, 177.51 MB, 305.57 MB, 305.73 MB, 433.53 MB, 433.49 MB, 433.55 MB, 577.45 MB, 667.16 MB, 665.86 MB, 666.70 MB, 666.51 MB, 667.00 MB, 667.77 MB, 666.26 MB, 667.36 MB, 666.29 MB, 665.84 MB, 667.85 MB, 666.20 MB, 666.00 MB, 666.61 MB, 667.82 MB, 667.26 MB, 666.32 MB, 666.41 MB, 666.52 MB, 666.40 MB, 666.84 MB, 665.99 MB, 667.11 MB, 666.80 MB, 666.67 MB, 667.38 MB, 666.59 MB, 666.38 MB, 666.12 MB, 666.28 MB, 665.93 MB, 666.21 MB, 667.15 MB, 667.61 MB, 666.05 MB, 666.83 MB, 667.00 MB, 666.89 MB, 667.50 MB, 666.16 MB, 666.87 MB, 667.57 MB, 665.99 MB, 665.99 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.87K (3871) - PeakMemoryUsage: 689.77 MB (723279972) - PerHostPeakMemUsage: 1.62 GB (1742277852) - RowsProduced: 1.51M (1513030) - TotalNetworkReceiveTime: 14s641ms - TotalNetworkSendTime: 17.811ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s782ms - SysTime: 1s139ms - UserTime: 12s524ms - VoluntaryContextSwitches: 104.66K (104662) Fragment Instance Lifecycle Timings: - ExecTime: 21s815ms - ExecTreeExecTime: 19s790ms - OpenTime: 4s653ms - ExecTreeOpenTime: 4s313ms - PrepareTime: 52.470ms - ExecTreePrepareTime: 113.892us DataStreamSender (dst_id=9):(Total: 1s264ms, non-child: 1s264ms, % non-child: 100.00%) - BytesSent: 66.38 MB (69603690) - NetworkThroughput(*): 235.87 MB/sec - OverallThroughput: 52.49 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1513030) - SerializeBatchTime: 980.612ms - TransmitDataRPCTime: 281.417ms - UncompressedRowBatchSize: 158.78 MB (166494196) CodeGen:(Total: 380.227ms, non-child: 380.227ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 258.918ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 41.106ms HASH_JOIN_NODE (id=3):(Total: 24s101ms, non-child: 7s491ms, % non-child: 31.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.36M (7364619) - BuildTime: 2s882ms - PeakMemoryUsage: 649.11 MB (680636051) - ProbeRows: 64.71M (64710551) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s595ms - RowsReturned: 1.51M (1513030) - RowsReturnedRate: 62.78 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s212ms - BuildRowsPartitioned: 7.36M (7364619) - GetNewBlockTime: 473.524us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 628.020ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s411ms, non-child: 341.425ms, % non-child: 24.19%) BytesReceived(500.000ms): 0, 12.90 MB, 40.06 MB, 70.29 MB, 100.97 MB, 132.41 MB, 160.84 MB, 173.65 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB - BytesReceived: 174.34 MB (182805639) - ConvertRowBatchTime: 176.781ms - DeserializeRowBatchTimer: 568.145ms - FirstBatchArrivalWaitTime: 283.984ms - PeakMemoryUsage: 0 - RowsReturned: 7.36M (7364619) - RowsReturnedRate: 5.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s608ms, non-child: 6s945ms, % non-child: 44.50%) BytesReceived(500.000ms): 0, 0, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 23.22 MB, 58.05 MB, 93.34 MB, 128.73 MB, 164.45 MB, 200.24 MB, 236.22 MB, 271.88 MB, 307.87 MB, 344.11 MB, 380.52 MB, 416.95 MB, 453.76 MB, 490.57 MB, 527.31 MB, 564.15 MB, 601.05 MB, 637.74 MB, 674.52 MB, 711.20 MB, 747.73 MB, 784.21 MB, 820.77 MB, 857.25 MB, 893.94 MB, 930.30 MB, 966.69 MB, 1002.87 MB, 1.01 GB, 1.05 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.19 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570365436) - ConvertRowBatchTime: 1s962ms - DeserializeRowBatchTimer: 9s009ms - FirstBatchArrivalWaitTime: 650.082ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64710551) - RowsReturnedRate: 4.15 M/sec - SendersBlockedTimer: 3s473ms - SendersBlockedTotalTimer(*): 41s675ms Instance de4b40c22a7cb446:28 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s706ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 158.15 MB, 177.57 MB, 305.58 MB, 305.53 MB, 433.55 MB, 433.49 MB, 449.45 MB, 657.45 MB, 665.69 MB, 666.22 MB, 667.58 MB, 666.00 MB, 667.19 MB, 666.32 MB, 665.73 MB, 665.76 MB, 666.23 MB, 665.96 MB, 666.27 MB, 667.37 MB, 666.13 MB, 665.74 MB, 667.54 MB, 666.26 MB, 666.03 MB, 665.72 MB, 667.12 MB, 667.05 MB, 667.37 MB, 667.09 MB, 667.18 MB, 666.13 MB, 666.48 MB, 666.77 MB, 667.15 MB, 666.35 MB, 667.63 MB, 667.88 MB, 665.94 MB, 667.25 MB, 666.83 MB, 666.39 MB, 666.00 MB, 667.63 MB, 665.78 MB, 666.16 MB, 665.92 MB, 667.70 MB, 667.17 MB, 667.34 MB, 667.36 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.81K (2809) - PeakMemoryUsage: 689.81 MB (723322658) - PerHostPeakMemUsage: 1.59 GB (1704156328) - RowsProduced: 1.51M (1508417) - TotalNetworkReceiveTime: 14s833ms - TotalNetworkSendTime: 10.667ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s875ms - SysTime: 925.860ms - UserTime: 12s755ms - VoluntaryContextSwitches: 111.97K (111966) Fragment Instance Lifecycle Timings: - ExecTime: 21s814ms - ExecTreeExecTime: 19s831ms - OpenTime: 4s653ms - ExecTreeOpenTime: 4s408ms - PrepareTime: 53.068ms - ExecTreePrepareTime: 201.872us DataStreamSender (dst_id=9):(Total: 1s171ms, non-child: 1s171ms, % non-child: 100.00%) - BytesSent: 66.17 MB (69384010) - NetworkThroughput(*): 377.84 MB/sec - OverallThroughput: 56.47 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1508417) - SerializeBatchTime: 994.526ms - TransmitDataRPCTime: 175.124ms - UncompressedRowBatchSize: 158.30 MB (165986566) CodeGen:(Total: 276.784ms, non-child: 276.784ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 77.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 166.258ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 32.198ms HASH_JOIN_NODE (id=3):(Total: 24s236ms, non-child: 7s443ms, % non-child: 30.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367997) - BuildTime: 2s878ms - PeakMemoryUsage: 649.10 MB (680635847) - ProbeRows: 64.65M (64645925) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s550ms - RowsReturned: 1.51M (1508417) - RowsReturnedRate: 62.24 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s217ms - BuildRowsPartitioned: 7.37M (7367997) - GetNewBlockTime: 453.500us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 625.744ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s506ms, non-child: 351.245ms, % non-child: 23.31%) BytesReceived(500.000ms): 0, 0, 22.49 MB, 51.60 MB, 82.05 MB, 112.91 MB, 143.83 MB, 168.27 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB - BytesReceived: 174.42 MB (182891113) - ConvertRowBatchTime: 184.245ms - DeserializeRowBatchTimer: 580.986ms - FirstBatchArrivalWaitTime: 378.706ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367997) - RowsReturnedRate: 4.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s803ms, non-child: 4s242ms, % non-child: 26.84%) BytesReceived(500.000ms): 0, 0, 2.05 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 36.57 MB, 71.60 MB, 106.88 MB, 142.51 MB, 178.20 MB, 214.08 MB, 249.91 MB, 285.86 MB, 321.76 MB, 357.98 MB, 394.36 MB, 430.88 MB, 467.83 MB, 504.42 MB, 541.12 MB, 577.68 MB, 614.56 MB, 651.21 MB, 688.13 MB, 724.75 MB, 761.24 MB, 797.61 MB, 834.20 MB, 870.58 MB, 907.16 MB, 943.39 MB, 979.83 MB, 1015.96 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.14 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.32 GB, 1.35 GB, 1.38 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB - BytesReceived: 1.46 GB (1568810220) - ConvertRowBatchTime: 2s061ms - DeserializeRowBatchTimer: 5s591ms - FirstBatchArrivalWaitTime: 744.210ms - PeakMemoryUsage: 0 - RowsReturned: 64.65M (64645925) - RowsReturnedRate: 4.09 M/sec - SendersBlockedTimer: 3s474ms - SendersBlockedTotalTimer(*): 45s215ms Instance de4b40c22a7cb446:21 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s704ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 156.72 MB, 177.57 MB, 305.60 MB, 305.62 MB, 433.57 MB, 433.55 MB, 433.51 MB, 577.48 MB, 666.05 MB, 667.66 MB, 666.19 MB, 665.89 MB, 666.55 MB, 667.05 MB, 667.32 MB, 666.62 MB, 666.88 MB, 667.33 MB, 667.19 MB, 666.58 MB, 667.75 MB, 667.54 MB, 667.09 MB, 667.15 MB, 667.16 MB, 667.75 MB, 667.40 MB, 666.69 MB, 667.74 MB, 666.11 MB, 666.76 MB, 667.44 MB, 665.94 MB, 665.81 MB, 667.48 MB, 667.55 MB, 667.13 MB, 666.51 MB, 665.73 MB, 667.67 MB, 666.38 MB, 666.51 MB, 666.63 MB, 667.40 MB, 665.97 MB, 665.96 MB, 666.76 MB, 667.65 MB, 666.73 MB, 666.90 MB, 665.86 MB, 665.82 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.41K (3411) - PeakMemoryUsage: 689.83 MB (723343007) - PerHostPeakMemUsage: 1.60 GB (1721109855) - RowsProduced: 1.51M (1511988) - TotalNetworkReceiveTime: 15s080ms - TotalNetworkSendTime: 12.250ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s894ms - SysTime: 956.854ms - UserTime: 12s479ms - VoluntaryContextSwitches: 113.31K (113305) Fragment Instance Lifecycle Timings: - ExecTime: 21s817ms - ExecTreeExecTime: 19s851ms - OpenTime: 4s661ms - ExecTreeOpenTime: 4s416ms - PrepareTime: 43.275ms - ExecTreePrepareTime: 199.204us DataStreamSender (dst_id=9):(Total: 1s141ms, non-child: 1s141ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69545913) - NetworkThroughput(*): 374.47 MB/sec - OverallThroughput: 58.08 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511988) - SerializeBatchTime: 962.793ms - TransmitDataRPCTime: 177.115ms - UncompressedRowBatchSize: 158.67 MB (166379504) CodeGen:(Total: 272.262ms, non-child: 272.262ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.361ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 165.158ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 28.238ms HASH_JOIN_NODE (id=3):(Total: 24s264ms, non-child: 7s317ms, % non-child: 30.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7368943) - BuildTime: 2s805ms - PeakMemoryUsage: 649.11 MB (680637479) - ProbeRows: 64.71M (64709732) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s536ms - RowsReturned: 1.51M (1511988) - RowsReturnedRate: 62.31 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s142ms - BuildRowsPartitioned: 7.37M (7368943) - GetNewBlockTime: 520.664us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 629.042ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s588ms, non-child: 422.202ms, % non-child: 26.58%) BytesReceived(500.000ms): 0, 12.37 MB, 39.55 MB, 69.77 MB, 100.48 MB, 131.93 MB, 160.55 MB, 173.67 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182911543) - ConvertRowBatchTime: 142.667ms - DeserializeRowBatchTimer: 874.175ms - FirstBatchArrivalWaitTime: 389.192ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7368943) - RowsReturnedRate: 4.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s838ms, non-child: 4s140ms, % non-child: 26.14%) BytesReceived(500.000ms): 0, 0, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 22.66 MB, 57.58 MB, 92.83 MB, 128.26 MB, 164.00 MB, 199.72 MB, 235.66 MB, 271.61 MB, 307.63 MB, 343.79 MB, 380.23 MB, 416.70 MB, 453.58 MB, 490.43 MB, 527.09 MB, 563.81 MB, 600.59 MB, 637.31 MB, 674.22 MB, 710.94 MB, 747.36 MB, 783.79 MB, 820.29 MB, 856.84 MB, 893.52 MB, 929.75 MB, 966.11 MB, 1002.32 MB, 1.01 GB, 1.05 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.19 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570335145) - ConvertRowBatchTime: 1s983ms - DeserializeRowBatchTimer: 5s540ms - FirstBatchArrivalWaitTime: 755.883ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64709732) - RowsReturnedRate: 4.09 M/sec - SendersBlockedTimer: 3s472ms - SendersBlockedTotalTimer(*): 52s068ms Instance de4b40c22a7cb446:2d (host=vb0228.halxg.cloudera.com:22000):(Total: 4s702ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 156.76 MB, 177.57 MB, 305.64 MB, 305.66 MB, 433.57 MB, 433.59 MB, 449.48 MB, 657.48 MB, 666.61 MB, 667.82 MB, 665.89 MB, 666.35 MB, 666.53 MB, 666.86 MB, 666.80 MB, 667.35 MB, 667.67 MB, 665.84 MB, 666.76 MB, 667.71 MB, 666.60 MB, 666.26 MB, 666.75 MB, 666.69 MB, 667.29 MB, 666.06 MB, 666.65 MB, 667.26 MB, 666.79 MB, 665.69 MB, 666.70 MB, 666.97 MB, 666.55 MB, 667.45 MB, 667.70 MB, 666.95 MB, 667.71 MB, 667.01 MB, 667.19 MB, 666.60 MB, 667.40 MB, 667.20 MB, 666.41 MB, 667.14 MB, 667.26 MB, 667.29 MB, 665.75 MB, 666.29 MB, 666.39 MB, 666.25 MB, 666.41 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.84K (3842) - PeakMemoryUsage: 689.78 MB (723281960) - PerHostPeakMemUsage: 1.60 GB (1720283702) - RowsProduced: 1.52M (1515423) - TotalNetworkReceiveTime: 14s979ms - TotalNetworkSendTime: 10.156ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s865ms - SysTime: 1s093ms - UserTime: 12s339ms - VoluntaryContextSwitches: 105.58K (105581) Fragment Instance Lifecycle Timings: - ExecTime: 21s828ms - ExecTreeExecTime: 19s888ms - OpenTime: 4s645ms - ExecTreeOpenTime: 4s391ms - PrepareTime: 57.422ms - ExecTreePrepareTime: 115.320us DataStreamSender (dst_id=9):(Total: 1s223ms, non-child: 1s223ms, % non-child: 100.00%) - BytesSent: 66.47 MB (69703754) - NetworkThroughput(*): 231.04 MB/sec - OverallThroughput: 54.34 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1515423) - SerializeBatchTime: 933.520ms - TransmitDataRPCTime: 287.723ms - UncompressedRowBatchSize: 159.03 MB (166757514) CodeGen:(Total: 290.328ms, non-child: 290.328ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.286ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 173.868ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 37.454ms HASH_JOIN_NODE (id=3):(Total: 24s276ms, non-child: 7s462ms, % non-child: 30.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365220) - BuildTime: 2s982ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64697601) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s486ms - RowsReturned: 1.52M (1515423) - RowsReturnedRate: 62.42 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s324ms - BuildRowsPartitioned: 7.37M (7365220) - GetNewBlockTime: 502.128us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 622.196ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s383ms, non-child: 345.833ms, % non-child: 25.00%) BytesReceived(500.000ms): 0, 0, 21.87 MB, 50.69 MB, 81.17 MB, 112.02 MB, 142.94 MB, 167.70 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB - BytesReceived: 174.36 MB (182827038) - ConvertRowBatchTime: 180.229ms - DeserializeRowBatchTimer: 575.456ms - FirstBatchArrivalWaitTime: 364.685ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365220) - RowsReturnedRate: 5.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s891ms, non-child: 6s664ms, % non-child: 41.94%) BytesReceived(500.000ms): 0, 0, 1.44 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 35.45 MB, 70.55 MB, 105.99 MB, 141.58 MB, 177.21 MB, 213.21 MB, 249.25 MB, 285.17 MB, 321.15 MB, 357.48 MB, 393.95 MB, 430.54 MB, 467.32 MB, 504.17 MB, 540.95 MB, 577.72 MB, 614.43 MB, 651.08 MB, 687.86 MB, 724.49 MB, 760.94 MB, 797.33 MB, 834.04 MB, 870.57 MB, 907.15 MB, 943.40 MB, 979.74 MB, 1015.80 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB - BytesReceived: 1.46 GB (1570058522) - ConvertRowBatchTime: 1s882ms - DeserializeRowBatchTimer: 8s806ms - FirstBatchArrivalWaitTime: 730.992ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64697601) - RowsReturnedRate: 4.07 M/sec - SendersBlockedTimer: 3s471ms - SendersBlockedTotalTimer(*): 38s277ms Instance de4b40c22a7cb446:26 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s700ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 104.89 KB, 153.22 MB, 177.71 MB, 177.64 MB, 305.57 MB, 305.60 MB, 433.68 MB, 433.49 MB, 529.48 MB, 674.43 MB, 666.12 MB, 667.61 MB, 667.39 MB, 667.28 MB, 667.57 MB, 667.05 MB, 666.01 MB, 667.19 MB, 665.97 MB, 667.13 MB, 666.86 MB, 667.81 MB, 665.98 MB, 665.96 MB, 666.12 MB, 666.35 MB, 667.74 MB, 666.68 MB, 667.37 MB, 667.11 MB, 666.20 MB, 666.14 MB, 666.64 MB, 666.06 MB, 667.29 MB, 667.05 MB, 666.05 MB, 666.08 MB, 665.98 MB, 666.38 MB, 667.93 MB, 667.56 MB, 666.35 MB, 667.51 MB, 667.26 MB, 665.79 MB, 666.34 MB, 668.06 MB, 667.18 MB, 667.88 MB, 667.78 MB, 667.38 MB, 665.89 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.01K (3008) - PeakMemoryUsage: 689.68 MB (723183407) - PerHostPeakMemUsage: 1.60 GB (1720638349) - RowsProduced: 1.51M (1510643) - TotalNetworkReceiveTime: 14s074ms - TotalNetworkSendTime: 10.892ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s875ms - SysTime: 1s024ms - UserTime: 13s407ms - VoluntaryContextSwitches: 100.60K (100599) Fragment Instance Lifecycle Timings: - ExecTime: 21s820ms - ExecTreeExecTime: 19s662ms - OpenTime: 4s650ms - ExecTreeOpenTime: 4s405ms - PrepareTime: 49.838ms - ExecTreePrepareTime: 187.088us DataStreamSender (dst_id=9):(Total: 1s378ms, non-child: 1s378ms, % non-child: 100.00%) - BytesSent: 66.25 MB (69471988) - NetworkThroughput(*): 221.42 MB/sec - OverallThroughput: 48.08 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1510643) - SerializeBatchTime: 1s076ms - TransmitDataRPCTime: 299.220ms - UncompressedRowBatchSize: 158.53 MB (166231514) CodeGen:(Total: 276.317ms, non-child: 276.317ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.064ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 164.668ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 31.033ms HASH_JOIN_NODE (id=3):(Total: 24s063ms, non-child: 7s898ms, % non-child: 32.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370778) - BuildTime: 2s921ms - PeakMemoryUsage: 649.11 MB (680638601) - ProbeRows: 64.66M (64662030) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s927ms - RowsReturned: 1.51M (1510643) - RowsReturnedRate: 62.78 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s262ms - BuildRowsPartitioned: 7.37M (7370778) - GetNewBlockTime: 858.924us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 622.206ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s460ms, non-child: 369.195ms, % non-child: 25.28%) BytesReceived(500.000ms): 0, 5.40 MB, 32.94 MB, 63.11 MB, 93.77 MB, 124.98 MB, 155.05 MB, 172.72 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB - BytesReceived: 174.48 MB (182956514) - ConvertRowBatchTime: 187.230ms - DeserializeRowBatchTimer: 610.264ms - FirstBatchArrivalWaitTime: 380.123ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370778) - RowsReturnedRate: 5.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s221ms, non-child: 7s002ms, % non-child: 46.00%) BytesReceived(500.000ms): 0, 0, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 15.08 MB, 49.60 MB, 84.74 MB, 120.19 MB, 155.80 MB, 191.55 MB, 227.49 MB, 263.37 MB, 299.37 MB, 335.41 MB, 371.84 MB, 408.18 MB, 444.89 MB, 481.72 MB, 518.46 MB, 555.19 MB, 592.00 MB, 628.74 MB, 665.60 MB, 702.41 MB, 738.99 MB, 775.35 MB, 811.91 MB, 848.48 MB, 884.98 MB, 921.44 MB, 957.63 MB, 993.92 MB, 1.01 GB, 1.04 GB, 1.08 GB, 1.11 GB, 1.15 GB, 1.18 GB, 1.22 GB, 1.26 GB, 1.29 GB, 1.33 GB, 1.36 GB, 1.40 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569172988) - ConvertRowBatchTime: 2s177ms - DeserializeRowBatchTimer: 8s915ms - FirstBatchArrivalWaitTime: 747.152ms - PeakMemoryUsage: 0 - RowsReturned: 64.66M (64662030) - RowsReturnedRate: 4.25 M/sec - SendersBlockedTimer: 3s467ms - SendersBlockedTotalTimer(*): 27s837ms Instance de4b40c22a7cb446:25 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s699ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.26 MB, 177.57 MB, 305.59 MB, 305.82 MB, 433.57 MB, 433.53 MB, 433.47 MB, 593.45 MB, 667.03 MB, 666.96 MB, 666.67 MB, 667.05 MB, 667.07 MB, 665.81 MB, 666.59 MB, 667.70 MB, 666.50 MB, 667.73 MB, 666.18 MB, 667.44 MB, 666.40 MB, 665.94 MB, 667.36 MB, 667.23 MB, 666.98 MB, 667.03 MB, 666.66 MB, 667.26 MB, 667.02 MB, 667.14 MB, 665.97 MB, 667.27 MB, 665.96 MB, 666.62 MB, 667.51 MB, 666.27 MB, 667.09 MB, 667.91 MB, 665.77 MB, 666.63 MB, 667.07 MB, 666.76 MB, 667.48 MB, 666.79 MB, 667.86 MB, 666.73 MB, 665.77 MB, 666.46 MB, 666.25 MB, 666.75 MB, 667.35 MB, 666.15 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.01K (3011) - PeakMemoryUsage: 689.78 MB (723281960) - PerHostPeakMemUsage: 1.60 GB (1720580914) - RowsProduced: 1.51M (1511825) - TotalNetworkReceiveTime: 15s116ms - TotalNetworkSendTime: 18.626ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s888ms - SysTime: 878.866ms - UserTime: 12s558ms - VoluntaryContextSwitches: 114.20K (114205) Fragment Instance Lifecycle Timings: - ExecTime: 21s821ms - ExecTreeExecTime: 19s818ms - OpenTime: 4s654ms - ExecTreeOpenTime: 4s412ms - PrepareTime: 44.991ms - ExecTreePrepareTime: 224.844us DataStreamSender (dst_id=9):(Total: 1s158ms, non-child: 1s158ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69542062) - NetworkThroughput(*): 385.57 MB/sec - OverallThroughput: 57.26 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511825) - SerializeBatchTime: 984.093ms - TransmitDataRPCTime: 172.007ms - UncompressedRowBatchSize: 158.65 MB (166361590) CodeGen:(Total: 267.676ms, non-child: 267.676ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 77.498ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 162.713ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 26.983ms HASH_JOIN_NODE (id=3):(Total: 24s228ms, non-child: 7s194ms, % non-child: 29.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365265) - BuildTime: 2s779ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.67M (64668310) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s453ms - RowsReturned: 1.51M (1511825) - RowsReturnedRate: 62.40 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s120ms - BuildRowsPartitioned: 7.37M (7365265) - GetNewBlockTime: 425.576us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 621.416ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s613ms, non-child: 424.444ms, % non-child: 26.30%) BytesReceived(500.000ms): 0, 15.94 MB, 43.08 MB, 73.36 MB, 104.03 MB, 135.51 MB, 163.00 MB, 173.98 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB - BytesReceived: 174.36 MB (182827135) - ConvertRowBatchTime: 137.024ms - DeserializeRowBatchTimer: 873.099ms - FirstBatchArrivalWaitTime: 392.261ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365265) - RowsReturnedRate: 4.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s910ms, non-child: 4s168ms, % non-child: 26.20%) BytesReceived(500.000ms): 0, 0, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 26.72 MB, 61.64 MB, 96.86 MB, 132.39 MB, 168.11 MB, 203.93 MB, 239.81 MB, 275.71 MB, 311.74 MB, 347.88 MB, 384.21 MB, 420.71 MB, 457.60 MB, 494.35 MB, 531.01 MB, 567.64 MB, 604.44 MB, 641.15 MB, 677.97 MB, 714.52 MB, 751.07 MB, 787.46 MB, 824.05 MB, 860.54 MB, 897.12 MB, 933.38 MB, 969.83 MB, 1006.07 MB, 1.02 GB, 1.05 GB, 1.09 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.23 GB, 1.27 GB, 1.31 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569347999) - ConvertRowBatchTime: 2s043ms - DeserializeRowBatchTimer: 5s504ms - FirstBatchArrivalWaitTime: 752.686ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64668310) - RowsReturnedRate: 4.06 M/sec - SendersBlockedTimer: 3s467ms - SendersBlockedTotalTimer(*): 51s999ms Instance de4b40c22a7cb446:2a (host=vb0214.halxg.cloudera.com:22000):(Total: 4s697ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.23 MB, 177.68 MB, 305.62 MB, 305.59 MB, 433.55 MB, 433.57 MB, 433.49 MB, 593.45 MB, 667.19 MB, 667.37 MB, 667.22 MB, 667.45 MB, 666.52 MB, 666.95 MB, 667.68 MB, 666.16 MB, 666.97 MB, 666.02 MB, 665.87 MB, 665.98 MB, 666.84 MB, 666.36 MB, 666.84 MB, 667.22 MB, 666.82 MB, 667.01 MB, 667.10 MB, 666.17 MB, 666.32 MB, 665.96 MB, 667.66 MB, 665.65 MB, 667.20 MB, 666.50 MB, 667.04 MB, 667.75 MB, 666.45 MB, 667.26 MB, 665.68 MB, 665.82 MB, 667.25 MB, 667.21 MB, 666.87 MB, 667.37 MB, 665.78 MB, 665.91 MB, 667.40 MB, 667.18 MB, 667.34 MB, 666.91 MB, 666.41 MB, 665.75 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.59K (3589) - PeakMemoryUsage: 689.69 MB (723194180) - PerHostPeakMemUsage: 1.59 GB (1707342219) - RowsProduced: 1.51M (1512670) - TotalNetworkReceiveTime: 16s165ms - TotalNetworkSendTime: 13.941ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s844ms - SysTime: 942.856ms - UserTime: 11s179ms - VoluntaryContextSwitches: 118.74K (118742) Fragment Instance Lifecycle Timings: - ExecTime: 21s823ms - ExecTreeExecTime: 20s130ms - OpenTime: 4s641ms - ExecTreeOpenTime: 4s380ms - PrepareTime: 56.454ms - ExecTreePrepareTime: 194.110us DataStreamSender (dst_id=9):(Total: 967.399ms, non-child: 967.399ms, % non-child: 100.00%) - BytesSent: 66.36 MB (69583693) - NetworkThroughput(*): 377.36 MB/sec - OverallThroughput: 68.60 MB/sec - PeakMemoryUsage: 450.64 KB (461456) - RowsReturned: 1.51M (1512670) - SerializeBatchTime: 789.840ms - TransmitDataRPCTime: 175.855ms - UncompressedRowBatchSize: 158.74 MB (166454580) CodeGen:(Total: 295.225ms, non-child: 295.225ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 81.247ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 178.684ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.748ms HASH_JOIN_NODE (id=3):(Total: 24s507ms, non-child: 6s868ms, % non-child: 28.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370098) - BuildTime: 2s966ms - PeakMemoryUsage: 649.11 MB (680636663) - ProbeRows: 64.67M (64669952) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s926ms - RowsReturned: 1.51M (1512670) - RowsReturnedRate: 61.72 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s305ms - BuildRowsPartitioned: 7.37M (7370098) - GetNewBlockTime: 703.277us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 618.735ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s386ms, non-child: 356.996ms, % non-child: 25.75%) BytesReceived(500.000ms): 0, 15.39 MB, 42.58 MB, 72.85 MB, 103.51 MB, 135.05 MB, 162.71 MB, 174.04 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB - BytesReceived: 174.47 MB (182944129) - ConvertRowBatchTime: 179.667ms - DeserializeRowBatchTimer: 593.839ms - FirstBatchArrivalWaitTime: 357.864ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370098) - RowsReturnedRate: 5.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s738ms, non-child: 3s743ms, % non-child: 22.36%) BytesReceived(500.000ms): 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 25.97 MB, 60.86 MB, 96.21 MB, 131.72 MB, 167.40 MB, 203.16 MB, 239.21 MB, 275.12 MB, 311.08 MB, 347.36 MB, 383.82 MB, 420.21 MB, 456.93 MB, 493.63 MB, 530.26 MB, 566.92 MB, 603.67 MB, 640.22 MB, 677.12 MB, 713.93 MB, 750.46 MB, 786.71 MB, 823.37 MB, 859.81 MB, 896.52 MB, 932.79 MB, 969.16 MB, 1005.36 MB, 1.02 GB, 1.05 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.20 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569389285) - ConvertRowBatchTime: 1s592ms - DeserializeRowBatchTimer: 5s679ms - FirstBatchArrivalWaitTime: 722.210ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64669952) - RowsReturnedRate: 3.86 M/sec - SendersBlockedTimer: 3s466ms - SendersBlockedTotalTimer(*): 38s208ms Instance de4b40c22a7cb446:1f (host=vb0230.halxg.cloudera.com:22000):(Total: 4s692ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 42.25 KB, 111.86 KB, 154.25 MB, 178.94 MB, 305.73 MB, 312.29 MB, 433.95 MB, 433.53 MB, 433.49 MB, 625.45 MB, 665.81 MB, 667.54 MB, 666.39 MB, 666.24 MB, 666.16 MB, 666.14 MB, 667.37 MB, 666.56 MB, 667.73 MB, 667.11 MB, 667.21 MB, 667.32 MB, 665.91 MB, 666.55 MB, 666.78 MB, 666.72 MB, 666.95 MB, 667.18 MB, 667.88 MB, 667.64 MB, 666.25 MB, 667.33 MB, 667.02 MB, 667.44 MB, 666.11 MB, 666.02 MB, 666.04 MB, 665.75 MB, 666.67 MB, 667.00 MB, 666.63 MB, 667.06 MB, 665.79 MB, 666.23 MB, 667.25 MB, 666.33 MB, 667.85 MB, 666.70 MB, 666.77 MB, 666.26 MB, 666.19 MB, 666.38 MB, 667.56 MB, 16.19 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.93K (2927) - PeakMemoryUsage: 689.68 MB (723180215) - PerHostPeakMemUsage: 1.59 GB (1709651561) - RowsProduced: 1.51M (1511615) - TotalNetworkReceiveTime: 17s001ms - TotalNetworkSendTime: 15.532ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s858ms - SysTime: 1s007ms - UserTime: 10s410ms - VoluntaryContextSwitches: 117.50K (117505) Fragment Instance Lifecycle Timings: - ExecTime: 21s829ms - ExecTreeExecTime: 20s274ms - OpenTime: 4s638ms - ExecTreeOpenTime: 4s391ms - PrepareTime: 53.612ms - ExecTreePrepareTime: 225.164us DataStreamSender (dst_id=9):(Total: 985.990ms, non-child: 985.990ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69542671) - NetworkThroughput(*): 232.92 MB/sec - OverallThroughput: 67.26 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511615) - SerializeBatchTime: 699.613ms - TransmitDataRPCTime: 284.737ms - UncompressedRowBatchSize: 158.63 MB (166338482) CodeGen:(Total: 279.646ms, non-child: 279.646ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 168.444ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 32.623ms HASH_JOIN_NODE (id=3):(Total: 24s662ms, non-child: 6s353ms, % non-child: 25.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365737) - BuildTime: 2s919ms - PeakMemoryUsage: 649.10 MB (680635439) - ProbeRows: 64.72M (64719214) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s540ms - RowsReturned: 1.51M (1511615) - RowsReturnedRate: 61.29 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s263ms - BuildRowsPartitioned: 7.37M (7365737) - GetNewBlockTime: 479.904us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 617.975ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s447ms, non-child: 478.882ms, % non-child: 33.09%) BytesReceived(500.000ms): 0, 0, 18.85 MB, 45.83 MB, 76.15 MB, 106.86 MB, 138.24 MB, 164.85 MB, 174.18 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB - BytesReceived: 174.37 MB (182838069) - ConvertRowBatchTime: 151.853ms - DeserializeRowBatchTimer: 928.602ms - FirstBatchArrivalWaitTime: 374.763ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365737) - RowsReturnedRate: 5.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s303ms, non-child: 6s297ms, % non-child: 36.39%) BytesReceived(500.000ms): 0, 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 29.68 MB, 64.76 MB, 100.13 MB, 135.71 MB, 171.57 MB, 207.36 MB, 243.41 MB, 279.30 MB, 315.32 MB, 351.68 MB, 388.00 MB, 424.57 MB, 461.39 MB, 498.20 MB, 535.05 MB, 571.72 MB, 608.48 MB, 645.06 MB, 681.89 MB, 718.55 MB, 755.21 MB, 791.50 MB, 828.14 MB, 864.49 MB, 901.12 MB, 937.41 MB, 973.76 MB, 1009.94 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570593306) - ConvertRowBatchTime: 1s400ms - DeserializeRowBatchTimer: 8s935ms - FirstBatchArrivalWaitTime: 739.028ms - PeakMemoryUsage: 0 - RowsReturned: 64.72M (64719214) - RowsReturnedRate: 3.74 M/sec - SendersBlockedTimer: 3s458ms - SendersBlockedTotalTimer(*): 34s625ms Instance de4b40c22a7cb446:2c (host=vb0232.halxg.cloudera.com:22000):(Total: 4s674ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 104.89 KB, 153.24 MB, 177.57 MB, 177.64 MB, 305.64 MB, 305.60 MB, 433.57 MB, 433.51 MB, 529.45 MB, 665.91 MB, 666.70 MB, 667.12 MB, 666.16 MB, 665.79 MB, 665.72 MB, 666.50 MB, 666.16 MB, 667.64 MB, 666.03 MB, 666.24 MB, 667.37 MB, 665.76 MB, 666.96 MB, 666.72 MB, 666.70 MB, 666.40 MB, 667.42 MB, 665.67 MB, 667.42 MB, 665.98 MB, 666.26 MB, 666.18 MB, 665.85 MB, 666.81 MB, 667.32 MB, 665.94 MB, 666.57 MB, 666.96 MB, 667.45 MB, 665.85 MB, 667.06 MB, 666.59 MB, 665.80 MB, 666.29 MB, 666.06 MB, 667.14 MB, 667.12 MB, 667.75 MB, 666.88 MB, 667.33 MB, 665.60 MB, 666.70 MB, 667.30 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.98K (2979) - PeakMemoryUsage: 689.68 MB (723180215) - PerHostPeakMemUsage: 1.60 GB (1720365752) - RowsProduced: 1.51M (1508089) - TotalNetworkReceiveTime: 17s548ms - TotalNetworkSendTime: 11.127ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s837ms - SysTime: 836.872ms - UserTime: 9s878ms - VoluntaryContextSwitches: 123.91K (123909) Fragment Instance Lifecycle Timings: - ExecTime: 21s845ms - ExecTreeExecTime: 20s440ms - OpenTime: 4s635ms - ExecTreeOpenTime: 4s357ms - PrepareTime: 39.616ms - ExecTreePrepareTime: 148.132us DataStreamSender (dst_id=9):(Total: 824.527ms, non-child: 824.527ms, % non-child: 100.00%) - BytesSent: 66.17 MB (69387839) - NetworkThroughput(*): 325.02 MB/sec - OverallThroughput: 80.26 MB/sec - PeakMemoryUsage: 450.64 KB (461456) - RowsReturned: 1.51M (1508089) - SerializeBatchTime: 619.544ms - TransmitDataRPCTime: 203.596ms - UncompressedRowBatchSize: 158.26 MB (165950478) CodeGen:(Total: 307.060ms, non-child: 307.060ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 89.431ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 187.322ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 29.742ms HASH_JOIN_NODE (id=3):(Total: 24s794ms, non-child: 6s074ms, % non-child: 24.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365037) - BuildTime: 2s897ms - PeakMemoryUsage: 649.10 MB (680635235) - ProbeRows: 64.71M (64713632) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s291ms - RowsReturned: 1.51M (1508089) - RowsReturnedRate: 60.82 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s268ms - BuildRowsPartitioned: 7.37M (7365037) - GetNewBlockTime: 699.172us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 596.373ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s436ms, non-child: 379.520ms, % non-child: 26.42%) BytesReceived(500.000ms): 0, 5.75 MB, 33.25 MB, 63.48 MB, 94.11 MB, 125.29 MB, 155.29 MB, 172.66 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB - BytesReceived: 174.35 MB (182820314) - ConvertRowBatchTime: 200.336ms - DeserializeRowBatchTimer: 583.206ms - FirstBatchArrivalWaitTime: 358.761ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365037) - RowsReturnedRate: 5.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s719ms, non-child: 4s188ms, % non-child: 23.64%) BytesReceived(500.000ms): 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 15.45 MB, 50.15 MB, 85.24 MB, 120.77 MB, 156.46 MB, 192.30 MB, 228.24 MB, 264.19 MB, 300.21 MB, 336.28 MB, 372.64 MB, 409.01 MB, 445.81 MB, 482.71 MB, 519.41 MB, 556.16 MB, 592.88 MB, 629.79 MB, 666.69 MB, 703.61 MB, 740.15 MB, 776.43 MB, 812.91 MB, 849.54 MB, 886.11 MB, 922.51 MB, 958.87 MB, 995.17 MB, 1.01 GB, 1.04 GB, 1.08 GB, 1.11 GB, 1.15 GB, 1.19 GB, 1.22 GB, 1.26 GB, 1.29 GB, 1.33 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570473192) - ConvertRowBatchTime: 1s239ms - DeserializeRowBatchTimer: 6s480ms - FirstBatchArrivalWaitTime: 722.555ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64713632) - RowsReturnedRate: 3.65 M/sec - SendersBlockedTimer: 3s442ms - SendersBlockedTotalTimer(*): 37s882ms Instance de4b40c22a7cb446:23 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s658ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 88.89 KB, 111.86 KB, 161.56 MB, 178.23 MB, 305.49 MB, 305.51 MB, 433.49 MB, 433.51 MB, 433.47 MB, 641.45 MB, 667.40 MB, 667.33 MB, 667.00 MB, 666.77 MB, 666.17 MB, 666.78 MB, 666.85 MB, 666.08 MB, 666.75 MB, 666.19 MB, 665.75 MB, 667.54 MB, 667.23 MB, 666.38 MB, 667.09 MB, 667.18 MB, 666.26 MB, 666.67 MB, 667.40 MB, 665.73 MB, 666.31 MB, 666.87 MB, 667.46 MB, 666.24 MB, 665.77 MB, 666.76 MB, 666.91 MB, 666.31 MB, 667.80 MB, 667.44 MB, 665.63 MB, 666.79 MB, 667.71 MB, 666.79 MB, 666.79 MB, 666.10 MB, 667.14 MB, 665.79 MB, 667.43 MB, 667.40 MB, 665.63 MB, 666.19 MB, 667.14 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.25K (3250) - PeakMemoryUsage: 689.70 MB (723200564) - PerHostPeakMemUsage: 1.60 GB (1720722065) - RowsProduced: 1.51M (1514169) - TotalNetworkReceiveTime: 16s909ms - TotalNetworkSendTime: 14.857ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s833ms - SysTime: 849.870ms - UserTime: 10s597ms - VoluntaryContextSwitches: 123.16K (123160) Fragment Instance Lifecycle Timings: - ExecTime: 21s862ms - ExecTreeExecTime: 20s187ms - OpenTime: 4s605ms - ExecTreeOpenTime: 4s365ms - PrepareTime: 53.180ms - ExecTreePrepareTime: 114.864us DataStreamSender (dst_id=9):(Total: 984.962ms, non-child: 984.962ms, % non-child: 100.00%) - BytesSent: 66.42 MB (69649018) - NetworkThroughput(*): 362.12 MB/sec - OverallThroughput: 67.44 MB/sec - PeakMemoryUsage: 450.64 KB (461456) - RowsReturned: 1.51M (1514169) - SerializeBatchTime: 799.626ms - TransmitDataRPCTime: 183.424ms - UncompressedRowBatchSize: 158.90 MB (166619526) CodeGen:(Total: 280.637ms, non-child: 280.637ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 76.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 162.051ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 41.858ms HASH_JOIN_NODE (id=3):(Total: 24s549ms, non-child: 6s148ms, % non-child: 25.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370459) - BuildTime: 2s387ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64695647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s828ms - RowsReturned: 1.51M (1514169) - RowsReturnedRate: 61.68 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s772ms - BuildRowsPartitioned: 7.37M (7370459) - GetNewBlockTime: 570.368us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 590.129ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s953ms, non-child: 357.442ms, % non-child: 18.30%) BytesReceived(500.000ms): 0, 0, 20.06 MB, 47.37 MB, 77.74 MB, 108.49 MB, 139.74 MB, 165.88 MB, 174.39 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB - BytesReceived: 174.48 MB (182951312) - ConvertRowBatchTime: 165.669ms - DeserializeRowBatchTimer: 620.148ms - FirstBatchArrivalWaitTime: 383.968ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370459) - RowsReturnedRate: 3.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s927ms, non-child: 3s586ms, % non-child: 21.19%) BytesReceived(500.000ms): 0, 0, 0, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 31.57 MB, 66.65 MB, 101.89 MB, 137.47 MB, 173.13 MB, 209.13 MB, 245.03 MB, 280.91 MB, 317.00 MB, 353.30 MB, 389.62 MB, 426.18 MB, 462.97 MB, 499.71 MB, 536.53 MB, 573.30 MB, 610.01 MB, 646.59 MB, 683.42 MB, 720.05 MB, 756.56 MB, 792.97 MB, 829.60 MB, 866.17 MB, 902.71 MB, 938.92 MB, 975.39 MB, 1011.52 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.44 GB, 1.45 GB, 1.46 GB - BytesReceived: 1.46 GB (1570004996) - ConvertRowBatchTime: 1s624ms - DeserializeRowBatchTimer: 5s322ms - FirstBatchArrivalWaitTime: 749.532ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64695647) - RowsReturnedRate: 3.82 M/sec - SendersBlockedTimer: 3s425ms - SendersBlockedTotalTimer(*): 41s103ms Instance de4b40c22a7cb446:24 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s654ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.21 MB, 177.55 MB, 305.53 MB, 305.53 MB, 433.59 MB, 433.55 MB, 433.51 MB, 593.45 MB, 666.55 MB, 666.98 MB, 665.83 MB, 665.90 MB, 666.12 MB, 666.12 MB, 666.82 MB, 665.94 MB, 667.48 MB, 667.09 MB, 667.74 MB, 666.02 MB, 667.38 MB, 665.99 MB, 667.68 MB, 665.88 MB, 667.54 MB, 666.29 MB, 667.68 MB, 667.45 MB, 666.93 MB, 666.69 MB, 666.16 MB, 666.47 MB, 666.78 MB, 666.51 MB, 667.62 MB, 667.85 MB, 667.68 MB, 667.54 MB, 666.15 MB, 667.49 MB, 665.90 MB, 666.30 MB, 666.08 MB, 667.31 MB, 666.46 MB, 667.61 MB, 667.53 MB, 666.88 MB, 667.53 MB, 666.53 MB, 665.77 MB, 667.44 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.35K (3347) - PeakMemoryUsage: 689.72 MB (723220913) - PerHostPeakMemUsage: 1.54 GB (1653945909) - RowsProduced: 1.52M (1515559) - TotalNetworkReceiveTime: 14s946ms - TotalNetworkSendTime: 23.501ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s855ms - SysTime: 985.849ms - UserTime: 12s556ms - VoluntaryContextSwitches: 105.07K (105071) Fragment Instance Lifecycle Timings: - ExecTime: 21s867ms - ExecTreeExecTime: 19s758ms - OpenTime: 4s618ms - ExecTreeOpenTime: 4s369ms - PrepareTime: 35.183ms - ExecTreePrepareTime: 119.353us DataStreamSender (dst_id=9):(Total: 1s344ms, non-child: 1s344ms, % non-child: 100.00%) - BytesSent: 66.47 MB (69701831) - NetworkThroughput(*): 225.46 MB/sec - OverallThroughput: 49.46 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1515559) - SerializeBatchTime: 1s046ms - TransmitDataRPCTime: 294.834ms - UncompressedRowBatchSize: 159.05 MB (166772474) CodeGen:(Total: 274.582ms, non-child: 274.582ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 169.094ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 25.760ms HASH_JOIN_NODE (id=3):(Total: 24s124ms, non-child: 7s160ms, % non-child: 29.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7368781) - BuildTime: 2s557ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64700766) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s579ms - RowsReturned: 1.52M (1515559) - RowsReturnedRate: 62.82 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s944ms - BuildRowsPartitioned: 7.37M (7368781) - GetNewBlockTime: 406.695us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 580.891ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s783ms, non-child: 349.300ms, % non-child: 19.58%) BytesReceived(500.000ms): 0, 15.09 MB, 42.29 MB, 72.55 MB, 103.18 MB, 134.72 MB, 162.45 MB, 174.00 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182912521) - ConvertRowBatchTime: 168.234ms - DeserializeRowBatchTimer: 641.541ms - FirstBatchArrivalWaitTime: 391.585ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7368781) - RowsReturnedRate: 4.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s679ms, non-child: 7s165ms, % non-child: 45.70%) BytesReceived(500.000ms): 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 25.81 MB, 60.63 MB, 96.04 MB, 131.45 MB, 167.11 MB, 202.93 MB, 238.85 MB, 274.68 MB, 310.82 MB, 346.97 MB, 383.51 MB, 420.01 MB, 456.65 MB, 493.39 MB, 530.13 MB, 566.89 MB, 603.72 MB, 640.42 MB, 677.20 MB, 713.92 MB, 750.40 MB, 786.89 MB, 823.45 MB, 859.89 MB, 896.55 MB, 932.91 MB, 969.41 MB, 1005.63 MB, 1.02 GB, 1.05 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.20 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570144265) - ConvertRowBatchTime: 2s100ms - DeserializeRowBatchTimer: 9s157ms - FirstBatchArrivalWaitTime: 756.769ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64700766) - RowsReturnedRate: 4.13 M/sec - SendersBlockedTimer: 3s421ms - SendersBlockedTotalTimer(*): 37s630ms Instance de4b40c22a7cb446:29 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s648ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 160.31 MB, 177.49 MB, 305.53 MB, 305.49 MB, 433.49 MB, 433.55 MB, 433.47 MB, 625.45 MB, 665.78 MB, 666.76 MB, 666.47 MB, 665.93 MB, 667.80 MB, 666.06 MB, 666.94 MB, 665.84 MB, 666.18 MB, 666.24 MB, 666.73 MB, 665.80 MB, 667.43 MB, 665.79 MB, 666.03 MB, 665.95 MB, 666.82 MB, 666.75 MB, 666.16 MB, 666.33 MB, 666.45 MB, 667.57 MB, 667.41 MB, 665.84 MB, 665.85 MB, 666.74 MB, 665.81 MB, 667.53 MB, 666.81 MB, 665.82 MB, 665.81 MB, 666.64 MB, 667.10 MB, 666.95 MB, 667.11 MB, 665.88 MB, 666.77 MB, 667.66 MB, 667.02 MB, 667.58 MB, 667.42 MB, 667.02 MB, 665.65 MB, 602.20 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.07K (3073) - PeakMemoryUsage: 689.81 MB (723319466) - PerHostPeakMemUsage: 1.60 GB (1720823652) - RowsProduced: 1.51M (1513861) - TotalNetworkReceiveTime: 16s011ms - TotalNetworkSendTime: 15.624ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s819ms - SysTime: 912.860ms - UserTime: 11s534ms - VoluntaryContextSwitches: 110.07K (110073) Fragment Instance Lifecycle Timings: - ExecTime: 21s872ms - ExecTreeExecTime: 19s987ms - OpenTime: 4s594ms - ExecTreeOpenTime: 4s352ms - PrepareTime: 53.842ms - ExecTreePrepareTime: 202.514us DataStreamSender (dst_id=9):(Total: 1s214ms, non-child: 1s214ms, % non-child: 100.00%) - BytesSent: 66.41 MB (69640764) - NetworkThroughput(*): 226.27 MB/sec - OverallThroughput: 54.66 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1513861) - SerializeBatchTime: 919.371ms - TransmitDataRPCTime: 293.517ms - UncompressedRowBatchSize: 158.87 MB (166585630) CodeGen:(Total: 276.414ms, non-child: 276.414ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 77.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 163.393ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.891ms HASH_JOIN_NODE (id=3):(Total: 24s337ms, non-child: 6s587ms, % non-child: 27.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367843) - BuildTime: 2s360ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.67M (64671462) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s273ms - RowsReturned: 1.51M (1513861) - RowsReturnedRate: 62.20 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s760ms - BuildRowsPartitioned: 7.37M (7367843) - GetNewBlockTime: 592.034us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 573.421ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s969ms, non-child: 294.759ms, % non-child: 14.96%) BytesReceived(500.000ms): 0, 17.52 MB, 44.58 MB, 74.93 MB, 105.57 MB, 136.94 MB, 164.05 MB, 174.15 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB - BytesReceived: 174.42 MB (182888509) - ConvertRowBatchTime: 151.374ms - DeserializeRowBatchTimer: 570.851ms - FirstBatchArrivalWaitTime: 380.732ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367843) - RowsReturnedRate: 3.74 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s253ms, non-child: 7s044ms, % non-child: 43.34%) BytesReceived(500.000ms): 0, 0, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 28.40 MB, 63.36 MB, 98.69 MB, 134.18 MB, 169.83 MB, 205.66 MB, 241.65 MB, 277.56 MB, 313.52 MB, 349.68 MB, 386.13 MB, 422.62 MB, 459.50 MB, 496.34 MB, 533.11 MB, 569.71 MB, 606.57 MB, 643.25 MB, 680.00 MB, 716.61 MB, 753.18 MB, 789.46 MB, 826.10 MB, 862.56 MB, 899.22 MB, 935.44 MB, 971.82 MB, 1007.98 MB, 1.02 GB, 1.05 GB, 1.09 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.23 GB, 1.27 GB, 1.31 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569417426) - ConvertRowBatchTime: 1s845ms - DeserializeRowBatchTimer: 9s238ms - FirstBatchArrivalWaitTime: 745.116ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64671462) - RowsReturnedRate: 3.98 M/sec - SendersBlockedTimer: 3s417ms - SendersBlockedTotalTimer(*): 47s826ms Instance de4b40c22a7cb446:20 (host=vb0212.halxg.cloudera.com:22000):(Total: 4s610ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 165.07 MB, 186.44 MB, 305.80 MB, 311.61 MB, 443.99 MB, 433.49 MB, 481.45 MB, 672.59 MB, 667.64 MB, 667.03 MB, 665.89 MB, 665.92 MB, 666.54 MB, 667.57 MB, 666.55 MB, 666.66 MB, 667.44 MB, 666.34 MB, 667.21 MB, 667.40 MB, 665.87 MB, 665.80 MB, 666.96 MB, 666.67 MB, 667.05 MB, 666.17 MB, 666.55 MB, 667.17 MB, 665.63 MB, 665.89 MB, 665.92 MB, 667.27 MB, 667.83 MB, 667.36 MB, 667.45 MB, 666.62 MB, 666.33 MB, 667.31 MB, 667.51 MB, 666.77 MB, 666.07 MB, 667.04 MB, 667.21 MB, 666.72 MB, 665.93 MB, 667.02 MB, 666.69 MB, 667.64 MB, 666.58 MB, 666.42 MB, 666.81 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.81K (2806) - PeakMemoryUsage: 689.71 MB (723217721) - PerHostPeakMemUsage: 1.60 GB (1720527823) - RowsProduced: 1.51M (1511840) - TotalNetworkReceiveTime: 14s781ms - TotalNetworkSendTime: 20.193ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 30s800ms - SysTime: 942.856ms - UserTime: 12s870ms - VoluntaryContextSwitches: 111.97K (111970) Fragment Instance Lifecycle Timings: - ExecTime: 21s911ms - ExecTreeExecTime: 19s909ms - OpenTime: 4s563ms - ExecTreeOpenTime: 4s325ms - PrepareTime: 46.818ms - ExecTreePrepareTime: 240.382us DataStreamSender (dst_id=9):(Total: 1s189ms, non-child: 1s189ms, % non-child: 100.00%) - BytesSent: 66.31 MB (69535007) - NetworkThroughput(*): 359.08 MB/sec - OverallThroughput: 55.74 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511840) - SerializeBatchTime: 1s003ms - TransmitDataRPCTime: 184.677ms - UncompressedRowBatchSize: 158.66 MB (166363232) CodeGen:(Total: 262.845ms, non-child: 262.845ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 75.900ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 160.720ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 25.737ms HASH_JOIN_NODE (id=3):(Total: 24s231ms, non-child: 7s358ms, % non-child: 30.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7369445) - BuildTime: 2s851ms - PeakMemoryUsage: 649.11 MB (680636714) - ProbeRows: 64.70M (64698144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s528ms - RowsReturned: 1.51M (1511840) - RowsReturnedRate: 62.39 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s282ms - BuildRowsPartitioned: 7.37M (7369445) - GetNewBlockTime: 526.879us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 536.104ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s430ms, non-child: 510.213ms, % non-child: 35.66%) BytesReceived(500.000ms): 0, 0, 24.65 MB, 54.26 MB, 84.78 MB, 115.71 MB, 146.42 MB, 169.69 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB - BytesReceived: 174.45 MB (182918915) - ConvertRowBatchTime: 225.220ms - DeserializeRowBatchTimer: 824.203ms - FirstBatchArrivalWaitTime: 392.124ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7369445) - RowsReturnedRate: 5.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 15s930ms, non-child: 4s256ms, % non-child: 26.72%) BytesReceived(500.000ms): 0, 0, 4.48 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 39.42 MB, 74.63 MB, 109.99 MB, 145.58 MB, 181.14 MB, 217.16 MB, 253.19 MB, 289.10 MB, 325.03 MB, 361.50 MB, 397.86 MB, 434.42 MB, 471.34 MB, 507.97 MB, 544.70 MB, 581.49 MB, 618.24 MB, 654.89 MB, 691.81 MB, 728.32 MB, 764.76 MB, 801.30 MB, 837.90 MB, 874.45 MB, 911.06 MB, 947.32 MB, 983.82 MB, 1019.85 MB, 1.03 GB, 1.07 GB, 1.10 GB, 1.14 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.28 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570072529) - ConvertRowBatchTime: 2s116ms - DeserializeRowBatchTimer: 5s514ms - FirstBatchArrivalWaitTime: 755.618ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64698144) - RowsReturnedRate: 4.06 M/sec - SendersBlockedTimer: 3s377ms - SendersBlockedTotalTimer(*): 47s266ms Averaged Fragment F00:(Total: 112.065ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 147.82 MB completion times: min:23s745ms max:26s494ms mean: 25s154ms stddev:679.440ms execution rates: min:164.57 MB/sec max:180.45 MB/sec mean:174.68 MB/sec stddev:4.26 MB/sec num instances: 15 - AverageThreadTokens: 11.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 10.59K (10588) - PeakMemoryUsage: 786.76 MB (824978006) - PerHostPeakMemUsage: 1.60 GB (1714962635) - RowsProduced: 64.69M (64687125) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s529ms - TotalStorageWaitTime: 665.450ms - TotalWallClockTime: 4m40s - SysTime: 1s859ms - UserTime: 37s398ms - VoluntaryContextSwitches: 64.18K (64179) Fragment Instance Lifecycle Timings: - ExecTime: 25s040ms - ExecTreeExecTime: 1s272ms - OpenTime: 66.777ms - ExecTreeOpenTime: 53.601us - PrepareTime: 45.247ms - ExecTreePrepareTime: 256.671us DataStreamSender (dst_id=7):(Total: 16s254ms, non-child: 16s254ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1569802510) - NetworkThroughput(*): 355.83 MB/sec - OverallThroughput: 92.65 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 64.69M (64687125) - SerializeBatchTime: 11s705ms - TransmitDataRPCTime: 4s527ms - UncompressedRowBatchSize: 3.31 GB (3558440420) CodeGen:(Total: 94.095ms, non-child: 94.095ms, % non-child: 100.00%) - CodegenTime: 1.770ms - CompileTime: 16.553ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 49.274ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.719ms HDFS_SCAN_NODE (id=2):(Total: 1s233ms, non-child: 1s233ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 10.24 - BytesRead: 1013.25 MB (1062467810) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1013.25 MB (1062467810) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1013.25 MB (1062467810) - DecompressionTime: 3s808ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 770.30 MB (807712886) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.479ms - RowBatchQueuePutWaitTime: 3m48s - RowsRead: 120.00M (119999272) - RowsReturned: 64.69M (64687125) - RowsReturnedRate: 52.63 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.43K (8431) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 13s401ms - ScannerThreadsSysTime: 857.996ms - ScannerThreadsUserTime: 17s718ms - ScannerThreadsVoluntaryContextSwitches: 63.88K (63883) - TotalRawHdfsReadTime(*): 752.595ms - TotalReadThroughput: 40.26 MB/sec Filter 1 (16.00 MB): - Rows processed: 371.91K (371910) - Rows rejected: 3.16K (3159) - Rows total: 120.00M (119999272) Fragment F00: Instance de4b40c22a7cb446:d (host=vb0226.halxg.cloudera.com:22000):(Total: 141.375ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 3:1/253.39 MB 0:2/506.78 MB 5:2/506.80 MB 7:1/253.40 MB 2:1/253.38 MB 1:2/506.79 MB 9:2/506.78 MB 8:3/760.18 MB 6:3/760.20 MB Filter 1 arrival: 4s512ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 772.63 MB, 773.23 MB, 773.23 MB, 773.23 MB, 773.23 MB, 773.23 MB, 773.23 MB, 789.23 MB, 791.07 MB, 791.39 MB, 791.07 MB, 791.14 MB, 791.05 MB, 743.69 MB, 696.18 MB, 695.98 MB, 695.84 MB, 695.50 MB, 695.75 MB, 696.07 MB, 600.31 MB, 600.34 MB, 600.52 MB, 600.52 MB, 600.45 MB, 600.61 MB, 504.50 MB, 504.58 MB, 408.28 MB, 313.76 MB, 313.43 MB, 313.29 MB, 313.57 MB, 217.56 MB, 217.21 MB, 411.01 MB, 410.93 MB, 410.89 MB, 363.40 MB, 363.34 MB, 363.40 MB, 315.53 MB, 315.38 MB, 315.66 MB, 267.81 MB, 219.89 MB, 172.43 MB, 164.49 MB, 109.44 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.10 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 9.01K (9014) - PeakMemoryUsage: 791.97 MB (830439411) - PerHostPeakMemUsage: 1.60 GB (1720782789) - RowsProduced: 67.16M (67162536) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s536ms - TotalStorageWaitTime: 698.276ms - TotalWallClockTime: 4m44s - SysTime: 1s474ms - UserTime: 33s862ms - VoluntaryContextSwitches: 66.78K (66778) Fragment Instance Lifecycle Timings: - ExecTime: 25s132ms - ExecTreeExecTime: 1s183ms - OpenTime: 90.112ms - ExecTreeOpenTime: 53.204us - PrepareTime: 51.220ms - ExecTreePrepareTime: 304.184us DataStreamSender (dst_id=7):(Total: 18s040ms, non-child: 18s040ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629752099) - NetworkThroughput(*): 260.88 MB/sec - OverallThroughput: 86.15 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.16M (67162536) - SerializeBatchTime: 12s064ms - TransmitDataRPCTime: 5s957ms - UncompressedRowBatchSize: 3.44 GB (3694612820) CodeGen:(Total: 125.491ms, non-child: 125.491ms, % non-child: 100.00%) - CodegenTime: 2.118ms - CompileTime: 16.790ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 72.181ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 35.794ms HDFS_SCAN_NODE (id=2):(Total: 1s148ms, non-child: 1s148ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 3:1/253.39 MB 0:2/506.78 MB 5:2/506.80 MB 7:1/253.40 MB 2:1/253.38 MB 1:2/506.79 MB 9:2/506.78 MB 8:3/760.18 MB 6:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 863ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.846ms ; Min: 1.802ms ; Max: 11.399ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.10 - BytesRead: 1.03 GB (1102912239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102912239) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102912239) - DecompressionTime: 3s051ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 775.50 MB (813171848) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.085ms - RowBatchQueuePutWaitTime: 3m54s - RowsRead: 124.58M (124580858) - RowsReturned: 67.16M (67162536) - RowsReturnedRate: 58.47 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.86K (6856) - ScannerThreadsTotalWallClockTime: 4m18s - MaterializeTupleTime(*): 10s303ms - ScannerThreadsSysTime: 643.897ms - ScannerThreadsUserTime: 13s867ms - ScannerThreadsVoluntaryContextSwitches: 66.43K (66426) - TotalRawHdfsReadTime(*): 805.878ms - TotalReadThroughput: 41.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 383.99K (383991) - Rows rejected: 3.36K (3364) - Rows total: 124.58M (124580858) Instance de4b40c22a7cb446:f (host=vb0228.halxg.cloudera.com:22000):(Total: 128.780ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 5:4/765.48 MB 9:2/506.78 MB 0:4/951.82 MB 7:1/253.39 MB 10:3/760.17 MB 2:2/506.82 MB Filter 1 arrival: 4s538ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 512.30 MB, 773.81 MB, 773.81 MB, 773.81 MB, 773.81 MB, 773.81 MB, 773.81 MB, 789.81 MB, 792.36 MB, 792.07 MB, 792.52 MB, 792.47 MB, 792.28 MB, 784.20 MB, 696.80 MB, 696.78 MB, 696.86 MB, 696.47 MB, 696.72 MB, 696.69 MB, 601.35 MB, 601.37 MB, 601.52 MB, 601.35 MB, 601.81 MB, 601.68 MB, 529.75 MB, 506.05 MB, 409.90 MB, 330.85 MB, 314.57 MB, 314.60 MB, 306.91 MB, 219.25 MB, 218.95 MB, 334.60 MB, 334.53 MB, 302.96 MB, 295.18 MB, 294.81 MB, 255.56 MB, 255.51 MB, 255.11 MB, 175.16 MB, 126.50 MB, 94.24 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 11.08 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 7.63K (7633) - PeakMemoryUsage: 793.09 MB (831614367) - PerHostPeakMemUsage: 1.60 GB (1720283702) - RowsProduced: 62.58M (62581434) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s524ms - TotalStorageWaitTime: 614.576ms - TotalWallClockTime: 4m25s - SysTime: 1s352ms - UserTime: 31s326ms - VoluntaryContextSwitches: 62.13K (62127) Fragment Instance Lifecycle Timings: - ExecTime: 23s615ms - ExecTreeExecTime: 1s163ms - OpenTime: 75.838ms - ExecTreeOpenTime: 57.536us - PrepareTime: 52.915ms - ExecTreePrepareTime: 155.072us DataStreamSender (dst_id=7):(Total: 16s628ms, non-child: 16s628ms, % non-child: 100.00%) - BytesSent: 1.41 GB (1518736816) - NetworkThroughput(*): 264.17 MB/sec - OverallThroughput: 87.10 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 62.58M (62581434) - SerializeBatchTime: 11s127ms - TransmitDataRPCTime: 5s482ms - UncompressedRowBatchSize: 3.21 GB (3442606282) CodeGen:(Total: 108.587ms, non-child: 108.587ms, % non-child: 100.00%) - CodegenTime: 2.092ms - CompileTime: 15.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 59.092ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 33.269ms HDFS_SCAN_NODE (id=2):(Total: 1s131ms, non-child: 1s131ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 5:4/765.48 MB 9:2/506.78 MB 0:4/951.82 MB 7:1/253.39 MB 10:3/760.17 MB 2:2/506.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 884ms Hdfs Read Thread Concurrency Bucket: 0:97.87% 1:0% 2:0% 3:0% 4:2.128% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 434.00 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 702.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB - FooterProcessingTime: (Avg: 3.976ms ; Min: 1.948ms ; Max: 6.671ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 10.30 - BytesRead: 980.66 MB (1028294922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 980.66 MB (1028294922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 980.66 MB (1028294922) - DecompressionTime: 2s819ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.63 MB (814356016) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.573ms - RowBatchQueuePutWaitTime: 3m39s - RowsRead: 116.10M (116100817) - RowsReturned: 62.58M (62581434) - RowsReturnedRate: 55.33 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 5.67K (5675) - ScannerThreadsTotalWallClockTime: 4m2s - MaterializeTupleTime(*): 9s536ms - ScannerThreadsSysTime: 619.900ms - ScannerThreadsUserTime: 12s758ms - ScannerThreadsVoluntaryContextSwitches: 61.83K (61834) - TotalRawHdfsReadTime(*): 677.229ms - TotalReadThroughput: 40.86 MB/sec Filter 1 (16.00 MB): - Rows processed: 347.64K (347645) - Rows rejected: 2.97K (2972) - Rows total: 116.10M (116100817) Instance de4b40c22a7cb446:5 (host=vb0218.halxg.cloudera.com:22000):(Total: 117.778ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.38 MB 2:1/253.39 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 7:2/506.76 MB 0:5/1.24 GB 1:1/253.39 MB Filter 1 arrival: 4s401ms MemoryUsage(500.000ms): 46.76 KB, 59.86 KB, 222.29 MB, 774.54 MB, 774.54 MB, 774.54 MB, 774.54 MB, 774.54 MB, 774.54 MB, 790.54 MB, 792.09 MB, 792.16 MB, 792.34 MB, 792.04 MB, 791.96 MB, 792.04 MB, 744.55 MB, 696.76 MB, 696.64 MB, 697.04 MB, 696.60 MB, 696.90 MB, 696.90 MB, 649.03 MB, 601.51 MB, 601.38 MB, 601.52 MB, 601.48 MB, 601.22 MB, 601.64 MB, 522.04 MB, 505.85 MB, 426.52 MB, 330.59 MB, 315.09 MB, 314.79 MB, 306.83 MB, 226.70 MB, 218.75 MB, 364.07 MB, 348.74 MB, 348.71 MB, 309.02 MB, 308.93 MB, 269.09 MB, 269.41 MB, 269.46 MB, 229.25 MB, 149.71 MB, 149.74 MB, 109.44 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.14 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.71K (12712) - PeakMemoryUsage: 793.00 MB (831518247) - PerHostPeakMemUsage: 1.60 GB (1720722065) - RowsProduced: 63.42M (63420083) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s520ms - TotalStorageWaitTime: 645.881ms - TotalWallClockTime: 4m42s - SysTime: 2s259ms - UserTime: 42s406ms - VoluntaryContextSwitches: 62.89K (62886) Fragment Instance Lifecycle Timings: - ExecTime: 25s046ms - ExecTreeExecTime: 1s330ms - OpenTime: 64.647ms - ExecTreeOpenTime: 50.272us - PrepareTime: 53.074ms - ExecTreePrepareTime: 245.384us DataStreamSender (dst_id=7):(Total: 14s689ms, non-child: 14s689ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538344755) - NetworkThroughput(*): 435.44 MB/sec - OverallThroughput: 99.87 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.42M (63420083) - SerializeBatchTime: 11s295ms - TransmitDataRPCTime: 3s369ms - UncompressedRowBatchSize: 3.25 GB (3488740381) CodeGen:(Total: 94.271ms, non-child: 94.271ms, % non-child: 100.00%) - CodegenTime: 1.731ms - CompileTime: 16.979ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.658ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 30.152ms HDFS_SCAN_NODE (id=2):(Total: 1s287ms, non-child: 1s287ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.38 MB 2:1/253.39 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 7:2/506.76 MB 0:5/1.24 GB 1:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 883ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:0% 2:0% 3:0% 4:0% 5:0% 6:2% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 158.43 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB - FooterProcessingTime: (Avg: 5.627ms ; Min: 1.925ms ; Max: 26.151ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 993.42 MB (1041676926) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.42 MB (1041676926) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.42 MB (1041676926) - DecompressionTime: 4s870ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.62 MB (814344888) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.733ms - RowBatchQueuePutWaitTime: 3m44s - RowsRead: 117.66M (117660047) - RowsReturned: 63.42M (63420083) - RowsReturnedRate: 49.26 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.50K (10501) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 17s361ms - ScannerThreadsSysTime: 1s108ms - ScannerThreadsUserTime: 22s858ms - ScannerThreadsVoluntaryContextSwitches: 62.67K (62670) - TotalRawHdfsReadTime(*): 712.131ms - TotalReadThroughput: 38.96 MB/sec Filter 1 (16.00 MB): - Rows processed: 342.37K (342367) - Rows rejected: 2.79K (2786) - Rows total: 117.66M (117660047) Instance de4b40c22a7cb446:c (host=vb0214.halxg.cloudera.com:22000):(Total: 115.989ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/234.34 MB 10:1/253.38 MB 0:1/253.42 MB 8:1/253.39 MB 3:2/506.77 MB 1:2/506.76 MB 6:2/481.03 MB 7:5/1.18 GB 4:3/760.14 MB Filter 1 arrival: 4s509ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 761.63 MB, 761.63 MB, 761.63 MB, 761.63 MB, 761.63 MB, 761.63 MB, 761.63 MB, 778.80 MB, 779.27 MB, 779.10 MB, 779.09 MB, 779.26 MB, 779.32 MB, 747.46 MB, 683.75 MB, 683.79 MB, 683.53 MB, 683.80 MB, 683.57 MB, 683.49 MB, 643.90 MB, 588.53 MB, 588.69 MB, 588.69 MB, 588.61 MB, 588.64 MB, 588.71 MB, 548.61 MB, 493.19 MB, 436.70 MB, 389.16 MB, 301.54 MB, 301.58 MB, 301.61 MB, 308.33 MB, 314.41 MB, 409.33 MB, 398.52 MB, 398.47 MB, 382.53 MB, 350.76 MB, 350.63 MB, 335.01 MB, 303.10 MB, 303.09 MB, 295.19 MB, 247.12 MB, 191.28 MB, 141.82 MB, 94.31 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 5 - AverageThreadTokens: 11.44 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.77K (12767) - PeakMemoryUsage: 780.12 MB (818012195) - PerHostPeakMemUsage: 1.59 GB (1707342219) - RowsProduced: 65.71M (65710227) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s530ms - TotalStorageWaitTime: 641.281ms - TotalWallClockTime: 4m56s - SysTime: 2s432ms - UserTime: 42s852ms - VoluntaryContextSwitches: 65.22K (65217) Fragment Instance Lifecycle Timings: - ExecTime: 26s069ms - ExecTreeExecTime: 1s365ms - OpenTime: 67.762ms - ExecTreeOpenTime: 52.177us - PrepareTime: 48.188ms - ExecTreePrepareTime: 273.571us DataStreamSender (dst_id=7):(Total: 15s504ms, non-child: 15s504ms, % non-child: 100.00%) - BytesSent: 1.49 GB (1594586844) - NetworkThroughput(*): 439.39 MB/sec - OverallThroughput: 98.08 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 65.71M (65710227) - SerializeBatchTime: 12s022ms - TransmitDataRPCTime: 3s460ms - UncompressedRowBatchSize: 3.37 GB (3614721257) CodeGen:(Total: 96.403ms, non-child: 96.403ms, % non-child: 100.00%) - CodegenTime: 1.515ms - CompileTime: 18.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.469ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.042ms HDFS_SCAN_NODE (id=2):(Total: 1s316ms, non-child: 1s316ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/234.34 MB 10:1/253.38 MB 0:1/253.42 MB 8:1/253.39 MB 3:2/506.77 MB 1:2/506.76 MB 6:2/481.03 MB 7:5/1.18 GB 4:3/760.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 749.35 MB, 807.79 MB, 924.66 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB - FooterProcessingTime: (Avg: 3.477ms ; Min: 2.281ms ; Max: 5.342ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.44 - BytesRead: 1.01 GB (1079189381) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 GB (1079189381) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 GB (1079189381) - DecompressionTime: 4s777ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 763.61 MB (800705708) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.049ms - RowBatchQueuePutWaitTime: 3m57s - RowsRead: 121.89M (121886452) - RowsReturned: 65.71M (65710227) - RowsReturnedRate: 49.93 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.43K (10433) - ScannerThreadsTotalWallClockTime: 4m30s - MaterializeTupleTime(*): 17s134ms - ScannerThreadsSysTime: 1s148ms - ScannerThreadsUserTime: 22s442ms - ScannerThreadsVoluntaryContextSwitches: 64.91K (64912) - TotalRawHdfsReadTime(*): 730.280ms - TotalReadThroughput: 39.58 MB/sec Filter 1 (16.00 MB): - Rows processed: 367.16K (367161) - Rows rejected: 3.03K (3032) - Rows total: 121.89M (121886452) Instance de4b40c22a7cb446:1 (host=vb0230.halxg.cloudera.com:22000):(Total: 114.115ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 9:1/253.39 MB 6:2/506.80 MB 3:1/7.47 MB 5:2/506.78 MB 0:2/506.78 MB 7:2/260.78 MB 2:2/506.80 MB 8:4/1013.57 MB 4:2/506.81 MB Filter 1 arrival: 4s439ms MemoryUsage(500.000ms): 0, 59.86 KB, 59.86 KB, 656.60 MB, 656.60 MB, 656.60 MB, 656.60 MB, 656.60 MB, 656.60 MB, 672.60 MB, 791.80 MB, 792.45 MB, 792.30 MB, 792.16 MB, 792.21 MB, 792.45 MB, 713.21 MB, 697.20 MB, 697.24 MB, 696.77 MB, 696.46 MB, 696.48 MB, 672.81 MB, 601.54 MB, 601.30 MB, 601.49 MB, 601.15 MB, 601.49 MB, 601.24 MB, 513.40 MB, 505.49 MB, 409.78 MB, 322.29 MB, 314.45 MB, 314.56 MB, 290.74 MB, 218.98 MB, 218.27 MB, 348.46 MB, 348.77 MB, 348.66 MB, 309.11 MB, 309.07 MB, 269.30 MB, 269.37 MB, 269.63 MB, 229.35 MB, 165.47 MB, 149.72 MB, 109.39 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.08 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.94K (8940) - PeakMemoryUsage: 793.01 MB (831527747) - PerHostPeakMemUsage: 1.59 GB (1709651561) - RowsProduced: 63.62M (63621256) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s533ms - TotalStorageWaitTime: 680.797ms - TotalWallClockTime: 4m35s - SysTime: 1s496ms - UserTime: 33s386ms - VoluntaryContextSwitches: 63.01K (63005) Fragment Instance Lifecycle Timings: - ExecTime: 24s674ms - ExecTreeExecTime: 1s221ms - OpenTime: 63.838ms - ExecTreeOpenTime: 59.448us - PrepareTime: 50.241ms - ExecTreePrepareTime: 261.704us DataStreamSender (dst_id=7):(Total: 17s323ms, non-child: 17s323ms, % non-child: 100.00%) - BytesSent: 1.44 GB (1543958316) - NetworkThroughput(*): 262.60 MB/sec - OverallThroughput: 85.00 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.62M (63621256) - SerializeBatchTime: 11s695ms - TransmitDataRPCTime: 5s607ms - UncompressedRowBatchSize: 3.26 GB (3499806916) CodeGen:(Total: 92.777ms, non-child: 92.777ms, % non-child: 100.00%) - CodegenTime: 1.509ms - CompileTime: 16.099ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.744ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.428ms HDFS_SCAN_NODE (id=2):(Total: 1s186ms, non-child: 1s186ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 9:1/253.39 MB 6:2/506.80 MB 3:1/7.47 MB 5:2/506.78 MB 0:2/506.78 MB 7:2/260.78 MB 2:2/506.80 MB 8:4/1013.57 MB 4:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:97.96% 1:2.041% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(500.000ms): 0, 0, 0, 588.19 MB, 588.19 MB, 588.19 MB, 588.19 MB, 588.19 MB, 588.19 MB, 588.19 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 721.26 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB - FooterProcessingTime: (Avg: 4.173ms ; Min: 2.089ms ; Max: 7.706ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 997.24 MB (1045686580) - BytesReadDataNodeCache: 0 - BytesReadLocal: 997.24 MB (1045686580) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 997.24 MB (1045686580) - DecompressionTime: 3s016ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.53 MB (814253052) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.947ms - RowBatchQueuePutWaitTime: 3m47s - RowsRead: 118.04M (118040430) - RowsReturned: 63.62M (63621256) - RowsReturnedRate: 53.60 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.88K (6877) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 10s454ms - ScannerThreadsSysTime: 651.894ms - ScannerThreadsUserTime: 13s907ms - ScannerThreadsVoluntaryContextSwitches: 62.80K (62802) - TotalRawHdfsReadTime(*): 755.309ms - TotalReadThroughput: 39.89 MB/sec Filter 1 (16.00 MB): - Rows processed: 442.07K (442069) - Rows rejected: 3.88K (3885) - Rows total: 118.04M (118040430) Instance de4b40c22a7cb446:9 (host=vb0222.halxg.cloudera.com:22000):(Total: 112.456ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.41 MB 8:1/253.41 MB 7:1/253.40 MB 0:4/1013.57 MB 6:3/760.17 MB 1:2/506.82 MB 9:5/1.24 GB Filter 1 arrival: 4s459ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 492.02 MB, 774.35 MB, 774.35 MB, 774.35 MB, 774.35 MB, 774.35 MB, 774.35 MB, 790.35 MB, 792.58 MB, 792.68 MB, 791.95 MB, 792.43 MB, 792.04 MB, 791.86 MB, 697.34 MB, 696.82 MB, 696.48 MB, 697.12 MB, 696.71 MB, 696.92 MB, 696.55 MB, 601.57 MB, 601.51 MB, 601.28 MB, 601.72 MB, 601.61 MB, 601.67 MB, 553.83 MB, 505.47 MB, 449.88 MB, 378.23 MB, 314.37 MB, 314.32 MB, 307.17 MB, 242.57 MB, 218.56 MB, 425.69 MB, 348.58 MB, 348.63 MB, 309.03 MB, 308.97 MB, 293.09 MB, 269.59 MB, 269.31 MB, 237.51 MB, 173.37 MB, 149.65 MB, 94.41 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 11.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.01K (12005) - PeakMemoryUsage: 792.86 MB (831372135) - PerHostPeakMemUsage: 1.60 GB (1721230764) - RowsProduced: 63.43M (63429366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s528ms - TotalStorageWaitTime: 694.314ms - TotalWallClockTime: 4m38s - SysTime: 2s330ms - UserTime: 39s231ms - VoluntaryContextSwitches: 63.02K (63022) Fragment Instance Lifecycle Timings: - ExecTime: 24s694ms - ExecTreeExecTime: 1s296ms - OpenTime: 64.367ms - ExecTreeOpenTime: 52.740us - PrepareTime: 48.040ms - ExecTreePrepareTime: 252.864us DataStreamSender (dst_id=7):(Total: 14s601ms, non-child: 14s601ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539393420) - NetworkThroughput(*): 456.25 MB/sec - OverallThroughput: 100.54 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.43M (63429366) - SerializeBatchTime: 11s362ms - TransmitDataRPCTime: 3s217ms - UncompressedRowBatchSize: 3.25 GB (3489251038) CodeGen:(Total: 93.765ms, non-child: 93.765ms, % non-child: 100.00%) - CodegenTime: 1.581ms - CompileTime: 16.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.805ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.712ms HDFS_SCAN_NODE (id=2):(Total: 1s257ms, non-child: 1s257ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.41 MB 8:1/253.41 MB 7:1/253.40 MB 0:4/1013.57 MB 6:3/760.17 MB 1:2/506.82 MB 9:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:97.96% 1:0% 2:0% 3:2.041% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 412.16 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB - FooterProcessingTime: (Avg: 4.424ms ; Min: 2.227ms ; Max: 10.862ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 10.37 - BytesRead: 993.42 MB (1041678633) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.42 MB (1041678633) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.42 MB (1041678633) - DecompressionTime: 4s322ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.41 MB (814121968) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.324ms - RowBatchQueuePutWaitTime: 3m43s - RowsRead: 117.66M (117660067) - RowsReturned: 63.43M (63429366) - RowsReturnedRate: 50.43 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.90K (9904) - ScannerThreadsTotalWallClockTime: 4m13s - MaterializeTupleTime(*): 15s423ms - ScannerThreadsSysTime: 1s013ms - ScannerThreadsUserTime: 20s212ms - ScannerThreadsVoluntaryContextSwitches: 62.77K (62773) - TotalRawHdfsReadTime(*): 677.990ms - TotalReadThroughput: 39.74 MB/sec Filter 1 (16.00 MB): - Rows processed: 383.50K (383495) - Rows rejected: 2.99K (2992) - Rows total: 117.66M (117660067) Instance de4b40c22a7cb446:a (host=vb0208.halxg.cloudera.com:22000):(Total: 112.390ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 2:2/506.77 MB 5:2/506.81 MB 6:4/1013.59 MB 7:2/479.24 MB 9:1/253.40 MB 10:2/440.61 MB 0:4/1013.59 MB Filter 1 arrival: 4s506ms MemoryUsage(500.000ms): 54.76 KB, 59.86 KB, 636.88 MB, 758.43 MB, 758.43 MB, 758.43 MB, 758.43 MB, 758.43 MB, 758.43 MB, 774.43 MB, 775.86 MB, 776.06 MB, 775.89 MB, 776.25 MB, 776.37 MB, 776.14 MB, 680.72 MB, 681.25 MB, 681.16 MB, 680.82 MB, 680.69 MB, 680.81 MB, 664.88 MB, 585.56 MB, 585.70 MB, 585.59 MB, 585.43 MB, 585.40 MB, 585.56 MB, 505.65 MB, 489.83 MB, 441.64 MB, 377.99 MB, 354.30 MB, 354.39 MB, 338.28 MB, 266.56 MB, 258.40 MB, 397.05 MB, 397.27 MB, 397.27 MB, 349.42 MB, 349.67 MB, 349.42 MB, 317.64 MB, 285.88 MB, 286.07 MB, 269.89 MB, 206.31 MB, 142.62 MB, 102.55 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 5 - AverageThreadTokens: 11.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.47K (12471) - PeakMemoryUsage: 777.03 MB (814777763) - PerHostPeakMemUsage: 1.59 GB (1704156328) - RowsProduced: 65.76M (65760793) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s519ms - TotalStorageWaitTime: 656.464ms - TotalWallClockTime: 4m46s - SysTime: 2s413ms - UserTime: 41s233ms - VoluntaryContextSwitches: 65.28K (65282) Fragment Instance Lifecycle Timings: - ExecTime: 25s317ms - ExecTreeExecTime: 1s310ms - OpenTime: 62.470ms - ExecTreeOpenTime: 47.696us - PrepareTime: 49.877ms - ExecTreePrepareTime: 287.448us DataStreamSender (dst_id=7):(Total: 15s119ms, non-child: 15s119ms, % non-child: 100.00%) - BytesSent: 1.49 GB (1595551550) - NetworkThroughput(*): 456.65 MB/sec - OverallThroughput: 100.64 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 65.76M (65760793) - SerializeBatchTime: 11s765ms - TransmitDataRPCTime: 3s332ms - UncompressedRowBatchSize: 3.37 GB (3617502899) CodeGen:(Total: 89.916ms, non-child: 89.916ms, % non-child: 100.00%) - CodegenTime: 1.750ms - CompileTime: 15.748ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 45.834ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.804ms HDFS_SCAN_NODE (id=2):(Total: 1s270ms, non-child: 1s270ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 2:2/506.77 MB 5:2/506.81 MB 6:4/1013.59 MB 7:2/479.24 MB 9:1/253.40 MB 10:2/440.61 MB 0:4/1013.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:0% 2:0% 3:0% 4:2% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 544.42 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 686.02 MB, 744.46 MB, 744.46 MB, 744.46 MB, 744.46 MB, 744.46 MB, 744.46 MB, 744.46 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB - FooterProcessingTime: (Avg: 3.413ms ; Min: 2.024ms ; Max: 7.646ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 1.01 GB (1080355072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 GB (1080355072) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 GB (1080355072) - DecompressionTime: 4s617ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 760.50 MB (797437000) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.179ms - RowBatchQueuePutWaitTime: 3m48s - RowsRead: 122.02M (122016885) - RowsReturned: 65.76M (65760793) - RowsReturnedRate: 51.76 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.23K (10232) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 16s457ms - ScannerThreadsSysTime: 1s079ms - ScannerThreadsUserTime: 21s615ms - ScannerThreadsVoluntaryContextSwitches: 64.95K (64953) - TotalRawHdfsReadTime(*): 775.912ms - TotalReadThroughput: 40.40 MB/sec Filter 1 (16.00 MB): - Rows processed: 346.21K (346209) - Rows rejected: 2.94K (2942) - Rows total: 122.02M (122016885) Instance de4b40c22a7cb446:7 (host=vb0220.halxg.cloudera.com:22000):(Total: 110.922ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 7:1/253.39 MB 9:1/253.41 MB 10:1/253.40 MB 6:1/253.39 MB 4:2/506.78 MB 5:1/253.38 MB 0:4/1013.57 MB 2:4/1013.58 MB Filter 1 arrival: 4s417ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.12 MB, 774.12 MB, 774.12 MB, 774.12 MB, 774.12 MB, 774.12 MB, 790.12 MB, 791.28 MB, 792.37 MB, 792.20 MB, 792.20 MB, 792.50 MB, 792.10 MB, 744.95 MB, 697.02 MB, 697.03 MB, 696.81 MB, 696.92 MB, 696.69 MB, 696.50 MB, 609.10 MB, 601.07 MB, 601.01 MB, 601.34 MB, 601.21 MB, 601.13 MB, 553.27 MB, 505.35 MB, 441.39 MB, 369.73 MB, 314.58 MB, 314.07 MB, 314.28 MB, 242.61 MB, 218.39 MB, 410.02 MB, 348.64 MB, 348.57 MB, 348.76 MB, 308.92 MB, 308.87 MB, 285.14 MB, 269.72 MB, 269.47 MB, 237.37 MB, 181.55 MB, 149.88 MB, 109.54 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.32 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.97K (12968) - PeakMemoryUsage: 792.99 MB (831505431) - PerHostPeakMemUsage: 1.60 GB (1720580914) - RowsProduced: 63.44M (63437986) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s524ms - TotalStorageWaitTime: 708.838ms - TotalWallClockTime: 4m41s - SysTime: 2s270ms - UserTime: 42s830ms - VoluntaryContextSwitches: 62.92K (62916) Fragment Instance Lifecycle Timings: - ExecTime: 25s237ms - ExecTreeExecTime: 1s361ms - OpenTime: 66.989ms - ExecTreeOpenTime: 59.276us - PrepareTime: 43.894ms - ExecTreePrepareTime: 256.791us DataStreamSender (dst_id=7):(Total: 14s634ms, non-child: 14s634ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1540021422) - NetworkThroughput(*): 469.57 MB/sec - OverallThroughput: 100.36 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.44M (63437986) - SerializeBatchTime: 11s483ms - TransmitDataRPCTime: 3s127ms - UncompressedRowBatchSize: 3.25 GB (3489725226) CodeGen:(Total: 93.143ms, non-child: 93.143ms, % non-child: 100.00%) - CodegenTime: 1.535ms - CompileTime: 18.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.530ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.454ms HDFS_SCAN_NODE (id=2):(Total: 1s313ms, non-child: 1s313ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 7:1/253.39 MB 9:1/253.41 MB 10:1/253.40 MB 6:1/253.39 MB 4:2/506.78 MB 5:1/253.38 MB 0:4/1013.57 MB 2:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 905ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:2% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 943.10 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB - FooterProcessingTime: (Avg: 6.363ms ; Min: 2.434ms ; Max: 27.533ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 993.44 MB (1041695130) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.44 MB (1041695130) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.44 MB (1041695130) - DecompressionTime: 4s877ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.55 MB (814271656) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.063ms - RowBatchQueuePutWaitTime: 3m43s - RowsRead: 117.66M (117660134) - RowsReturned: 63.44M (63437986) - RowsReturnedRate: 48.30 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 10.69K (10690) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 17s606ms - ScannerThreadsSysTime: 1s120ms - ScannerThreadsUserTime: 23s117ms - ScannerThreadsVoluntaryContextSwitches: 62.63K (62634) - TotalRawHdfsReadTime(*): 831.875ms - TotalReadThroughput: 39.74 MB/sec Filter 1 (16.00 MB): - Rows processed: 361.22K (361218) - Rows rejected: 3.10K (3101) - Rows total: 117.66M (117660134) Instance de4b40c22a7cb446:b (host=vb0206.halxg.cloudera.com:22000):(Total: 109.393ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:1/253.40 MB 8:1/253.41 MB 3:1/253.40 MB 7:2/506.80 MB 9:3/760.16 MB 10:1/253.41 MB 6:1/253.40 MB 2:3/760.21 MB Filter 1 arrival: 4s475ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.60 MB, 774.60 MB, 774.60 MB, 774.60 MB, 774.60 MB, 774.60 MB, 790.60 MB, 791.77 MB, 792.77 MB, 792.17 MB, 792.32 MB, 791.93 MB, 792.35 MB, 697.12 MB, 696.58 MB, 697.04 MB, 696.99 MB, 696.85 MB, 696.67 MB, 696.57 MB, 601.67 MB, 601.78 MB, 601.65 MB, 601.49 MB, 601.80 MB, 602.07 MB, 513.69 MB, 505.79 MB, 409.90 MB, 322.46 MB, 314.36 MB, 314.63 MB, 299.08 MB, 218.42 MB, 203.69 MB, 348.75 MB, 348.68 MB, 308.92 MB, 308.92 MB, 309.04 MB, 269.24 MB, 269.10 MB, 269.24 MB, 197.25 MB, 149.49 MB, 109.50 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.40 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.98K (8978) - PeakMemoryUsage: 792.98 MB (831503339) - PerHostPeakMemUsage: 1.60 GB (1720823652) - RowsProduced: 63.41M (63407462) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s525ms - TotalStorageWaitTime: 724.222ms - TotalWallClockTime: 4m33s - SysTime: 1s435ms - UserTime: 32s715ms - VoluntaryContextSwitches: 63.05K (63049) Fragment Instance Lifecycle Timings: - ExecTime: 24s286ms - ExecTreeExecTime: 1s211ms - OpenTime: 64.781ms - ExecTreeOpenTime: 59.502us - PrepareTime: 44.567ms - ExecTreePrepareTime: 315.644us DataStreamSender (dst_id=7):(Total: 17s243ms, non-child: 17s243ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538865305) - NetworkThroughput(*): 254.78 MB/sec - OverallThroughput: 85.11 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.41M (63407462) - SerializeBatchTime: 11s463ms - TransmitDataRPCTime: 5s760ms - UncompressedRowBatchSize: 3.25 GB (3488046102) CodeGen:(Total: 89.554ms, non-child: 89.554ms, % non-child: 100.00%) - CodegenTime: 1.585ms - CompileTime: 17.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 45.988ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.147ms HDFS_SCAN_NODE (id=2):(Total: 1s176ms, non-child: 1s176ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:1/253.40 MB 8:1/253.41 MB 3:1/253.40 MB 7:2/506.80 MB 9:3/760.16 MB 10:1/253.41 MB 6:1/253.40 MB 2:3/760.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB - FooterProcessingTime: (Avg: 4.572ms ; Min: 2.406ms ; Max: 17.315ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 993.41 MB (1041661462) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.41 MB (1041661462) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.41 MB (1041661462) - DecompressionTime: 2s966ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.47 MB (814187868) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.343ms - RowBatchQueuePutWaitTime: 3m45s - RowsRead: 117.66M (117659817) - RowsReturned: 63.41M (63407462) - RowsReturnedRate: 53.88 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.95K (6947) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 10s148ms - ScannerThreadsSysTime: 639.895ms - ScannerThreadsUserTime: 13s583ms - ScannerThreadsVoluntaryContextSwitches: 62.65K (62653) - TotalRawHdfsReadTime(*): 779.723ms - TotalReadThroughput: 41.39 MB/sec Filter 1 (16.00 MB): - Rows processed: 358.53K (358530) - Rows rejected: 3.02K (3025) - Rows total: 117.66M (117659817) Instance de4b40c22a7cb446:8 (host=vb0216.halxg.cloudera.com:22000):(Total: 107.218ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 3:3/760.19 MB 0:1/253.41 MB 2:2/506.79 MB 4:2/506.80 MB 7:1/253.39 MB 6:3/760.20 MB 10:4/1013.58 MB Filter 1 arrival: 4s471ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 790.92 MB, 792.61 MB, 792.53 MB, 792.04 MB, 792.52 MB, 792.12 MB, 744.58 MB, 697.48 MB, 696.58 MB, 696.92 MB, 696.81 MB, 696.60 MB, 696.72 MB, 601.88 MB, 602.03 MB, 602.09 MB, 602.04 MB, 601.98 MB, 601.72 MB, 577.50 MB, 506.12 MB, 441.97 MB, 394.32 MB, 314.85 MB, 314.84 MB, 315.09 MB, 218.89 MB, 219.14 MB, 348.03 MB, 348.75 MB, 349.01 MB, 308.81 MB, 308.85 MB, 309.18 MB, 269.10 MB, 269.45 MB, 229.50 MB, 165.67 MB, 149.89 MB, 110.08 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.29 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.50K (8496) - PeakMemoryUsage: 792.99 MB (831513527) - PerHostPeakMemUsage: 1.60 GB (1720638349) - RowsProduced: 63.41M (63414772) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s530ms - TotalStorageWaitTime: 650.801ms - TotalWallClockTime: 4m34s - SysTime: 1s306ms - UserTime: 32s545ms - VoluntaryContextSwitches: 62.97K (62968) Fragment Instance Lifecycle Timings: - ExecTime: 24s375ms - ExecTreeExecTime: 1s201ms - OpenTime: 62.602ms - ExecTreeOpenTime: 56.496us - PrepareTime: 44.576ms - ExecTreePrepareTime: 280.232us DataStreamSender (dst_id=7):(Total: 17s515ms, non-child: 17s515ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539186319) - NetworkThroughput(*): 249.08 MB/sec - OverallThroughput: 83.81 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.41M (63414772) - SerializeBatchTime: 11s601ms - TransmitDataRPCTime: 5s893ms - UncompressedRowBatchSize: 3.25 GB (3488448228) CodeGen:(Total: 88.898ms, non-child: 88.898ms, % non-child: 100.00%) - CodegenTime: 1.598ms - CompileTime: 15.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.234ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.554ms HDFS_SCAN_NODE (id=2):(Total: 1s167ms, non-child: 1s167ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 3:3/760.19 MB 0:1/253.41 MB 2:2/506.79 MB 4:2/506.80 MB 7:1/253.39 MB 6:3/760.20 MB 10:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB - FooterProcessingTime: (Avg: 3.561ms ; Min: 2.354ms ; Max: 5.203ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 993.45 MB (1041708915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.45 MB (1041708915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.45 MB (1041708915) - DecompressionTime: 2s900ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.53 MB (814248044) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.300ms - RowBatchQueuePutWaitTime: 3m47s - RowsRead: 117.66M (117659798) - RowsReturned: 63.41M (63414772) - RowsReturnedRate: 54.31 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.46K (6463) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 9s864ms - ScannerThreadsSysTime: 601.901ms - ScannerThreadsUserTime: 13s232ms - ScannerThreadsVoluntaryContextSwitches: 62.65K (62647) - TotalRawHdfsReadTime(*): 732.553ms - TotalReadThroughput: 40.55 MB/sec Filter 1 (16.00 MB): - Rows processed: 336.46K (336464) - Rows rejected: 2.79K (2791) - Rows total: 117.66M (117659798) Instance de4b40c22a7cb446:3 (host=vb0224.halxg.cloudera.com:22000):(Total: 105.300ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.77 MB 1:2/506.81 MB 4:1/253.38 MB 6:1/253.38 MB 2:2/506.78 MB 0:2/506.80 MB 10:2/506.83 MB 8:1/253.39 MB 3:4/1013.55 MB 7:1/253.40 MB Filter 1 arrival: 4s413ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.58 MB, 774.58 MB, 774.58 MB, 774.58 MB, 774.58 MB, 774.58 MB, 790.58 MB, 791.11 MB, 792.19 MB, 792.33 MB, 791.94 MB, 792.44 MB, 792.06 MB, 784.68 MB, 697.00 MB, 696.62 MB, 696.60 MB, 696.96 MB, 696.99 MB, 696.64 MB, 609.84 MB, 601.58 MB, 601.80 MB, 601.86 MB, 601.59 MB, 601.21 MB, 585.58 MB, 505.89 MB, 481.92 MB, 402.11 MB, 314.83 MB, 315.10 MB, 314.59 MB, 251.07 MB, 218.96 MB, 300.26 MB, 412.10 MB, 412.06 MB, 412.05 MB, 364.12 MB, 364.29 MB, 364.50 MB, 356.14 MB, 316.61 MB, 316.93 MB, 316.54 MB, 268.70 MB, 212.72 MB, 173.02 MB, 157.29 MB, 65.59 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 3 - AverageThreadTokens: 11.23 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 13.67K (13671) - PeakMemoryUsage: 793.00 MB (831520799) - PerHostPeakMemUsage: 1.60 GB (1721109855) - RowsProduced: 67.17M (67166465) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s533ms - TotalStorageWaitTime: 661.589ms - TotalWallClockTime: 4m56s - SysTime: 2s406ms - UserTime: 44s889ms - VoluntaryContextSwitches: 66.61K (66606) Fragment Instance Lifecycle Timings: - ExecTime: 26s385ms - ExecTreeExecTime: 1s378ms - OpenTime: 63.376ms - ExecTreeOpenTime: 58.952us - PrepareTime: 41.881ms - ExecTreePrepareTime: 281.056us DataStreamSender (dst_id=7):(Total: 15s528ms, non-child: 15s528ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629589814) - NetworkThroughput(*): 462.25 MB/sec - OverallThroughput: 100.08 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67166465) - SerializeBatchTime: 12s142ms - TransmitDataRPCTime: 3s362ms - UncompressedRowBatchSize: 3.44 GB (3694828947) CodeGen:(Total: 87.490ms, non-child: 87.490ms, % non-child: 100.00%) - CodegenTime: 1.866ms - CompileTime: 16.353ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.086ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.501ms HDFS_SCAN_NODE (id=2):(Total: 1s332ms, non-child: 1s332ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/506.77 MB 1:2/506.81 MB 4:1/253.38 MB 6:1/253.38 MB 2:2/506.78 MB 0:2/506.80 MB 10:2/506.83 MB 8:1/253.39 MB 3:4/1013.55 MB 7:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 818.08 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.100ms ; Min: 1.864ms ; Max: 20.597ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.23 - BytesRead: 1.03 GB (1102921011) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102921011) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102921011) - DecompressionTime: 5s117ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.51 MB (814229680) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.031ms - RowBatchQueuePutWaitTime: 3m55s - RowsRead: 124.58M (124581238) - RowsReturned: 67.17M (67166465) - RowsReturnedRate: 50.41 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.27K (11269) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 18s374ms - ScannerThreadsSysTime: 1s172ms - ScannerThreadsUserTime: 24s123ms - ScannerThreadsVoluntaryContextSwitches: 66.30K (66298) - TotalRawHdfsReadTime(*): 819.239ms - TotalReadThroughput: 39.69 MB/sec Filter 1 (16.00 MB): - Rows processed: 379.58K (379579) - Rows rejected: 3.14K (3144) - Rows total: 124.58M (124581238) Instance de4b40c22a7cb446:e (host=vb0232.halxg.cloudera.com:22000):(Total: 104.085ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.38 MB 8:1/253.40 MB 6:2/506.79 MB 0:4/1013.60 MB 4:2/506.80 MB 3:2/506.79 MB 9:4/1013.57 MB 5:1/253.39 MB 1:1/253.41 MB Filter 1 arrival: 4s527ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 791.23 MB, 792.35 MB, 791.74 MB, 792.13 MB, 792.55 MB, 792.57 MB, 696.78 MB, 696.78 MB, 696.75 MB, 696.75 MB, 696.82 MB, 696.55 MB, 673.05 MB, 601.46 MB, 601.76 MB, 601.53 MB, 601.60 MB, 601.74 MB, 601.34 MB, 505.58 MB, 505.89 MB, 409.53 MB, 314.36 MB, 314.65 MB, 314.44 MB, 274.66 MB, 218.82 MB, 281.50 MB, 412.23 MB, 412.16 MB, 411.95 MB, 364.23 MB, 364.36 MB, 364.54 MB, 317.05 MB, 316.74 MB, 316.82 MB, 268.82 MB, 220.73 MB, 173.29 MB, 173.12 MB, 125.17 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.35 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.64K (8639) - PeakMemoryUsage: 792.88 MB (831397059) - PerHostPeakMemUsage: 1.60 GB (1720365752) - RowsProduced: 67.17M (67171819) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s532ms - TotalStorageWaitTime: 716.998ms - TotalWallClockTime: 4m44s - SysTime: 1s493ms - UserTime: 34s315ms - VoluntaryContextSwitches: 66.59K (66590) Fragment Instance Lifecycle Timings: - ExecTime: 25s365ms - ExecTreeExecTime: 1s213ms - OpenTime: 61.463ms - ExecTreeOpenTime: 41.612us - PrepareTime: 42.582ms - ExecTreePrepareTime: 313.324us DataStreamSender (dst_id=7):(Total: 16s555ms, non-child: 16s555ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630295798) - NetworkThroughput(*): 357.21 MB/sec - OverallThroughput: 93.91 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67171819) - SerializeBatchTime: 12s180ms - TransmitDataRPCTime: 4s352ms - UncompressedRowBatchSize: 3.44 GB (3695123473) CodeGen:(Total: 87.174ms, non-child: 87.174ms, % non-child: 100.00%) - CodegenTime: 1.668ms - CompileTime: 14.319ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.246ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.090ms HDFS_SCAN_NODE (id=2):(Total: 1s177ms, non-child: 1s177ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.38 MB 8:1/253.40 MB 6:2/506.79 MB 0:4/1013.60 MB 4:2/506.80 MB 3:2/506.79 MB 9:4/1013.57 MB 5:1/253.39 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:98.04% 1:0% 2:1.961% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 799.62 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.753ms ; Min: 1.812ms ; Max: 23.595ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 1.03 GB (1102943871) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102943871) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102943871) - DecompressionTime: 3s105ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.42 MB (814130564) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.313ms - RowBatchQueuePutWaitTime: 3m55s - RowsRead: 124.58M (124581331) - RowsReturned: 67.17M (67171819) - RowsReturnedRate: 57.03 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.51K (6508) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 10s600ms - ScannerThreadsSysTime: 675.891ms - ScannerThreadsUserTime: 14s135ms - ScannerThreadsVoluntaryContextSwitches: 66.37K (66367) - TotalRawHdfsReadTime(*): 755.132ms - TotalReadThroughput: 41.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 355.30K (355301) - Rows rejected: 2.83K (2825) - Rows total: 124.58M (124581331) Instance de4b40c22a7cb446:2 (host=vb0212.halxg.cloudera.com:22000):(Total: 103.958ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:1/253.42 MB 4:1/253.39 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 8:3/760.17 MB 5:3/760.16 MB 9:1/253.39 MB 3:1/253.40 MB 2:1/253.40 MB Filter 1 arrival: 4s383ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 773.28 MB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 790.40 MB, 792.09 MB, 792.18 MB, 792.20 MB, 791.91 MB, 792.45 MB, 792.22 MB, 696.76 MB, 696.80 MB, 697.07 MB, 696.97 MB, 697.01 MB, 697.04 MB, 688.74 MB, 609.74 MB, 601.78 MB, 601.93 MB, 602.08 MB, 601.39 MB, 601.59 MB, 593.70 MB, 505.38 MB, 497.74 MB, 418.30 MB, 330.71 MB, 314.53 MB, 315.09 MB, 314.75 MB, 227.01 MB, 218.65 MB, 319.11 MB, 285.48 MB, 285.40 MB, 253.28 MB, 253.47 MB, 221.69 MB, 221.93 MB, 189.57 MB, 126.31 MB, 126.20 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 10.92 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 11.65K (11655) - PeakMemoryUsage: 792.88 MB (831398743) - PerHostPeakMemUsage: 1.60 GB (1720527823) - RowsProduced: 59.70M (59701607) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s528ms - TotalStorageWaitTime: 627.013ms - TotalWallClockTime: 4m27s - SysTime: 2s300ms - UserTime: 39s315ms - VoluntaryContextSwitches: 58.83K (58830) Fragment Instance Lifecycle Timings: - ExecTime: 24s531ms - ExecTreeExecTime: 1s359ms - OpenTime: 63.182ms - ExecTreeOpenTime: 47.351us - PrepareTime: 40.710ms - ExecTreePrepareTime: 280.121us DataStreamSender (dst_id=7):(Total: 14s134ms, non-child: 14s134ms, % non-child: 100.00%) - BytesSent: 1.35 GB (1448646790) - NetworkThroughput(*): 446.06 MB/sec - OverallThroughput: 97.74 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 59.70M (59701607) - SerializeBatchTime: 11s012ms - TransmitDataRPCTime: 3s097ms - UncompressedRowBatchSize: 3.06 GB (3284186925) CodeGen:(Total: 87.940ms, non-child: 87.940ms, % non-child: 100.00%) - CodegenTime: 1.647ms - CompileTime: 15.872ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.443ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.111ms HDFS_SCAN_NODE (id=2):(Total: 1s312ms, non-child: 1s312ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:1/253.42 MB 4:1/253.39 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 8:3/760.17 MB 5:3/760.16 MB 9:1/253.39 MB 3:1/253.40 MB 2:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB - FooterProcessingTime: (Avg: 3.412ms ; Min: 2.058ms ; Max: 5.164ms ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.92 - BytesRead: 934.98 MB (980401417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.98 MB (980401417) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.98 MB (980401417) - DecompressionTime: 4s359ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.42 MB (814140392) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.858ms - RowBatchQueuePutWaitTime: 3m41s - RowsRead: 110.74M (110738621) - RowsReturned: 59.70M (59701607) - RowsReturnedRate: 45.48 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 9.51K (9510) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 15s545ms - ScannerThreadsSysTime: 1s093ms - ScannerThreadsUserTime: 20s359ms - ScannerThreadsVoluntaryContextSwitches: 58.51K (58514) - TotalRawHdfsReadTime(*): 811.627ms - TotalReadThroughput: 38.16 MB/sec Filter 1 (16.00 MB): - Rows processed: 362.57K (362569) - Rows rejected: 3.30K (3298) - Rows total: 110.74M (110738621) Instance de4b40c22a7cb446:4 (host=vb0234.halxg.cloudera.com:22000):(Total: 101.636ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.79 MB 6:1/253.39 MB 1:3/760.21 MB 7:1/253.40 MB 8:1/253.38 MB 10:3/760.19 MB 3:3/760.17 MB 4:4/1013.54 MB Filter 1 arrival: 4s433ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.16 MB, 774.16 MB, 774.16 MB, 774.16 MB, 774.16 MB, 774.16 MB, 774.16 MB, 791.30 MB, 792.33 MB, 792.39 MB, 792.51 MB, 792.47 MB, 792.21 MB, 760.42 MB, 696.87 MB, 696.83 MB, 696.89 MB, 696.72 MB, 696.49 MB, 696.74 MB, 609.05 MB, 601.18 MB, 601.00 MB, 601.27 MB, 601.90 MB, 601.80 MB, 545.67 MB, 505.97 MB, 433.70 MB, 354.30 MB, 314.39 MB, 314.65 MB, 314.56 MB, 218.62 MB, 218.49 MB, 411.28 MB, 412.23 MB, 412.22 MB, 364.63 MB, 364.16 MB, 364.22 MB, 316.96 MB, 316.73 MB, 316.73 MB, 308.86 MB, 228.97 MB, 173.43 MB, 173.65 MB, 125.42 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.35 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 9.31K (9306) - PeakMemoryUsage: 793.04 MB (831561703) - PerHostPeakMemUsage: 1.62 GB (1742277852) - RowsProduced: 67.17M (67173409) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s535ms - TotalStorageWaitTime: 698.589ms - TotalWallClockTime: 4m46s - SysTime: 1s526ms - UserTime: 34s720ms - VoluntaryContextSwitches: 66.60K (66598) Fragment Instance Lifecycle Timings: - ExecTime: 25s507ms - ExecTreeExecTime: 1s233ms - OpenTime: 64.129ms - ExecTreeOpenTime: 47.316us - PrepareTime: 37.483ms - ExecTreePrepareTime: 164.992us DataStreamSender (dst_id=7):(Total: 18s036ms, non-child: 18s036ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630484665) - NetworkThroughput(*): 269.30 MB/sec - OverallThroughput: 86.21 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67173409) - SerializeBatchTime: 12s243ms - TransmitDataRPCTime: 5s774ms - UncompressedRowBatchSize: 3.44 GB (3695210939) CodeGen:(Total: 86.142ms, non-child: 86.142ms, % non-child: 100.00%) - CodegenTime: 2.037ms - CompileTime: 16.790ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.483ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 22.317ms HDFS_SCAN_NODE (id=2):(Total: 1s194ms, non-child: 1s194ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.79 MB 6:1/253.39 MB 1:3/760.21 MB 7:1/253.40 MB 8:1/253.38 MB 10:3/760.19 MB 3:3/760.17 MB 4:4/1013.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.751ms ; Min: 1.981ms ; Max: 6.550ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 1.03 GB (1102941326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102941326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102941326) - DecompressionTime: 3s155ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.57 MB (814295164) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.466ms - RowBatchQueuePutWaitTime: 3m58s - RowsRead: 124.58M (124581346) - RowsReturned: 67.17M (67173409) - RowsReturnedRate: 56.25 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.16K (7158) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 10s776ms - ScannerThreadsSysTime: 706.886ms - ScannerThreadsUserTime: 14s397ms - ScannerThreadsVoluntaryContextSwitches: 66.30K (66302) - TotalRawHdfsReadTime(*): 763.367ms - TotalReadThroughput: 41.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 400.96K (400964) - Rows rejected: 3.71K (3706) - Rows total: 124.58M (124581346) Instance de4b40c22a7cb446:6 (host=vb0204.halxg.cloudera.com:22000):(Total: 95.583ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.15 MB 2:2/506.79 MB 5:1/253.39 MB 7:2/506.77 MB 8:4/1013.58 MB 4:4/1013.59 MB 0:2/506.81 MB Filter 1 arrival: 4s347ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 710.83 MB, 710.83 MB, 710.83 MB, 710.83 MB, 710.83 MB, 710.83 MB, 726.83 MB, 728.96 MB, 728.87 MB, 728.71 MB, 728.47 MB, 728.52 MB, 728.67 MB, 641.02 MB, 641.21 MB, 641.67 MB, 641.33 MB, 641.53 MB, 641.15 MB, 553.70 MB, 553.91 MB, 554.05 MB, 553.66 MB, 553.37 MB, 553.52 MB, 466.11 MB, 393.90 MB, 322.70 MB, 290.99 MB, 291.10 MB, 251.34 MB, 203.16 MB, 433.18 MB, 475.16 MB, 475.29 MB, 475.59 MB, 419.70 MB, 419.51 MB, 419.77 MB, 419.55 MB, 364.07 MB, 363.93 MB, 363.95 MB, 331.69 MB, 300.30 MB, 196.56 MB, 196.43 MB, 141.02 MB, 19.94 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 1 - AverageThreadTokens: 10.61 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 9.58K (9576) - PeakMemoryUsage: 729.57 MB (765007627) - PerHostPeakMemUsage: 1.54 GB (1653945909) - RowsProduced: 67.15M (67147667) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s536ms - TotalStorageWaitTime: 562.106ms - TotalWallClockTime: 4m30s - SysTime: 1s397ms - UserTime: 35s342ms - VoluntaryContextSwitches: 66.82K (66820) Fragment Instance Lifecycle Timings: - ExecTime: 25s364ms - ExecTreeExecTime: 1s255ms - OpenTime: 66.095ms - ExecTreeOpenTime: 60.451us - PrepareTime: 29.457ms - ExecTreePrepareTime: 177.684us DataStreamSender (dst_id=7):(Total: 18s265ms, non-child: 18s265ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629623739) - NetworkThroughput(*): 253.77 MB/sec - OverallThroughput: 85.09 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.15M (67147667) - SerializeBatchTime: 12s120ms - TransmitDataRPCTime: 6s124ms - UncompressedRowBatchSize: 3.44 GB (3693794873) CodeGen:(Total: 89.872ms, non-child: 89.872ms, % non-child: 100.00%) - CodegenTime: 2.315ms - CompileTime: 16.623ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.313ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.408ms HDFS_SCAN_NODE (id=2):(Total: 1s221ms, non-child: 1s221ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/760.15 MB 2:2/506.79 MB 5:1/253.39 MB 7:2/506.77 MB 8:4/1013.58 MB 4:4/1013.59 MB 0:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:98.04% 1:0% 2:1.961% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 941.22 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.177ms ; Min: 2.003ms ; Max: 5.224ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.61 - BytesRead: 1.03 GB (1102950275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102950275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102950275) - DecompressionTime: 3s164ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 713.16 MB (747799456) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.922ms - RowBatchQueuePutWaitTime: 3m40s - RowsRead: 124.58M (124581250) - RowsReturned: 67.15M (67147667) - RowsReturnedRate: 54.97 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.45K (7448) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 11s433ms - ScannerThreadsSysTime: 590.904ms - ScannerThreadsUserTime: 15s163ms - ScannerThreadsVoluntaryContextSwitches: 66.47K (66466) - TotalRawHdfsReadTime(*): 660.675ms - TotalReadThroughput: 41.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 411.10K (411102) - Rows rejected: 3.53K (3534) - Rows total: 124.58M (124581250) Averaged Fragment F01:(Total: 113.563ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 138.37 MB completion times: min:2s957ms max:4s059ms mean: 3s573ms stddev:271.552ms execution rates: min:324.55 MB/sec max:384.59 MB/sec mean:358.92 MB/sec stddev:18.45 MB/sec num instances: 15 - AverageThreadTokens: 5.74 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.01K (2007) - PeakMemoryUsage: 377.83 MB (396182244) - PerHostPeakMemUsage: 1.51 GB (1626399820) - RowsProduced: 7.37M (7367283) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.177ms - TotalStorageWaitTime: 169.467ms - TotalWallClockTime: 20s035ms - SysTime: 320.148ms - UserTime: 8s980ms - VoluntaryContextSwitches: 7.11K (7108) Fragment Instance Lifecycle Timings: - ExecTime: 3s458ms - ExecTreeExecTime: 619.853ms - OpenTime: 69.420ms - ExecTreeOpenTime: 55.874us - PrepareTime: 44.102ms - ExecTreePrepareTime: 158.761us DataStreamSender (dst_id=8):(Total: 1s855ms, non-child: 1s855ms, % non-child: 100.00%) - BytesSent: 174.40 MB (182873564) - NetworkThroughput(*): 359.62 MB/sec - OverallThroughput: 94.32 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.37M (7367283) - SerializeBatchTime: 1s348ms - TransmitDataRPCTime: 504.987ms - UncompressedRowBatchSize: 386.50 MB (405274453) CodeGen:(Total: 97.020ms, non-child: 97.020ms, % non-child: 100.00%) - CodegenTime: 1.745ms - CompileTime: 17.179ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 51.282ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.005ms HDFS_SCAN_NODE (id=1):(Total: 614.661ms, non-child: 614.661ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 4.91 - BytesRead: 322.02 MB (337667513) - BytesReadDataNodeCache: 0 - BytesReadLocal: 322.02 MB (337667513) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 322.02 MB (337667513) - DecompressionTime: 1s122ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 373.28 MB (391409936) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.855ms - RowBatchQueuePutWaitTime: 8s048ms - RowsRead: 30.00M (30000000) - RowsReturned: 7.37M (7367283) - RowsReturnedRate: 11.99 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1669) - ScannerThreadsTotalWallClockTime: 16s507ms - MaterializeTupleTime(*): 5s090ms - ScannerThreadsSysTime: 180.103ms - ScannerThreadsUserTime: 6s179ms - ScannerThreadsVoluntaryContextSwitches: 7.03K (7030) - TotalRawHdfsReadTime(*): 225.032ms - TotalReadThroughput: 91.62 MB/sec Filter 0 (4.00 MB): - Rows processed: 30.00M (30000000) - Rows rejected: 14.84M (14836390) - Rows total: 30.00M (30000000) Fragment F01: Instance de4b40c22a7cb446:16 (host=vb0222.halxg.cloudera.com:22000):(Total: 152.918ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 10:1/253.10 MB Filter 0 arrival: 633ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 340.43 MB, 300.77 MB, 224.10 MB, 191.73 MB, 128.12 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 4.86 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.71K (1707) - PeakMemoryUsage: 341.25 MB (357824755) - PerHostPeakMemUsage: 1.49 GB (1602645007) - RowsProduced: 6.52M (6516139) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.797ms - TotalStorageWaitTime: 155.462ms - TotalWallClockTime: 16s832ms - SysTime: 320.950ms - UserTime: 7s932ms - VoluntaryContextSwitches: 6.23K (6226) Fragment Instance Lifecycle Timings: - ExecTime: 3s191ms - ExecTreeExecTime: 549.571ms - OpenTime: 101.616ms - ExecTreeOpenTime: 72.860us - PrepareTime: 51.250ms - ExecTreePrepareTime: 162.336us DataStreamSender (dst_id=8):(Total: 1s828ms, non-child: 1s828ms, % non-child: 100.00%) - BytesSent: 154.18 MB (161674094) - NetworkThroughput(*): 266.62 MB/sec - OverallThroughput: 84.34 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.52M (6516139) - SerializeBatchTime: 1s247ms - TransmitDataRPCTime: 578.287ms - UncompressedRowBatchSize: 341.85 MB (358453005) CodeGen:(Total: 136.782ms, non-child: 136.782ms, % non-child: 100.00%) - CodegenTime: 2.146ms - CompileTime: 24.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 75.743ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 35.734ms HDFS_SCAN_NODE (id=1):(Total: 545.442ms, non-child: 545.442ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 10:1/253.10 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 482ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 284.77 MB, 284.77 MB, 284.77 MB, 284.77 MB, 284.77 MB - FooterProcessingTime: (Avg: 3.135ms ; Min: 2.386ms ; Max: 4.161ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 284.77 MB (298605909) - BytesReadDataNodeCache: 0 - BytesReadLocal: 284.77 MB (298605909) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 284.77 MB (298605909) - DecompressionTime: 957.753ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 336.75 MB (353106308) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.775ms - RowBatchQueuePutWaitTime: 6s192ms - RowsRead: 26.52M (26524501) - RowsReturned: 6.52M (6516139) - RowsReturnedRate: 11.95 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.42K (1418) - ScannerThreadsTotalWallClockTime: 13s539ms - MaterializeTupleTime(*): 4s401ms - ScannerThreadsSysTime: 191.969ms - ScannerThreadsUserTime: 5s288ms - ScannerThreadsVoluntaryContextSwitches: 6.15K (6150) - TotalRawHdfsReadTime(*): 183.357ms - TotalReadThroughput: 81.36 MB/sec Filter 0 (4.00 MB): - Rows processed: 26.52M (26524501) - Rows rejected: 13.12M (13115129) - Rows total: 26.52M (26524501) Instance de4b40c22a7cb446:19 (host=vb0206.halxg.cloudera.com:22000):(Total: 141.380ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 6:1/253.08 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Filter 0 arrival: 649ms MemoryUsage(500.000ms): 59.86 KB, 369.50 MB, 329.31 MB, 281.91 MB, 249.67 MB, 170.26 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.86K (1865) - PeakMemoryUsage: 370.00 MB (387974427) - PerHostPeakMemUsage: 1.50 GB (1614148274) - RowsProduced: 7.25M (7254751) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.258ms - TotalStorageWaitTime: 113.504ms - TotalWallClockTime: 18s881ms - SysTime: 358.943ms - UserTime: 9s960ms - VoluntaryContextSwitches: 6.99K (6990) Fragment Instance Lifecycle Timings: - ExecTime: 3s328ms - ExecTreeExecTime: 600.642ms - OpenTime: 83.193ms - ExecTreeOpenTime: 52.386us - PrepareTime: 58.121ms - ExecTreePrepareTime: 199.378us DataStreamSender (dst_id=8):(Total: 1s713ms, non-child: 1s713ms, % non-child: 100.00%) - BytesSent: 171.72 MB (180058250) - NetworkThroughput(*): 392.80 MB/sec - OverallThroughput: 100.21 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7254751) - SerializeBatchTime: 1s273ms - TransmitDataRPCTime: 437.157ms - UncompressedRowBatchSize: 380.60 MB (399084065) CodeGen:(Total: 122.164ms, non-child: 122.164ms, % non-child: 100.00%) - CodegenTime: 2.155ms - CompileTime: 15.386ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 66.647ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 39.441ms HDFS_SCAN_NODE (id=1):(Total: 595.563ms, non-child: 595.563ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 6:1/253.08 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB - FooterProcessingTime: (Avg: 3.358ms ; Min: 2.941ms ; Max: 3.729ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.10 MB (332501203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.10 MB (332501203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.10 MB (332501203) - DecompressionTime: 1s365ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.46 MB (383213988) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.578ms - RowBatchQueuePutWaitTime: 5s900ms - RowsRead: 29.55M (29548399) - RowsReturned: 7.25M (7254751) - RowsReturnedRate: 12.18 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1542) - ScannerThreadsTotalWallClockTime: 15s469ms - MaterializeTupleTime(*): 5s937ms - ScannerThreadsSysTime: 201.967ms - ScannerThreadsUserTime: 7s269ms - ScannerThreadsVoluntaryContextSwitches: 6.92K (6922) - TotalRawHdfsReadTime(*): 215.204ms - TotalReadThroughput: 105.70 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29548399) - Rows rejected: 14.61M (14614391) - Rows total: 29.55M (29548399) Instance de4b40c22a7cb446:1d (host=vb0228.halxg.cloudera.com:22000):(Total: 133.966ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/144.90 MB 8:2/506.14 MB 4:1/253.09 MB 1:2/506.18 MB Filter 0 arrival: 663ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 414.91 MB, 383.16 MB, 319.55 MB, 271.37 MB, 178.39 MB, 129.09 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.46K (2461) - PeakMemoryUsage: 415.55 MB (435738063) - PerHostPeakMemUsage: 1.58 GB (1697228255) - RowsProduced: 8.09M (8085997) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.121ms - TotalStorageWaitTime: 225.933ms - TotalWallClockTime: 23s112ms - SysTime: 441.930ms - UserTime: 9s742ms - VoluntaryContextSwitches: 7.87K (7868) Fragment Instance Lifecycle Timings: - ExecTime: 3s640ms - ExecTreeExecTime: 624.783ms - OpenTime: 80.156ms - ExecTreeOpenTime: 47.688us - PrepareTime: 53.760ms - ExecTreePrepareTime: 166.296us DataStreamSender (dst_id=8):(Total: 1s892ms, non-child: 1s892ms, % non-child: 100.00%) - BytesSent: 191.44 MB (200741644) - NetworkThroughput(*): 446.00 MB/sec - OverallThroughput: 101.17 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.09M (8085997) - SerializeBatchTime: 1s460ms - TransmitDataRPCTime: 429.238ms - UncompressedRowBatchSize: 424.20 MB (444810931) CodeGen:(Total: 116.715ms, non-child: 116.715ms, % non-child: 100.00%) - CodegenTime: 2.258ms - CompileTime: 16.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 62.039ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 37.139ms HDFS_SCAN_NODE (id=1):(Total: 619.321ms, non-child: 619.321ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/144.90 MB 8:2/506.14 MB 4:1/253.09 MB 1:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 0, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB - FooterProcessingTime: (Avg: 2.715ms ; Min: 1.908ms ; Max: 3.802ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.71 - BytesRead: 353.47 MB (370644173) - BytesReadDataNodeCache: 0 - BytesReadLocal: 353.47 MB (370644173) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 353.47 MB (370644173) - DecompressionTime: 1s240ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 410.93 MB (430887560) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.584ms - RowBatchQueuePutWaitTime: 9s657ms - RowsRead: 32.93M (32927525) - RowsReturned: 8.09M (8085997) - RowsReturnedRate: 13.06 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.08K (2082) - ScannerThreadsTotalWallClockTime: 19s391ms - MaterializeTupleTime(*): 5s647ms - ScannerThreadsSysTime: 236.961ms - ScannerThreadsUserTime: 6s812ms - ScannerThreadsVoluntaryContextSwitches: 7.79K (7789) - TotalRawHdfsReadTime(*): 268.962ms - TotalReadThroughput: 88.37 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.93M (32927525) - Rows rejected: 16.28M (16283549) - Rows total: 32.93M (32927525) Instance de4b40c22a7cb446:1b (host=vb0218.halxg.cloudera.com:22000):(Total: 117.336ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Filter 0 arrival: 654ms MemoryUsage(500.000ms): 46.76 KB, 59.86 KB, 369.27 MB, 329.84 MB, 289.68 MB, 250.20 MB, 170.22 MB, 68.27 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 5.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.65K (1652) - PeakMemoryUsage: 369.94 MB (387908851) - PerHostPeakMemUsage: 1.51 GB (1622689578) - RowsProduced: 7.26M (7259174) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.833ms - TotalStorageWaitTime: 142.197ms - TotalWallClockTime: 20s127ms - SysTime: 233.963ms - UserTime: 7s757ms - VoluntaryContextSwitches: 7.15K (7148) Fragment Instance Lifecycle Timings: - ExecTime: 3s484ms - ExecTreeExecTime: 607.400ms - OpenTime: 68.061ms - ExecTreeOpenTime: 48.560us - PrepareTime: 49.250ms - ExecTreePrepareTime: 102.452us DataStreamSender (dst_id=8):(Total: 1s885ms, non-child: 1s885ms, % non-child: 100.00%) - BytesSent: 171.82 MB (180163672) - NetworkThroughput(*): 341.06 MB/sec - OverallThroughput: 91.15 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.26M (7259174) - SerializeBatchTime: 1s378ms - TransmitDataRPCTime: 503.771ms - UncompressedRowBatchSize: 380.83 MB (399327370) CodeGen:(Total: 97.697ms, non-child: 97.697ms, % non-child: 100.00%) - CodegenTime: 1.620ms - CompileTime: 16.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 51.173ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 30.005ms HDFS_SCAN_NODE (id=1):(Total: 602.482ms, non-child: 602.482ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB - FooterProcessingTime: (Avg: 2.888ms ; Min: 2.235ms ; Max: 3.565ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.57 - BytesRead: 317.11 MB (332515761) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.11 MB (332515761) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.11 MB (332515761) - DecompressionTime: 940.614ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.33 MB (383075700) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.884ms - RowBatchQueuePutWaitTime: 9s137ms - RowsRead: 29.55M (29549877) - RowsReturned: 7.26M (7259174) - RowsReturnedRate: 12.05 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1349) - ScannerThreadsTotalWallClockTime: 16s574ms - MaterializeTupleTime(*): 3s932ms - ScannerThreadsSysTime: 139.977ms - ScannerThreadsUserTime: 4s878ms - ScannerThreadsVoluntaryContextSwitches: 7.07K (7073) - TotalRawHdfsReadTime(*): 250.823ms - TotalReadThroughput: 79.28 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29549877) - Rows rejected: 14.61M (14608642) - Rows total: 29.55M (29549877) Instance de4b40c22a7cb446:14 (host=vb0214.halxg.cloudera.com:22000):(Total: 114.080ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 10:1/253.10 MB 8:1/253.08 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Filter 0 arrival: 635ms MemoryUsage(500.000ms): 59.86 KB, 407.50 MB, 407.09 MB, 311.84 MB, 250.21 MB, 218.18 MB, 170.34 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 6.57 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.34K (2340) - PeakMemoryUsage: 408.04 MB (427860391) - PerHostPeakMemUsage: 1.57 GB (1684280798) - RowsProduced: 7.99M (7994104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.414ms - TotalStorageWaitTime: 163.721ms - TotalWallClockTime: 23s225ms - SysTime: 406.935ms - UserTime: 9s937ms - VoluntaryContextSwitches: 7.82K (7821) Fragment Instance Lifecycle Timings: - ExecTime: 3s680ms - ExecTreeExecTime: 615.235ms - OpenTime: 65.803ms - ExecTreeOpenTime: 44.920us - PrepareTime: 48.241ms - ExecTreePrepareTime: 183.211us DataStreamSender (dst_id=8):(Total: 1s867ms, non-child: 1s867ms, % non-child: 100.00%) - BytesSent: 189.23 MB (198425730) - NetworkThroughput(*): 434.58 MB/sec - OverallThroughput: 101.33 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.99M (7994104) - SerializeBatchTime: 1s429ms - TransmitDataRPCTime: 435.441ms - UncompressedRowBatchSize: 419.38 MB (439755892) CodeGen:(Total: 94.585ms, non-child: 94.585ms, % non-child: 100.00%) - CodegenTime: 1.548ms - CompileTime: 17.646ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.272ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.135ms HDFS_SCAN_NODE (id=1):(Total: 608.662ms, non-child: 608.662ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 10:1/253.10 MB 8:1/253.08 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB - FooterProcessingTime: (Avg: 3.295ms ; Min: 2.988ms ; Max: 3.657ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.57 - BytesRead: 349.51 MB (366484495) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.51 MB (366484495) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.51 MB (366484495) - DecompressionTime: 1s255ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 403.57 MB (423175760) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.156ms - RowBatchQueuePutWaitTime: 9s739ms - RowsRead: 32.56M (32556938) - RowsReturned: 7.99M (7994104) - RowsReturnedRate: 13.13 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.95K (1948) - ScannerThreadsTotalWallClockTime: 19s479ms - MaterializeTupleTime(*): 5s742ms - ScannerThreadsSysTime: 223.963ms - ScannerThreadsUserTime: 6s951ms - ScannerThreadsVoluntaryContextSwitches: 7.74K (7740) - TotalRawHdfsReadTime(*): 262.572ms - TotalReadThroughput: 99.86 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.56M (32556938) - Rows rejected: 16.10M (16099787) - Rows total: 32.56M (32556938) Instance de4b40c22a7cb446:1c (host=vb0234.halxg.cloudera.com:22000):(Total: 111.049ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.08 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Filter 0 arrival: 661ms MemoryUsage(500.000ms): 59.86 KB, 435.36 MB, 435.55 MB, 340.01 MB, 292.10 MB, 292.48 MB, 196.54 MB, 130.61 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 6.88 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.64K (2636) - PeakMemoryUsage: 436.28 MB (457470375) - PerHostPeakMemUsage: 1.62 GB (1742277852) - RowsProduced: 8.71M (8710542) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.165ms - TotalStorageWaitTime: 176.085ms - TotalWallClockTime: 25s399ms - SysTime: 334.946ms - UserTime: 11s305ms - VoluntaryContextSwitches: 8.55K (8547) Fragment Instance Lifecycle Timings: - ExecTime: 3s947ms - ExecTreeExecTime: 656.129ms - OpenTime: 68.341ms - ExecTreeOpenTime: 61.044us - PrepareTime: 42.667ms - ExecTreePrepareTime: 211.844us DataStreamSender (dst_id=8):(Total: 1s975ms, non-child: 1s975ms, % non-child: 100.00%) - BytesSent: 206.20 MB (216214378) - NetworkThroughput(*): 448.99 MB/sec - OverallThroughput: 104.38 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.71M (8710542) - SerializeBatchTime: 1s513ms - TransmitDataRPCTime: 459.249ms - UncompressedRowBatchSize: 456.97 MB (479167158) CodeGen:(Total: 93.979ms, non-child: 93.979ms, % non-child: 100.00%) - CodegenTime: 1.528ms - CompileTime: 21.089ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.391ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.910ms HDFS_SCAN_NODE (id=1):(Total: 650.529ms, non-child: 650.529ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.08 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 561ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB - FooterProcessingTime: (Avg: 3.724ms ; Min: 3.125ms ; Max: 3.872ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.88 - BytesRead: 380.51 MB (398991806) - BytesReadDataNodeCache: 0 - BytesReadLocal: 380.51 MB (398991806) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 380.51 MB (398991806) - DecompressionTime: 1s469ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 431.77 MB (452747808) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.880ms - RowBatchQueuePutWaitTime: 11s331ms - RowsRead: 35.46M (35457891) - RowsReturned: 8.71M (8710542) - RowsReturnedRate: 13.39 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.26K (2256) - ScannerThreadsTotalWallClockTime: 21s383ms - MaterializeTupleTime(*): 6s551ms - ScannerThreadsSysTime: 206.966ms - ScannerThreadsUserTime: 8s025ms - ScannerThreadsVoluntaryContextSwitches: 8.47K (8469) - TotalRawHdfsReadTime(*): 284.431ms - TotalReadThroughput: 95.13 MB/sec Filter 0 (4.00 MB): - Rows processed: 35.46M (35457891) - Rows rejected: 17.53M (17531363) - Rows total: 35.46M (35457891) Instance de4b40c22a7cb446:18 (host=vb0208.halxg.cloudera.com:22000):(Total: 109.804ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 8:1/253.09 MB 3:2/506.18 MB 6:1/253.08 MB Filter 0 arrival: 648ms MemoryUsage(500.000ms): 54.76 KB, 59.86 KB, 369.53 MB, 329.30 MB, 273.71 MB, 233.98 MB, 169.81 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.85K (1847) - PeakMemoryUsage: 369.99 MB (387962123) - PerHostPeakMemUsage: 1.49 GB (1597576106) - RowsProduced: 7.25M (7253437) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.628ms - TotalStorageWaitTime: 156.541ms - TotalWallClockTime: 19s426ms - SysTime: 368.941ms - UserTime: 9s093ms - VoluntaryContextSwitches: 6.96K (6956) Fragment Instance Lifecycle Timings: - ExecTime: 3s412ms - ExecTreeExecTime: 622.988ms - OpenTime: 63.461ms - ExecTreeOpenTime: 50.460us - PrepareTime: 46.300ms - ExecTreePrepareTime: 182.296us DataStreamSender (dst_id=8):(Total: 1s713ms, non-child: 1s713ms, % non-child: 100.00%) - BytesSent: 171.68 MB (180016307) - NetworkThroughput(*): 420.68 MB/sec - OverallThroughput: 100.19 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7253437) - SerializeBatchTime: 1s302ms - TransmitDataRPCTime: 408.098ms - UncompressedRowBatchSize: 380.53 MB (399011783) CodeGen:(Total: 89.758ms, non-child: 89.758ms, % non-child: 100.00%) - CodegenTime: 1.631ms - CompileTime: 16.916ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 45.780ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.581ms HDFS_SCAN_NODE (id=1):(Total: 617.948ms, non-child: 617.948ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 8:1/253.09 MB 3:2/506.18 MB 6:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB - FooterProcessingTime: (Avg: 2.975ms ; Min: 2.343ms ; Max: 3.647ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.11 MB (332513220) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.11 MB (332513220) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.11 MB (332513220) - DecompressionTime: 1s180ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.37 MB (383116692) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.382ms - RowBatchQueuePutWaitTime: 6s950ms - RowsRead: 29.55M (29549430) - RowsReturned: 7.25M (7253437) - RowsReturnedRate: 11.74 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1520) - ScannerThreadsTotalWallClockTime: 15s951ms - MaterializeTupleTime(*): 5s250ms - ScannerThreadsSysTime: 185.969ms - ScannerThreadsUserTime: 6s387ms - ScannerThreadsVoluntaryContextSwitches: 6.89K (6886) - TotalRawHdfsReadTime(*): 212.124ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29549430) - Rows rejected: 14.62M (14617454) - Rows total: 29.55M (29549430) Instance de4b40c22a7cb446:1e (host=vb0230.halxg.cloudera.com:22000):(Total: 108.844ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 0:2/348.96 MB 9:1/253.09 MB 2:1/253.08 MB Filter 0 arrival: 661ms MemoryUsage(500.000ms): 59.86 KB, 333.46 MB, 293.78 MB, 239.75 MB, 207.39 MB, 143.84 MB ThreadUsage(500.000ms): 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.50 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.65K (1647) - PeakMemoryUsage: 334.22 MB (350458083) - PerHostPeakMemUsage: 1.36 GB (1463059874) - RowsProduced: 6.35M (6354730) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.834ms - TotalStorageWaitTime: 178.291ms - TotalWallClockTime: 16s682ms - SysTime: 310.949ms - UserTime: 7s987ms - VoluntaryContextSwitches: 5.96K (5962) Fragment Instance Lifecycle Timings: - ExecTime: 3s303ms - ExecTreeExecTime: 638.144ms - OpenTime: 63.403ms - ExecTreeOpenTime: 63.684us - PrepareTime: 45.406ms - ExecTreePrepareTime: 114.804us DataStreamSender (dst_id=8):(Total: 1s876ms, non-child: 1s876ms, % non-child: 100.00%) - BytesSent: 150.43 MB (157738441) - NetworkThroughput(*): 257.40 MB/sec - OverallThroughput: 80.17 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.35M (6354730) - SerializeBatchTime: 1s289ms - TransmitDataRPCTime: 584.415ms - UncompressedRowBatchSize: 333.38 MB (349573890) CodeGen:(Total: 90.864ms, non-child: 90.864ms, % non-child: 100.00%) - CodegenTime: 1.609ms - CompileTime: 15.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.501ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.890ms HDFS_SCAN_NODE (id=1):(Total: 632.906ms, non-child: 632.906ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 0:2/348.96 MB 9:1/253.09 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 277.80 MB, 277.80 MB, 277.80 MB, 277.80 MB, 277.80 MB - FooterProcessingTime: (Avg: 4.266ms ; Min: 3.101ms ; Max: 6.632ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 277.80 MB (291292814) - BytesReadDataNodeCache: 0 - BytesReadLocal: 277.80 MB (291292814) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 277.80 MB (291292814) - DecompressionTime: 952.811ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 329.72 MB (345733532) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.289ms - RowBatchQueuePutWaitTime: 5s933ms - RowsRead: 25.87M (25871292) - RowsReturned: 6.35M (6354730) - RowsReturnedRate: 10.04 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1348) - ScannerThreadsTotalWallClockTime: 13s314ms - MaterializeTupleTime(*): 4s481ms - ScannerThreadsSysTime: 195.967ms - ScannerThreadsUserTime: 5s342ms - ScannerThreadsVoluntaryContextSwitches: 5.87K (5873) - TotalRawHdfsReadTime(*): 202.471ms - TotalReadThroughput: 92.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 25.87M (25871292) - Rows rejected: 12.79M (12794754) - Rows total: 25.87M (25871292) Instance de4b40c22a7cb446:11 (host=vb0216.halxg.cloudera.com:22000):(Total: 108.714ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.13 MB 7:1/253.09 MB 3:1/114.22 MB 5:1/253.08 MB Filter 0 arrival: 639ms MemoryUsage(500.000ms): 59.86 KB, 336.83 MB, 336.76 MB, 256.66 MB, 207.65 MB, 143.70 MB, 44.44 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 5, 5, 2 - AverageThreadTokens: 5.14 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.99K (1985) - PeakMemoryUsage: 337.21 MB (353594651) - PerHostPeakMemUsage: 1.48 GB (1586476700) - RowsProduced: 6.46M (6462494) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.099ms - TotalStorageWaitTime: 136.516ms - TotalWallClockTime: 17s212ms - SysTime: 259.957ms - UserTime: 8s392ms - VoluntaryContextSwitches: 6.33K (6325) Fragment Instance Lifecycle Timings: - ExecTime: 3s239ms - ExecTreeExecTime: 627.712ms - OpenTime: 65.226ms - ExecTreeOpenTime: 53.704us - PrepareTime: 43.449ms - ExecTreePrepareTime: 202.868us DataStreamSender (dst_id=8):(Total: 1s574ms, non-child: 1s574ms, % non-child: 100.00%) - BytesSent: 152.98 MB (160409146) - NetworkThroughput(*): 415.14 MB/sec - OverallThroughput: 97.18 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.46M (6462494) - SerializeBatchTime: 1s203ms - TransmitDataRPCTime: 368.495ms - UncompressedRowBatchSize: 339.03 MB (355501994) CodeGen:(Total: 90.851ms, non-child: 90.851ms, % non-child: 100.00%) - CodegenTime: 1.610ms - CompileTime: 17.659ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.760ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.951ms HDFS_SCAN_NODE (id=1):(Total: 622.027ms, non-child: 622.027ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.13 MB 7:1/253.09 MB 3:1/114.22 MB 5:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB - FooterProcessingTime: (Avg: 3.257ms ; Min: 3.023ms ; Max: 3.356ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.14 - BytesRead: 282.41 MB (296127991) - BytesReadDataNodeCache: 0 - BytesReadLocal: 282.41 MB (296127991) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 282.41 MB (296127991) - DecompressionTime: 1s042ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 332.68 MB (348842412) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.775ms - RowBatchQueuePutWaitTime: 5s755ms - RowsRead: 26.30M (26303132) - RowsReturned: 6.46M (6462494) - RowsReturnedRate: 10.39 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1617) - ScannerThreadsTotalWallClockTime: 13s907ms - MaterializeTupleTime(*): 4s775ms - ScannerThreadsSysTime: 147.975ms - ScannerThreadsUserTime: 5s793ms - ScannerThreadsVoluntaryContextSwitches: 6.25K (6254) - TotalRawHdfsReadTime(*): 200.641ms - TotalReadThroughput: 80.69 MB/sec Filter 0 (4.00 MB): - Rows processed: 26.30M (26303132) - Rows rejected: 13.01M (13005478) - Rows total: 26.30M (26303132) Instance de4b40c22a7cb446:13 (host=vb0226.halxg.cloudera.com:22000):(Total: 103.526ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.09 MB 6:1/253.08 MB 3:2/506.18 MB Filter 0 arrival: 636ms MemoryUsage(500.000ms): 59.86 KB, 77.91 MB, 300.76 MB, 237.01 MB, 197.33 MB, 133.36 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.33 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.62K (1616) - PeakMemoryUsage: 301.22 MB (315854863) - PerHostPeakMemUsage: 1.42 GB (1529729879) - RowsProduced: 5.80M (5801549) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.229ms - TotalStorageWaitTime: 142.646ms - TotalWallClockTime: 13s453ms - SysTime: 271.956ms - UserTime: 7s378ms - VoluntaryContextSwitches: 5.40K (5402) Fragment Instance Lifecycle Timings: - ExecTime: 2s853ms - ExecTreeExecTime: 618.778ms - OpenTime: 61.940ms - ExecTreeOpenTime: 50.060us - PrepareTime: 41.542ms - ExecTreePrepareTime: 151.112us DataStreamSender (dst_id=8):(Total: 1s376ms, non-child: 1s376ms, % non-child: 100.00%) - BytesSent: 137.29 MB (143955919) - NetworkThroughput(*): 415.75 MB/sec - OverallThroughput: 99.74 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 5.80M (5801549) - SerializeBatchTime: 1s043ms - TransmitDataRPCTime: 330.212ms - UncompressedRowBatchSize: 304.36 MB (319143379) CodeGen:(Total: 86.324ms, non-child: 86.324ms, % non-child: 100.00%) - CodegenTime: 1.485ms - CompileTime: 15.346ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 45.701ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.730ms HDFS_SCAN_NODE (id=1):(Total: 614.185ms, non-child: 614.185ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.09 MB 6:1/253.08 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:0% 2:0% 3:16.67% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 48.39 MB, 253.67 MB, 253.67 MB, 253.67 MB, 253.67 MB - FooterProcessingTime: (Avg: 3.773ms ; Min: 3.127ms ; Max: 5.404ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 3.33 - BytesRead: 253.67 MB (265995099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.67 MB (265995099) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.67 MB (265995099) - DecompressionTime: 949.177ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 296.63 MB (311042240) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.011ms - RowBatchQueuePutWaitTime: 3s375ms - RowsRead: 23.64M (23638435) - RowsReturned: 5.80M (5801549) - RowsReturnedRate: 9.45 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1255) - ScannerThreadsTotalWallClockTime: 10s538ms - MaterializeTupleTime(*): 4s289ms - ScannerThreadsSysTime: 149.974ms - ScannerThreadsUserTime: 5s184ms - ScannerThreadsVoluntaryContextSwitches: 5.33K (5327) - TotalRawHdfsReadTime(*): 166.832ms - TotalReadThroughput: 84.56 MB/sec Filter 0 (4.00 MB): - Rows processed: 23.64M (23638435) - Rows rejected: 11.69M (11692207) - Rows total: 23.64M (23638435) Instance de4b40c22a7cb446:10 (host=vb0212.halxg.cloudera.com:22000):(Total: 102.387ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:2/506.17 MB Filter 0 arrival: 646ms MemoryUsage(500.000ms): 59.86 KB, 4.06 MB, 369.51 MB, 321.63 MB, 266.20 MB, 249.91 MB, 178.04 MB, 26.64 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 2 - AverageThreadTokens: 4.25 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.14K (2138) - PeakMemoryUsage: 370.05 MB (388027675) - PerHostPeakMemUsage: 1.53 GB (1646459668) - RowsProduced: 7.26M (7255948) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.339ms - TotalStorageWaitTime: 191.813ms - TotalWallClockTime: 18s048ms - SysTime: 357.943ms - UserTime: 8s559ms - VoluntaryContextSwitches: 6.70K (6700) Fragment Instance Lifecycle Timings: - ExecTime: 3s570ms - ExecTreeExecTime: 643.536ms - OpenTime: 62.594ms - ExecTreeOpenTime: 56.767us - PrepareTime: 39.744ms - ExecTreePrepareTime: 184.833us DataStreamSender (dst_id=8):(Total: 2s031ms, non-child: 2s031ms, % non-child: 100.00%) - BytesSent: 171.74 MB (180084106) - NetworkThroughput(*): 273.60 MB/sec - OverallThroughput: 84.55 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.26M (7255948) - SerializeBatchTime: 1s400ms - TransmitDataRPCTime: 627.710ms - UncompressedRowBatchSize: 380.66 MB (399149916) CodeGen:(Total: 87.221ms, non-child: 87.221ms, % non-child: 100.00%) - CodegenTime: 1.619ms - CompileTime: 15.171ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.525ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.992ms HDFS_SCAN_NODE (id=1):(Total: 638.606ms, non-child: 638.606ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:2/506.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB - FooterProcessingTime: (Avg: 4.079ms ; Min: 3.145ms ; Max: 5.364ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.25 - BytesRead: 317.10 MB (332499940) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.10 MB (332499940) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.10 MB (332499940) - DecompressionTime: 1s044ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.53 MB (383283628) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.488ms - RowBatchQueuePutWaitTime: 8s321ms - RowsRead: 29.55M (29548710) - RowsReturned: 7.26M (7255948) - RowsReturnedRate: 11.36 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1806) - ScannerThreadsTotalWallClockTime: 14s415ms - MaterializeTupleTime(*): 4s736ms - ScannerThreadsSysTime: 213.965ms - ScannerThreadsUserTime: 5s683ms - ScannerThreadsVoluntaryContextSwitches: 6.61K (6608) - TotalRawHdfsReadTime(*): 199.200ms - TotalReadThroughput: 79.27 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29548710) - Rows rejected: 14.62M (14615105) - Rows total: 29.55M (29548710) Instance de4b40c22a7cb446:17 (host=vb0232.halxg.cloudera.com:22000):(Total: 102.285ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 2:1/129.89 MB 3:2/506.17 MB 6:1/253.09 MB Filter 0 arrival: 627ms MemoryUsage(500.000ms): 59.86 KB, 408.04 MB, 407.80 MB, 360.09 MB, 312.30 MB, 249.84 MB, 169.89 MB, 112.35 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6, 5 - AverageThreadTokens: 6.50 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.47K (2471) - PeakMemoryUsage: 408.53 MB (428372383) - PerHostPeakMemUsage: 1.58 GB (1697500167) - RowsProduced: 8.00M (7996520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.246ms - TotalStorageWaitTime: 188.494ms - TotalWallClockTime: 23s989ms - SysTime: 368.941ms - UserTime: 11s014ms - VoluntaryContextSwitches: 7.79K (7786) Fragment Instance Lifecycle Timings: - ExecTime: 3s834ms - ExecTreeExecTime: 627.932ms - OpenTime: 63.577ms - ExecTreeOpenTime: 50.940us - PrepareTime: 38.683ms - ExecTreePrepareTime: 110.828us DataStreamSender (dst_id=8):(Total: 1s935ms, non-child: 1s935ms, % non-child: 100.00%) - BytesSent: 189.34 MB (198532238) - NetworkThroughput(*): 406.51 MB/sec - OverallThroughput: 97.84 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.00M (7996520) - SerializeBatchTime: 1s466ms - TransmitDataRPCTime: 465.760ms - UncompressedRowBatchSize: 419.51 MB (439888796) CodeGen:(Total: 86.544ms, non-child: 86.544ms, % non-child: 100.00%) - CodegenTime: 1.487ms - CompileTime: 15.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.205ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 23.317ms HDFS_SCAN_NODE (id=1):(Total: 621.387ms, non-child: 621.387ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 2:1/129.89 MB 3:2/506.17 MB 6:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB - FooterProcessingTime: (Avg: 3.327ms ; Min: 2.705ms ; Max: 4.465ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.50 - BytesRead: 349.72 MB (366706943) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.72 MB (366706943) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.72 MB (366706943) - DecompressionTime: 1s381ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 404.01 MB (423631448) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.177ms - RowBatchQueuePutWaitTime: 9s680ms - RowsRead: 32.58M (32577610) - RowsReturned: 8.00M (7996520) - RowsReturnedRate: 12.87 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2092) - ScannerThreadsTotalWallClockTime: 20s091ms - MaterializeTupleTime(*): 6s484ms - ScannerThreadsSysTime: 179.970ms - ScannerThreadsUserTime: 7s890ms - ScannerThreadsVoluntaryContextSwitches: 7.71K (7709) - TotalRawHdfsReadTime(*): 218.486ms - TotalReadThroughput: 87.43 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.58M (32577610) - Rows rejected: 16.12M (16119523) - Rows total: 32.58M (32577610) Instance de4b40c22a7cb446:15 (host=vb0224.halxg.cloudera.com:22000):(Total: 101.917ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/78.16 MB 2:1/253.11 MB 0:1/93.74 MB 8:1/253.09 MB 1:2/506.15 MB Filter 0 arrival: 627ms MemoryUsage(500.000ms): 59.86 KB, 419.22 MB, 419.20 MB, 348.40 MB, 265.56 MB, 249.92 MB, 170.69 MB ThreadUsage(500.000ms): 8, 8, 8, 7, 6, 6, 6 - AverageThreadTokens: 7.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.03K (2030) - PeakMemoryUsage: 419.53 MB (439906987) - PerHostPeakMemUsage: 1.58 GB (1698008634) - RowsProduced: 8.24M (8243657) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.190ms - TotalStorageWaitTime: 216.768ms - TotalWallClockTime: 24s071ms - SysTime: 280.954ms - UserTime: 9s076ms - VoluntaryContextSwitches: 8.17K (8167) Fragment Instance Lifecycle Timings: - ExecTime: 3s641ms - ExecTreeExecTime: 617.303ms - OpenTime: 64.151ms - ExecTreeOpenTime: 61.984us - PrepareTime: 37.738ms - ExecTreePrepareTime: 128.280us DataStreamSender (dst_id=8):(Total: 2s195ms, non-child: 2s195ms, % non-child: 100.00%) - BytesSent: 195.35 MB (204837421) - NetworkThroughput(*): 274.16 MB/sec - OverallThroughput: 88.99 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.24M (8243657) - SerializeBatchTime: 1s479ms - TransmitDataRPCTime: 712.536ms - UncompressedRowBatchSize: 432.48 MB (453483811) CodeGen:(Total: 86.254ms, non-child: 86.254ms, % non-child: 100.00%) - CodegenTime: 1.581ms - CompileTime: 16.112ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.967ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 22.690ms HDFS_SCAN_NODE (id=1):(Total: 612.567ms, non-child: 612.567ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/78.16 MB 2:1/253.11 MB 0:1/93.74 MB 8:1/253.09 MB 1:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:28 BytesRead(500.000ms): 0, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB - FooterProcessingTime: (Avg: 3.592ms ; Min: 2.979ms ; Max: 5.222ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 360.40 MB (377905027) - BytesReadDataNodeCache: 0 - BytesReadLocal: 360.40 MB (377905027) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 360.40 MB (377905027) - DecompressionTime: 1s052ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 414.98 MB (435138356) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.107ms - RowBatchQueuePutWaitTime: 11s340ms - RowsRead: 33.55M (33551637) - RowsReturned: 8.24M (8243657) - RowsReturnedRate: 13.46 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1696) - ScannerThreadsTotalWallClockTime: 20s365ms - MaterializeTupleTime(*): 5s018ms - ScannerThreadsSysTime: 168.971ms - ScannerThreadsUserTime: 6s069ms - ScannerThreadsVoluntaryContextSwitches: 8.09K (8087) - TotalRawHdfsReadTime(*): 259.503ms - TotalReadThroughput: 102.97 MB/sec Filter 0 (4.00 MB): - Rows processed: 33.55M (33551637) - Rows rejected: 16.59M (16588559) - Rows total: 33.55M (33551637) Instance de4b40c22a7cb446:12 (host=vb0220.halxg.cloudera.com:22000):(Total: 100.933ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 9:1/253.07 MB 4:2/506.17 MB 0:1/253.08 MB 2:1/141.46 MB Filter 0 arrival: 633ms MemoryUsage(500.000ms): 59.86 KB, 415.10 MB, 382.77 MB, 327.09 MB, 279.86 MB, 186.09 MB, 138.51 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.04K (2038) - PeakMemoryUsage: 415.58 MB (435765631) - PerHostPeakMemUsage: 1.55 GB (1664400590) - RowsProduced: 8.07M (8065631) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.126ms - TotalStorageWaitTime: 194.969ms - TotalWallClockTime: 22s099ms - SysTime: 273.956ms - UserTime: 9s082ms - VoluntaryContextSwitches: 7.74K (7739) Fragment Instance Lifecycle Timings: - ExecTime: 3s558ms - ExecTreeExecTime: 619.558ms - OpenTime: 63.497ms - ExecTreeOpenTime: 60.344us - PrepareTime: 37.392ms - ExecTreePrepareTime: 176.168us DataStreamSender (dst_id=8):(Total: 2s203ms, non-child: 2s203ms, % non-child: 100.00%) - BytesSent: 190.92 MB (200197427) - NetworkThroughput(*): 262.70 MB/sec - OverallThroughput: 86.65 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.07M (8065631) - SerializeBatchTime: 1s473ms - TransmitDataRPCTime: 726.780ms - UncompressedRowBatchSize: 423.14 MB (443690601) CodeGen:(Total: 85.519ms, non-child: 85.519ms, % non-child: 100.00%) - CodegenTime: 1.625ms - CompileTime: 16.238ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.408ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 22.369ms HDFS_SCAN_NODE (id=1):(Total: 614.242ms, non-child: 614.242ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 9:1/253.07 MB 4:2/506.17 MB 0:1/253.08 MB 2:1/141.46 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB - FooterProcessingTime: (Avg: 3.570ms ; Min: 2.921ms ; Max: 4.959ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.71 - BytesRead: 352.61 MB (369737350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 352.61 MB (369737350) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 352.61 MB (369737350) - DecompressionTime: 1s082ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 410.99 MB (430957056) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.655ms - RowBatchQueuePutWaitTime: 9s901ms - RowsRead: 32.85M (32847511) - RowsReturned: 8.07M (8065631) - RowsReturnedRate: 13.13 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.72K (1720) - ScannerThreadsTotalWallClockTime: 18s477ms - MaterializeTupleTime(*): 5s093ms - ScannerThreadsSysTime: 150.974ms - ScannerThreadsUserTime: 6s177ms - ScannerThreadsVoluntaryContextSwitches: 7.67K (7666) - TotalRawHdfsReadTime(*): 238.927ms - TotalReadThroughput: 100.75 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.85M (32847511) - Rows rejected: 16.25M (16247271) - Rows total: 32.85M (32847511) Instance de4b40c22a7cb446:1a (host=vb0204.halxg.cloudera.com:22000):(Total: 94.299ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.07 MB 1:1/253.10 MB 8:1/253.08 MB 7:2/506.14 MB Filter 0 arrival: 643ms MemoryUsage(500.000ms): 59.86 KB, 369.17 MB, 329.63 MB, 257.63 MB, 217.87 MB, 169.99 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.67K (1672) - PeakMemoryUsage: 370.04 MB (388014411) - PerHostPeakMemUsage: 1.44 GB (1549515925) - RowsProduced: 7.25M (7254572) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.376ms - TotalStorageWaitTime: 159.071ms - TotalWallClockTime: 17s973ms - SysTime: 210.966ms - UserTime: 7s488ms - VoluntaryContextSwitches: 6.99K (6986) Fragment Instance Lifecycle Timings: - ExecTime: 3s194ms - ExecTreeExecTime: 628.081ms - OpenTime: 66.275ms - ExecTreeOpenTime: 62.719us - PrepareTime: 27.982ms - ExecTreePrepareTime: 104.714us DataStreamSender (dst_id=8):(Total: 1s770ms, non-child: 1s770ms, % non-child: 100.00%) - BytesSent: 171.71 MB (180054699) - NetworkThroughput(*): 338.25 MB/sec - OverallThroughput: 96.96 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7254572) - SerializeBatchTime: 1s260ms - TransmitDataRPCTime: 507.655ms - UncompressedRowBatchSize: 380.59 MB (399074216) CodeGen:(Total: 90.047ms, non-child: 90.047ms, % non-child: 100.00%) - CodegenTime: 2.273ms - CompileTime: 17.219ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.117ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.189ms HDFS_SCAN_NODE (id=1):(Total: 624.050ms, non-child: 624.050ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.07 MB 1:1/253.10 MB 8:1/253.08 MB 7:2/506.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB - FooterProcessingTime: (Avg: 2.863ms ; Min: 2.280ms ; Max: 4.447ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.09 MB (332490978) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.09 MB (332490978) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.09 MB (332490978) - DecompressionTime: 917.181ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.44 MB (383196564) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.077ms - RowBatchQueuePutWaitTime: 7s505ms - RowsRead: 29.55M (29547112) - RowsReturned: 7.25M (7254572) - RowsReturnedRate: 11.62 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.40K (1397) - ScannerThreadsTotalWallClockTime: 14s712ms - MaterializeTupleTime(*): 4s016ms - ScannerThreadsSysTime: 105.982ms - ScannerThreadsUserTime: 4s932ms - ScannerThreadsVoluntaryContextSwitches: 6.91K (6909) - TotalRawHdfsReadTime(*): 211.949ms - TotalReadThroughput: 105.70 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29547112) - Rows rejected: 14.61M (14612646) - Rows total: 29.55M (29547112) Averaged Fragment F03:(Total: 75.733ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 143.95 MB, max: 396.14 MB, avg: 257.24 MB, stddev: 74.80 MB completion times: min:189.661ms max:384.691ms mean: 262.765ms stddev:50.827ms execution rates: min:650.46 MB/sec max:1.15 GB/sec mean:963.61 MB/sec stddev:137.26 MB/sec num instances: 14 - AverageThreadTokens: 0.71 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 57 (57) - PeakMemoryUsage: 26.93 MB (28240309) - PerHostPeakMemUsage: 50.77 MB (53232612) - RowsProduced: 642.56K (642562) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.750ms - TotalStorageWaitTime: 17.703ms - TotalWallClockTime: 434.828ms - SysTime: 17.925ms - UserTime: 342.376ms - VoluntaryContextSwitches: 202 (202) Fragment Instance Lifecycle Timings: - ExecTime: 185.914ms - ExecTreeExecTime: 21.376ms - OpenTime: 34.668ms - ExecTreeOpenTime: 53.114us - PrepareTime: 41.018ms - ExecTreePrepareTime: 609.622us DataStreamSender (dst_id=10):(Total: 91.592ms, non-child: 91.592ms, % non-child: 100.00%) - BytesSent: 7.95 MB (8341062) - NetworkThroughput(*): 324.65 MB/sec - OverallThroughput: 86.74 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 642.56K (642562) - SerializeBatchTime: 66.916ms - TransmitDataRPCTime: 24.449ms - UncompressedRowBatchSize: 22.68 MB (23778751) CodeGen:(Total: 62.164ms, non-child: 62.164ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 7.616ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 26.115ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 27.828ms HDFS_SCAN_NODE (id=0):(Total: 22.306ms, non-child: 22.306ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 0.36 - BytesRead: 13.68 MB (14346276) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.68 MB (14346276) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.68 MB (14346276) - DecompressionTime: 47.605ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 26.47 MB (27758676) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.673ms - RowBatchQueuePutWaitTime: 32.016ms - RowsRead: 3.21M (3214285) - RowsReturned: 642.56K (642562) - RowsReturnedRate: 34.69 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 26 (26) - ScannerThreadsTotalWallClockTime: 214.281ms - MaterializeTupleTime(*): 110.776ms - ScannerThreadsSysTime: 9.283ms - ScannerThreadsUserTime: 153.761ms - ScannerThreadsVoluntaryContextSwitches: 125 (125) - TotalRawHdfsReadTime(*): 12.858ms - TotalReadThroughput: 3.58 MB/sec Fragment F03: Instance de4b40c22a7cb446:34 (host=vb0226.halxg.cloudera.com:22000):(Total: 96.125ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/143.95 MB MemoryUsage(500.000ms): 17.30 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 34 (34) - PeakMemoryUsage: 17.74 MB (18603791) - PerHostPeakMemUsage: 41.39 MB (43401015) - RowsProduced: 358.59K (358588) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.920ms - TotalStorageWaitTime: 7.895ms - TotalWallClockTime: 280.079ms - SysTime: 10.998ms - UserTime: 244.962ms - VoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 124.173ms - ExecTreeExecTime: 11.786ms - OpenTime: 49.717ms - ExecTreeOpenTime: 68.988us - PrepareTime: 46.383ms - ExecTreePrepareTime: 874.452us DataStreamSender (dst_id=10):(Total: 53.901ms, non-child: 53.901ms, % non-child: 100.00%) - BytesSent: 4.41 MB (4627636) - NetworkThroughput(*): 306.21 MB/sec - OverallThroughput: 81.88 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 358.59K (358588) - SerializeBatchTime: 39.336ms - TransmitDataRPCTime: 14.412ms - UncompressedRowBatchSize: 12.66 MB (13269976) CodeGen:(Total: 83.514ms, non-child: 83.514ms, % non-child: 100.00%) - CodegenTime: 1.317ms - CompileTime: 10.673ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 37.832ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 34.269ms HDFS_SCAN_NODE (id=0):(Total: 14.136ms, non-child: 14.136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/143.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 7.70 MB - FooterProcessingTime: (Avg: 1.889ms ; Min: 1.889ms ; Max: 1.889ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.70 MB (8073491) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.70 MB (8073491) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.70 MB (8073491) - DecompressionTime: 26.002ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 17.34 MB (18179578) - PerReadThreadRawHdfsThroughput: 2.03 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.183ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1797139) - RowsReturned: 358.59K (358588) - RowsReturnedRate: 25.37 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 106.222ms - MaterializeTupleTime(*): 68.264ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 92.985ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 3.696ms - TotalReadThroughput: 15.40 MB/sec Instance de4b40c22a7cb446:37 (host=vb0234.halxg.cloudera.com:22000):(Total: 90.905ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.19 MB 2:1/143.95 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 81 (81) - PeakMemoryUsage: 53.04 MB (55613877) - PerHostPeakMemUsage: 82.58 MB (86590681) - RowsProduced: 989.16K (989165) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.226ms - TotalStorageWaitTime: 21.082ms - TotalWallClockTime: 755.726ms - SysTime: 41.993ms - UserTime: 534.918ms - VoluntaryContextSwitches: 562 (562) Fragment Instance Lifecycle Timings: - ExecTime: 292.983ms - ExecTreeExecTime: 16.691ms - OpenTime: 44.611ms - ExecTreeOpenTime: 47.244us - PrepareTime: 46.252ms - ExecTreePrepareTime: 748.272us DataStreamSender (dst_id=10):(Total: 129.402ms, non-child: 129.402ms, % non-child: 100.00%) - BytesSent: 12.19 MB (12784483) - NetworkThroughput(*): 385.03 MB/sec - OverallThroughput: 94.22 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 989.16K (989165) - SerializeBatchTime: 97.442ms - TransmitDataRPCTime: 31.665ms - UncompressedRowBatchSize: 34.91 MB (36605177) CodeGen:(Total: 79.365ms, non-child: 79.365ms, % non-child: 100.00%) - CodegenTime: 1.320ms - CompileTime: 7.972ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 35.444ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 35.226ms HDFS_SCAN_NODE (id=0):(Total: 17.563ms, non-child: 17.563ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.19 MB 2:1/143.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 2.579ms ; Min: 2.532ms ; Max: 2.625ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 21.07 MB (22098342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 21.07 MB (22098342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21.07 MB (22098342) - DecompressionTime: 71.821ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 52.40 MB (54943904) - PerReadThreadRawHdfsThroughput: 1.62 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.427ms - RowBatchQueuePutWaitTime: 141.181ms - RowsRead: 4.95M (4950000) - RowsReturned: 989.16K (989165) - RowsReturnedRate: 56.32 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 44 (44) - ScannerThreadsTotalWallClockTime: 418.164ms - MaterializeTupleTime(*): 174.199ms - ScannerThreadsSysTime: 21.996ms - ScannerThreadsUserTime: 232.963ms - ScannerThreadsVoluntaryContextSwitches: 513 (513) - TotalRawHdfsReadTime(*): 12.707ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:33 (host=vb0214.halxg.cloudera.com:22000):(Total: 80.552ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 32 (32) - PeakMemoryUsage: 19.96 MB (20931307) - PerHostPeakMemUsage: 40.87 MB (42854450) - RowsProduced: 629.43K (629430) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.375ms - TotalStorageWaitTime: 10.227ms - TotalWallClockTime: 326.304ms - SysTime: 6.999ms - UserTime: 291.955ms - VoluntaryContextSwitches: 50 (50) Fragment Instance Lifecycle Timings: - ExecTime: 149.330ms - ExecTreeExecTime: 14.222ms - OpenTime: 33.212ms - ExecTreeOpenTime: 63.258us - PrepareTime: 47.278ms - ExecTreePrepareTime: 245.314us DataStreamSender (dst_id=10):(Total: 82.588ms, non-child: 82.588ms, % non-child: 100.00%) - BytesSent: 7.88 MB (8262871) - NetworkThroughput(*): 356.34 MB/sec - OverallThroughput: 95.41 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 629.43K (629430) - SerializeBatchTime: 60.305ms - TransmitDataRPCTime: 22.113ms - UncompressedRowBatchSize: 22.21 MB (23292786) CodeGen:(Total: 61.493ms, non-child: 61.493ms, % non-child: 100.00%) - CodegenTime: 1.067ms - CompileTime: 7.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.789ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 28.581ms HDFS_SCAN_NODE (id=0):(Total: 14.487ms, non-child: 14.487ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.088ms ; Min: 2.088ms ; Max: 2.088ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14022303) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14022303) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14022303) - DecompressionTime: 42.752ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.54 MB (20484566) - PerReadThreadRawHdfsThroughput: 1.68 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.527ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152634) - RowsReturned: 629.43K (629430) - RowsReturnedRate: 43.45 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 143.791ms - MaterializeTupleTime(*): 86.780ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 129.979ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 7.764ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:3a (host=vb0232.halxg.cloudera.com:22000):(Total: 77.419ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.18 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 21.44 MB (22476472) - PerHostPeakMemUsage: 44.75 MB (46926391) - RowsProduced: 630.52K (630516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.761ms - TotalStorageWaitTime: 26.573ms - TotalWallClockTime: 412.879ms - SysTime: 10.998ms - UserTime: 334.949ms - VoluntaryContextSwitches: 128 (128) Fragment Instance Lifecycle Timings: - ExecTime: 193.227ms - ExecTreeExecTime: 36.878ms - OpenTime: 31.552ms - ExecTreeOpenTime: 46.552us - PrepareTime: 45.839ms - ExecTreePrepareTime: 635.948us DataStreamSender (dst_id=10):(Total: 86.935ms, non-child: 86.935ms, % non-child: 100.00%) - BytesSent: 7.74 MB (8111985) - NetworkThroughput(*): 312.62 MB/sec - OverallThroughput: 88.99 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.52K (630516) - SerializeBatchTime: 62.022ms - TransmitDataRPCTime: 24.746ms - UncompressedRowBatchSize: 22.25 MB (23332976) CodeGen:(Total: 66.309ms, non-child: 66.309ms, % non-child: 100.00%) - CodegenTime: 937.648us - CompileTime: 6.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.640ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 35.096ms HDFS_SCAN_NODE (id=0):(Total: 37.879ms, non-child: 37.879ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.992ms ; Min: 1.992ms ; Max: 1.992ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14024611) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14024611) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14024611) - DecompressionTime: 45.711ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 21.05 MB (22069675) - PerReadThreadRawHdfsThroughput: 560.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.276ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152861) - RowsReturned: 630.52K (630516) - RowsReturnedRate: 16.65 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 188.128ms - MaterializeTupleTime(*): 109.755ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 149.977ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 23.848ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:36 (host=vb0218.halxg.cloudera.com:22000):(Total: 77.082ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/155.97 MB MemoryUsage(500.000ms): 76.76 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 34 (34) - PeakMemoryUsage: 10.71 MB (11225854) - PerHostPeakMemUsage: 32.26 MB (33827977) - RowsProduced: 388.47K (388469) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.838ms - TotalStorageWaitTime: 9.702ms - TotalWallClockTime: 250.270ms - SysTime: 7.999ms - UserTime: 205.969ms - VoluntaryContextSwitches: 160 (160) Fragment Instance Lifecycle Timings: - ExecTime: 111.712ms - ExecTreeExecTime: 23.905ms - OpenTime: 32.341ms - ExecTreeOpenTime: 51.104us - PrepareTime: 44.698ms - ExecTreePrepareTime: 811.384us DataStreamSender (dst_id=10):(Total: 53.581ms, non-child: 53.581ms, % non-child: 100.00%) - BytesSent: 4.89 MB (5124070) - NetworkThroughput(*): 330.89 MB/sec - OverallThroughput: 91.20 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 388.47K (388469) - SerializeBatchTime: 38.665ms - TransmitDataRPCTime: 14.768ms - UncompressedRowBatchSize: 13.71 MB (14375753) CodeGen:(Total: 61.170ms, non-child: 61.170ms, % non-child: 100.00%) - CodegenTime: 964.140us - CompileTime: 7.166ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.270ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 29.234ms HDFS_SCAN_NODE (id=0):(Total: 25.385ms, non-child: 25.385ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/155.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.511ms ; Min: 2.511ms ; Max: 2.511ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 8.33 MB (8731657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.33 MB (8731657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.33 MB (8731657) - DecompressionTime: 29.065ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.37 MB (10877425) - PerReadThreadRawHdfsThroughput: 1.83 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.451ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.95M (1947366) - RowsReturned: 388.47K (388469) - RowsReturnedRate: 15.30 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 20 (20) - ScannerThreadsTotalWallClockTime: 106.247ms - MaterializeTupleTime(*): 63.256ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 91.986ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 4.450ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:31 (host=vb0208.halxg.cloudera.com:22000):(Total: 75.947ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/143.96 MB MemoryUsage(500.000ms): 1.13 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 27 (27) - PeakMemoryUsage: 11.51 MB (12069537) - PerHostPeakMemUsage: 32.74 MB (34334262) - RowsProduced: 359.83K (359831) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.340ms - TotalStorageWaitTime: 26.684ms - TotalWallClockTime: 260.443ms - SysTime: 6.998ms - UserTime: 191.970ms - VoluntaryContextSwitches: 58 (58) Fragment Instance Lifecycle Timings: - ExecTime: 116.777ms - ExecTreeExecTime: 30.877ms - OpenTime: 31.987ms - ExecTreeOpenTime: 52.300us - PrepareTime: 43.877ms - ExecTreePrepareTime: 693.336us DataStreamSender (dst_id=10):(Total: 53.204ms, non-child: 53.204ms, % non-child: 100.00%) - BytesSent: 4.55 MB (4770285) - NetworkThroughput(*): 304.52 MB/sec - OverallThroughput: 85.51 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 359.83K (359831) - SerializeBatchTime: 38.113ms - TransmitDataRPCTime: 14.939ms - UncompressedRowBatchSize: 12.70 MB (13315971) CodeGen:(Total: 57.332ms, non-child: 57.332ms, % non-child: 100.00%) - CodegenTime: 1.076ms - CompileTime: 7.132ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.996ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.706ms HDFS_SCAN_NODE (id=0):(Total: 32.125ms, non-child: 32.125ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/143.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 100.00 KB - FooterProcessingTime: (Avg: 1.736ms ; Min: 1.736ms ; Max: 1.736ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.70 MB (8072992) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.70 MB (8072992) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.70 MB (8072992) - DecompressionTime: 25.654ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 11.11 MB (11652500) - PerReadThreadRawHdfsThroughput: 348.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.503ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1797174) - RowsReturned: 359.83K (359831) - RowsReturnedRate: 11.20 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 111.714ms - MaterializeTupleTime(*): 55.441ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 80.987ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 22.061ms - TotalReadThroughput: 200.00 KB/sec Instance de4b40c22a7cb446:3b (host=vb0230.halxg.cloudera.com:22000):(Total: 75.861ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/252.21 MB 2:1/143.90 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 82 (82) - PeakMemoryUsage: 52.93 MB (55497134) - PerHostPeakMemUsage: 79.32 MB (83169174) - RowsProduced: 989.50K (989505) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.132ms - TotalStorageWaitTime: 35.402ms - TotalWallClockTime: 680.116ms - SysTime: 31.995ms - UserTime: 503.922ms - VoluntaryContextSwitches: 406 (406) Fragment Instance Lifecycle Timings: - ExecTime: 260.310ms - ExecTreeExecTime: 16.736ms - OpenTime: 32.369ms - ExecTreeOpenTime: 44.288us - PrepareTime: 43.421ms - ExecTreePrepareTime: 702.216us DataStreamSender (dst_id=10):(Total: 135.269ms, non-child: 135.269ms, % non-child: 100.00%) - BytesSent: 12.15 MB (12743952) - NetworkThroughput(*): 304.72 MB/sec - OverallThroughput: 89.85 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 989.50K (989505) - SerializeBatchTime: 95.121ms - TransmitDataRPCTime: 39.885ms - UncompressedRowBatchSize: 34.92 MB (36617757) CodeGen:(Total: 59.778ms, non-child: 59.778ms, % non-child: 100.00%) - CodegenTime: 942.512us - CompileTime: 7.102ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.377ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 27.751ms HDFS_SCAN_NODE (id=0):(Total: 17.594ms, non-child: 17.594ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/252.21 MB 2:1/143.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 1.884ms ; Min: 1.788ms ; Max: 1.980ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 21.07 MB (22094188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 21.07 MB (22094188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21.07 MB (22094188) - DecompressionTime: 75.683ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 52.35 MB (54892705) - PerReadThreadRawHdfsThroughput: 763.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.947ms - RowBatchQueuePutWaitTime: 88.517ms - RowsRead: 4.95M (4949385) - RowsReturned: 989.50K (989505) - RowsReturnedRate: 56.24 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 50 (50) - ScannerThreadsTotalWallClockTime: 387.471ms - MaterializeTupleTime(*): 178.284ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 239.963ms - ScannerThreadsVoluntaryContextSwitches: 358 (358) - TotalRawHdfsReadTime(*): 27.604ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:2f (host=vb0228.halxg.cloudera.com:22000):(Total: 75.162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/252.21 MB MemoryUsage(500.000ms): 10.20 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 70 (70) - PeakMemoryUsage: 20.41 MB (21404411) - PerHostPeakMemUsage: 44.02 MB (46156880) - RowsProduced: 631.37K (631372) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.956ms - TotalStorageWaitTime: 8.826ms - TotalWallClockTime: 384.141ms - SysTime: 16.996ms - UserTime: 337.948ms - VoluntaryContextSwitches: 56 (56) Fragment Instance Lifecycle Timings: - ExecTime: 185.717ms - ExecTreeExecTime: 14.323ms - OpenTime: 32.435ms - ExecTreeOpenTime: 54.016us - PrepareTime: 42.683ms - ExecTreePrepareTime: 127.440us DataStreamSender (dst_id=10):(Total: 101.330ms, non-child: 101.330ms, % non-child: 100.00%) - BytesSent: 7.81 MB (8193478) - NetworkThroughput(*): 305.96 MB/sec - OverallThroughput: 77.11 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 631.37K (631372) - SerializeBatchTime: 75.231ms - TransmitDataRPCTime: 25.539ms - UncompressedRowBatchSize: 22.28 MB (23364656) CodeGen:(Total: 58.695ms, non-child: 58.695ms, % non-child: 100.00%) - CodegenTime: 1.072ms - CompileTime: 7.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.061ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 26.325ms HDFS_SCAN_NODE (id=0):(Total: 14.199ms, non-child: 14.199ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/252.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 1.23 MB - FooterProcessingTime: (Avg: 2.194ms ; Min: 2.194ms ; Max: 2.194ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 13.38 MB (14026723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14026723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14026723) - DecompressionTime: 46.560ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.05 MB (21024230) - PerReadThreadRawHdfsThroughput: 2.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.420ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3153576) - RowsReturned: 631.37K (631372) - RowsReturnedRate: 44.46 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 166.025ms - MaterializeTupleTime(*): 105.723ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 148.977ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 5.998ms - TotalReadThroughput: 2.46 MB/sec Instance de4b40c22a7cb446:2e (host=vb0222.halxg.cloudera.com:22000):(Total: 73.143ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/156.02 MB 8:1/143.97 MB MemoryUsage(500.000ms): 19.87 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 67 (67) - PeakMemoryUsage: 43.97 MB (46100919) - PerHostPeakMemUsage: 71.31 MB (74777477) - RowsProduced: 748.10K (748102) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.614ms - TotalStorageWaitTime: 17.035ms - TotalWallClockTime: 576.505ms - SysTime: 27.995ms - UserTime: 416.936ms - VoluntaryContextSwitches: 439 (439) Fragment Instance Lifecycle Timings: - ExecTime: 213.761ms - ExecTreeExecTime: 14.468ms - OpenTime: 32.693ms - ExecTreeOpenTime: 55.824us - PrepareTime: 40.398ms - ExecTreePrepareTime: 232.112us DataStreamSender (dst_id=10):(Total: 99.856ms, non-child: 99.856ms, % non-child: 100.00%) - BytesSent: 9.22 MB (9664157) - NetworkThroughput(*): 327.76 MB/sec - OverallThroughput: 92.30 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 748.10K (748102) - SerializeBatchTime: 71.544ms - TransmitDataRPCTime: 28.119ms - UncompressedRowBatchSize: 26.40 MB (27684370) CodeGen:(Total: 57.463ms, non-child: 57.463ms, % non-child: 100.00%) - CodegenTime: 980.688us - CompileTime: 7.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.263ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.093ms HDFS_SCAN_NODE (id=0):(Total: 14.646ms, non-child: 14.646ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/156.02 MB 8:1/143.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 16.03 MB - FooterProcessingTime: (Avg: 2.078ms ; Min: 2.034ms ; Max: 2.122ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 16.03 MB (16807204) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.03 MB (16807204) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.03 MB (16807204) - DecompressionTime: 57.358ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 43.42 MB (45532322) - PerReadThreadRawHdfsThroughput: 1.96 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.867ms - RowBatchQueuePutWaitTime: 99.215ms - RowsRead: 3.75M (3745028) - RowsReturned: 748.10K (748102) - RowsReturnedRate: 51.08 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 42 (42) - ScannerThreadsTotalWallClockTime: 330.083ms - MaterializeTupleTime(*): 147.011ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 191.970ms - ScannerThreadsVoluntaryContextSwitches: 399 (399) - TotalRawHdfsReadTime(*): 7.969ms - TotalReadThroughput: 32.06 MB/sec Instance de4b40c22a7cb446:38 (host=vb0216.halxg.cloudera.com:22000):(Total: 70.917ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 41 (41) - PeakMemoryUsage: 21.06 MB (22085387) - PerHostPeakMemUsage: 41.57 MB (43588443) - RowsProduced: 630.97K (630965) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.588ms - TotalStorageWaitTime: 8.080ms - TotalWallClockTime: 342.673ms - SysTime: 5.999ms - UserTime: 313.952ms - VoluntaryContextSwitches: 51 (51) Fragment Instance Lifecycle Timings: - ExecTime: 158.057ms - ExecTreeExecTime: 12.635ms - OpenTime: 33.007ms - ExecTreeOpenTime: 52.324us - PrepareTime: 37.881ms - ExecTreePrepareTime: 56.392us DataStreamSender (dst_id=10):(Total: 90.367ms, non-child: 90.367ms, % non-child: 100.00%) - BytesSent: 7.95 MB (8340215) - NetworkThroughput(*): 323.69 MB/sec - OverallThroughput: 88.02 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.97K (630965) - SerializeBatchTime: 65.606ms - TransmitDataRPCTime: 24.572ms - UncompressedRowBatchSize: 22.27 MB (23349589) CodeGen:(Total: 58.498ms, non-child: 58.498ms, % non-child: 100.00%) - CodegenTime: 994.996us - CompileTime: 7.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.609ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.784ms HDFS_SCAN_NODE (id=0):(Total: 12.372ms, non-child: 12.372ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.891ms ; Min: 1.891ms ; Max: 1.891ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14024819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14024819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14024819) - DecompressionTime: 44.072ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.51 MB (21504502) - PerReadThreadRawHdfsThroughput: 2.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.410ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152961) - RowsReturned: 630.97K (630965) - RowsReturnedRate: 51.00 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 151.644ms - MaterializeTupleTime(*): 94.624ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 137.979ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 6.065ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:32 (host=vb0206.halxg.cloudera.com:22000):(Total: 69.172ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/252.17 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 40 (40) - PeakMemoryUsage: 20.59 MB (21594952) - PerHostPeakMemUsage: 45.70 MB (47915296) - RowsProduced: 630.05K (630049) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.475ms - TotalStorageWaitTime: 23.661ms - TotalWallClockTime: 387.469ms - SysTime: 14.997ms - UserTime: 316.951ms - VoluntaryContextSwitches: 77 (77) Fragment Instance Lifecycle Timings: - ExecTime: 185.671ms - ExecTreeExecTime: 29.498ms - OpenTime: 31.877ms - ExecTreeOpenTime: 48.924us - PrepareTime: 37.240ms - ExecTreePrepareTime: 1.490ms DataStreamSender (dst_id=10):(Total: 93.305ms, non-child: 93.305ms, % non-child: 100.00%) - BytesSent: 7.88 MB (8265294) - NetworkThroughput(*): 310.30 MB/sec - OverallThroughput: 84.48 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.05K (630049) - SerializeBatchTime: 67.688ms - TransmitDataRPCTime: 25.402ms - UncompressedRowBatchSize: 22.24 MB (23315693) CodeGen:(Total: 55.485ms, non-child: 55.485ms, % non-child: 100.00%) - CodegenTime: 1.010ms - CompileTime: 7.068ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.970ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 23.957ms HDFS_SCAN_NODE (id=0):(Total: 32.138ms, non-child: 32.138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/252.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.908ms ; Min: 1.908ms ; Max: 1.908ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14019753) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14019753) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14019753) - DecompressionTime: 43.639ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.05 MB (21023283) - PerReadThreadRawHdfsThroughput: 626.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.269ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152011) - RowsReturned: 630.05K (630049) - RowsReturnedRate: 19.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 169.947ms - MaterializeTupleTime(*): 97.830ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 135.979ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 21.329ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:39 (host=vb0220.halxg.cloudera.com:22000):(Total: 68.917ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/155.93 MB 8:1/143.90 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 100 (100) - PeakMemoryUsage: 43.96 MB (46093751) - PerHostPeakMemUsage: 70.05 MB (73456398) - RowsProduced: 749.46K (749458) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.117ms - TotalStorageWaitTime: 17.074ms - TotalWallClockTime: 596.426ms - SysTime: 36.993ms - UserTime: 405.938ms - VoluntaryContextSwitches: 464 (464) Fragment Instance Lifecycle Timings: - ExecTime: 222.192ms - ExecTreeExecTime: 14.952ms - OpenTime: 32.635ms - ExecTreeOpenTime: 45.036us - PrepareTime: 36.237ms - ExecTreePrepareTime: 149.408us DataStreamSender (dst_id=10):(Total: 107.750ms, non-child: 107.750ms, % non-child: 100.00%) - BytesSent: 9.22 MB (9670923) - NetworkThroughput(*): 315.31 MB/sec - OverallThroughput: 85.59 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 749.46K (749458) - SerializeBatchTime: 78.250ms - TransmitDataRPCTime: 29.249ms - UncompressedRowBatchSize: 26.45 MB (27734546) CodeGen:(Total: 57.724ms, non-child: 57.724ms, % non-child: 100.00%) - CodegenTime: 984.872us - CompileTime: 7.216ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.516ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.447ms HDFS_SCAN_NODE (id=0):(Total: 14.667ms, non-child: 14.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/155.93 MB 8:1/143.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 2.025ms ; Min: 1.967ms ; Max: 2.083ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 16.02 MB (16801537) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.02 MB (16801537) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.02 MB (16801537) - DecompressionTime: 57.898ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 43.37 MB (45481122) - PerReadThreadRawHdfsThroughput: 1.93 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.742ms - RowBatchQueuePutWaitTime: 119.309ms - RowsRead: 3.74M (3743821) - RowsReturned: 749.46K (749458) - RowsReturnedRate: 51.10 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 62 (62) - ScannerThreadsTotalWallClockTime: 341.632ms - MaterializeTupleTime(*): 138.308ms - ScannerThreadsSysTime: 15.996ms - ScannerThreadsUserTime: 186.971ms - ScannerThreadsVoluntaryContextSwitches: 417 (417) - TotalRawHdfsReadTime(*): 8.090ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:30 (host=vb0224.halxg.cloudera.com:22000):(Total: 68.266ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/252.20 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 102 (102) - PeakMemoryUsage: 19.80 MB (20765418) - PerHostPeakMemUsage: 42.19 MB (44244156) - RowsProduced: 630.60K (630601) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.550ms - TotalStorageWaitTime: 9.232ms - TotalWallClockTime: 429.173ms - SysTime: 6.998ms - UserTime: 385.941ms - VoluntaryContextSwitches: 116 (116) Fragment Instance Lifecycle Timings: - ExecTime: 201.209ms - ExecTreeExecTime: 18.438ms - OpenTime: 32.117ms - ExecTreeOpenTime: 49.444us - PrepareTime: 36.107ms - ExecTreePrepareTime: 1.690ms DataStreamSender (dst_id=10):(Total: 105.575ms, non-child: 105.575ms, % non-child: 100.00%) - BytesSent: 7.76 MB (8136512) - NetworkThroughput(*): 349.82 MB/sec - OverallThroughput: 73.50 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.60K (630601) - SerializeBatchTime: 83.145ms - TransmitDataRPCTime: 22.181ms - UncompressedRowBatchSize: 22.26 MB (23336117) CodeGen:(Total: 54.925ms, non-child: 54.925ms, % non-child: 100.00%) - CodegenTime: 917.356us - CompileTime: 7.159ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.066ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 23.086ms HDFS_SCAN_NODE (id=0):(Total: 21.405ms, non-child: 21.405ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/252.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.275ms ; Min: 2.275ms ; Max: 2.275ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14025713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14025713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14025713) - DecompressionTime: 51.771ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.44 MB (20380035) - PerReadThreadRawHdfsThroughput: 2.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.925ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3153218) - RowsReturned: 630.60K (630601) - RowsReturnedRate: 29.46 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 21 (21) - ScannerThreadsTotalWallClockTime: 195.886ms - MaterializeTupleTime(*): 129.470ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 183.972ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 6.314ms - TotalReadThroughput: 0.00 /sec Instance de4b40c22a7cb446:35 (host=vb0204.halxg.cloudera.com:22000):(Total: 60.792ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 47 (47) - PeakMemoryUsage: 19.93 MB (20901521) - PerHostPeakMemUsage: 41.97 MB (44013974) - RowsProduced: 629.82K (629818) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.604ms - TotalStorageWaitTime: 26.370ms - TotalWallClockTime: 405.389ms - SysTime: 22.995ms - UserTime: 306.953ms - VoluntaryContextSwitches: 218 (218) Fragment Instance Lifecycle Timings: - ExecTime: 187.677ms - ExecTreeExecTime: 43.860ms - OpenTime: 34.802ms - ExecTreeOpenTime: 64.302us - PrepareTime: 25.958ms - ExecTreePrepareTime: 76.896us DataStreamSender (dst_id=10):(Total: 89.228ms, non-child: 89.228ms, % non-child: 100.00%) - BytesSent: 7.70 MB (8079011) - NetworkThroughput(*): 311.96 MB/sec - OverallThroughput: 86.35 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 629.82K (629818) - SerializeBatchTime: 64.362ms - TransmitDataRPCTime: 24.697ms - UncompressedRowBatchSize: 22.23 MB (23307150) CodeGen:(Total: 58.538ms, non-child: 58.538ms, % non-child: 100.00%) - CodegenTime: 1.371ms - CompileTime: 7.900ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 25.773ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 24.043ms HDFS_SCAN_NODE (id=0):(Total: 43.690ms, non-child: 43.690ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.539ms ; Min: 2.539ms ; Max: 2.539ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14024538) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14024538) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14024538) - DecompressionTime: 48.491ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.62 MB (20575620) - PerReadThreadRawHdfsThroughput: 604.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.478ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152826) - RowsReturned: 629.82K (629818) - RowsReturnedRate: 14.42 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 25 (25) - ScannerThreadsTotalWallClockTime: 182.982ms - MaterializeTupleTime(*): 101.916ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 147.977ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 22.122ms - TotalReadThroughput: 0.00 /sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 13:MERGING-EXCHANGE | 1 | 98.41us | 0ns | 98.41us | 10 | 10 | | 06:TOP-N | 15 | 8.90ms | 0ns | 10.13ms | 150 | 10 | | 12:AGGREGATE | 15 | 84.00ms | 0ns | 109.77ms | 3.39M | 5.08M | | 11:EXCHANGE | 15 | 15.51ms | 0ns | 22.11ms | 3.39M | 5.08M | | 05:AGGREGATE | 15 | 222.13ms | 0ns | 262.71ms | 3.39M | 5.08M | | 04:HASH JOIN | 15 | 238.35ms | 0ns | 273.36ms | 8.97M | 5.08M | | |--10:EXCHANGE | 15 | 13.12ms | 0ns | 13.75ms | 9.00M | 9.00M | | | 00:SCAN HDFS | 14 | 16.36ms | 0ns | 22.27ms | 9.00M | 9.00M | | 09:EXCHANGE | 15 | 104.03ms | 0ns | 130.04ms | 22.69M | 18.00M | | 03:HASH JOIN | 15 | 6.95s | 0ns | 7.49s | 22.69M | 18.00M | | |--08:EXCHANGE | 15 | 400.96ms | 0ns | 502.50ms | 110.51M | 45.00M | | | 01:SCAN HDFS | 15 | 625.98ms | 0ns | 667.11ms | 110.51M | 45.00M | | 07:EXCHANGE | 15 | 5.21s | 0ns | 7.28s | 970.31M | 180.00M | | 02:SCAN HDFS | 15 | 1.24s | 0ns | 1.36s | 970.31M | 180.00M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=854183ec25551621:f27df8e300000000): Summary: Session ID: ff47e0d0c2c98cb4:bdc265929c200980 Session Type: BEESWAX Start Time: 2016-11-29 13:09:25.691733000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build f6f910016b442fd621cde4a536c7ce61b02897e0) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:53429 Default Db: tpch_300_parquet Sql Statement: select l_orderkey, sum(l_extendedprice * (1 - l_discount)) as revenue, o_orderdate, o_shippriority from customer, orders, lineitem where c_mktsegment = 'BUILDING' and c_custkey = o_custkey and l_orderkey = o_orderkey and o_orderdate < '1995-03-15' and l_shipdate > '1995-03-15' group by l_orderkey, o_orderdate, o_shippriority order by revenue desc, o_orderdate limit 10 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.12GB VCores=4 PLAN-ROOT SINK | 13:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | limit: 10 | hosts=15 per-host-mem=unavailable | tuple-ids=4 row-size=58B cardinality=10 | 06:TOP-N [LIMIT=10] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | hosts=15 per-host-mem=580B | tuple-ids=4 row-size=58B cardinality=10 | 12:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | hosts=15 per-host-mem=308.87MB | tuple-ids=3 row-size=58B cardinality=5076417 | 11:EXCHANGE [HASH(l_orderkey,o_orderdate,o_shippriority)] | hosts=15 per-host-mem=0B | tuple-ids=3 row-size=58B cardinality=5076417 | 05:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | hosts=15 per-host-mem=308.87MB | tuple-ids=3 row-size=58B cardinality=5076417 | 04:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: o_custkey = c_custkey | runtime filters: RF000 <- c_custkey | hosts=15 per-host-mem=20.77MB | tuple-ids=2,1,0 row-size=133B cardinality=5076417 | |--10:EXCHANGE [HASH(c_custkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=0 row-size=33B cardinality=9000000 | | | 00:SCAN HDFS [tpch_300_parquet.customer, RANDOM] | partitions=1/1 files=18 size=3.52GB | predicates: c_mktsegment = 'BUILDING' | table stats: 45000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=0 row-size=33B cardinality=9000000 | 09:EXCHANGE [HASH(o_custkey)] | hosts=15 per-host-mem=0B | tuple-ids=2,1 row-size=100B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF001 <- o_orderkey | hosts=15 per-host-mem=157.36MB | tuple-ids=2,1 row-size=100B cardinality=17999891 | |--08:EXCHANGE [HASH(o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=50B cardinality=45000000 | | | 01:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o_orderdate < '1995-03-15' | runtime filters: RF000 -> o_custkey | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=50B cardinality=45000000 | 07:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=2 row-size=50B cardinality=179998909 | 02:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate > '1995-03-15' runtime filters: RF001 -> l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=352.00MB tuple-ids=2 row-size=50B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1203629695 Estimated Per-Host VCores: 4 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 17.754ms - Analysis finished: 7.078ms (7.078ms) - Equivalence classes computed: 7.381ms (303.026us) - Single node plan created: 11.046ms (3.665ms) - Runtime filters computed: 11.369ms (323.038us) - Distributed plan created: 13.293ms (1.923ms) - Lineage info computed: 14.153ms (860.268us) - Planning finished: 17.754ms (3.601ms) Query Timeline: 27s387ms - Query submitted: 61.666us (61.666us) - Planning finished: 21.629ms (21.567ms) - Submit for admission: 23.251ms (1.621ms) - Completed admission: 23.329ms (78.751us) - Ready to start 90 fragment instances: 23.645ms (315.664us) - All 90 fragment instances started: 40.075ms (16.429ms) - First dynamic filter received: 549.774ms (509.698ms) - Rows available: 27s348ms (26s799ms) - First row fetched: 27s363ms (14.958ms) - ComputeScanRangeAssignmentTimer: 774.666us ImpalaServer: - ClientFetchWaitTimer: 14.971ms - RowMaterializationTimer: 15.075ms Execution Profile 854183ec25551621:f27df8e300000000:(Total: 27s340ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 1 3 2 15 REMOTE false 15 (15) N/A N/A true 0 4 1 15 REMOTE false 15 (15) N/A N/A true Fragment instance start latencies: Count: 90, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 5ms Per Node Peak Memory Usage: vb0232.halxg.cloudera.com:22000(1.60 GB) vb0226.halxg.cloudera.com:22000(1.60 GB) vb0214.halxg.cloudera.com:22000(1.58 GB) vb0216.halxg.cloudera.com:22000(1.60 GB) vb0228.halxg.cloudera.com:22000(1.60 GB) vb0206.halxg.cloudera.com:22000(1.60 GB) vb0220.halxg.cloudera.com:22000(1.60 GB) vb0218.halxg.cloudera.com:22000(1.60 GB) vb0234.halxg.cloudera.com:22000(1.62 GB) vb0222.halxg.cloudera.com:22000(1.60 GB) vb0224.halxg.cloudera.com:22000(1.60 GB) vb0212.halxg.cloudera.com:22000(1.60 GB) vb0208.halxg.cloudera.com:22000(1.58 GB) vb0230.halxg.cloudera.com:22000(1.59 GB) vb0204.halxg.cloudera.com:22000(1.54 GB) - FiltersReceived: 30 (30) - FinalizationTimer: 0.000ns Coordinator Fragment F06: Instance 854183ec25551621:f27df8e300000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 27s323ms, non-child: 1.019ms, % non-child: 0.00%) MemoryUsage(500.000ms): 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 6 (6) - PeakMemoryUsage: 304.50 KB (311808) - PerHostPeakMemUsage: 1.54 GB (1654113004) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s310ms - SysTime: 0.000ns - UserTime: 59.991ms - VoluntaryContextSwitches: 9 (9) Fragment Instance Lifecycle Timings: - ExecTime: 15.079ms - ExecTreeExecTime: 205.528us - OpenTime: 27s295ms - ExecTreeOpenTime: 27s235ms - PrepareTime: 28.441ms - ExecTreePrepareTime: 59.945us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 86.900ms, non-child: 86.900ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 8.023ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 29 (29) - NumInstructions: 593 (593) - OptimizationTime: 50.363ms - PeakMemoryUsage: 296.50 KB (303616) - PrepareTime: 27.903ms EXCHANGE_NODE (id=13):(Total: 27s235ms, non-child: 98.406us, % non-child: 0.00%) ExecOption: Codegen Enabled BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 5.21 KB (5331) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 215.782us - FirstBatchArrivalWaitTime: 27s235ms - MergeGetNext: 199.912us - MergeGetNextBatch: 160.971us - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F05:(Total: 27s318ms, non-child: 3.731ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:27s316ms max:27s324ms mean: 27s319ms stddev:2.161ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.41 MB (153521342) - PerHostPeakMemUsage: 1.60 GB (1713615209) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s890ms - TotalNetworkSendTime: 329.240us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s272ms - SysTime: 18.663ms - UserTime: 365.944ms - VoluntaryContextSwitches: 336 (336) Fragment Instance Lifecycle Timings: - ExecTime: 619.203us - ExecTreeExecTime: 4.612us - OpenTime: 27s272ms - ExecTreeOpenTime: 26s988ms - PrepareTime: 45.820ms - ExecTreePrepareTime: 871.473us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 78.227us, non-child: 78.227us, % non-child: 100.00%) - BytesSent: 355.00 B (355) - NetworkThroughput(*): 11.01 MB/sec - OverallThroughput: 4.44 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 20.722us - TransmitDataRPCTime: 32.854us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 325.075ms, non-child: 325.075ms, % non-child: 100.00%) - CodegenTime: 4.720ms - CompileTime: 61.302ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 221.381ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 41.770ms SORT_NODE (id=6):(Total: 26s989ms, non-child: 8.897ms, % non-child: 0.03%) - InsertBatchTime: 8.624ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s980ms, non-child: 83.995ms, % non-child: 0.31%) - BuildTime: 66.936ms - GetNewBlockTime: 333.383us - GetResultsTime: 11.856ms - HTResizeTime: 16.940ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153466236) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.136us EXCHANGE_NODE (id=11):(Total: 26s896ms, non-child: 26s896ms, % non-child: 100.00%) - BytesReceived: 6.20 MB (6497183) - ConvertRowBatchTime: 5.520ms - DeserializeRowBatchTimer: 30.146ms - FirstBatchArrivalWaitTime: 26s837ms - PeakMemoryUsage: 0 - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F05: Instance 854183ec25551621:59 (host=vb0228.halxg.cloudera.com:22000):(Total: 27s322ms, non-child: 3.283ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 40 (40) - PeakMemoryUsage: 146.41 MB (153526010) - PerHostPeakMemUsage: 1.60 GB (1722137586) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s906ms - TotalNetworkSendTime: 328.412us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s269ms - SysTime: 19.997ms - UserTime: 341.948ms - VoluntaryContextSwitches: 424 (424) Fragment Instance Lifecycle Timings: - ExecTime: 554.920us - ExecTreeExecTime: 4.016us - OpenTime: 27s269ms - ExecTreeOpenTime: 26s994ms - PrepareTime: 53.172ms - ExecTreePrepareTime: 890.372us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 98.872us, non-child: 98.872us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 6.08 MB/sec - OverallThroughput: 3.45 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.516us - TransmitDataRPCTime: 56.112us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 324.144ms, non-child: 324.144ms, % non-child: 100.00%) - CodegenTime: 4.073ms - CompileTime: 60.602ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.607ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 49.329ms SORT_NODE (id=6):(Total: 26s994ms, non-child: 9.871ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 9.609ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s985ms, non-child: 73.462ms, % non-child: 0.27%) ExecOption: Codegen Enabled - BuildTime: 55.071ms - GetNewBlockTime: 438.656us - GetResultsTime: 13.156ms - HTResizeTime: 16.782ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.35K (226347) - RowsReturnedRate: 8.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.800us EXCHANGE_NODE (id=11):(Total: 26s911ms, non-child: 22.109ms, % non-child: 0.08%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6500856) - ConvertRowBatchTime: 4.196ms - DeserializeRowBatchTimer: 41.150ms - FirstBatchArrivalWaitTime: 26s838ms - PeakMemoryUsage: 0 - RowsReturned: 226.35K (226347) - RowsReturnedRate: 8.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:54 (host=vb0208.halxg.cloudera.com:22000):(Total: 27s321ms, non-child: 4.715ms, % non-child: 0.02%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 46 (46) - PeakMemoryUsage: 146.41 MB (153517175) - PerHostPeakMemUsage: 1.58 GB (1696780208) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s888ms - TotalNetworkSendTime: 228.332us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s286ms - SysTime: 21.996ms - UserTime: 377.942ms - VoluntaryContextSwitches: 253 (253) Fragment Instance Lifecycle Timings: - ExecTime: 492.776us - ExecTreeExecTime: 4.712us - OpenTime: 27s286ms - ExecTreeOpenTime: 27s008ms - PrepareTime: 35.215ms - ExecTreePrepareTime: 818.092us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 69.296us, non-child: 69.296us, % non-child: 100.00%) - BytesSent: 371.00 B (371) - NetworkThroughput(*): 13.32 MB/sec - OverallThroughput: 5.11 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.272us - TransmitDataRPCTime: 26.560us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 307.455ms, non-child: 307.455ms, % non-child: 100.00%) - CodegenTime: 6.702ms - CompileTime: 60.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 216.398ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 30.012ms SORT_NODE (id=6):(Total: 27s009ms, non-child: 9.654ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 9.310ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s999ms, non-child: 103.186ms, % non-child: 0.38%) ExecOption: Codegen Enabled - BuildTime: 83.696ms - GetNewBlockTime: 275.116us - GetResultsTime: 13.563ms - HTResizeTime: 20.500ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153469806) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.99K (226986) - RowsReturnedRate: 8.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.180us EXCHANGE_NODE (id=11):(Total: 26s896ms, non-child: 13.617ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.22 MB (6518870) - ConvertRowBatchTime: 6.800ms - DeserializeRowBatchTimer: 25.086ms - FirstBatchArrivalWaitTime: 26s854ms - PeakMemoryUsage: 0 - RowsReturned: 226.99K (226986) - RowsReturnedRate: 8.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:4e (host=vb0234.halxg.cloudera.com:22000):(Total: 27s320ms, non-child: 3.232ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 48 (48) - PeakMemoryUsage: 146.42 MB (153533736) - PerHostPeakMemUsage: 1.62 GB (1744038224) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s894ms - TotalNetworkSendTime: 342.496us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s272ms - SysTime: 23.997ms - UserTime: 354.946ms - VoluntaryContextSwitches: 363 (363) Fragment Instance Lifecycle Timings: - ExecTime: 615.740us - ExecTreeExecTime: 4.276us - OpenTime: 27s272ms - ExecTreeOpenTime: 26s985ms - PrepareTime: 48.560ms - ExecTreePrepareTime: 844.760us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 69.196us, non-child: 69.196us, % non-child: 100.00%) - BytesSent: 354.00 B (354) - NetworkThroughput(*): 11.64 MB/sec - OverallThroughput: 4.88 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.088us - TransmitDataRPCTime: 29.000us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 331.023ms, non-child: 331.023ms, % non-child: 100.00%) - CodegenTime: 3.790ms - CompileTime: 62.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 222.920ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 44.967ms SORT_NODE (id=6):(Total: 26s986ms, non-child: 10.131ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 9.816ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s976ms, non-child: 76.567ms, % non-child: 0.28%) ExecOption: Codegen Enabled - BuildTime: 57.420ms - GetNewBlockTime: 237.956us - GetResultsTime: 12.985ms - HTResizeTime: 14.125ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153469014) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.51K (226511) - RowsReturnedRate: 8.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.852us EXCHANGE_NODE (id=11):(Total: 26s899ms, non-child: 9.902ms, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6502210) - ConvertRowBatchTime: 4.441ms - DeserializeRowBatchTimer: 23.120ms - FirstBatchArrivalWaitTime: 26s832ms - PeakMemoryUsage: 0 - RowsReturned: 226.51K (226511) - RowsReturnedRate: 8.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:56 (host=vb0214.halxg.cloudera.com:22000):(Total: 27s319ms, non-child: 3.414ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.58 GB (1692730655) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s908ms - TotalNetworkSendTime: 300.764us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s264ms - SysTime: 13.997ms - UserTime: 343.948ms - VoluntaryContextSwitches: 440 (440) Fragment Instance Lifecycle Timings: - ExecTime: 617.845us - ExecTreeExecTime: 4.669us - OpenTime: 27s263ms - ExecTreeOpenTime: 26s991ms - PrepareTime: 56.124ms - ExecTreePrepareTime: 744.993us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 112.941us, non-child: 112.941us, % non-child: 100.00%) - BytesSent: 361.00 B (361) - NetworkThroughput(*): 12.75 MB/sec - OverallThroughput: 3.05 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 62.209us - TransmitDataRPCTime: 27.001us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 324.341ms, non-child: 324.341ms, % non-child: 100.00%) - CodegenTime: 3.997ms - CompileTime: 60.145ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 211.283ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 52.313ms SORT_NODE (id=6):(Total: 26s991ms, non-child: 8.926ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.647ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s982ms, non-child: 70.002ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 52.290ms - GetNewBlockTime: 237.421us - GetResultsTime: 12.749ms - HTResizeTime: 14.275ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.91K (225907) - RowsReturnedRate: 8.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.345us EXCHANGE_NODE (id=11):(Total: 26s912ms, non-child: 18.173ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.19 MB (6486621) - ConvertRowBatchTime: 4.171ms - DeserializeRowBatchTimer: 38.456ms - FirstBatchArrivalWaitTime: 26s837ms - PeakMemoryUsage: 0 - RowsReturned: 225.91K (225907) - RowsReturnedRate: 8.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:53 (host=vb0222.halxg.cloudera.com:22000):(Total: 27s319ms, non-child: 3.323ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.41 MB (153525869) - PerHostPeakMemUsage: 1.60 GB (1720553986) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s874ms - TotalNetworkSendTime: 251.080us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s275ms - SysTime: 19.997ms - UserTime: 381.942ms - VoluntaryContextSwitches: 214 (214) Fragment Instance Lifecycle Timings: - ExecTime: 761.512us - ExecTreeExecTime: 4.816us - OpenTime: 27s274ms - ExecTreeOpenTime: 26s995ms - PrepareTime: 44.613ms - ExecTreePrepareTime: 832.008us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 67.848us, non-child: 67.848us, % non-child: 100.00%) - BytesSent: 339.00 B (339) - NetworkThroughput(*): 12.07 MB/sec - OverallThroughput: 4.76 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.620us - TransmitDataRPCTime: 26.784us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 319.777ms, non-child: 319.777ms, % non-child: 100.00%) - CodegenTime: 3.958ms - CompileTime: 63.594ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 214.645ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 40.921ms SORT_NODE (id=6):(Total: 26s996ms, non-child: 9.033ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.735ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s987ms, non-child: 103.928ms, % non-child: 0.39%) ExecOption: Codegen Enabled - BuildTime: 85.982ms - GetNewBlockTime: 288.240us - GetResultsTime: 12.485ms - HTResizeTime: 20.129ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.37 MB (153475150) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.84K (226843) - RowsReturnedRate: 8.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.104us EXCHANGE_NODE (id=11):(Total: 26s883ms, non-child: 14.706ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.21 MB (6513172) - ConvertRowBatchTime: 7.429ms - DeserializeRowBatchTimer: 24.150ms - FirstBatchArrivalWaitTime: 26s842ms - PeakMemoryUsage: 0 - RowsReturned: 226.84K (226843) - RowsReturnedRate: 8.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:51 (host=vb0220.halxg.cloudera.com:22000):(Total: 27s318ms, non-child: 4.320ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.29 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 51 (51) - PeakMemoryUsage: 146.44 MB (153552593) - PerHostPeakMemUsage: 1.60 GB (1720867986) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s811ms - TotalNetworkSendTime: 281.248us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s267ms - SysTime: 18.997ms - UserTime: 437.934ms - VoluntaryContextSwitches: 225 (225) Fragment Instance Lifecycle Timings: - ExecTime: 556.000us - ExecTreeExecTime: 5.468us - OpenTime: 27s267ms - ExecTreeOpenTime: 26s927ms - PrepareTime: 51.390ms - ExecTreePrepareTime: 945.148us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 72.776us, non-child: 72.776us, % non-child: 100.00%) - BytesSent: 368.00 B (368) - NetworkThroughput(*): 12.80 MB/sec - OverallThroughput: 4.82 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.852us - TransmitDataRPCTime: 27.424us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 385.534ms, non-child: 385.534ms, % non-child: 100.00%) - CodegenTime: 5.573ms - CompileTime: 60.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 277.467ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 47.091ms SORT_NODE (id=6):(Total: 26s928ms, non-child: 8.944ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.618ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s919ms, non-child: 100.644ms, % non-child: 0.37%) ExecOption: Codegen Enabled - BuildTime: 82.535ms - GetNewBlockTime: 299.528us - GetResultsTime: 12.344ms - HTResizeTime: 22.663ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153469806) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.65K (225653) - RowsReturnedRate: 8.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.132us EXCHANGE_NODE (id=11):(Total: 26s819ms, non-child: 12.294ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6479676) - ConvertRowBatchTime: 6.745ms - DeserializeRowBatchTimer: 23.292ms - FirstBatchArrivalWaitTime: 26s776ms - PeakMemoryUsage: 0 - RowsReturned: 225.65K (225653) - RowsReturnedRate: 8.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:57 (host=vb0226.halxg.cloudera.com:22000):(Total: 27s318ms, non-child: 3.347ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 66.83 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.42 MB (153537735) - PerHostPeakMemUsage: 1.60 GB (1719696027) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s886ms - TotalNetworkSendTime: 204.808us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s278ms - SysTime: 23.997ms - UserTime: 366.944ms - VoluntaryContextSwitches: 258 (258) Fragment Instance Lifecycle Timings: - ExecTime: 449.296us - ExecTreeExecTime: 4.876us - OpenTime: 27s278ms - ExecTreeOpenTime: 27s004ms - PrepareTime: 40.168ms - ExecTreePrepareTime: 973.488us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 69.516us, non-child: 69.516us, % non-child: 100.00%) - BytesSent: 365.00 B (365) - NetworkThroughput(*): 12.26 MB/sec - OverallThroughput: 5.01 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 15.932us - TransmitDataRPCTime: 28.388us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 309.877ms, non-child: 309.877ms, % non-child: 100.00%) - CodegenTime: 4.103ms - CompileTime: 59.985ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.081ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 36.239ms SORT_NODE (id=6):(Total: 27s005ms, non-child: 8.228ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.929ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s997ms, non-child: 102.615ms, % non-child: 0.38%) ExecOption: Codegen Enabled - BuildTime: 85.456ms - GetNewBlockTime: 369.536us - GetResultsTime: 11.876ms - HTResizeTime: 23.481ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.04K (226044) - RowsReturnedRate: 8.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.088us EXCHANGE_NODE (id=11):(Total: 26s894ms, non-child: 14.645ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.10 MB - BytesReceived: 6.19 MB (6490537) - ConvertRowBatchTime: 6.692ms - DeserializeRowBatchTimer: 26.517ms - FirstBatchArrivalWaitTime: 26s852ms - PeakMemoryUsage: 0 - RowsReturned: 226.04K (226044) - RowsReturnedRate: 8.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:52 (host=vb0216.halxg.cloudera.com:22000):(Total: 27s317ms, non-child: 3.708ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.39 MB (153505576) - PerHostPeakMemUsage: 1.60 GB (1720816310) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s857ms - TotalNetworkSendTime: 304.452us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s270ms - SysTime: 29.996ms - UserTime: 384.941ms - VoluntaryContextSwitches: 185 (185) Fragment Instance Lifecycle Timings: - ExecTime: 537.040us - ExecTreeExecTime: 4.116us - OpenTime: 27s269ms - ExecTreeOpenTime: 26s983ms - PrepareTime: 47.986ms - ExecTreePrepareTime: 949.360us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 83.964us, non-child: 83.964us, % non-child: 100.00%) - BytesSent: 355.00 B (355) - NetworkThroughput(*): 8.04 MB/sec - OverallThroughput: 4.03 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.207us - TransmitDataRPCTime: 42.084us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 329.597ms, non-child: 329.597ms, % non-child: 100.00%) - CodegenTime: 4.080ms - CompileTime: 59.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 225.883ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 44.038ms SORT_NODE (id=6):(Total: 26s984ms, non-child: 8.249ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.996ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s976ms, non-child: 109.768ms, % non-child: 0.41%) ExecOption: Codegen Enabled - BuildTime: 91.854ms - GetNewBlockTime: 576.520us - GetResultsTime: 12.528ms - HTResizeTime: 22.005ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.35 MB (153463232) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.39K (226386) - RowsReturnedRate: 8.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.996us EXCHANGE_NODE (id=11):(Total: 26s866ms, non-child: 14.169ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6499267) - ConvertRowBatchTime: 7.631ms - DeserializeRowBatchTimer: 23.881ms - FirstBatchArrivalWaitTime: 26s833ms - PeakMemoryUsage: 0 - RowsReturned: 226.39K (226386) - RowsReturnedRate: 8.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:4d (host=vb0224.halxg.cloudera.com:22000):(Total: 27s316ms, non-child: 3.407ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 42 (42) - PeakMemoryUsage: 146.39 MB (153500409) - PerHostPeakMemUsage: 1.60 GB (1720263834) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s911ms - TotalNetworkSendTime: 342.832us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s270ms - SysTime: 16.997ms - UserTime: 345.948ms - VoluntaryContextSwitches: 430 (430) Fragment Instance Lifecycle Timings: - ExecTime: 807.696us - ExecTreeExecTime: 5.296us - OpenTime: 27s270ms - ExecTreeOpenTime: 26s993ms - PrepareTime: 46.738ms - ExecTreePrepareTime: 790.196us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 83.560us, non-child: 83.560us, % non-child: 100.00%) - BytesSent: 369.00 B (369) - NetworkThroughput(*): 8.03 MB/sec - OverallThroughput: 4.21 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 15.944us - TransmitDataRPCTime: 43.820us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 318.948ms, non-child: 318.948ms, % non-child: 100.00%) - CodegenTime: 4.814ms - CompileTime: 60.351ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 215.104ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 42.868ms SORT_NODE (id=6):(Total: 26s994ms, non-child: 9.409ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 9.158ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s985ms, non-child: 68.828ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 52.555ms - GetNewBlockTime: 257.188us - GetResultsTime: 11.531ms - HTResizeTime: 13.710ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.35 MB (153458065) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.57K (226574) - RowsReturnedRate: 8.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.836us EXCHANGE_NODE (id=11):(Total: 26s916ms, non-child: 16.838ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6506091) - ConvertRowBatchTime: 4.366ms - DeserializeRowBatchTimer: 35.634ms - FirstBatchArrivalWaitTime: 26s844ms - PeakMemoryUsage: 0 - RowsReturned: 226.57K (226574) - RowsReturnedRate: 8.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:4b (host=vb0230.halxg.cloudera.com:22000):(Total: 27s316ms, non-child: 3.461ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.41 MB (153521378) - PerHostPeakMemUsage: 1.59 GB (1709741976) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s914ms - TotalNetworkSendTime: 575.520us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s284ms - SysTime: 14.997ms - UserTime: 357.946ms - VoluntaryContextSwitches: 438 (438) Fragment Instance Lifecycle Timings: - ExecTime: 792.288us - ExecTreeExecTime: 4.716us - OpenTime: 27s283ms - ExecTreeOpenTime: 26s998ms - PrepareTime: 33.118ms - ExecTreePrepareTime: 869.044us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 75.800us, non-child: 75.800us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 11.89 MB/sec - OverallThroughput: 4.50 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.604us - TransmitDataRPCTime: 28.724us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 314.340ms, non-child: 314.340ms, % non-child: 100.00%) - CodegenTime: 4.113ms - CompileTime: 67.551ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 217.020ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 29.104ms SORT_NODE (id=6):(Total: 26s998ms, non-child: 9.037ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.803ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s989ms, non-child: 69.683ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 52.149ms - GetNewBlockTime: 237.108us - GetResultsTime: 12.569ms - HTResizeTime: 12.821ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.06K (225064) - RowsReturnedRate: 8.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.144us EXCHANGE_NODE (id=11):(Total: 26s920ms, non-child: 15.755ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.16 MB (6463365) - ConvertRowBatchTime: 4.603ms - DeserializeRowBatchTimer: 36.831ms - FirstBatchArrivalWaitTime: 26s848ms - PeakMemoryUsage: 0 - RowsReturned: 225.06K (225064) - RowsReturnedRate: 8.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:55 (host=vb0206.halxg.cloudera.com:22000):(Total: 27s316ms, non-child: 4.210ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.29 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153506824) - PerHostPeakMemUsage: 1.60 GB (1720450783) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s880ms - TotalNetworkSendTime: 448.468us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s275ms - SysTime: 19.997ms - UserTime: 375.943ms - VoluntaryContextSwitches: 237 (237) Fragment Instance Lifecycle Timings: - ExecTime: 857.006us - ExecTreeExecTime: 4.276us - OpenTime: 27s274ms - ExecTreeOpenTime: 26s997ms - PrepareTime: 41.968ms - ExecTreePrepareTime: 841.312us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 56.694us, non-child: 56.694us, % non-child: 100.00%) - BytesSent: 346.00 B (346) - NetworkThroughput(*): 15.68 MB/sec - OverallThroughput: 5.82 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 14.954us - TransmitDataRPCTime: 21.046us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 313.741ms, non-child: 313.741ms, % non-child: 100.00%) - CodegenTime: 6.000ms - CompileTime: 60.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 215.506ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 37.259ms SORT_NODE (id=6):(Total: 26s998ms, non-child: 8.844ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.602ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s989ms, non-child: 100.188ms, % non-child: 0.37%) ExecOption: Codegen Enabled - BuildTime: 85.438ms - GetNewBlockTime: 300.968us - GetResultsTime: 9.811ms - HTResizeTime: 19.656ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153464614) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 227.03K (227034) - RowsReturnedRate: 8.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.914us EXCHANGE_NODE (id=11):(Total: 26s889ms, non-child: 19.465ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.22 MB (6517655) - ConvertRowBatchTime: 7.550ms - DeserializeRowBatchTimer: 35.462ms - FirstBatchArrivalWaitTime: 26s847ms - PeakMemoryUsage: 0 - RowsReturned: 227.03K (227034) - RowsReturnedRate: 8.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:4c (host=vb0212.halxg.cloudera.com:22000):(Total: 27s316ms, non-child: 3.633ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 29.90 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 41 (41) - PeakMemoryUsage: 146.41 MB (153522197) - PerHostPeakMemUsage: 1.60 GB (1720741123) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s921ms - TotalNetworkSendTime: 370.172us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s271ms - SysTime: 9.998ms - UserTime: 343.947ms - VoluntaryContextSwitches: 416 (416) Fragment Instance Lifecycle Timings: - ExecTime: 650.953us - ExecTreeExecTime: 4.720us - OpenTime: 27s271ms - ExecTreeOpenTime: 27s001ms - PrepareTime: 44.715ms - ExecTreePrepareTime: 856.001us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 72.192us, non-child: 72.192us, % non-child: 100.00%) - BytesSent: 348.00 B (348) - NetworkThroughput(*): 12.18 MB/sec - OverallThroughput: 4.60 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.256us - TransmitDataRPCTime: 27.245us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 309.634ms, non-child: 309.634ms, % non-child: 100.00%) - CodegenTime: 4.342ms - CompileTime: 60.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 208.159ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 40.541ms SORT_NODE (id=6):(Total: 27s002ms, non-child: 8.485ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.242ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s994ms, non-child: 68.032ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 51.441ms - GetNewBlockTime: 278.058us - GetResultsTime: 11.351ms - HTResizeTime: 12.016ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.35 MB (153457475) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.55K (226547) - RowsReturnedRate: 8.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.108us EXCHANGE_NODE (id=11):(Total: 26s926ms, non-child: 10.239ms, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.23 MB - BytesReceived: 6.21 MB (6507973) - ConvertRowBatchTime: 4.307ms - DeserializeRowBatchTimer: 21.353ms - FirstBatchArrivalWaitTime: 26s853ms - PeakMemoryUsage: 0 - RowsReturned: 226.55K (226547) - RowsReturnedRate: 8.41 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:58 (host=vb0232.halxg.cloudera.com:22000):(Total: 27s315ms, non-child: 4.126ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 48 (48) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1720756569) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s881ms - TotalNetworkSendTime: 289.264us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s263ms - SysTime: 23.996ms - UserTime: 357.945ms - VoluntaryContextSwitches: 347 (347) Fragment Instance Lifecycle Timings: - ExecTime: 520.539us - ExecTreeExecTime: 3.760us - OpenTime: 27s262ms - ExecTreeOpenTime: 26s972ms - PrepareTime: 53.179ms - ExecTreePrepareTime: 904.836us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 84.436us, non-child: 84.436us, % non-child: 100.00%) - BytesSent: 337.00 B (337) - NetworkThroughput(*): 10.52 MB/sec - OverallThroughput: 3.81 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 26.456us - TransmitDataRPCTime: 30.560us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 337.985ms, non-child: 337.985ms, % non-child: 100.00%) - CodegenTime: 5.385ms - CompileTime: 61.623ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 226.521ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 49.169ms SORT_NODE (id=6):(Total: 26s973ms, non-child: 7.369ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.127ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s966ms, non-child: 78.690ms, % non-child: 0.29%) ExecOption: Codegen Enabled - BuildTime: 64.094ms - GetNewBlockTime: 366.432us - GetResultsTime: 9.858ms - HTResizeTime: 16.366ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.89K (225894) - RowsReturnedRate: 8.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.636us EXCHANGE_NODE (id=11):(Total: 26s887ms, non-child: 20.150ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6484589) - ConvertRowBatchTime: 5.151ms - DeserializeRowBatchTimer: 36.070ms - FirstBatchArrivalWaitTime: 26s824ms - PeakMemoryUsage: 0 - RowsReturned: 225.89K (225894) - RowsReturnedRate: 8.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:4f (host=vb0218.halxg.cloudera.com:22000):(Total: 27s315ms, non-child: 3.706ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.42 MB (153536878) - PerHostPeakMemUsage: 1.60 GB (1720539872) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s911ms - TotalNetworkSendTime: 286.712us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s266ms - SysTime: 8.999ms - UserTime: 350.946ms - VoluntaryContextSwitches: 432 (432) Fragment Instance Lifecycle Timings: - ExecTime: 560.596us - ExecTreeExecTime: 5.280us - OpenTime: 27s266ms - ExecTreeOpenTime: 26s991ms - PrepareTime: 49.287ms - ExecTreePrepareTime: 961.824us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 74.972us, non-child: 74.972us, % non-child: 100.00%) - BytesSent: 353.00 B (353) - NetworkThroughput(*): 10.77 MB/sec - OverallThroughput: 4.49 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.304us - TransmitDataRPCTime: 31.252us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 319.611ms, non-child: 319.611ms, % non-child: 100.00%) - CodegenTime: 4.141ms - CompileTime: 60.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.843ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 45.092ms SORT_NODE (id=6):(Total: 26s992ms, non-child: 9.010ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.748ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s983ms, non-child: 67.027ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 51.206ms - GetNewBlockTime: 381.268us - GetResultsTime: 10.826ms - HTResizeTime: 11.951ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153468036) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.56K (226556) - RowsReturnedRate: 8.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.836us EXCHANGE_NODE (id=11):(Total: 26s916ms, non-child: 19.388ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6504921) - ConvertRowBatchTime: 4.327ms - DeserializeRowBatchTimer: 38.319ms - FirstBatchArrivalWaitTime: 26s842ms - PeakMemoryUsage: 0 - RowsReturned: 226.56K (226556) - RowsReturnedRate: 8.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:50 (host=vb0204.halxg.cloudera.com:22000):(Total: 27s314ms, non-child: 4.079ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 45 (45) - PeakMemoryUsage: 146.41 MB (153517644) - PerHostPeakMemUsage: 1.54 GB (1654113004) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 26s899ms - TotalNetworkSendTime: 384.046us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s274ms - SysTime: 11.998ms - UserTime: 365.945ms - VoluntaryContextSwitches: 380 (380) Fragment Instance Lifecycle Timings: - ExecTime: 513.850us - ExecTreeExecTime: 4.190us - OpenTime: 27s273ms - ExecTreeOpenTime: 26s979ms - PrepareTime: 41.073ms - ExecTreePrepareTime: 850.675us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 81.356us, non-child: 81.356us, % non-child: 100.00%) - BytesSent: 349.00 B (349) - NetworkThroughput(*): 7.11 MB/sec - OverallThroughput: 4.09 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.619us - TransmitDataRPCTime: 46.816us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 330.114ms, non-child: 330.114ms, % non-child: 100.00%) - CodegenTime: 5.732ms - CompileTime: 62.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 229.275ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 37.613ms SORT_NODE (id=6):(Total: 26s980ms, non-child: 8.258ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.024ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 26s972ms, non-child: 67.303ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 52.851ms - GetNewBlockTime: 456.750us - GetResultsTime: 10.216ms - HTResizeTime: 13.615ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153469806) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.75K (225750) - RowsReturnedRate: 8.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.072us EXCHANGE_NODE (id=11):(Total: 26s905ms, non-child: 11.236ms, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6481942) - ConvertRowBatchTime: 4.388ms - DeserializeRowBatchTimer: 22.864ms - FirstBatchArrivalWaitTime: 26s832ms - PeakMemoryUsage: 0 - RowsReturned: 225.75K (225750) - RowsReturnedRate: 8.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 4s794ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:27s274ms max:27s295ms mean: 27s286ms stddev:6.885ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.01 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 289 (289) - PeakMemoryUsage: 302.80 MB (317512531) - PerHostPeakMemUsage: 1.60 GB (1713615209) - RowsProduced: 226.27K (226273) - TotalNetworkReceiveTime: 26s216ms - TotalNetworkSendTime: 3.375ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s366ms - SysTime: 102.583ms - UserTime: 1s185ms - VoluntaryContextSwitches: 7.55K (7549) Fragment Instance Lifecycle Timings: - ExecTime: 22s489ms - ExecTreeExecTime: 22s385ms - OpenTime: 4s739ms - ExecTreeOpenTime: 4s348ms - PrepareTime: 55.684ms - ExecTreePrepareTime: 1.047ms DataStreamSender (dst_id=11):(Total: 64.200ms, non-child: 64.200ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6497183) - NetworkThroughput(*): 351.13 MB/sec - OverallThroughput: 97.17 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.27K (226273) - SerializeBatchTime: 45.245ms - TransmitDataRPCTime: 18.800ms - UncompressedRowBatchSize: 13.60 MB (14257945) CodeGen:(Total: 428.653ms, non-child: 428.653ms, % non-child: 100.00%) - CodegenTime: 8.119ms - CompileTime: 110.050ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 279.650ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 38.391ms AGGREGATION_NODE (id=5):(Total: 26s734ms, non-child: 222.133ms, % non-child: 0.83%) - GetNewBlockTime: 520.361us - GetResultsTime: 9.996ms - HTResizeTime: 21.808ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.57 MB (152639663) - PinTime: 0.000ns - ReductionFactorEstimate: 17.47 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.46 K/sec - StreamingTime: 202.830ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s512ms, non-child: 238.347ms, % non-child: 0.90%) - BuildRows: 599.72K (599724) - BuildTime: 118.234ms - PeakMemoryUsage: 153.17 MB (160605684) - ProbeRows: 1.51M (1512369) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 224.808ms - RowsReturned: 597.67K (597671) - RowsReturnedRate: 22.54 K/sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 73.982ms - BuildRowsPartitioned: 599.72K (599724) - GetNewBlockTime: 227.271us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.277ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.124ms, non-child: 13.124ms, % non-child: 100.00%) - BytesReceived: 7.44 MB (7801409) - ConvertRowBatchTime: 10.318ms - DeserializeRowBatchTimer: 45.131ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.72K (599724) - RowsReturnedRate: 45.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s274ms, non-child: 26s274ms, % non-child: 100.00%) - BytesReceived: 66.34 MB (69567648) - ConvertRowBatchTime: 47.908ms - DeserializeRowBatchTimer: 376.006ms - FirstBatchArrivalWaitTime: 4s333ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512369) - RowsReturnedRate: 57.56 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F04: Instance 854183ec25551621:3c (host=vb0230.halxg.cloudera.com:22000):(Total: 4s796ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.39 MB, 145.72 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.95 MB, 159.28 MB, 159.54 MB, 167.41 MB, 167.35 MB, 167.31 MB, 168.39 MB, 168.43 MB, 168.37 MB, 168.35 MB, 168.56 MB, 168.43 MB, 168.60 MB, 168.39 MB, 168.35 MB, 170.37 MB, 170.58 MB, 170.57 MB, 170.39 MB, 170.33 MB, 170.43 MB, 170.53 MB, 170.37 MB, 170.47 MB, 170.53 MB, 170.31 MB, 170.49 MB, 170.39 MB, 170.39 MB, 290.31 MB, 298.33 MB, 298.43 MB, 298.99 MB, 302.10 MB, 302.51 MB, 302.33 MB, 302.43 MB, 302.39 MB, 302.54 MB, 302.41 MB, 302.56 MB, 302.29 MB, 302.43 MB, 302.45 MB, 302.51 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 226 (226) - PeakMemoryUsage: 302.78 MB (317489421) - PerHostPeakMemUsage: 1.59 GB (1709741976) - RowsProduced: 226.57K (226567) - TotalNetworkReceiveTime: 26s266ms - TotalNetworkSendTime: 2.976ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s374ms - SysTime: 105.983ms - UserTime: 1s142ms - VoluntaryContextSwitches: 7.61K (7611) Fragment Instance Lifecycle Timings: - ExecTime: 22s478ms - ExecTreeExecTime: 22s379ms - OpenTime: 4s749ms - ExecTreeOpenTime: 4s341ms - PrepareTime: 47.234ms - ExecTreePrepareTime: 940.888us DataStreamSender (dst_id=11):(Total: 68.574ms, non-child: 68.574ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6507006) - NetworkThroughput(*): 255.80 MB/sec - OverallThroughput: 90.49 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.57K (226567) - SerializeBatchTime: 44.177ms - TransmitDataRPCTime: 24.259ms - UncompressedRowBatchSize: 13.62 MB (14276469) CodeGen:(Total: 441.067ms, non-child: 441.067ms, % non-child: 100.00%) - CodegenTime: 7.054ms - CompileTime: 111.226ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 295.350ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 33.903ms AGGREGATION_NODE (id=5):(Total: 26s722ms, non-child: 203.216ms, % non-child: 0.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 574.948us - GetResultsTime: 9.531ms - HTResizeTime: 21.280ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.49 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.57K (226567) - RowsReturnedRate: 8.48 K/sec - StreamingTime: 185.565ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s518ms, non-child: 204.842ms, % non-child: 0.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.56K (599564) - BuildTime: 127.180ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1514078) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 193.106ms - RowsReturned: 599.07K (599068) - RowsReturnedRate: 22.59 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 82.401ms - BuildRowsPartitioned: 599.56K (599564) - GetNewBlockTime: 211.808us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.562ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.380ms, non-child: 13.380ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7798216) - ConvertRowBatchTime: 10.453ms - DeserializeRowBatchTimer: 46.319ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.56K (599564) - RowsReturnedRate: 44.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s314ms, non-child: 94.883ms, % non-child: 0.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 991.97 KB, 2.57 MB, 4.15 MB, 5.72 MB, 7.31 MB, 8.86 MB, 10.47 MB, 12.10 MB, 13.70 MB, 15.35 MB, 16.93 MB, 18.57 MB, 20.17 MB, 21.78 MB, 23.42 MB, 25.06 MB, 26.67 MB, 28.33 MB, 29.95 MB, 31.55 MB, 33.16 MB, 34.78 MB, 36.41 MB, 38.02 MB, 39.63 MB, 41.24 MB, 42.88 MB, 44.51 MB, 46.12 MB, 47.71 MB, 49.33 MB, 50.95 MB, 52.56 MB, 54.16 MB, 55.80 MB, 57.47 MB, 59.09 MB, 60.73 MB, 62.37 MB, 63.79 MB, 64.85 MB, 65.54 MB, 65.95 MB, 66.19 MB, 66.30 MB - BytesReceived: 66.41 MB (69638120) - ConvertRowBatchTime: 39.906ms - DeserializeRowBatchTimer: 481.633ms - FirstBatchArrivalWaitTime: 4s328ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1514078) - RowsReturnedRate: 57.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:3d (host=vb0212.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 17.21 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.08 MB, 159.47 MB, 159.53 MB, 167.37 MB, 167.35 MB, 167.43 MB, 168.43 MB, 168.41 MB, 168.35 MB, 168.58 MB, 168.33 MB, 168.29 MB, 168.41 MB, 168.33 MB, 168.62 MB, 170.41 MB, 170.31 MB, 170.47 MB, 170.56 MB, 170.54 MB, 170.47 MB, 170.58 MB, 170.54 MB, 170.39 MB, 170.53 MB, 170.33 MB, 170.45 MB, 170.29 MB, 178.51 MB, 298.33 MB, 298.33 MB, 298.41 MB, 299.83 MB, 302.39 MB, 302.47 MB, 302.45 MB, 302.31 MB, 302.45 MB, 302.53 MB, 302.37 MB, 302.31 MB, 302.56 MB, 302.33 MB, 302.47 MB, 113.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 263 (263) - PeakMemoryUsage: 302.88 MB (317587727) - PerHostPeakMemUsage: 1.60 GB (1720741123) - RowsProduced: 226.01K (226006) - TotalNetworkReceiveTime: 26s215ms - TotalNetworkSendTime: 2.891ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s362ms - SysTime: 112.982ms - UserTime: 1s170ms - VoluntaryContextSwitches: 7.54K (7535) Fragment Instance Lifecycle Timings: - ExecTime: 22s477ms - ExecTreeExecTime: 22s378ms - OpenTime: 4s740ms - ExecTreeOpenTime: 4s369ms - PrepareTime: 55.461ms - ExecTreePrepareTime: 1.088ms DataStreamSender (dst_id=11):(Total: 57.847ms, non-child: 57.847ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490880) - NetworkThroughput(*): 443.86 MB/sec - OverallThroughput: 107.01 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226006) - SerializeBatchTime: 43.753ms - TransmitDataRPCTime: 13.946ms - UncompressedRowBatchSize: 13.58 MB (14241118) CodeGen:(Total: 404.982ms, non-child: 404.982ms, % non-child: 100.00%) - CodegenTime: 7.657ms - CompileTime: 108.878ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 260.900ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 34.718ms AGGREGATION_NODE (id=5):(Total: 26s749ms, non-child: 232.606ms, % non-child: 0.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 625.349us - GetResultsTime: 9.244ms - HTResizeTime: 20.208ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.40 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226006) - RowsReturnedRate: 8.45 K/sec - StreamingTime: 213.985ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s516ms, non-child: 240.348ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.51K (599515) - BuildTime: 124.836ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1509753) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 227.070ms - RowsReturned: 595.84K (595842) - RowsReturnedRate: 22.47 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 80.295ms - BuildRowsPartitioned: 599.51K (599515) - GetNewBlockTime: 259.786us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.905ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.749ms, non-child: 13.749ms, % non-child: 100.00%) BytesReceived(500.000ms): 4.27 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7799573) - ConvertRowBatchTime: 10.433ms - DeserializeRowBatchTimer: 41.104ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.51K (599515) - RowsReturnedRate: 43.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s276ms, non-child: 109.395ms, % non-child: 0.42%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.44 MB, 3.00 MB, 4.60 MB, 6.15 MB, 7.71 MB, 9.32 MB, 10.89 MB, 12.50 MB, 14.09 MB, 15.73 MB, 17.31 MB, 18.92 MB, 20.54 MB, 22.12 MB, 23.75 MB, 25.34 MB, 27.01 MB, 28.61 MB, 30.22 MB, 31.82 MB, 33.41 MB, 35.04 MB, 36.63 MB, 38.27 MB, 39.90 MB, 41.52 MB, 43.14 MB, 44.79 MB, 46.36 MB, 47.99 MB, 49.56 MB, 51.22 MB, 52.78 MB, 54.41 MB, 56.05 MB, 57.75 MB, 59.40 MB, 61.03 MB, 62.64 MB, 63.92 MB, 64.92 MB, 65.48 MB, 65.83 MB, 66.02 MB - BytesReceived: 66.23 MB (69445042) - ConvertRowBatchTime: 51.270ms - DeserializeRowBatchTimer: 348.669ms - FirstBatchArrivalWaitTime: 4s353ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1509753) - RowsReturnedRate: 57.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:43 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.29 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.91 MB, 159.01 MB, 159.53 MB, 159.97 MB, 167.58 MB, 167.51 MB, 168.07 MB, 168.54 MB, 168.33 MB, 168.54 MB, 168.56 MB, 168.37 MB, 168.49 MB, 168.29 MB, 168.53 MB, 169.49 MB, 170.33 MB, 170.39 MB, 170.54 MB, 170.31 MB, 170.56 MB, 170.45 MB, 170.37 MB, 170.43 MB, 170.56 MB, 170.31 MB, 170.35 MB, 170.45 MB, 170.56 MB, 226.37 MB, 298.35 MB, 298.47 MB, 298.31 MB, 300.79 MB, 302.37 MB, 302.43 MB, 302.41 MB, 302.51 MB, 302.49 MB, 302.47 MB, 302.39 MB, 302.39 MB, 302.39 MB, 302.33 MB, 302.51 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 263 (263) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720816310) - RowsProduced: 226.41K (226407) - TotalNetworkReceiveTime: 26s273ms - TotalNetworkSendTime: 3.556ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s369ms - SysTime: 87.986ms - UserTime: 1s143ms - VoluntaryContextSwitches: 7.63K (7626) Fragment Instance Lifecycle Timings: - ExecTime: 22s484ms - ExecTreeExecTime: 22s384ms - OpenTime: 4s742ms - ExecTreeOpenTime: 4s354ms - PrepareTime: 53.569ms - ExecTreePrepareTime: 989.644us DataStreamSender (dst_id=11):(Total: 56.267ms, non-child: 56.267ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6500034) - NetworkThroughput(*): 441.81 MB/sec - OverallThroughput: 110.17 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.41K (226407) - SerializeBatchTime: 42.097ms - TransmitDataRPCTime: 14.030ms - UncompressedRowBatchSize: 13.61 MB (14266377) CodeGen:(Total: 420.124ms, non-child: 420.124ms, % non-child: 100.00%) - CodegenTime: 7.390ms - CompileTime: 111.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 275.039ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 32.591ms AGGREGATION_NODE (id=5):(Total: 26s739ms, non-child: 203.719ms, % non-child: 0.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 519.264us - GetResultsTime: 9.778ms - HTResizeTime: 20.853ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.41K (226407) - RowsReturnedRate: 8.47 K/sec - StreamingTime: 184.666ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s535ms, non-child: 210.184ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.69K (600689) - BuildTime: 123.913ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1514342) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 197.140ms - RowsReturned: 599.40K (599405) - RowsReturnedRate: 22.59 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 81.074ms - BuildRowsPartitioned: 600.69K (600689) - GetNewBlockTime: 264.272us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.815ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.148ms, non-child: 13.148ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.27 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7813575) - ConvertRowBatchTime: 10.270ms - DeserializeRowBatchTimer: 43.974ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.69K (600689) - RowsReturnedRate: 45.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s325ms, non-child: 98.481ms, % non-child: 0.37%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 195.51 KB, 1.89 MB, 3.47 MB, 5.07 MB, 6.64 MB, 8.23 MB, 9.80 MB, 11.43 MB, 13.05 MB, 14.62 MB, 16.25 MB, 17.87 MB, 19.49 MB, 21.07 MB, 22.70 MB, 24.30 MB, 25.93 MB, 27.58 MB, 29.22 MB, 30.82 MB, 32.41 MB, 34.03 MB, 35.65 MB, 37.25 MB, 38.88 MB, 40.48 MB, 42.11 MB, 43.72 MB, 45.35 MB, 46.97 MB, 48.58 MB, 50.17 MB, 51.80 MB, 53.42 MB, 55.02 MB, 56.67 MB, 58.31 MB, 59.98 MB, 61.63 MB, 63.20 MB, 64.42 MB, 65.32 MB, 65.77 MB, 66.10 MB, 66.27 MB - BytesReceived: 66.43 MB (69658141) - ConvertRowBatchTime: 42.836ms - DeserializeRowBatchTimer: 482.745ms - FirstBatchArrivalWaitTime: 4s336ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1514342) - RowsReturnedRate: 57.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:46 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.38 MB, 143.41 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.83 MB, 159.11 MB, 159.53 MB, 167.45 MB, 167.47 MB, 167.37 MB, 168.45 MB, 168.58 MB, 168.56 MB, 168.58 MB, 168.45 MB, 168.43 MB, 168.51 MB, 168.51 MB, 168.41 MB, 170.51 MB, 170.43 MB, 170.51 MB, 170.54 MB, 170.47 MB, 170.54 MB, 170.47 MB, 170.37 MB, 170.31 MB, 170.33 MB, 170.43 MB, 170.41 MB, 170.33 MB, 170.29 MB, 274.53 MB, 298.37 MB, 298.47 MB, 299.14 MB, 302.56 MB, 302.41 MB, 302.35 MB, 302.45 MB, 302.33 MB, 302.41 MB, 302.49 MB, 302.41 MB, 302.45 MB, 302.41 MB, 302.41 MB, 302.41 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 265 (265) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1720450783) - RowsProduced: 226.60K (226605) - TotalNetworkReceiveTime: 26s283ms - TotalNetworkSendTime: 3.426ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s363ms - SysTime: 113.982ms - UserTime: 1s094ms - VoluntaryContextSwitches: 7.59K (7586) Fragment Instance Lifecycle Timings: - ExecTime: 22s486ms - ExecTreeExecTime: 22s384ms - OpenTime: 4s742ms - ExecTreeOpenTime: 4s369ms - PrepareTime: 53.521ms - ExecTreePrepareTime: 1.029ms DataStreamSender (dst_id=11):(Total: 70.856ms, non-child: 70.856ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6509211) - NetworkThroughput(*): 252.26 MB/sec - OverallThroughput: 87.61 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.60K (226605) - SerializeBatchTime: 46.095ms - TransmitDataRPCTime: 24.608ms - UncompressedRowBatchSize: 13.62 MB (14278859) CodeGen:(Total: 407.093ms, non-child: 407.093ms, % non-child: 100.00%) - CodegenTime: 7.039ms - CompileTime: 108.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 263.653ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 34.667ms AGGREGATION_NODE (id=5):(Total: 26s754ms, non-child: 195.989ms, % non-child: 0.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 492.812us - GetResultsTime: 9.440ms - HTResizeTime: 19.886ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.42 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.60K (226605) - RowsReturnedRate: 8.47 K/sec - StreamingTime: 178.362ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s558ms, non-child: 227.351ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.91K (599908) - BuildTime: 116.327ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 214.969ms - RowsReturned: 597.80K (597802) - RowsReturnedRate: 22.51 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 69.567ms - BuildRowsPartitioned: 599.91K (599908) - GetNewBlockTime: 228.366us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.964ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.244ms, non-child: 13.244ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7802204) - ConvertRowBatchTime: 10.596ms - DeserializeRowBatchTimer: 43.103ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.91K (599908) - RowsReturnedRate: 45.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s331ms, non-child: 95.415ms, % non-child: 0.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 938.12 KB, 2.50 MB, 4.06 MB, 5.64 MB, 7.23 MB, 8.80 MB, 10.41 MB, 11.95 MB, 13.56 MB, 15.18 MB, 16.83 MB, 18.44 MB, 20.05 MB, 21.66 MB, 23.24 MB, 24.86 MB, 26.48 MB, 28.09 MB, 29.68 MB, 31.31 MB, 32.92 MB, 34.49 MB, 36.16 MB, 37.75 MB, 39.37 MB, 40.99 MB, 42.64 MB, 44.27 MB, 45.87 MB, 47.55 MB, 49.15 MB, 50.76 MB, 52.39 MB, 54.04 MB, 55.68 MB, 57.31 MB, 58.97 MB, 60.63 MB, 62.28 MB, 63.67 MB, 64.75 MB, 65.44 MB, 65.87 MB, 66.10 MB, 66.23 MB - BytesReceived: 66.34 MB (69563264) - ConvertRowBatchTime: 39.079ms - DeserializeRowBatchTimer: 477.280ms - FirstBatchArrivalWaitTime: 4s355ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512100) - RowsReturnedRate: 57.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:44 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 9.97 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.81 MB, 159.33 MB, 159.31 MB, 167.33 MB, 167.37 MB, 167.37 MB, 168.43 MB, 168.41 MB, 168.41 MB, 168.43 MB, 168.56 MB, 168.49 MB, 168.29 MB, 168.37 MB, 168.67 MB, 170.31 MB, 170.47 MB, 170.47 MB, 170.54 MB, 170.41 MB, 170.49 MB, 170.37 MB, 170.39 MB, 170.37 MB, 170.53 MB, 170.33 MB, 170.49 MB, 170.51 MB, 170.29 MB, 298.33 MB, 298.43 MB, 298.41 MB, 299.37 MB, 302.53 MB, 302.47 MB, 302.29 MB, 302.39 MB, 302.29 MB, 302.39 MB, 302.47 MB, 302.51 MB, 302.39 MB, 302.41 MB, 302.35 MB, 302.38 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 353 (353) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1720553986) - RowsProduced: 226.08K (226079) - TotalNetworkReceiveTime: 26s222ms - TotalNetworkSendTime: 3.210ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s370ms - SysTime: 93.985ms - UserTime: 1s181ms - VoluntaryContextSwitches: 7.54K (7545) Fragment Instance Lifecycle Timings: - ExecTime: 22s492ms - ExecTreeExecTime: 22s384ms - OpenTime: 4s745ms - ExecTreeOpenTime: 4s368ms - PrepareTime: 50.045ms - ExecTreePrepareTime: 1.158ms DataStreamSender (dst_id=11):(Total: 60.424ms, non-child: 60.424ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6488944) - NetworkThroughput(*): 425.27 MB/sec - OverallThroughput: 102.42 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.08K (226079) - SerializeBatchTime: 45.722ms - TransmitDataRPCTime: 14.551ms - UncompressedRowBatchSize: 13.59 MB (14245725) CodeGen:(Total: 413.401ms, non-child: 413.401ms, % non-child: 100.00%) - CodegenTime: 6.958ms - CompileTime: 109.555ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 266.220ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 37.123ms AGGREGATION_NODE (id=5):(Total: 26s754ms, non-child: 227.452ms, % non-child: 0.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 413.284us - GetResultsTime: 10.022ms - HTResizeTime: 22.132ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.48 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.08K (226079) - RowsReturnedRate: 8.45 K/sec - StreamingTime: 207.626ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s527ms, non-child: 242.285ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.72K (599717) - BuildTime: 114.081ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.52M (1515800) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 229.311ms - RowsReturned: 597.23K (597227) - RowsReturnedRate: 22.51 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 69.764ms - BuildRowsPartitioned: 599.72K (599717) - GetNewBlockTime: 188.212us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.126ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.628ms, non-child: 12.628ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.97 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7802369) - ConvertRowBatchTime: 10.025ms - DeserializeRowBatchTimer: 44.021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.72K (599717) - RowsReturnedRate: 47.49 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s285ms, non-child: 102.308ms, % non-child: 0.39%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.27 MB, 2.86 MB, 4.46 MB, 6.04 MB, 7.63 MB, 9.20 MB, 10.80 MB, 12.41 MB, 13.99 MB, 15.61 MB, 17.24 MB, 18.82 MB, 20.44 MB, 22.05 MB, 23.63 MB, 25.26 MB, 26.90 MB, 28.52 MB, 30.12 MB, 31.77 MB, 33.37 MB, 34.99 MB, 36.61 MB, 38.22 MB, 39.86 MB, 41.48 MB, 43.12 MB, 44.70 MB, 46.31 MB, 47.95 MB, 49.56 MB, 51.22 MB, 52.82 MB, 54.46 MB, 56.14 MB, 57.77 MB, 59.43 MB, 61.09 MB, 62.75 MB, 64.05 MB, 65.10 MB, 65.71 MB, 66.09 MB, 66.28 MB, 66.44 MB - BytesReceived: 66.49 MB (69722938) - ConvertRowBatchTime: 51.156ms - DeserializeRowBatchTimer: 291.404ms - FirstBatchArrivalWaitTime: 4s355ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1515800) - RowsReturnedRate: 57.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:47 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 153.11 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.83 MB, 158.84 MB, 159.41 MB, 167.33 MB, 167.47 MB, 167.29 MB, 168.33 MB, 168.37 MB, 168.35 MB, 168.35 MB, 168.45 MB, 168.29 MB, 168.51 MB, 168.54 MB, 168.45 MB, 170.45 MB, 170.35 MB, 170.39 MB, 170.47 MB, 170.53 MB, 170.49 MB, 170.37 MB, 170.45 MB, 170.31 MB, 170.33 MB, 170.35 MB, 170.43 MB, 170.43 MB, 170.43 MB, 282.43 MB, 298.54 MB, 298.37 MB, 299.06 MB, 302.43 MB, 302.60 MB, 302.29 MB, 302.31 MB, 302.33 MB, 302.45 MB, 302.41 MB, 302.45 MB, 302.56 MB, 302.33 MB, 302.43 MB, 302.37 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 270 (270) - PeakMemoryUsage: 302.88 MB (317587727) - PerHostPeakMemUsage: 1.58 GB (1692730655) - RowsProduced: 226.70K (226701) - TotalNetworkReceiveTime: 26s256ms - TotalNetworkSendTime: 3.262ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s353ms - SysTime: 106.983ms - UserTime: 1s123ms - VoluntaryContextSwitches: 7.61K (7609) Fragment Instance Lifecycle Timings: - ExecTime: 22s489ms - ExecTreeExecTime: 22s386ms - OpenTime: 4s732ms - ExecTreeOpenTime: 4s355ms - PrepareTime: 62.930ms - ExecTreePrepareTime: 1.047ms DataStreamSender (dst_id=11):(Total: 70.826ms, non-child: 70.826ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6510245) - NetworkThroughput(*): 250.79 MB/sec - OverallThroughput: 87.66 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.70K (226701) - SerializeBatchTime: 45.912ms - TransmitDataRPCTime: 24.755ms - UncompressedRowBatchSize: 13.62 MB (14284911) CodeGen:(Total: 422.809ms, non-child: 422.809ms, % non-child: 100.00%) - CodegenTime: 7.534ms - CompileTime: 108.078ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 268.042ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 46.175ms AGGREGATION_NODE (id=5):(Total: 26s743ms, non-child: 199.975ms, % non-child: 0.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 409.226us - GetResultsTime: 9.349ms - HTResizeTime: 18.428ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.44 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.70K (226701) - RowsReturnedRate: 8.48 K/sec - StreamingTime: 182.091ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s543ms, non-child: 237.001ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.40K (599400) - BuildTime: 113.871ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1513156) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 223.374ms - RowsReturned: 598.55K (598547) - RowsReturnedRate: 22.55 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 70.526ms - BuildRowsPartitioned: 599.40K (599400) - GetNewBlockTime: 224.038us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.375ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.731ms, non-child: 12.731ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7799692) - ConvertRowBatchTime: 10.014ms - DeserializeRowBatchTimer: 47.899ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.40K (599400) - RowsReturnedRate: 47.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s306ms, non-child: 94.306ms, % non-child: 0.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 849.61 KB, 2.39 MB, 3.97 MB, 5.55 MB, 7.14 MB, 8.72 MB, 10.31 MB, 11.91 MB, 13.51 MB, 15.13 MB, 16.74 MB, 18.38 MB, 20.05 MB, 21.68 MB, 23.26 MB, 24.87 MB, 26.52 MB, 28.16 MB, 29.77 MB, 31.37 MB, 32.97 MB, 34.57 MB, 36.19 MB, 37.74 MB, 39.37 MB, 40.99 MB, 42.60 MB, 44.22 MB, 45.79 MB, 47.46 MB, 49.08 MB, 50.72 MB, 52.33 MB, 53.97 MB, 55.62 MB, 57.24 MB, 58.91 MB, 60.54 MB, 62.16 MB, 63.58 MB, 64.72 MB, 65.44 MB, 65.88 MB, 66.15 MB, 66.25 MB - BytesReceived: 66.38 MB (69608887) - ConvertRowBatchTime: 41.047ms - DeserializeRowBatchTimer: 478.045ms - FirstBatchArrivalWaitTime: 4s341ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1513156) - RowsReturnedRate: 57.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:49 (host=vb0232.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 26.74 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.79 MB, 158.93 MB, 159.53 MB, 161.33 MB, 167.58 MB, 167.51 MB, 168.21 MB, 168.45 MB, 168.35 MB, 168.43 MB, 168.47 MB, 168.35 MB, 168.45 MB, 168.37 MB, 168.53 MB, 169.93 MB, 170.60 MB, 170.37 MB, 170.49 MB, 170.51 MB, 170.41 MB, 170.49 MB, 170.29 MB, 170.35 MB, 170.37 MB, 170.49 MB, 170.45 MB, 170.39 MB, 170.35 MB, 234.45 MB, 298.45 MB, 298.35 MB, 298.49 MB, 301.79 MB, 302.45 MB, 302.31 MB, 302.33 MB, 302.43 MB, 302.29 MB, 302.51 MB, 302.31 MB, 302.56 MB, 302.53 MB, 302.47 MB, 302.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 283 (283) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.60 GB (1720756569) - RowsProduced: 226.34K (226342) - TotalNetworkReceiveTime: 26s179ms - TotalNetworkSendTime: 3.926ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s357ms - SysTime: 90.986ms - UserTime: 1s202ms - VoluntaryContextSwitches: 7.56K (7558) Fragment Instance Lifecycle Timings: - ExecTime: 22s495ms - ExecTreeExecTime: 22s389ms - OpenTime: 4s727ms - ExecTreeOpenTime: 4s340ms - PrepareTime: 68.351ms - ExecTreePrepareTime: 922.640us DataStreamSender (dst_id=11):(Total: 70.479ms, non-child: 70.479ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6499568) - NetworkThroughput(*): 257.31 MB/sec - OverallThroughput: 87.95 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.34K (226342) - SerializeBatchTime: 46.250ms - TransmitDataRPCTime: 24.089ms - UncompressedRowBatchSize: 13.60 MB (14262290) CodeGen:(Total: 432.354ms, non-child: 432.354ms, % non-child: 100.00%) - CodegenTime: 11.843ms - CompileTime: 114.806ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 270.259ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 46.628ms AGGREGATION_NODE (id=5):(Total: 26s730ms, non-child: 233.199ms, % non-child: 0.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 570.768us - GetResultsTime: 10.578ms - HTResizeTime: 19.744ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.46 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.34K (226342) - RowsReturnedRate: 8.47 K/sec - StreamingTime: 213.530ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s497ms, non-child: 254.705ms, % non-child: 0.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.57K (599574) - BuildTime: 117.003ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510381) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 240.268ms - RowsReturned: 597.67K (597669) - RowsReturnedRate: 22.55 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.433ms - BuildRowsPartitioned: 599.57K (599574) - GetNewBlockTime: 215.988us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.395ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.781ms, non-child: 12.781ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.28 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7799003) - ConvertRowBatchTime: 10.084ms - DeserializeRowBatchTimer: 49.110ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.57K (599574) - RowsReturnedRate: 46.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s243ms, non-child: 112.116ms, % non-child: 0.43%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 232.42 KB, 1.90 MB, 3.52 MB, 5.10 MB, 6.70 MB, 8.23 MB, 9.86 MB, 11.48 MB, 13.06 MB, 14.67 MB, 16.26 MB, 17.86 MB, 19.48 MB, 21.07 MB, 22.66 MB, 24.28 MB, 25.92 MB, 27.53 MB, 29.15 MB, 30.78 MB, 32.35 MB, 33.95 MB, 35.58 MB, 37.17 MB, 38.80 MB, 40.38 MB, 42.02 MB, 43.62 MB, 45.22 MB, 46.83 MB, 48.45 MB, 50.08 MB, 51.71 MB, 53.33 MB, 54.97 MB, 56.62 MB, 58.25 MB, 59.91 MB, 61.51 MB, 63.09 MB, 64.26 MB, 65.18 MB, 65.61 MB, 65.95 MB, 66.12 MB - BytesReceived: 66.27 MB (69486091) - ConvertRowBatchTime: 52.426ms - DeserializeRowBatchTimer: 444.206ms - FirstBatchArrivalWaitTime: 4s325ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510381) - RowsReturnedRate: 57.55 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:40 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 3.80 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.89 MB, 159.23 MB, 159.35 MB, 167.43 MB, 167.43 MB, 167.45 MB, 168.47 MB, 168.49 MB, 168.35 MB, 168.43 MB, 168.39 MB, 168.35 MB, 168.47 MB, 168.41 MB, 168.43 MB, 170.56 MB, 170.54 MB, 170.31 MB, 170.35 MB, 170.58 MB, 170.39 MB, 170.47 MB, 170.39 MB, 170.43 MB, 170.37 MB, 170.41 MB, 170.41 MB, 170.39 MB, 170.45 MB, 290.29 MB, 298.29 MB, 298.43 MB, 298.74 MB, 302.06 MB, 302.31 MB, 302.47 MB, 302.29 MB, 302.45 MB, 302.39 MB, 302.37 MB, 302.41 MB, 302.29 MB, 302.29 MB, 302.58 MB, 302.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 241 (241) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720539872) - RowsProduced: 225.69K (225687) - TotalNetworkReceiveTime: 26s154ms - TotalNetworkSendTime: 3.627ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s345ms - SysTime: 115.982ms - UserTime: 1s243ms - VoluntaryContextSwitches: 7.48K (7477) Fragment Instance Lifecycle Timings: - ExecTime: 22s481ms - ExecTreeExecTime: 22s382ms - OpenTime: 4s737ms - ExecTreeOpenTime: 4s363ms - PrepareTime: 57.964ms - ExecTreePrepareTime: 919.672us DataStreamSender (dst_id=11):(Total: 68.396ms, non-child: 68.396ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6479908) - NetworkThroughput(*): 258.61 MB/sec - OverallThroughput: 90.35 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.69K (225687) - SerializeBatchTime: 44.334ms - TransmitDataRPCTime: 23.896ms - UncompressedRowBatchSize: 13.56 MB (14221013) CodeGen:(Total: 413.857ms, non-child: 413.857ms, % non-child: 100.00%) - CodegenTime: 7.667ms - CompileTime: 107.684ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 265.316ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 40.329ms AGGREGATION_NODE (id=5):(Total: 26s746ms, non-child: 255.492ms, % non-child: 0.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 444.912us - GetResultsTime: 9.764ms - HTResizeTime: 27.925ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.49 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.69K (225687) - RowsReturnedRate: 8.44 K/sec - StreamingTime: 236.657ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s490ms, non-child: 265.143ms, % non-child: 1.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 598.38K (598376) - BuildTime: 108.495ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512081) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 250.325ms - RowsReturned: 596.11K (596109) - RowsReturnedRate: 22.50 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 66.086ms - BuildRowsPartitioned: 598.38K (598376) - GetNewBlockTime: 219.580us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.482ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.019ms, non-child: 13.019ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7788493) - ConvertRowBatchTime: 10.256ms - DeserializeRowBatchTimer: 44.185ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 598.38K (598376) - RowsReturnedRate: 45.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s226ms, non-child: 122.814ms, % non-child: 0.47%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.08 MB, 2.64 MB, 4.21 MB, 5.77 MB, 7.34 MB, 8.93 MB, 10.55 MB, 12.13 MB, 13.78 MB, 15.38 MB, 16.98 MB, 18.58 MB, 20.21 MB, 21.79 MB, 23.42 MB, 25.05 MB, 26.66 MB, 28.26 MB, 29.89 MB, 31.48 MB, 33.11 MB, 34.71 MB, 36.33 MB, 37.92 MB, 39.51 MB, 41.11 MB, 42.73 MB, 44.38 MB, 45.98 MB, 47.58 MB, 49.19 MB, 50.82 MB, 52.47 MB, 54.10 MB, 55.76 MB, 57.40 MB, 59.04 MB, 60.72 MB, 62.35 MB, 63.74 MB, 64.79 MB, 65.46 MB, 65.91 MB, 66.12 MB, 66.24 MB - BytesReceived: 66.34 MB (69560785) - ConvertRowBatchTime: 58.558ms - DeserializeRowBatchTimer: 275.326ms - FirstBatchArrivalWaitTime: 4s347ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512081) - RowsReturnedRate: 57.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:48 (host=vb0226.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 20.98 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.91 MB, 159.31 MB, 159.56 MB, 167.54 MB, 167.43 MB, 167.37 MB, 168.43 MB, 168.49 MB, 168.53 MB, 168.33 MB, 168.51 MB, 168.51 MB, 168.41 MB, 168.39 MB, 168.69 MB, 170.37 MB, 170.45 MB, 170.31 MB, 170.29 MB, 170.47 MB, 170.29 MB, 170.37 MB, 170.45 MB, 170.51 MB, 170.33 MB, 170.45 MB, 170.56 MB, 170.43 MB, 194.43 MB, 298.37 MB, 298.37 MB, 298.35 MB, 299.87 MB, 302.47 MB, 302.35 MB, 302.56 MB, 302.43 MB, 302.54 MB, 302.49 MB, 302.47 MB, 302.35 MB, 302.51 MB, 302.53 MB, 302.47 MB, 95.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 288 (288) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1719696027) - RowsProduced: 226.01K (226010) - TotalNetworkReceiveTime: 26s218ms - TotalNetworkSendTime: 2.824ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s379ms - SysTime: 87.986ms - UserTime: 1s195ms - VoluntaryContextSwitches: 7.54K (7537) Fragment Instance Lifecycle Timings: - ExecTime: 22s498ms - ExecTreeExecTime: 22s390ms - OpenTime: 4s749ms - ExecTreeOpenTime: 4s373ms - PrepareTime: 46.146ms - ExecTreePrepareTime: 1.661ms DataStreamSender (dst_id=11):(Total: 59.697ms, non-child: 59.697ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6489684) - NetworkThroughput(*): 426.61 MB/sec - OverallThroughput: 103.67 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226010) - SerializeBatchTime: 45.039ms - TransmitDataRPCTime: 14.507ms - UncompressedRowBatchSize: 13.58 MB (14241366) CodeGen:(Total: 408.743ms, non-child: 408.743ms, % non-child: 100.00%) - CodegenTime: 6.965ms - CompileTime: 109.014ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 265.810ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 33.391ms AGGREGATION_NODE (id=5):(Total: 26s765ms, non-child: 236.534ms, % non-child: 0.88%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 963.432us - GetResultsTime: 10.242ms - HTResizeTime: 23.639ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.51 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226010) - RowsReturnedRate: 8.44 K/sec - StreamingTime: 216.073ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s528ms, non-child: 248.716ms, % non-child: 0.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.76K (599760) - BuildTime: 113.641ms - PeakMemoryUsage: 153.17 MB (160609672) - ProbeRows: 1.51M (1512321) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 232.607ms - RowsReturned: 597.51K (597507) - RowsReturnedRate: 22.52 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 69.734ms - BuildRowsPartitioned: 599.76K (599760) - GetNewBlockTime: 259.052us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.904ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.132ms, non-child: 13.132ms, % non-child: 100.00%) BytesReceived(500.000ms): 5.46 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7804066) - ConvertRowBatchTime: 10.395ms - DeserializeRowBatchTimer: 42.683ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.76K (599760) - RowsReturnedRate: 45.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s280ms, non-child: 105.505ms, % non-child: 0.40%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.54 MB, 3.11 MB, 4.71 MB, 6.31 MB, 7.88 MB, 9.47 MB, 11.06 MB, 12.66 MB, 14.29 MB, 15.91 MB, 17.56 MB, 19.18 MB, 20.80 MB, 22.36 MB, 24.01 MB, 25.63 MB, 27.24 MB, 28.88 MB, 30.48 MB, 32.05 MB, 33.68 MB, 35.29 MB, 36.89 MB, 38.49 MB, 40.11 MB, 41.74 MB, 43.37 MB, 44.97 MB, 46.58 MB, 48.18 MB, 49.76 MB, 51.36 MB, 52.99 MB, 54.61 MB, 56.27 MB, 57.93 MB, 59.57 MB, 61.21 MB, 62.80 MB, 64.09 MB, 65.07 MB, 65.59 MB, 65.96 MB, 66.16 MB - BytesReceived: 66.34 MB (69559920) - ConvertRowBatchTime: 51.203ms - DeserializeRowBatchTimer: 285.564ms - FirstBatchArrivalWaitTime: 4s355ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512321) - RowsReturnedRate: 57.55 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:45 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 11.38 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.08 MB, 159.54 MB, 159.31 MB, 167.32 MB, 167.49 MB, 167.47 MB, 168.33 MB, 168.45 MB, 168.37 MB, 168.41 MB, 168.47 MB, 168.33 MB, 168.37 MB, 168.33 MB, 168.70 MB, 170.53 MB, 170.43 MB, 170.47 MB, 170.41 MB, 170.49 MB, 170.35 MB, 170.45 MB, 170.33 MB, 170.37 MB, 170.33 MB, 170.33 MB, 170.29 MB, 170.49 MB, 186.41 MB, 298.49 MB, 298.51 MB, 298.35 MB, 299.45 MB, 302.43 MB, 302.37 MB, 302.31 MB, 302.37 MB, 302.43 MB, 302.53 MB, 302.49 MB, 302.49 MB, 302.29 MB, 302.43 MB, 302.37 MB, 302.36 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 372 (372) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.58 GB (1696780208) - RowsProduced: 226.75K (226754) - TotalNetworkReceiveTime: 26s218ms - TotalNetworkSendTime: 3.282ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s377ms - SysTime: 106.983ms - UserTime: 1s196ms - VoluntaryContextSwitches: 7.50K (7505) Fragment Instance Lifecycle Timings: - ExecTime: 22s497ms - ExecTreeExecTime: 22s386ms - OpenTime: 4s752ms - ExecTreeOpenTime: 4s373ms - PrepareTime: 42.601ms - ExecTreePrepareTime: 1.108ms DataStreamSender (dst_id=11):(Total: 61.843ms, non-child: 61.843ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6510455) - NetworkThroughput(*): 414.79 MB/sec - OverallThroughput: 100.40 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.75K (226754) - SerializeBatchTime: 46.712ms - TransmitDataRPCTime: 14.968ms - UncompressedRowBatchSize: 13.63 MB (14288258) CodeGen:(Total: 409.796ms, non-child: 409.796ms, % non-child: 100.00%) - CodegenTime: 7.302ms - CompileTime: 113.396ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 264.512ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 31.369ms AGGREGATION_NODE (id=5):(Total: 26s760ms, non-child: 236.119ms, % non-child: 0.88%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 341.364us - GetResultsTime: 10.688ms - HTResizeTime: 25.901ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.45 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.75K (226754) - RowsReturnedRate: 8.47 K/sec - StreamingTime: 216.172ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s524ms, non-child: 244.313ms, % non-child: 0.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.12K (599125) - BuildTime: 110.301ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510659) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 230.812ms - RowsReturned: 598.24K (598243) - RowsReturnedRate: 22.55 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 66.083ms - BuildRowsPartitioned: 599.12K (599125) - GetNewBlockTime: 208.340us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.773ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.553ms, non-child: 12.553ms, % non-child: 100.00%) BytesReceived(500.000ms): 2.42 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7792235) - ConvertRowBatchTime: 9.978ms - DeserializeRowBatchTimer: 42.408ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.12K (599125) - RowsReturnedRate: 47.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s280ms, non-child: 104.033ms, % non-child: 0.40%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.26 MB, 2.82 MB, 4.42 MB, 5.99 MB, 7.56 MB, 9.16 MB, 10.72 MB, 12.34 MB, 13.97 MB, 15.60 MB, 17.20 MB, 18.84 MB, 20.43 MB, 22.07 MB, 23.70 MB, 25.30 MB, 26.87 MB, 28.51 MB, 30.14 MB, 31.79 MB, 33.34 MB, 34.97 MB, 36.62 MB, 38.25 MB, 39.85 MB, 41.42 MB, 43.02 MB, 44.60 MB, 46.27 MB, 47.88 MB, 49.47 MB, 51.06 MB, 52.72 MB, 54.33 MB, 55.97 MB, 57.60 MB, 59.24 MB, 60.85 MB, 62.51 MB, 63.83 MB, 64.86 MB, 65.46 MB, 65.87 MB, 66.07 MB, 66.20 MB - BytesReceived: 66.27 MB (69488808) - ConvertRowBatchTime: 51.325ms - DeserializeRowBatchTimer: 283.725ms - FirstBatchArrivalWaitTime: 4s356ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510659) - RowsReturnedRate: 57.48 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:42 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s795ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.34 MB, 29.85 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.83 MB, 158.92 MB, 159.29 MB, 167.03 MB, 167.31 MB, 167.39 MB, 168.45 MB, 168.45 MB, 168.45 MB, 168.35 MB, 168.43 MB, 168.49 MB, 168.31 MB, 168.31 MB, 168.29 MB, 170.23 MB, 170.33 MB, 170.54 MB, 170.33 MB, 170.41 MB, 170.53 MB, 170.39 MB, 170.58 MB, 170.49 MB, 170.54 MB, 170.39 MB, 170.41 MB, 170.41 MB, 170.39 MB, 266.37 MB, 298.41 MB, 298.29 MB, 299.10 MB, 302.47 MB, 302.58 MB, 302.47 MB, 302.29 MB, 302.33 MB, 302.53 MB, 302.43 MB, 302.37 MB, 302.51 MB, 302.43 MB, 302.41 MB, 302.47 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 340 (340) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720867986) - RowsProduced: 226.65K (226652) - TotalNetworkReceiveTime: 26s216ms - TotalNetworkSendTime: 3.781ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s365ms - SysTime: 90.985ms - UserTime: 1s192ms - VoluntaryContextSwitches: 7.63K (7629) Fragment Instance Lifecycle Timings: - ExecTime: 22s498ms - ExecTreeExecTime: 22s385ms - OpenTime: 4s729ms - ExecTreeOpenTime: 4s294ms - PrepareTime: 65.716ms - ExecTreePrepareTime: 994.332us DataStreamSender (dst_id=11):(Total: 60.375ms, non-child: 60.375ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6508447) - NetworkThroughput(*): 426.39 MB/sec - OverallThroughput: 102.81 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.65K (226652) - SerializeBatchTime: 45.644ms - TransmitDataRPCTime: 14.556ms - UncompressedRowBatchSize: 13.62 MB (14281816) CodeGen:(Total: 481.817ms, non-child: 481.817ms, % non-child: 100.00%) - CodegenTime: 10.887ms - CompileTime: 108.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 324.648ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 47.934ms AGGREGATION_NODE (id=5):(Total: 26s680ms, non-child: 192.688ms, % non-child: 0.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 438.168us - GetResultsTime: 11.053ms - HTResizeTime: 17.339ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.41 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.65K (226652) - RowsReturnedRate: 8.49 K/sec - StreamingTime: 171.761ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s488ms, non-child: 225.512ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.59K (599586) - BuildTime: 119.593ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.52M (1515016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 213.589ms - RowsReturned: 597.96K (597959) - RowsReturnedRate: 22.57 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.912ms - BuildRowsPartitioned: 599.59K (599586) - GetNewBlockTime: 210.516us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.503ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.365ms, non-child: 13.365ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7799275) - ConvertRowBatchTime: 10.623ms - DeserializeRowBatchTimer: 44.900ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.59K (599586) - RowsReturnedRate: 44.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s263ms, non-child: 91.855ms, % non-child: 0.35%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 850.36 KB, 2.39 MB, 3.96 MB, 5.50 MB, 7.11 MB, 8.71 MB, 10.27 MB, 11.89 MB, 13.51 MB, 15.08 MB, 16.73 MB, 18.34 MB, 19.96 MB, 21.57 MB, 23.19 MB, 24.79 MB, 26.39 MB, 28.06 MB, 29.67 MB, 31.28 MB, 32.90 MB, 34.54 MB, 36.11 MB, 37.73 MB, 39.38 MB, 41.01 MB, 42.64 MB, 44.26 MB, 45.91 MB, 47.51 MB, 49.10 MB, 50.76 MB, 52.41 MB, 54.03 MB, 55.65 MB, 57.31 MB, 58.99 MB, 60.62 MB, 62.28 MB, 63.72 MB, 64.81 MB, 65.55 MB, 65.96 MB, 66.22 MB, 66.34 MB - BytesReceived: 66.46 MB (69689963) - ConvertRowBatchTime: 38.104ms - DeserializeRowBatchTimer: 471.350ms - FirstBatchArrivalWaitTime: 4s279ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1515016) - RowsReturnedRate: 57.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:41 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s794ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.02 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.03 MB, 159.01 MB, 159.35 MB, 167.54 MB, 167.35 MB, 167.33 MB, 168.56 MB, 168.33 MB, 168.37 MB, 168.35 MB, 168.37 MB, 168.37 MB, 168.35 MB, 168.31 MB, 168.47 MB, 170.32 MB, 170.56 MB, 170.39 MB, 170.43 MB, 170.29 MB, 170.33 MB, 170.56 MB, 170.31 MB, 170.43 MB, 170.51 MB, 170.49 MB, 170.31 MB, 170.35 MB, 178.35 MB, 266.51 MB, 298.29 MB, 298.39 MB, 298.78 MB, 302.33 MB, 302.37 MB, 302.41 MB, 302.41 MB, 302.51 MB, 302.35 MB, 302.35 MB, 302.43 MB, 302.33 MB, 302.56 MB, 302.31 MB, 302.43 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 259 (259) - PeakMemoryUsage: 302.83 MB (317543947) - PerHostPeakMemUsage: 1.54 GB (1654113004) - RowsProduced: 226.01K (226011) - TotalNetworkReceiveTime: 26s262ms - TotalNetworkSendTime: 3.541ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s377ms - SysTime: 92.985ms - UserTime: 1s137ms - VoluntaryContextSwitches: 7.53K (7534) Fragment Instance Lifecycle Timings: - ExecTime: 22s489ms - ExecTreeExecTime: 22s387ms - OpenTime: 4s747ms - ExecTreeOpenTime: 4s333ms - PrepareTime: 46.862ms - ExecTreePrepareTime: 722.368us DataStreamSender (dst_id=11):(Total: 57.664ms, non-child: 57.664ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490598) - NetworkThroughput(*): 458.77 MB/sec - OverallThroughput: 107.34 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226011) - SerializeBatchTime: 43.992ms - TransmitDataRPCTime: 13.492ms - UncompressedRowBatchSize: 13.58 MB (14241429) CodeGen:(Total: 446.329ms, non-child: 446.329ms, % non-child: 100.00%) - CodegenTime: 7.738ms - CompileTime: 109.027ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 303.456ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 33.281ms AGGREGATION_NODE (id=5):(Total: 26s721ms, non-child: 186.739ms, % non-child: 0.70%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 341.908us - GetResultsTime: 10.553ms - HTResizeTime: 15.497ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.54 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226011) - RowsReturnedRate: 8.46 K/sec - StreamingTime: 164.597ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s534ms, non-child: 225.134ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.14K (600137) - BuildTime: 120.329ms - PeakMemoryUsage: 153.17 MB (160605404) - ProbeRows: 1.51M (1511370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 211.594ms - RowsReturned: 597.66K (597663) - RowsReturnedRate: 22.52 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 77.857ms - BuildRowsPartitioned: 600.14K (600137) - GetNewBlockTime: 152.225us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.724ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.188ms, non-child: 13.188ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7804921) - ConvertRowBatchTime: 10.343ms - DeserializeRowBatchTimer: 45.199ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.14K (600137) - RowsReturnedRate: 45.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s310ms, non-child: 84.581ms, % non-child: 0.32%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 803.74 KB, 2.35 MB, 3.94 MB, 5.51 MB, 7.12 MB, 8.68 MB, 10.23 MB, 11.83 MB, 13.42 MB, 15.03 MB, 16.61 MB, 18.22 MB, 19.84 MB, 21.43 MB, 23.07 MB, 24.68 MB, 26.30 MB, 27.94 MB, 29.56 MB, 31.21 MB, 32.80 MB, 34.39 MB, 35.98 MB, 37.60 MB, 39.25 MB, 40.86 MB, 42.49 MB, 44.07 MB, 45.70 MB, 47.34 MB, 48.95 MB, 50.61 MB, 52.20 MB, 53.87 MB, 55.50 MB, 57.14 MB, 58.84 MB, 60.46 MB, 62.10 MB, 63.53 MB, 64.61 MB, 65.37 MB, 65.79 MB, 66.04 MB, 66.18 MB - BytesReceived: 66.29 MB (69513883) - ConvertRowBatchTime: 39.184ms - DeserializeRowBatchTimer: 258.907ms - FirstBatchArrivalWaitTime: 4s318ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1511370) - RowsReturnedRate: 57.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:4a (host=vb0228.halxg.cloudera.com:22000):(Total: 4s792ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 9.23 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.95 MB, 159.40 MB, 159.51 MB, 167.45 MB, 167.58 MB, 167.33 MB, 168.35 MB, 168.41 MB, 168.39 MB, 168.39 MB, 168.41 MB, 168.41 MB, 168.45 MB, 168.45 MB, 168.60 MB, 170.41 MB, 170.39 MB, 170.41 MB, 170.39 MB, 170.33 MB, 170.45 MB, 170.37 MB, 170.47 MB, 170.43 MB, 170.43 MB, 170.35 MB, 170.37 MB, 170.33 MB, 186.39 MB, 298.39 MB, 298.49 MB, 298.58 MB, 300.18 MB, 302.53 MB, 302.33 MB, 302.39 MB, 302.39 MB, 302.58 MB, 302.41 MB, 302.37 MB, 302.37 MB, 302.43 MB, 302.56 MB, 302.31 MB, 302.37 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 326 (326) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1722137586) - RowsProduced: 226.65K (226646) - TotalNetworkReceiveTime: 26s121ms - TotalNetworkSendTime: 3.474ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s366ms - SysTime: 118.981ms - UserTime: 1s292ms - VoluntaryContextSwitches: 7.47K (7468) Fragment Instance Lifecycle Timings: - ExecTime: 22s495ms - ExecTreeExecTime: 22s390ms - OpenTime: 4s729ms - ExecTreeOpenTime: 4s323ms - PrepareTime: 62.506ms - ExecTreePrepareTime: 1.207ms DataStreamSender (dst_id=11):(Total: 71.656ms, non-child: 71.656ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6508169) - NetworkThroughput(*): 253.92 MB/sec - OverallThroughput: 86.62 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.65K (226646) - SerializeBatchTime: 47.065ms - TransmitDataRPCTime: 24.443ms - UncompressedRowBatchSize: 13.62 MB (14281446) CodeGen:(Total: 444.301ms, non-child: 444.301ms, % non-child: 100.00%) - CodegenTime: 7.983ms - CompileTime: 108.794ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 296.802ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 38.146ms AGGREGATION_NODE (id=5):(Total: 26s714ms, non-child: 260.643ms, % non-child: 0.98%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 421.808us - GetResultsTime: 9.513ms - HTResizeTime: 26.790ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.44 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.65K (226646) - RowsReturnedRate: 8.48 K/sec - StreamingTime: 242.095ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s453ms, non-child: 260.799ms, % non-child: 0.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.85K (600846) - BuildTime: 121.477ms - PeakMemoryUsage: 153.17 MB (160605726) - ProbeRows: 1.51M (1510992) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 246.416ms - RowsReturned: 598.18K (598176) - RowsReturnedRate: 22.61 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 76.879ms - BuildRowsPartitioned: 600.85K (600846) - GetNewBlockTime: 249.524us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.034ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.455ms, non-child: 13.455ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.73 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7814097) - ConvertRowBatchTime: 10.547ms - DeserializeRowBatchTimer: 44.774ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.85K (600846) - RowsReturnedRate: 44.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s193ms, non-child: 120.399ms, % non-child: 0.46%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.20 MB, 2.81 MB, 4.41 MB, 5.96 MB, 7.50 MB, 9.10 MB, 10.68 MB, 12.32 MB, 13.93 MB, 15.50 MB, 17.09 MB, 18.70 MB, 20.33 MB, 21.91 MB, 23.53 MB, 25.12 MB, 26.73 MB, 28.35 MB, 29.96 MB, 31.60 MB, 33.22 MB, 34.85 MB, 36.46 MB, 38.07 MB, 39.68 MB, 41.26 MB, 42.89 MB, 44.54 MB, 46.18 MB, 47.80 MB, 49.37 MB, 50.99 MB, 52.63 MB, 54.29 MB, 55.91 MB, 57.60 MB, 59.21 MB, 60.87 MB, 62.51 MB, 63.83 MB, 64.87 MB, 65.48 MB, 65.85 MB, 66.10 MB, 66.21 MB - BytesReceived: 66.29 MB (69510999) - ConvertRowBatchTime: 59.054ms - DeserializeRowBatchTimer: 291.868ms - FirstBatchArrivalWaitTime: 4s308ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510992) - RowsReturnedRate: 57.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:3e (host=vb0224.halxg.cloudera.com:22000):(Total: 4s791ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.87 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.97 MB, 158.87 MB, 159.43 MB, 167.39 MB, 167.35 MB, 167.31 MB, 168.31 MB, 168.33 MB, 168.51 MB, 168.58 MB, 168.45 MB, 168.51 MB, 168.47 MB, 168.31 MB, 168.33 MB, 170.26 MB, 170.41 MB, 170.41 MB, 170.35 MB, 170.43 MB, 170.47 MB, 170.41 MB, 170.47 MB, 170.33 MB, 170.39 MB, 170.39 MB, 170.54 MB, 170.35 MB, 170.51 MB, 258.54 MB, 298.29 MB, 298.43 MB, 298.47 MB, 301.79 MB, 302.60 MB, 302.37 MB, 302.51 MB, 302.31 MB, 302.54 MB, 302.41 MB, 302.31 MB, 302.33 MB, 302.51 MB, 302.35 MB, 302.35 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 361 (361) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.60 GB (1720263834) - RowsProduced: 225.92K (225919) - TotalNetworkReceiveTime: 26s112ms - TotalNetworkSendTime: 3.112ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s349ms - SysTime: 99.984ms - UserTime: 1s324ms - VoluntaryContextSwitches: 7.43K (7426) Fragment Instance Lifecycle Timings: - ExecTime: 22s483ms - ExecTreeExecTime: 22s383ms - OpenTime: 4s726ms - ExecTreeOpenTime: 4s340ms - PrepareTime: 64.849ms - ExecTreePrepareTime: 802.432us DataStreamSender (dst_id=11):(Total: 64.518ms, non-child: 64.518ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6485481) - NetworkThroughput(*): 304.74 MB/sec - OverallThroughput: 95.87 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.92K (225919) - SerializeBatchTime: 44.077ms - TransmitDataRPCTime: 20.296ms - UncompressedRowBatchSize: 13.58 MB (14235637) CodeGen:(Total: 435.943ms, non-child: 435.943ms, % non-child: 100.00%) - CodegenTime: 10.876ms - CompileTime: 108.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 277.050ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 50.017ms AGGREGATION_NODE (id=5):(Total: 26s724ms, non-child: 262.706ms, % non-child: 0.98%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 752.392us - GetResultsTime: 9.478ms - HTResizeTime: 26.682ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.46 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.92K (225919) - RowsReturnedRate: 8.45 K/sec - StreamingTime: 244.316ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s461ms, non-child: 273.362ms, % non-child: 1.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.57K (600572) - BuildTime: 120.282ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510897) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 258.444ms - RowsReturned: 596.62K (596623) - RowsReturnedRate: 22.55 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 75.592ms - BuildRowsPartitioned: 600.57K (600572) - GetNewBlockTime: 251.216us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.728ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.475ms, non-child: 13.475ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7813069) - ConvertRowBatchTime: 10.648ms - DeserializeRowBatchTimer: 46.669ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.57K (600572) - RowsReturnedRate: 44.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s188ms, non-child: 130.044ms, % non-child: 0.50%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 679.69 KB, 2.19 MB, 3.79 MB, 5.35 MB, 6.95 MB, 8.50 MB, 10.12 MB, 11.70 MB, 13.31 MB, 14.91 MB, 16.56 MB, 18.16 MB, 19.80 MB, 21.40 MB, 23.02 MB, 24.66 MB, 26.28 MB, 27.91 MB, 29.50 MB, 31.10 MB, 32.74 MB, 34.33 MB, 35.93 MB, 37.57 MB, 39.17 MB, 40.79 MB, 42.38 MB, 44.00 MB, 45.60 MB, 47.23 MB, 48.83 MB, 50.47 MB, 52.10 MB, 53.71 MB, 55.35 MB, 56.96 MB, 58.59 MB, 60.26 MB, 61.93 MB, 63.35 MB, 64.52 MB, 65.34 MB, 65.77 MB, 66.02 MB, 66.16 MB - BytesReceived: 66.28 MB (69501540) - ConvertRowBatchTime: 62.564ms - DeserializeRowBatchTimer: 286.061ms - FirstBatchArrivalWaitTime: 4s325ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510897) - RowsReturnedRate: 57.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 854183ec25551621:3f (host=vb0234.halxg.cloudera.com:22000):(Total: 4s791ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.82 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.99 MB, 159.01 MB, 159.51 MB, 165.89 MB, 167.54 MB, 167.33 MB, 168.39 MB, 168.47 MB, 168.43 MB, 168.43 MB, 168.56 MB, 168.51 MB, 168.45 MB, 168.47 MB, 168.45 MB, 170.06 MB, 170.33 MB, 170.31 MB, 170.41 MB, 170.53 MB, 170.31 MB, 170.33 MB, 170.54 MB, 170.47 MB, 170.31 MB, 170.41 MB, 170.35 MB, 170.47 MB, 170.37 MB, 250.37 MB, 298.47 MB, 298.43 MB, 298.58 MB, 301.93 MB, 302.37 MB, 302.37 MB, 302.47 MB, 302.39 MB, 302.45 MB, 302.39 MB, 302.47 MB, 302.43 MB, 302.43 MB, 302.54 MB, 302.33 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 237 (237) - PeakMemoryUsage: 302.88 MB (317587727) - PerHostPeakMemUsage: 1.62 GB (1744038224) - RowsProduced: 225.71K (225710) - TotalNetworkReceiveTime: 26s240ms - TotalNetworkSendTime: 3.739ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s374ms - SysTime: 111.983ms - UserTime: 1s139ms - VoluntaryContextSwitches: 7.59K (7592) Fragment Instance Lifecycle Timings: - ExecTime: 22s499ms - ExecTreeExecTime: 22s387ms - OpenTime: 4s733ms - ExecTreeOpenTime: 4s321ms - PrepareTime: 57.500ms - ExecTreePrepareTime: 1.117ms DataStreamSender (dst_id=11):(Total: 63.586ms, non-child: 63.586ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6479115) - NetworkThroughput(*): 395.97 MB/sec - OverallThroughput: 97.17 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.71K (225710) - SerializeBatchTime: 47.812ms - TransmitDataRPCTime: 15.604ms - UncompressedRowBatchSize: 13.56 MB (14222462) CodeGen:(Total: 447.172ms, non-child: 447.172ms, % non-child: 100.00%) - CodegenTime: 6.887ms - CompileTime: 113.375ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 297.697ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 35.597ms AGGREGATION_NODE (id=5):(Total: 26s709ms, non-child: 204.912ms, % non-child: 0.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 495.792us - GetResultsTime: 10.701ms - HTResizeTime: 20.813ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.71K (225710) - RowsReturnedRate: 8.45 K/sec - StreamingTime: 184.948ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s504ms, non-child: 215.516ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.10K (599100) - BuildTime: 122.188ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512589) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 203.091ms - RowsReturned: 597.23K (597231) - RowsReturnedRate: 22.53 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 76.530ms - BuildRowsPartitioned: 599.10K (599100) - GetNewBlockTime: 266.152us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.874ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.009ms, non-child: 13.009ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB, 7.43 MB - BytesReceived: 7.43 MB (7790354) - ConvertRowBatchTime: 10.098ms - DeserializeRowBatchTimer: 50.621ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.10K (599100) - RowsReturnedRate: 46.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s289ms, non-child: 94.330ms, % non-child: 0.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 687.73 KB, 2.25 MB, 3.82 MB, 5.40 MB, 6.95 MB, 8.56 MB, 10.18 MB, 11.76 MB, 13.36 MB, 14.98 MB, 16.61 MB, 18.20 MB, 19.79 MB, 21.42 MB, 23.02 MB, 24.62 MB, 26.20 MB, 27.86 MB, 29.47 MB, 31.10 MB, 32.70 MB, 34.33 MB, 35.90 MB, 37.53 MB, 39.17 MB, 40.79 MB, 42.38 MB, 44.00 MB, 45.58 MB, 47.25 MB, 48.86 MB, 50.46 MB, 52.10 MB, 53.74 MB, 55.33 MB, 57.03 MB, 58.65 MB, 60.32 MB, 61.96 MB, 63.42 MB, 64.58 MB, 65.37 MB, 65.82 MB, 66.09 MB, 66.22 MB - BytesReceived: 66.34 MB (69566339) - ConvertRowBatchTime: 40.915ms - DeserializeRowBatchTimer: 483.311ms - FirstBatchArrivalWaitTime: 4s311ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512589) - RowsReturnedRate: 57.54 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 4s798ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:27s152ms max:27s162ms mean: 27s157ms stddev:3.103ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.34K (3343) - PeakMemoryUsage: 689.81 MB (723318826) - PerHostPeakMemUsage: 1.60 GB (1713615209) - RowsProduced: 1.51M (1512369) - TotalNetworkReceiveTime: 16s428ms - TotalNetworkSendTime: 16.088ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s597ms - SysTime: 970.718ms - UserTime: 11s641ms - VoluntaryContextSwitches: 113.80K (113797) Fragment Instance Lifecycle Timings: - ExecTime: 22s357ms - ExecTreeExecTime: 20s543ms - OpenTime: 4s749ms - ExecTreeOpenTime: 4s491ms - PrepareTime: 49.424ms - ExecTreePrepareTime: 201.480us DataStreamSender (dst_id=9):(Total: 1s095ms, non-child: 1s095ms, % non-child: 100.00%) - BytesSent: 66.34 MB (69567648) - NetworkThroughput(*): 304.04 MB/sec - OverallThroughput: 61.88 MB/sec - PeakMemoryUsage: 464.51 KB (475655) - RowsReturned: 1.51M (1512369) - SerializeBatchTime: 862.039ms - TransmitDataRPCTime: 231.735ms - UncompressedRowBatchSize: 158.71 MB (166421449) CodeGen:(Total: 289.215ms, non-child: 289.215ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 81.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 175.517ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 31.953ms HASH_JOIN_NODE (id=3):(Total: 25s031ms, non-child: 6s945ms, % non-child: 27.75%) - BuildRows: 7.37M (7367283) - BuildTime: 2s792ms - PeakMemoryUsage: 649.10 MB (680634611) - ProbeRows: 64.69M (64687050) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s176ms - RowsReturned: 1.51M (1512369) - RowsReturnedRate: 60.42 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 2s149ms - BuildRowsPartitioned: 7.37M (7367283) - GetNewBlockTime: 560.685us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 606.305ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s671ms, non-child: 1s671ms, % non-child: 100.00%) - BytesReceived: 174.40 MB (182870894) - ConvertRowBatchTime: 183.802ms - DeserializeRowBatchTimer: 697.314ms - FirstBatchArrivalWaitTime: 368.560ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367283) - RowsReturnedRate: 4.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s890ms, non-child: 16s890ms, % non-child: 100.00%) - BytesReceived: 1.46 GB (1569870527) - ConvertRowBatchTime: 1s740ms - DeserializeRowBatchTimer: 7s201ms - FirstBatchArrivalWaitTime: 726.571ms - PeakMemoryUsage: 0 - RowsReturned: 64.69M (64687050) - RowsReturnedRate: 3.83 M/sec - SendersBlockedTimer: 3s566ms - SendersBlockedTotalTimer(*): 44s236ms Fragment F02: Instance 854183ec25551621:2d (host=vb0228.halxg.cloudera.com:22000):(Total: 4s838ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 162.85 MB, 177.51 MB, 305.51 MB, 305.51 MB, 433.47 MB, 433.51 MB, 433.49 MB, 609.45 MB, 667.16 MB, 667.02 MB, 666.07 MB, 666.83 MB, 668.07 MB, 666.15 MB, 667.54 MB, 666.64 MB, 666.18 MB, 666.62 MB, 666.83 MB, 666.62 MB, 666.45 MB, 666.39 MB, 666.54 MB, 666.16 MB, 665.76 MB, 667.24 MB, 666.79 MB, 667.49 MB, 666.70 MB, 667.49 MB, 665.92 MB, 666.15 MB, 667.73 MB, 667.89 MB, 668.01 MB, 666.58 MB, 665.82 MB, 666.20 MB, 666.99 MB, 667.42 MB, 666.84 MB, 665.75 MB, 666.71 MB, 665.99 MB, 667.68 MB, 667.34 MB, 666.13 MB, 667.08 MB, 665.93 MB, 667.02 MB, 666.28 MB, 666.44 MB, 603.39 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.51K (3512) - PeakMemoryUsage: 690.78 MB (724338095) - PerHostPeakMemUsage: 1.60 GB (1722137586) - RowsProduced: 1.52M (1515423) - TotalNetworkReceiveTime: 16s396ms - TotalNetworkSendTime: 8.734ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s635ms - SysTime: 915.861ms - UserTime: 11s769ms - VoluntaryContextSwitches: 117.39K (117394) Fragment Instance Lifecycle Timings: - ExecTime: 22s323ms - ExecTreeExecTime: 20s484ms - OpenTime: 4s779ms - ExecTreeOpenTime: 4s533ms - PrepareTime: 58.833ms - ExecTreePrepareTime: 205.144us DataStreamSender (dst_id=9):(Total: 1s070ms, non-child: 1s070ms, % non-child: 100.00%) - BytesSent: 66.47 MB (69700694) - NetworkThroughput(*): 371.55 MB/sec - OverallThroughput: 62.10 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1515423) - SerializeBatchTime: 889.621ms - TransmitDataRPCTime: 178.901ms - UncompressedRowBatchSize: 159.03 MB (166757514) CodeGen:(Total: 276.587ms, non-child: 276.587ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 165.448ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 30.587ms HASH_JOIN_NODE (id=3):(Total: 25s014ms, non-child: 6s909ms, % non-child: 27.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365220) - BuildTime: 2s548ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64697559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s392ms - RowsReturned: 1.52M (1515423) - RowsReturnedRate: 60.58 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s868ms - BuildRowsPartitioned: 7.37M (7365220) - GetNewBlockTime: 466.412us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 641.503ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s958ms, non-child: 300.069ms, % non-child: 15.32%) BytesReceived(500.000ms): 0, 0, 22.97 MB, 52.96 MB, 84.78 MB, 116.83 MB, 147.38 MB, 168.81 MB, 174.18 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB - BytesReceived: 174.35 MB (182822754) - ConvertRowBatchTime: 148.450ms - DeserializeRowBatchTimer: 563.025ms - FirstBatchArrivalWaitTime: 370.866ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365220) - RowsReturnedRate: 3.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s612ms, non-child: 3s886ms, % non-child: 23.39%) BytesReceived(500.000ms): 0, 0, 3.51 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 29.72 MB, 65.42 MB, 101.22 MB, 136.99 MB, 172.60 MB, 208.44 MB, 244.43 MB, 280.61 MB, 316.99 MB, 353.33 MB, 389.86 MB, 426.15 MB, 462.56 MB, 498.94 MB, 535.37 MB, 571.83 MB, 608.34 MB, 644.89 MB, 681.36 MB, 717.77 MB, 754.07 MB, 790.48 MB, 826.78 MB, 863.14 MB, 899.48 MB, 935.79 MB, 972.59 MB, 1009.04 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570116710) - ConvertRowBatchTime: 1s808ms - DeserializeRowBatchTimer: 5s478ms - FirstBatchArrivalWaitTime: 727.249ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64697559) - RowsReturnedRate: 3.89 M/sec - SendersBlockedTimer: 3s608ms - SendersBlockedTotalTimer(*): 43s391ms Instance 854183ec25551621:28 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s828ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 163.88 MB, 177.49 MB, 305.55 MB, 305.57 MB, 433.55 MB, 433.53 MB, 433.51 MB, 625.48 MB, 666.57 MB, 665.93 MB, 667.15 MB, 667.05 MB, 667.48 MB, 666.90 MB, 667.59 MB, 667.68 MB, 667.17 MB, 666.51 MB, 667.45 MB, 667.62 MB, 665.94 MB, 666.55 MB, 667.40 MB, 665.81 MB, 666.41 MB, 667.46 MB, 667.33 MB, 666.12 MB, 665.74 MB, 665.90 MB, 667.36 MB, 665.69 MB, 666.08 MB, 667.74 MB, 666.11 MB, 667.59 MB, 667.24 MB, 666.30 MB, 666.00 MB, 666.69 MB, 666.52 MB, 667.35 MB, 666.02 MB, 667.21 MB, 667.44 MB, 667.03 MB, 667.47 MB, 665.83 MB, 667.43 MB, 665.74 MB, 665.53 MB, 667.24 MB, 425.58 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.38K (3377) - PeakMemoryUsage: 689.93 MB (723447944) - PerHostPeakMemUsage: 1.58 GB (1696780208) - RowsProduced: 1.51M (1508417) - TotalNetworkReceiveTime: 16s599ms - TotalNetworkSendTime: 8.687ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s616ms - SysTime: 879.866ms - UserTime: 11s542ms - VoluntaryContextSwitches: 118.44K (118442) Fragment Instance Lifecycle Timings: - ExecTime: 22s329ms - ExecTreeExecTime: 20s569ms - OpenTime: 4s777ms - ExecTreeOpenTime: 4s509ms - PrepareTime: 50.970ms - ExecTreePrepareTime: 206.040us DataStreamSender (dst_id=9):(Total: 1s029ms, non-child: 1s029ms, % non-child: 100.00%) - BytesSent: 66.17 MB (69384783) - NetworkThroughput(*): 376.26 MB/sec - OverallThroughput: 64.28 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1508417) - SerializeBatchTime: 851.637ms - TransmitDataRPCTime: 175.864ms - UncompressedRowBatchSize: 158.30 MB (165986566) CodeGen:(Total: 307.399ms, non-child: 307.399ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.483ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 188.063ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 40.158ms HASH_JOIN_NODE (id=3):(Total: 25s075ms, non-child: 6s862ms, % non-child: 27.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367997) - BuildTime: 2s618ms - PeakMemoryUsage: 649.11 MB (680636357) - ProbeRows: 64.65M (64645919) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s245ms - RowsReturned: 1.51M (1508417) - RowsReturnedRate: 60.15 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s949ms - BuildRowsPartitioned: 7.37M (7367997) - GetNewBlockTime: 553.812us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 636.645ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s868ms, non-child: 305.650ms, % non-child: 16.36%) BytesReceived(500.000ms): 0, 0, 23.76 MB, 53.89 MB, 85.69 MB, 117.78 MB, 148.21 MB, 169.30 MB, 174.31 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB - BytesReceived: 174.42 MB (182891559) - ConvertRowBatchTime: 157.622ms - DeserializeRowBatchTimer: 587.594ms - FirstBatchArrivalWaitTime: 357.467ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367997) - RowsReturnedRate: 3.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s838ms, non-child: 3s744ms, % non-child: 22.24%) BytesReceived(500.000ms): 0, 0, 4.39 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 30.84 MB, 66.49 MB, 102.30 MB, 137.87 MB, 173.55 MB, 209.32 MB, 245.24 MB, 281.33 MB, 317.66 MB, 353.94 MB, 390.24 MB, 426.49 MB, 462.86 MB, 499.10 MB, 535.56 MB, 571.87 MB, 608.58 MB, 645.15 MB, 681.66 MB, 717.95 MB, 754.30 MB, 790.55 MB, 826.94 MB, 863.23 MB, 899.65 MB, 936.04 MB, 972.85 MB, 1009.34 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568888127) - ConvertRowBatchTime: 1s740ms - DeserializeRowBatchTimer: 5s462ms - FirstBatchArrivalWaitTime: 714.416ms - PeakMemoryUsage: 0 - RowsReturned: 64.65M (64645919) - RowsReturnedRate: 3.84 M/sec - SendersBlockedTimer: 3s598ms - SendersBlockedTotalTimer(*): 43s195ms Instance 854183ec25551621:26 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.80 MB, 177.60 MB, 177.51 MB, 305.64 MB, 433.53 MB, 433.55 MB, 433.47 MB, 497.45 MB, 685.03 MB, 666.34 MB, 665.62 MB, 667.81 MB, 666.95 MB, 666.33 MB, 667.57 MB, 667.70 MB, 665.72 MB, 667.11 MB, 666.50 MB, 666.70 MB, 666.61 MB, 667.41 MB, 666.58 MB, 666.72 MB, 667.57 MB, 666.21 MB, 666.58 MB, 667.35 MB, 667.32 MB, 666.64 MB, 666.39 MB, 666.54 MB, 665.81 MB, 666.01 MB, 665.96 MB, 667.48 MB, 666.15 MB, 665.86 MB, 667.01 MB, 666.00 MB, 666.21 MB, 666.28 MB, 666.13 MB, 666.51 MB, 666.51 MB, 667.17 MB, 665.78 MB, 667.22 MB, 666.96 MB, 666.75 MB, 667.67 MB, 667.59 MB, 667.06 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.87K (2865) - PeakMemoryUsage: 689.78 MB (723281960) - PerHostPeakMemUsage: 1.60 GB (1720816310) - RowsProduced: 1.51M (1510643) - TotalNetworkReceiveTime: 15s712ms - TotalNetworkSendTime: 9.774ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s627ms - SysTime: 997.848ms - UserTime: 12s428ms - VoluntaryContextSwitches: 106.56K (106555) Fragment Instance Lifecycle Timings: - ExecTime: 22s339ms - ExecTreeExecTime: 20s352ms - OpenTime: 4s766ms - ExecTreeOpenTime: 4s521ms - PrepareTime: 53.598ms - ExecTreePrepareTime: 202.144us DataStreamSender (dst_id=9):(Total: 1s283ms, non-child: 1s283ms, % non-child: 100.00%) - BytesSent: 66.26 MB (69474214) - NetworkThroughput(*): 219.62 MB/sec - OverallThroughput: 51.64 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1510643) - SerializeBatchTime: 979.074ms - TransmitDataRPCTime: 301.679ms - UncompressedRowBatchSize: 158.53 MB (166231514) CodeGen:(Total: 276.084ms, non-child: 276.084ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.268ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 165.877ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 31.382ms HASH_JOIN_NODE (id=3):(Total: 24s870ms, non-child: 7s297ms, % non-child: 29.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370778) - BuildTime: 2s776ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.66M (64662071) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s523ms - RowsReturned: 1.51M (1510643) - RowsReturnedRate: 60.74 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s110ms - BuildRowsPartitioned: 7.37M (7370778) - GetNewBlockTime: 463.256us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 625.840ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s724ms, non-child: 458.292ms, % non-child: 26.57%) BytesReceived(500.000ms): 0, 7.10 MB, 34.82 MB, 66.02 MB, 97.97 MB, 130.00 MB, 157.30 MB, 172.64 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB - BytesReceived: 174.48 MB (182950991) - ConvertRowBatchTime: 149.078ms - DeserializeRowBatchTimer: 909.135ms - FirstBatchArrivalWaitTime: 377.092ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370778) - RowsReturnedRate: 4.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s322ms, non-child: 6s822ms, % non-child: 41.80%) BytesReceived(500.000ms): 0, 0, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.19 MB, 44.12 MB, 79.79 MB, 115.61 MB, 151.19 MB, 186.91 MB, 222.73 MB, 258.86 MB, 295.07 MB, 331.30 MB, 367.63 MB, 403.98 MB, 440.32 MB, 476.72 MB, 512.91 MB, 549.44 MB, 585.94 MB, 622.61 MB, 659.08 MB, 695.69 MB, 732.02 MB, 768.31 MB, 804.76 MB, 841.08 MB, 877.46 MB, 913.66 MB, 950.29 MB, 986.88 MB, 1023.19 MB, 1.03 GB, 1.07 GB, 1.11 GB, 1.14 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569281141) - ConvertRowBatchTime: 1s965ms - DeserializeRowBatchTimer: 8s986ms - FirstBatchArrivalWaitTime: 735.947ms - PeakMemoryUsage: 0 - RowsReturned: 64.66M (64662071) - RowsReturnedRate: 3.96 M/sec - SendersBlockedTimer: 3s587ms - SendersBlockedTotalTimer(*): 43s070ms Instance 854183ec25551621:25 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s816ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 42.25 KB, 111.86 KB, 153.26 MB, 177.62 MB, 305.55 MB, 305.57 MB, 433.51 MB, 433.51 MB, 433.47 MB, 561.45 MB, 667.82 MB, 666.48 MB, 667.72 MB, 666.19 MB, 667.60 MB, 666.58 MB, 665.94 MB, 666.54 MB, 665.92 MB, 665.85 MB, 667.12 MB, 666.91 MB, 667.17 MB, 667.43 MB, 665.91 MB, 666.93 MB, 667.48 MB, 667.22 MB, 665.90 MB, 666.11 MB, 667.12 MB, 666.46 MB, 667.39 MB, 667.12 MB, 666.57 MB, 667.29 MB, 667.16 MB, 667.49 MB, 666.76 MB, 667.06 MB, 666.92 MB, 667.10 MB, 667.40 MB, 667.21 MB, 667.42 MB, 666.24 MB, 667.55 MB, 667.55 MB, 666.87 MB, 667.71 MB, 666.78 MB, 667.28 MB, 666.28 MB, 665.47 MB, 667.54 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.82K (3820) - PeakMemoryUsage: 689.81 MB (723322658) - PerHostPeakMemUsage: 1.60 GB (1720867986) - RowsProduced: 1.51M (1511825) - TotalNetworkReceiveTime: 15s533ms - TotalNetworkSendTime: 26.948ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s590ms - SysTime: 1s147ms - UserTime: 12s385ms - VoluntaryContextSwitches: 105.57K (105572) Fragment Instance Lifecycle Timings: - ExecTime: 22s338ms - ExecTreeExecTime: 20s324ms - OpenTime: 4s766ms - ExecTreeOpenTime: 4s486ms - PrepareTime: 50.417ms - ExecTreePrepareTime: 207.344us DataStreamSender (dst_id=9):(Total: 1s253ms, non-child: 1s253ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69539578) - NetworkThroughput(*): 229.96 MB/sec - OverallThroughput: 52.92 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511825) - SerializeBatchTime: 962.576ms - TransmitDataRPCTime: 288.394ms - UncompressedRowBatchSize: 158.65 MB (166361590) CodeGen:(Total: 314.363ms, non-child: 314.363ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 83.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 195.458ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 35.311ms HASH_JOIN_NODE (id=3):(Total: 24s807ms, non-child: 7s375ms, % non-child: 29.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365265) - BuildTime: 2s935ms - PeakMemoryUsage: 649.10 MB (680635286) - ProbeRows: 64.67M (64668256) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s427ms - RowsReturned: 1.51M (1511825) - RowsReturnedRate: 60.94 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s278ms - BuildRowsPartitioned: 7.37M (7365265) - GetNewBlockTime: 407.560us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 622.832ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s527ms, non-child: 360.503ms, % non-child: 23.60%) BytesReceived(500.000ms): 0, 0, 17.85 MB, 45.20 MB, 76.74 MB, 108.79 MB, 140.36 MB, 164.55 MB, 173.64 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB - BytesReceived: 174.36 MB (182827376) - ConvertRowBatchTime: 191.588ms - DeserializeRowBatchTimer: 556.545ms - FirstBatchArrivalWaitTime: 345.304ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365265) - RowsReturnedRate: 4.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s366ms, non-child: 6s888ms, % non-child: 42.09%) BytesReceived(500.000ms): 0, 0, 0, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 21.08 MB, 56.33 MB, 92.12 MB, 127.80 MB, 163.55 MB, 199.33 MB, 235.21 MB, 271.34 MB, 307.54 MB, 343.96 MB, 380.26 MB, 416.53 MB, 453.00 MB, 489.40 MB, 525.72 MB, 562.22 MB, 598.82 MB, 635.38 MB, 671.85 MB, 708.16 MB, 744.49 MB, 780.88 MB, 817.22 MB, 853.45 MB, 889.92 MB, 926.19 MB, 963.02 MB, 999.54 MB, 1.01 GB, 1.05 GB, 1.08 GB, 1.12 GB, 1.15 GB, 1.19 GB, 1.23 GB, 1.26 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569414072) - ConvertRowBatchTime: 1s929ms - DeserializeRowBatchTimer: 8s960ms - FirstBatchArrivalWaitTime: 705.685ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64668256) - RowsReturnedRate: 3.95 M/sec - SendersBlockedTimer: 3s584ms - SendersBlockedTotalTimer(*): 50s167ms Instance 854183ec25551621:20 (host=vb0212.halxg.cloudera.com:22000):(Total: 4s816ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 17.18 MB, 170.46 MB, 177.55 MB, 305.53 MB, 305.53 MB, 433.55 MB, 433.57 MB, 433.45 MB, 641.45 MB, 666.86 MB, 665.92 MB, 667.29 MB, 665.80 MB, 666.92 MB, 667.35 MB, 666.80 MB, 666.42 MB, 667.01 MB, 666.70 MB, 665.99 MB, 666.83 MB, 667.58 MB, 666.27 MB, 666.05 MB, 667.32 MB, 667.51 MB, 667.89 MB, 665.96 MB, 666.52 MB, 667.34 MB, 667.41 MB, 666.10 MB, 666.12 MB, 665.94 MB, 667.83 MB, 666.69 MB, 666.98 MB, 667.52 MB, 666.44 MB, 666.04 MB, 666.00 MB, 667.16 MB, 665.63 MB, 666.39 MB, 667.56 MB, 665.64 MB, 665.97 MB, 667.47 MB, 667.35 MB, 667.62 MB, 666.05 MB, 666.80 MB, 665.93 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.29K (3288) - PeakMemoryUsage: 689.85 MB (723356972) - PerHostPeakMemUsage: 1.60 GB (1720741123) - RowsProduced: 1.51M (1511840) - TotalNetworkReceiveTime: 16s623ms - TotalNetworkSendTime: 22.057ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s616ms - SysTime: 932.857ms - UserTime: 11s509ms - VoluntaryContextSwitches: 116.28K (116281) Fragment Instance Lifecycle Timings: - ExecTime: 22s339ms - ExecTreeExecTime: 20s552ms - OpenTime: 4s766ms - ExecTreeOpenTime: 4s511ms - PrepareTime: 49.590ms - ExecTreePrepareTime: 227.233us DataStreamSender (dst_id=9):(Total: 1s065ms, non-child: 1s065ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69539889) - NetworkThroughput(*): 300.69 MB/sec - OverallThroughput: 62.24 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511840) - SerializeBatchTime: 842.603ms - TransmitDataRPCTime: 220.551ms - UncompressedRowBatchSize: 158.66 MB (166363232) CodeGen:(Total: 285.814ms, non-child: 285.814ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.898ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 174.581ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 30.772ms HASH_JOIN_NODE (id=3):(Total: 25s061ms, non-child: 6s834ms, % non-child: 27.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7369445) - BuildTime: 2s888ms - PeakMemoryUsage: 649.11 MB (680636918) - ProbeRows: 64.70M (64698010) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s945ms - RowsReturned: 1.51M (1511840) - RowsReturnedRate: 60.33 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s229ms - BuildRowsPartitioned: 7.37M (7369445) - GetNewBlockTime: 416.941us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 626.592ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s598ms, non-child: 359.880ms, % non-child: 22.51%) BytesReceived(500.000ms): 0, 29.01 KB, 26.17 MB, 56.73 MB, 88.57 MB, 120.64 MB, 150.52 MB, 170.40 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182917883) - ConvertRowBatchTime: 186.196ms - DeserializeRowBatchTimer: 580.756ms - FirstBatchArrivalWaitTime: 371.723ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7369445) - RowsReturnedRate: 4.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s151ms, non-child: 4s877ms, % non-child: 28.44%) BytesReceived(500.000ms): 0, 0, 7.12 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 33.83 MB, 69.53 MB, 105.51 MB, 141.09 MB, 176.74 MB, 212.64 MB, 248.72 MB, 284.85 MB, 321.13 MB, 357.46 MB, 393.84 MB, 430.25 MB, 466.70 MB, 502.98 MB, 539.49 MB, 575.94 MB, 612.55 MB, 649.00 MB, 685.52 MB, 721.78 MB, 758.25 MB, 794.56 MB, 830.86 MB, 867.23 MB, 903.53 MB, 940.12 MB, 976.89 MB, 1013.26 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570128079) - ConvertRowBatchTime: 1s736ms - DeserializeRowBatchTimer: 6s778ms - FirstBatchArrivalWaitTime: 729.330ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64698010) - RowsReturnedRate: 3.77 M/sec - SendersBlockedTimer: 3s585ms - SendersBlockedTotalTimer(*): 53s750ms Instance 854183ec25551621:2b (host=vb0226.halxg.cloudera.com:22000):(Total: 4s814ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 25.13 MB, 175.86 MB, 177.55 MB, 305.51 MB, 305.59 MB, 433.53 MB, 433.51 MB, 449.45 MB, 657.45 MB, 666.56 MB, 665.89 MB, 667.25 MB, 665.66 MB, 666.59 MB, 666.76 MB, 666.25 MB, 667.12 MB, 667.10 MB, 667.50 MB, 666.77 MB, 666.48 MB, 665.94 MB, 665.84 MB, 667.73 MB, 667.93 MB, 667.78 MB, 667.19 MB, 667.62 MB, 666.87 MB, 667.38 MB, 667.61 MB, 665.74 MB, 667.07 MB, 666.55 MB, 667.81 MB, 666.38 MB, 667.42 MB, 665.80 MB, 666.48 MB, 665.80 MB, 667.53 MB, 667.77 MB, 667.42 MB, 666.46 MB, 666.80 MB, 666.34 MB, 666.04 MB, 666.29 MB, 666.96 MB, 666.20 MB, 667.33 MB, 667.02 MB, 666.07 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.18K (3176) - PeakMemoryUsage: 689.72 MB (723218918) - PerHostPeakMemUsage: 1.60 GB (1719696027) - RowsProduced: 1.51M (1509614) - TotalNetworkReceiveTime: 16s224ms - TotalNetworkSendTime: 9.627ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s616ms - SysTime: 903.862ms - UserTime: 11s904ms - VoluntaryContextSwitches: 116.26K (116261) Fragment Instance Lifecycle Timings: - ExecTime: 22s341ms - ExecTreeExecTime: 20s522ms - OpenTime: 4s765ms - ExecTreeOpenTime: 4s510ms - PrepareTime: 49.121ms - ExecTreePrepareTime: 186.696us DataStreamSender (dst_id=9):(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) - BytesSent: 66.23 MB (69445196) - NetworkThroughput(*): 388.46 MB/sec - OverallThroughput: 63.42 MB/sec - PeakMemoryUsage: 450.64 KB (461456) - RowsReturned: 1.51M (1509614) - SerializeBatchTime: 871.997ms - TransmitDataRPCTime: 170.488ms - UncompressedRowBatchSize: 158.42 MB (166118284) CodeGen:(Total: 284.742ms, non-child: 284.742ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.701ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 174.272ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 30.243ms HASH_JOIN_NODE (id=3):(Total: 25s028ms, non-child: 7s133ms, % non-child: 28.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.36M (7361508) - BuildTime: 2s955ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.64M (64638875) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s201ms - RowsReturned: 1.51M (1509614) - RowsReturnedRate: 60.31 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s295ms - BuildRowsPartitioned: 7.36M (7361508) - GetNewBlockTime: 532.484us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 622.013ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s528ms, non-child: 372.013ms, % non-child: 24.34%) BytesReceived(500.000ms): 0, 705.27 KB, 28.03 MB, 58.74 MB, 90.65 MB, 122.68 MB, 151.94 MB, 170.94 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB, 174.26 MB - BytesReceived: 174.26 MB (182727525) - ConvertRowBatchTime: 182.510ms - DeserializeRowBatchTimer: 640.937ms - FirstBatchArrivalWaitTime: 370.493ms - PeakMemoryUsage: 0 - RowsReturned: 7.36M (7361508) - RowsReturnedRate: 4.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s850ms, non-child: 3s810ms, % non-child: 22.62%) BytesReceived(500.000ms): 0, 0, 9.17 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 36.27 MB, 72.06 MB, 107.88 MB, 143.43 MB, 179.16 MB, 214.99 MB, 251.06 MB, 287.27 MB, 323.55 MB, 359.86 MB, 396.21 MB, 432.46 MB, 468.81 MB, 505.04 MB, 541.58 MB, 577.88 MB, 614.35 MB, 650.73 MB, 687.31 MB, 723.60 MB, 759.82 MB, 796.28 MB, 832.48 MB, 868.91 MB, 905.34 MB, 941.82 MB, 978.55 MB, 1014.71 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.44 GB, 1.45 GB, 1.45 GB, 1.46 GB - BytesReceived: 1.46 GB (1568724068) - ConvertRowBatchTime: 1s770ms - DeserializeRowBatchTimer: 5s466ms - FirstBatchArrivalWaitTime: 727.558ms - PeakMemoryUsage: 0 - RowsReturned: 64.64M (64638875) - RowsReturnedRate: 3.84 M/sec - SendersBlockedTimer: 3s583ms - SendersBlockedTotalTimer(*): 43s012ms Instance 854183ec25551621:1f (host=vb0230.halxg.cloudera.com:22000):(Total: 4s807ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 153.55 MB, 177.51 MB, 305.73 MB, 305.55 MB, 433.59 MB, 433.53 MB, 433.47 MB, 593.45 MB, 665.79 MB, 666.16 MB, 666.55 MB, 665.96 MB, 666.45 MB, 666.83 MB, 667.03 MB, 666.36 MB, 666.61 MB, 666.78 MB, 666.58 MB, 666.67 MB, 665.86 MB, 667.29 MB, 665.85 MB, 665.82 MB, 666.85 MB, 666.17 MB, 666.60 MB, 665.84 MB, 667.10 MB, 666.13 MB, 667.08 MB, 666.24 MB, 667.37 MB, 666.56 MB, 666.07 MB, 666.36 MB, 666.23 MB, 667.81 MB, 667.57 MB, 666.32 MB, 666.02 MB, 667.15 MB, 667.66 MB, 666.33 MB, 666.11 MB, 667.39 MB, 667.24 MB, 667.27 MB, 667.66 MB, 666.25 MB, 666.70 MB, 667.65 MB, 667.32 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.64K (3644) - PeakMemoryUsage: 689.70 MB (723200564) - PerHostPeakMemUsage: 1.59 GB (1709741976) - RowsProduced: 1.51M (1511615) - TotalNetworkReceiveTime: 15s865ms - TotalNetworkSendTime: 20.343ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s617ms - SysTime: 1s109ms - UserTime: 12s161ms - VoluntaryContextSwitches: 107.54K (107542) Fragment Instance Lifecycle Timings: - ExecTime: 22s346ms - ExecTreeExecTime: 20s397ms - OpenTime: 4s766ms - ExecTreeOpenTime: 4s504ms - PrepareTime: 41.015ms - ExecTreePrepareTime: 188.076us DataStreamSender (dst_id=9):(Total: 1s232ms, non-child: 1s232ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69540434) - NetworkThroughput(*): 222.00 MB/sec - OverallThroughput: 53.81 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511615) - SerializeBatchTime: 931.544ms - TransmitDataRPCTime: 298.734ms - UncompressedRowBatchSize: 158.63 MB (166338482) CodeGen:(Total: 292.185ms, non-child: 292.185ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 84.470ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 176.811ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 30.377ms HASH_JOIN_NODE (id=3):(Total: 24s899ms, non-child: 7s251ms, % non-child: 29.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365737) - BuildTime: 2s804ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.72M (64719148) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s452ms - RowsReturned: 1.51M (1511615) - RowsReturnedRate: 60.71 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s149ms - BuildRowsPartitioned: 7.37M (7365737) - GetNewBlockTime: 618.452us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 617.634ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s678ms, non-child: 448.979ms, % non-child: 26.75%) BytesReceived(500.000ms): 0, 0, 19.82 MB, 47.99 MB, 79.62 MB, 111.64 MB, 143.00 MB, 166.17 MB, 173.83 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB - BytesReceived: 174.36 MB (182834279) - ConvertRowBatchTime: 150.259ms - DeserializeRowBatchTimer: 888.102ms - FirstBatchArrivalWaitTime: 372.571ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365737) - RowsReturnedRate: 4.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s438ms, non-child: 6s737ms, % non-child: 40.98%) BytesReceived(500.000ms): 0, 0, 141.64 KB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 24.06 MB, 59.53 MB, 95.34 MB, 131.10 MB, 166.89 MB, 202.62 MB, 238.65 MB, 274.72 MB, 311.08 MB, 347.55 MB, 383.98 MB, 420.26 MB, 456.73 MB, 493.20 MB, 529.60 MB, 566.01 MB, 602.66 MB, 639.18 MB, 675.79 MB, 712.14 MB, 748.52 MB, 784.86 MB, 821.26 MB, 857.57 MB, 893.85 MB, 930.22 MB, 966.95 MB, 1003.48 MB, 1.02 GB, 1.05 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.19 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570630767) - ConvertRowBatchTime: 1s868ms - DeserializeRowBatchTimer: 8s990ms - FirstBatchArrivalWaitTime: 731.273ms - PeakMemoryUsage: 0 - RowsReturned: 64.72M (64719148) - RowsReturnedRate: 3.94 M/sec - SendersBlockedTimer: 3s574ms - SendersBlockedTotalTimer(*): 42s897ms Instance 854183ec25551621:2c (host=vb0232.halxg.cloudera.com:22000):(Total: 4s800ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.19 MB, 177.51 MB, 185.51 MB, 305.59 MB, 433.57 MB, 433.53 MB, 433.47 MB, 497.45 MB, 672.67 MB, 667.28 MB, 667.37 MB, 667.88 MB, 665.85 MB, 667.21 MB, 666.03 MB, 666.03 MB, 667.24 MB, 667.81 MB, 665.68 MB, 666.14 MB, 666.69 MB, 666.93 MB, 666.19 MB, 667.62 MB, 667.14 MB, 667.13 MB, 667.16 MB, 665.74 MB, 667.34 MB, 666.06 MB, 667.10 MB, 666.62 MB, 667.34 MB, 667.21 MB, 667.15 MB, 665.75 MB, 667.71 MB, 666.12 MB, 667.25 MB, 666.67 MB, 666.02 MB, 665.83 MB, 666.96 MB, 665.69 MB, 666.55 MB, 667.33 MB, 666.16 MB, 666.44 MB, 666.50 MB, 666.63 MB, 665.56 MB, 667.15 MB, 666.65 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.32K (3318) - PeakMemoryUsage: 689.69 MB (723197372) - PerHostPeakMemUsage: 1.60 GB (1720756569) - RowsProduced: 1.51M (1508089) - TotalNetworkReceiveTime: 16s702ms - TotalNetworkSendTime: 9.657ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s614ms - SysTime: 1s003ms - UserTime: 11s357ms - VoluntaryContextSwitches: 111.44K (111441) Fragment Instance Lifecycle Timings: - ExecTime: 22s360ms - ExecTreeExecTime: 20s575ms - OpenTime: 4s751ms - ExecTreeOpenTime: 4s502ms - PrepareTime: 48.927ms - ExecTreePrepareTime: 135.280us DataStreamSender (dst_id=9):(Total: 1s088ms, non-child: 1s088ms, % non-child: 100.00%) - BytesSent: 66.17 MB (69388948) - NetworkThroughput(*): 240.51 MB/sec - OverallThroughput: 60.80 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1508089) - SerializeBatchTime: 811.311ms - TransmitDataRPCTime: 275.143ms - UncompressedRowBatchSize: 158.26 MB (165950478) CodeGen:(Total: 274.056ms, non-child: 274.056ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 82.227ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 165.021ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 25.980ms HASH_JOIN_NODE (id=3):(Total: 25s074ms, non-child: 6s841ms, % non-child: 27.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365037) - BuildTime: 2s759ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.71M (64713412) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s137ms - RowsReturned: 1.51M (1508089) - RowsReturnedRate: 60.14 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s118ms - BuildRowsPartitioned: 7.37M (7365037) - GetNewBlockTime: 561.796us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 606.969ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s722ms, non-child: 347.597ms, % non-child: 20.17%) BytesReceived(500.000ms): 0, 7.45 MB, 35.12 MB, 66.41 MB, 98.29 MB, 130.33 MB, 157.49 MB, 172.57 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB - BytesReceived: 174.34 MB (182812185) - ConvertRowBatchTime: 170.826ms - DeserializeRowBatchTimer: 597.817ms - FirstBatchArrivalWaitTime: 378.321ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365037) - RowsReturnedRate: 4.27 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s975ms, non-child: 6s274ms, % non-child: 36.96%) BytesReceived(500.000ms): 0, 0, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.22 MB, 44.75 MB, 80.41 MB, 116.29 MB, 151.97 MB, 187.87 MB, 223.74 MB, 259.86 MB, 296.09 MB, 332.29 MB, 368.60 MB, 404.92 MB, 441.31 MB, 477.83 MB, 514.09 MB, 550.57 MB, 587.15 MB, 623.87 MB, 660.49 MB, 697.02 MB, 733.38 MB, 769.58 MB, 806.05 MB, 842.33 MB, 878.78 MB, 915.10 MB, 951.70 MB, 988.36 MB, 1.00 GB, 1.04 GB, 1.07 GB, 1.11 GB, 1.14 GB, 1.18 GB, 1.22 GB, 1.25 GB, 1.29 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570529249) - ConvertRowBatchTime: 1s608ms - DeserializeRowBatchTimer: 8s509ms - FirstBatchArrivalWaitTime: 737.136ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64713412) - RowsReturnedRate: 3.81 M/sec - SendersBlockedTimer: 3s568ms - SendersBlockedTotalTimer(*): 46s374ms Instance 854183ec25551621:2a (host=vb0214.halxg.cloudera.com:22000):(Total: 4s800ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.24 MB, 177.68 MB, 305.62 MB, 305.75 MB, 433.57 MB, 433.57 MB, 433.49 MB, 561.45 MB, 667.47 MB, 667.48 MB, 666.54 MB, 667.43 MB, 666.85 MB, 667.47 MB, 665.70 MB, 666.33 MB, 667.91 MB, 666.13 MB, 667.71 MB, 665.75 MB, 665.72 MB, 667.57 MB, 666.44 MB, 667.36 MB, 667.36 MB, 667.66 MB, 666.19 MB, 665.70 MB, 666.83 MB, 667.90 MB, 666.79 MB, 665.88 MB, 666.82 MB, 667.01 MB, 666.40 MB, 666.21 MB, 667.27 MB, 666.38 MB, 667.53 MB, 667.41 MB, 666.32 MB, 666.23 MB, 666.92 MB, 666.36 MB, 666.54 MB, 665.76 MB, 666.70 MB, 667.22 MB, 667.60 MB, 666.40 MB, 667.47 MB, 667.11 MB, 667.01 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.59K (3590) - PeakMemoryUsage: 689.68 MB (723180215) - PerHostPeakMemUsage: 1.58 GB (1692730655) - RowsProduced: 1.51M (1512670) - TotalNetworkReceiveTime: 16s092ms - TotalNetworkSendTime: 12.080ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s576ms - SysTime: 1s060ms - UserTime: 11s889ms - VoluntaryContextSwitches: 107.64K (107643) Fragment Instance Lifecycle Timings: - ExecTime: 22s354ms - ExecTreeExecTime: 20s488ms - OpenTime: 4s742ms - ExecTreeOpenTime: 4s480ms - PrepareTime: 57.401ms - ExecTreePrepareTime: 205.334us DataStreamSender (dst_id=9):(Total: 1s168ms, non-child: 1s168ms, % non-child: 100.00%) - BytesSent: 66.37 MB (69589772) - NetworkThroughput(*): 230.24 MB/sec - OverallThroughput: 56.77 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1512670) - SerializeBatchTime: 878.559ms - TransmitDataRPCTime: 288.242ms - UncompressedRowBatchSize: 158.74 MB (166454580) CodeGen:(Total: 290.852ms, non-child: 290.852ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 81.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 180.433ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 28.742ms HASH_JOIN_NODE (id=3):(Total: 24s965ms, non-child: 7s136ms, % non-child: 28.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370098) - BuildTime: 2s955ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.67M (64669657) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s220ms - RowsReturned: 1.51M (1512670) - RowsReturnedRate: 60.59 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s308ms - BuildRowsPartitioned: 7.37M (7370098) - GetNewBlockTime: 547.895us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 605.937ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s498ms, non-child: 370.183ms, % non-child: 24.71%) BytesReceived(500.000ms): 0, 17.26 MB, 44.67 MB, 76.22 MB, 108.25 MB, 139.84 MB, 164.27 MB, 173.70 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB - BytesReceived: 174.47 MB (182941023) - ConvertRowBatchTime: 190.090ms - DeserializeRowBatchTimer: 594.480ms - FirstBatchArrivalWaitTime: 356.696ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370098) - RowsReturnedRate: 4.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s769ms, non-child: 6s930ms, % non-child: 41.33%) BytesReceived(500.000ms): 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 20.23 MB, 55.59 MB, 91.48 MB, 127.15 MB, 162.86 MB, 198.67 MB, 234.58 MB, 270.69 MB, 306.96 MB, 343.33 MB, 379.76 MB, 416.02 MB, 452.30 MB, 488.64 MB, 524.89 MB, 561.18 MB, 597.75 MB, 634.20 MB, 670.72 MB, 707.16 MB, 743.58 MB, 779.83 MB, 816.13 MB, 852.38 MB, 888.93 MB, 925.22 MB, 961.87 MB, 998.36 MB, 1.01 GB, 1.05 GB, 1.08 GB, 1.12 GB, 1.15 GB, 1.19 GB, 1.23 GB, 1.26 GB, 1.30 GB, 1.33 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569431237) - ConvertRowBatchTime: 1s763ms - DeserializeRowBatchTimer: 9s217ms - FirstBatchArrivalWaitTime: 712.699ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64669657) - RowsReturnedRate: 3.86 M/sec - SendersBlockedTimer: 3s567ms - SendersBlockedTotalTimer(*): 39s232ms Instance 854183ec25551621:27 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s789ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 162.82 MB, 178.79 MB, 319.13 MB, 306.27 MB, 433.64 MB, 433.53 MB, 433.51 MB, 625.48 MB, 667.57 MB, 667.06 MB, 665.64 MB, 666.31 MB, 666.74 MB, 666.01 MB, 667.48 MB, 667.63 MB, 667.54 MB, 665.80 MB, 667.24 MB, 666.77 MB, 665.78 MB, 666.88 MB, 667.15 MB, 667.74 MB, 666.73 MB, 666.21 MB, 667.80 MB, 665.81 MB, 667.86 MB, 667.07 MB, 666.51 MB, 666.69 MB, 666.49 MB, 665.92 MB, 666.49 MB, 666.70 MB, 666.35 MB, 666.65 MB, 666.22 MB, 666.44 MB, 666.38 MB, 666.58 MB, 668.05 MB, 666.48 MB, 668.11 MB, 666.72 MB, 666.52 MB, 665.62 MB, 666.15 MB, 667.68 MB, 667.09 MB, 666.92 MB, 473.80 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.92K (2917) - PeakMemoryUsage: 689.81 MB (723313082) - PerHostPeakMemUsage: 1.60 GB (1720553986) - RowsProduced: 1.52M (1516792) - TotalNetworkReceiveTime: 15s313ms - TotalNetworkSendTime: 10.605ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s562ms - SysTime: 943.856ms - UserTime: 12s863ms - VoluntaryContextSwitches: 111.75K (111747) Fragment Instance Lifecycle Timings: - ExecTime: 22s363ms - ExecTreeExecTime: 20s373ms - OpenTime: 4s737ms - ExecTreeOpenTime: 4s461ms - PrepareTime: 51.945ms - ExecTreePrepareTime: 257.440us DataStreamSender (dst_id=9):(Total: 1s172ms, non-child: 1s172ms, % non-child: 100.00%) - BytesSent: 66.53 MB (69760804) - NetworkThroughput(*): 381.24 MB/sec - OverallThroughput: 56.72 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1516792) - SerializeBatchTime: 996.571ms - TransmitDataRPCTime: 174.506ms - UncompressedRowBatchSize: 159.18 MB (166908168) CodeGen:(Total: 308.781ms, non-child: 308.781ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 85.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 189.156ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 33.480ms HASH_JOIN_NODE (id=3):(Total: 24s831ms, non-child: 7s494ms, % non-child: 30.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367515) - BuildTime: 2s832ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64704966) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s664ms - RowsReturned: 1.52M (1516792) - RowsReturnedRate: 61.08 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s198ms - BuildRowsPartitioned: 7.37M (7367515) - GetNewBlockTime: 528.108us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 597.203ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s596ms, non-child: 452.000ms, % non-child: 28.31%) BytesReceived(500.000ms): 0, 0, 23.30 MB, 53.41 MB, 85.18 MB, 117.28 MB, 147.81 MB, 169.03 MB, 174.26 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB - BytesReceived: 174.41 MB (182877983) - ConvertRowBatchTime: 201.393ms - DeserializeRowBatchTimer: 778.060ms - FirstBatchArrivalWaitTime: 346.740ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367515) - RowsReturnedRate: 4.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s204ms, non-child: 4s224ms, % non-child: 26.07%) BytesReceived(500.000ms): 0, 0, 3.90 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 30.21 MB, 65.80 MB, 101.51 MB, 137.18 MB, 172.80 MB, 208.63 MB, 244.72 MB, 280.78 MB, 317.06 MB, 353.47 MB, 389.82 MB, 426.15 MB, 462.63 MB, 499.06 MB, 535.54 MB, 571.97 MB, 608.51 MB, 645.00 MB, 681.44 MB, 717.78 MB, 754.27 MB, 790.61 MB, 826.87 MB, 863.20 MB, 899.55 MB, 935.96 MB, 972.68 MB, 1009.20 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570278763) - ConvertRowBatchTime: 2s062ms - DeserializeRowBatchTimer: 5s650ms - FirstBatchArrivalWaitTime: 705.328ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64704966) - RowsReturnedRate: 3.99 M/sec - SendersBlockedTimer: 3s559ms - SendersBlockedTotalTimer(*): 49s807ms Instance 854183ec25551621:24 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s783ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 159.93 MB, 177.62 MB, 319.47 MB, 306.85 MB, 433.55 MB, 433.49 MB, 433.51 MB, 561.45 MB, 666.79 MB, 666.89 MB, 666.78 MB, 666.71 MB, 666.83 MB, 667.26 MB, 667.56 MB, 666.83 MB, 667.15 MB, 667.50 MB, 665.75 MB, 667.55 MB, 666.98 MB, 667.20 MB, 666.50 MB, 667.17 MB, 667.57 MB, 666.93 MB, 667.34 MB, 666.49 MB, 666.95 MB, 665.94 MB, 666.59 MB, 666.07 MB, 667.54 MB, 666.43 MB, 667.05 MB, 665.89 MB, 665.73 MB, 666.92 MB, 666.79 MB, 667.49 MB, 665.96 MB, 666.50 MB, 667.17 MB, 666.78 MB, 666.09 MB, 666.01 MB, 667.46 MB, 667.05 MB, 665.70 MB, 665.97 MB, 667.33 MB, 666.19 MB, 666.52 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.16K (3163) - PeakMemoryUsage: 689.72 MB (723220913) - PerHostPeakMemUsage: 1.54 GB (1654113004) - RowsProduced: 1.52M (1515559) - TotalNetworkReceiveTime: 18s101ms - TotalNetworkSendTime: 24.559ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s613ms - SysTime: 841.871ms - UserTime: 9s945ms - VoluntaryContextSwitches: 125.52K (125518) Fragment Instance Lifecycle Timings: - ExecTime: 22s371ms - ExecTreeExecTime: 20s922ms - OpenTime: 4s747ms - ExecTreeOpenTime: 4s494ms - PrepareTime: 35.637ms - ExecTreePrepareTime: 151.181us DataStreamSender (dst_id=9):(Total: 764.631ms, non-child: 764.631ms, % non-child: 100.00%) - BytesSent: 66.48 MB (69705770) - NetworkThroughput(*): 396.59 MB/sec - OverallThroughput: 86.94 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1515559) - SerializeBatchTime: 595.639ms - TransmitDataRPCTime: 167.621ms - UncompressedRowBatchSize: 159.05 MB (166772474) CodeGen:(Total: 278.815ms, non-child: 278.815ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 83.356ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 169.119ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 24.497ms HASH_JOIN_NODE (id=3):(Total: 25s412ms, non-child: 6s233ms, % non-child: 24.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7368781) - BuildTime: 2s909ms - PeakMemoryUsage: 649.10 MB (680634827) - ProbeRows: 64.70M (64700696) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s421ms - RowsReturned: 1.52M (1515559) - RowsReturnedRate: 59.64 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s277ms - BuildRowsPartitioned: 7.37M (7368781) - GetNewBlockTime: 567.656us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 588.623ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s543ms, non-child: 498.540ms, % non-child: 32.30%) BytesReceived(500.000ms): 0, 16.92 MB, 44.35 MB, 75.83 MB, 107.87 MB, 139.52 MB, 164.00 MB, 173.65 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182910954) - ConvertRowBatchTime: 218.584ms - DeserializeRowBatchTimer: 835.716ms - FirstBatchArrivalWaitTime: 385.685ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7368781) - RowsReturnedRate: 4.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s106ms, non-child: 2s992ms, % non-child: 16.52%) BytesReceived(500.000ms): 0, 0, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 20.04 MB, 55.35 MB, 91.17 MB, 126.71 MB, 162.40 MB, 198.17 MB, 234.05 MB, 270.12 MB, 306.37 MB, 342.68 MB, 379.10 MB, 415.46 MB, 451.77 MB, 488.07 MB, 524.37 MB, 560.96 MB, 597.57 MB, 634.13 MB, 670.64 MB, 706.97 MB, 743.40 MB, 779.88 MB, 816.31 MB, 852.56 MB, 888.96 MB, 925.37 MB, 962.23 MB, 998.92 MB, 1.01 GB, 1.05 GB, 1.08 GB, 1.12 GB, 1.15 GB, 1.19 GB, 1.23 GB, 1.26 GB, 1.30 GB, 1.33 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570216636) - ConvertRowBatchTime: 1s169ms - DeserializeRowBatchTimer: 5s050ms - FirstBatchArrivalWaitTime: 744.454ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64700696) - RowsReturnedRate: 3.57 M/sec - SendersBlockedTimer: 3s551ms - SendersBlockedTotalTimer(*): 49s702ms Instance 854183ec25551621:22 (host=vb0234.halxg.cloudera.com:22000):(Total: 4s773ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 154.34 MB, 177.73 MB, 307.66 MB, 307.53 MB, 434.49 MB, 433.62 MB, 433.49 MB, 561.48 MB, 665.90 MB, 667.75 MB, 667.23 MB, 666.73 MB, 665.73 MB, 666.95 MB, 665.71 MB, 667.53 MB, 666.93 MB, 666.38 MB, 667.45 MB, 666.74 MB, 665.84 MB, 666.44 MB, 665.99 MB, 667.32 MB, 666.05 MB, 666.95 MB, 667.34 MB, 666.22 MB, 665.78 MB, 666.91 MB, 666.08 MB, 665.87 MB, 665.87 MB, 666.69 MB, 666.62 MB, 666.05 MB, 667.39 MB, 666.36 MB, 667.40 MB, 666.95 MB, 667.35 MB, 667.37 MB, 666.73 MB, 667.45 MB, 667.65 MB, 667.53 MB, 667.47 MB, 666.16 MB, 666.35 MB, 667.68 MB, 666.98 MB, 666.32 MB, 667.27 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.17K (3169) - PeakMemoryUsage: 689.72 MB (723224105) - PerHostPeakMemUsage: 1.62 GB (1744038224) - RowsProduced: 1.51M (1513030) - TotalNetworkReceiveTime: 16s963ms - TotalNetworkSendTime: 22.295ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s568ms - SysTime: 1s054ms - UserTime: 10s997ms - VoluntaryContextSwitches: 112.48K (112483) Fragment Instance Lifecycle Timings: - ExecTime: 22s377ms - ExecTreeExecTime: 20s755ms - OpenTime: 4s722ms - ExecTreeOpenTime: 4s468ms - PrepareTime: 50.863ms - ExecTreePrepareTime: 203.364us DataStreamSender (dst_id=9):(Total: 1s020ms, non-child: 1s020ms, % non-child: 100.00%) - BytesSent: 66.38 MB (69603749) - NetworkThroughput(*): 235.34 MB/sec - OverallThroughput: 65.03 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1513030) - SerializeBatchTime: 736.868ms - TransmitDataRPCTime: 282.054ms - UncompressedRowBatchSize: 158.78 MB (166494196) CodeGen:(Total: 292.936ms, non-child: 292.936ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 173.268ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 38.850ms HASH_JOIN_NODE (id=3):(Total: 25s221ms, non-child: 6s819ms, % non-child: 27.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.36M (7364619) - BuildTime: 2s863ms - PeakMemoryUsage: 649.10 MB (680634827) - ProbeRows: 64.71M (64710387) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s032ms - RowsReturned: 1.51M (1513030) - RowsReturnedRate: 59.99 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s242ms - BuildRowsPartitioned: 7.36M (7364619) - GetNewBlockTime: 573.004us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 579.488ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s574ms, non-child: 474.839ms, % non-child: 30.15%) BytesReceived(500.000ms): 0, 14.64 MB, 42.14 MB, 73.53 MB, 105.52 MB, 137.43 MB, 162.47 MB, 173.41 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB, 174.33 MB - BytesReceived: 174.33 MB (182801781) - ConvertRowBatchTime: 214.670ms - DeserializeRowBatchTimer: 784.424ms - FirstBatchArrivalWaitTime: 370.531ms - PeakMemoryUsage: 0 - RowsReturned: 7.36M (7364619) - RowsReturnedRate: 4.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s280ms, non-child: 6s692ms, % non-child: 38.73%) BytesReceived(500.000ms): 0, 0, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 17.51 MB, 52.69 MB, 88.57 MB, 124.13 MB, 160.00 MB, 195.84 MB, 231.70 MB, 267.75 MB, 304.05 MB, 340.26 MB, 376.62 MB, 413.02 MB, 449.40 MB, 485.69 MB, 522.08 MB, 558.62 MB, 595.31 MB, 631.89 MB, 668.41 MB, 704.78 MB, 741.17 MB, 777.50 MB, 813.88 MB, 850.17 MB, 886.67 MB, 923.09 MB, 959.82 MB, 996.35 MB, 1.01 GB, 1.04 GB, 1.08 GB, 1.12 GB, 1.15 GB, 1.19 GB, 1.22 GB, 1.26 GB, 1.30 GB, 1.33 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570440651) - ConvertRowBatchTime: 1s474ms - DeserializeRowBatchTimer: 9s322ms - FirstBatchArrivalWaitTime: 727.518ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64710387) - RowsReturnedRate: 3.74 M/sec - SendersBlockedTimer: 3s540ms - SendersBlockedTotalTimer(*): 46s014ms Instance 854183ec25551621:21 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s768ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 159.66 MB, 182.22 MB, 312.34 MB, 305.49 MB, 435.34 MB, 433.53 MB, 433.47 MB, 561.45 MB, 667.20 MB, 665.79 MB, 667.28 MB, 667.77 MB, 665.93 MB, 666.91 MB, 667.11 MB, 667.24 MB, 665.84 MB, 667.79 MB, 666.27 MB, 667.81 MB, 667.12 MB, 665.84 MB, 666.19 MB, 666.17 MB, 667.26 MB, 667.03 MB, 667.32 MB, 665.74 MB, 667.62 MB, 665.91 MB, 666.53 MB, 665.71 MB, 666.55 MB, 667.16 MB, 667.79 MB, 666.30 MB, 667.50 MB, 667.42 MB, 666.87 MB, 667.24 MB, 667.30 MB, 666.63 MB, 666.86 MB, 667.49 MB, 667.38 MB, 667.03 MB, 667.72 MB, 666.20 MB, 667.54 MB, 667.22 MB, 666.72 MB, 666.26 MB, 667.21 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.47K (3469) - PeakMemoryUsage: 689.66 MB (723159866) - PerHostPeakMemUsage: 1.60 GB (1720263834) - RowsProduced: 1.51M (1511988) - TotalNetworkReceiveTime: 16s887ms - TotalNetworkSendTime: 22.289ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s563ms - SysTime: 918.860ms - UserTime: 11s127ms - VoluntaryContextSwitches: 119.53K (119529) Fragment Instance Lifecycle Timings: - ExecTime: 22s386ms - ExecTreeExecTime: 20s703ms - OpenTime: 4s719ms - ExecTreeOpenTime: 4s457ms - PrepareTime: 49.272ms - ExecTreePrepareTime: 213.908us DataStreamSender (dst_id=9):(Total: 970.929ms, non-child: 970.929ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69542318) - NetworkThroughput(*): 376.68 MB/sec - OverallThroughput: 68.31 MB/sec - PeakMemoryUsage: 450.64 KB (461456) - RowsReturned: 1.51M (1511988) - SerializeBatchTime: 793.059ms - TransmitDataRPCTime: 176.068ms - UncompressedRowBatchSize: 158.67 MB (166379504) CodeGen:(Total: 293.675ms, non-child: 293.675ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 81.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 178.798ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 33.032ms HASH_JOIN_NODE (id=3):(Total: 25s157ms, non-child: 6s719ms, % non-child: 26.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7368943) - BuildTime: 2s835ms - PeakMemoryUsage: 649.10 MB (680630135) - ProbeRows: 64.71M (64709736) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s910ms - RowsReturned: 1.51M (1511988) - RowsReturnedRate: 60.10 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s222ms - BuildRowsPartitioned: 7.37M (7368943) - GetNewBlockTime: 676.864us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 578.547ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s583ms, non-child: 489.765ms, % non-child: 30.94%) BytesReceived(500.000ms): 0, 14.14 MB, 41.58 MB, 73.04 MB, 105.01 MB, 136.92 MB, 162.18 MB, 173.49 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182910222) - ConvertRowBatchTime: 224.468ms - DeserializeRowBatchTimer: 793.522ms - FirstBatchArrivalWaitTime: 364.374ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7368943) - RowsReturnedRate: 4.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s319ms, non-child: 3s634ms, % non-child: 20.99%) BytesReceived(500.000ms): 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 16.91 MB, 52.09 MB, 87.79 MB, 123.36 MB, 159.09 MB, 194.85 MB, 230.75 MB, 266.88 MB, 303.10 MB, 339.43 MB, 375.75 MB, 412.17 MB, 448.59 MB, 485.08 MB, 521.30 MB, 557.83 MB, 594.38 MB, 630.99 MB, 667.49 MB, 703.91 MB, 740.45 MB, 776.88 MB, 813.12 MB, 849.47 MB, 885.87 MB, 922.24 MB, 958.83 MB, 995.45 MB, 1.01 GB, 1.04 GB, 1.08 GB, 1.11 GB, 1.15 GB, 1.19 GB, 1.22 GB, 1.26 GB, 1.30 GB, 1.33 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570414892) - ConvertRowBatchTime: 1s595ms - DeserializeRowBatchTimer: 5s556ms - FirstBatchArrivalWaitTime: 722.682ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64709736) - RowsReturnedRate: 3.74 M/sec - SendersBlockedTimer: 3s535ms - SendersBlockedTotalTimer(*): 38s877ms Instance 854183ec25551621:23 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s762ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 158.08 MB, 178.20 MB, 313.74 MB, 308.15 MB, 433.49 MB, 433.51 MB, 433.51 MB, 609.45 MB, 665.88 MB, 666.41 MB, 666.82 MB, 666.06 MB, 667.38 MB, 666.78 MB, 666.96 MB, 666.60 MB, 666.27 MB, 666.12 MB, 667.54 MB, 666.51 MB, 666.19 MB, 666.30 MB, 667.65 MB, 667.58 MB, 666.08 MB, 666.67 MB, 666.65 MB, 666.88 MB, 667.05 MB, 666.34 MB, 667.79 MB, 666.14 MB, 666.42 MB, 666.20 MB, 666.15 MB, 667.18 MB, 666.65 MB, 667.37 MB, 666.73 MB, 667.60 MB, 667.69 MB, 666.65 MB, 667.13 MB, 665.75 MB, 667.43 MB, 666.45 MB, 665.89 MB, 667.35 MB, 665.99 MB, 667.31 MB, 666.75 MB, 667.40 MB, 666.60 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.74K (3737) - PeakMemoryUsage: 689.66 MB (723159866) - PerHostPeakMemUsage: 1.60 GB (1720539872) - RowsProduced: 1.51M (1514169) - TotalNetworkReceiveTime: 17s816ms - TotalNetworkSendTime: 20.029ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s567ms - SysTime: 902.862ms - UserTime: 10s127ms - VoluntaryContextSwitches: 125.58K (125580) Fragment Instance Lifecycle Timings: - ExecTime: 22s388ms - ExecTreeExecTime: 20s887ms - OpenTime: 4s715ms - ExecTreeOpenTime: 4s463ms - PrepareTime: 46.817ms - ExecTreePrepareTime: 245.628us DataStreamSender (dst_id=9):(Total: 880.922ms, non-child: 880.922ms, % non-child: 100.00%) - BytesSent: 66.43 MB (69655327) - NetworkThroughput(*): 367.95 MB/sec - OverallThroughput: 75.41 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1514169) - SerializeBatchTime: 698.703ms - TransmitDataRPCTime: 180.536ms - UncompressedRowBatchSize: 158.90 MB (166619526) CodeGen:(Total: 286.518ms, non-child: 286.518ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 172.101ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.427ms HASH_JOIN_NODE (id=3):(Total: 25s347ms, non-child: 6s205ms, % non-child: 24.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370459) - BuildTime: 2s839ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64695626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s415ms - RowsReturned: 1.51M (1514169) - RowsReturnedRate: 59.74 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s231ms - BuildRowsPartitioned: 7.37M (7370459) - GetNewBlockTime: 715.664us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 577.474ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s586ms, non-child: 502.502ms, % non-child: 31.67%) BytesReceived(500.000ms): 0, 0, 20.62 MB, 49.55 MB, 81.22 MB, 113.29 MB, 144.39 MB, 167.12 MB, 174.05 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB - BytesReceived: 174.48 MB (182952758) - ConvertRowBatchTime: 227.391ms - DeserializeRowBatchTimer: 807.046ms - FirstBatchArrivalWaitTime: 376.344ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370459) - RowsReturnedRate: 4.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s033ms, non-child: 3s308ms, % non-child: 18.35%) BytesReceived(500.000ms): 0, 0, 972.75 KB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 25.79 MB, 61.44 MB, 97.24 MB, 132.86 MB, 168.48 MB, 204.47 MB, 240.40 MB, 276.49 MB, 312.90 MB, 349.22 MB, 385.60 MB, 421.87 MB, 458.40 MB, 494.72 MB, 531.15 MB, 567.52 MB, 604.17 MB, 640.59 MB, 677.09 MB, 713.42 MB, 749.80 MB, 786.25 MB, 822.52 MB, 858.95 MB, 895.44 MB, 931.72 MB, 968.41 MB, 1004.89 MB, 1.02 GB, 1.05 GB, 1.09 GB, 1.12 GB, 1.16 GB, 1.20 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570074130) - ConvertRowBatchTime: 1s403ms - DeserializeRowBatchTimer: 5s361ms - FirstBatchArrivalWaitTime: 733.395ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64695626) - RowsReturnedRate: 3.59 M/sec - SendersBlockedTimer: 3s529ms - SendersBlockedTotalTimer(*): 35s283ms Instance 854183ec25551621:29 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s758ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 88.89 KB, 111.86 KB, 153.19 MB, 177.55 MB, 305.53 MB, 305.49 MB, 433.51 MB, 433.53 MB, 433.49 MB, 593.45 MB, 665.72 MB, 667.56 MB, 667.54 MB, 666.40 MB, 667.83 MB, 666.76 MB, 666.79 MB, 667.35 MB, 667.08 MB, 666.50 MB, 665.83 MB, 666.18 MB, 666.40 MB, 666.72 MB, 666.37 MB, 667.91 MB, 666.88 MB, 667.19 MB, 667.58 MB, 667.19 MB, 666.86 MB, 666.63 MB, 667.19 MB, 666.97 MB, 667.35 MB, 666.58 MB, 666.67 MB, 666.05 MB, 667.27 MB, 667.58 MB, 666.12 MB, 667.38 MB, 666.58 MB, 665.81 MB, 666.11 MB, 667.09 MB, 667.85 MB, 666.55 MB, 666.52 MB, 666.74 MB, 666.07 MB, 666.31 MB, 666.01 MB, 666.10 MB, 665.52 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.11K (3111) - PeakMemoryUsage: 689.66 MB (723159866) - PerHostPeakMemUsage: 1.60 GB (1720450783) - RowsProduced: 1.51M (1513861) - TotalNetworkReceiveTime: 15s594ms - TotalNetworkSendTime: 13.634ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s574ms - SysTime: 945.856ms - UserTime: 12s619ms - VoluntaryContextSwitches: 104.98K (104980) Fragment Instance Lifecycle Timings: - ExecTime: 22s396ms - ExecTreeExecTime: 20s246ms - OpenTime: 4s711ms - ExecTreeOpenTime: 4s466ms - PrepareTime: 46.946ms - ExecTreePrepareTime: 187.398us DataStreamSender (dst_id=9):(Total: 1s390ms, non-child: 1s390ms, % non-child: 100.00%) - BytesSent: 66.42 MB (69643244) - NetworkThroughput(*): 223.45 MB/sec - OverallThroughput: 47.76 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1513861) - SerializeBatchTime: 1s090ms - TransmitDataRPCTime: 297.238ms - UncompressedRowBatchSize: 158.87 MB (166585630) CodeGen:(Total: 275.420ms, non-child: 275.420ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.076ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 164.343ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 31.452ms HASH_JOIN_NODE (id=3):(Total: 24s709ms, non-child: 7s063ms, % non-child: 28.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367843) - BuildTime: 2s360ms - PeakMemoryUsage: 649.11 MB (680636969) - ProbeRows: 64.67M (64671442) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s648ms - RowsReturned: 1.51M (1513861) - RowsReturnedRate: 61.27 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s766ms - BuildRowsPartitioned: 7.37M (7367843) - GetNewBlockTime: 780.374us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 567.280ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 2s084ms, non-child: 273.625ms, % non-child: 13.13%) BytesReceived(500.000ms): 0, 0, 19.08 MB, 46.75 MB, 78.27 MB, 110.30 MB, 141.78 MB, 165.45 MB, 173.79 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB - BytesReceived: 174.41 MB (182884146) - ConvertRowBatchTime: 143.909ms - DeserializeRowBatchTimer: 542.546ms - FirstBatchArrivalWaitTime: 384.200ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367843) - RowsReturnedRate: 3.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s093ms, non-child: 7s284ms, % non-child: 45.27%) BytesReceived(500.000ms): 0, 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 22.66 MB, 58.08 MB, 93.89 MB, 129.63 MB, 165.22 MB, 201.07 MB, 236.92 MB, 273.02 MB, 309.40 MB, 345.66 MB, 382.02 MB, 418.28 MB, 454.78 MB, 491.13 MB, 527.59 MB, 563.83 MB, 600.46 MB, 637.01 MB, 673.41 MB, 709.71 MB, 746.09 MB, 782.42 MB, 818.68 MB, 854.93 MB, 891.45 MB, 927.82 MB, 964.49 MB, 1000.93 MB, 1.01 GB, 1.05 GB, 1.08 GB, 1.12 GB, 1.16 GB, 1.19 GB, 1.23 GB, 1.26 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.40 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569489393) - ConvertRowBatchTime: 2s203ms - DeserializeRowBatchTimer: 9s227ms - FirstBatchArrivalWaitTime: 743.896ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64671442) - RowsReturnedRate: 4.02 M/sec - SendersBlockedTimer: 3s526ms - SendersBlockedTotalTimer(*): 38s773ms Averaged Fragment F00:(Total: 107.536ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 147.82 MB completion times: min:24s074ms max:27s124ms mean: 25s256ms stddev:864.633ms execution rates: min:164.43 MB/sec max:181.50 MB/sec mean:174.04 MB/sec stddev:5.21 MB/sec num instances: 15 - AverageThreadTokens: 11.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 10.70K (10701) - PeakMemoryUsage: 785.42 MB (823569619) - PerHostPeakMemUsage: 1.60 GB (1713615209) - RowsProduced: 64.69M (64687050) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s653ms - TotalStorageWaitTime: 649.424ms - TotalWallClockTime: 4m42s - SysTime: 1s824ms - UserTime: 37s513ms - VoluntaryContextSwitches: 64.18K (64179) Fragment Instance Lifecycle Timings: - ExecTime: 25s147ms - ExecTreeExecTime: 1s279ms - OpenTime: 65.134ms - ExecTreeOpenTime: 51.829us - PrepareTime: 42.359ms - ExecTreePrepareTime: 288.398us DataStreamSender (dst_id=7):(Total: 16s209ms, non-child: 16s209ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1569870527) - NetworkThroughput(*): 358.69 MB/sec - OverallThroughput: 92.87 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 64.69M (64687050) - SerializeBatchTime: 11s682ms - TransmitDataRPCTime: 4s504ms - UncompressedRowBatchSize: 3.31 GB (3558436306) CodeGen:(Total: 91.040ms, non-child: 91.040ms, % non-child: 100.00%) - CodegenTime: 1.623ms - CompileTime: 16.892ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.342ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.292ms HDFS_SCAN_NODE (id=2):(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 10.22 - BytesRead: 1013.25 MB (1062467810) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1013.25 MB (1062467810) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1013.25 MB (1062467810) - DecompressionTime: 3s825ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 768.95 MB (806302378) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.396ms - RowBatchQueuePutWaitTime: 3m49s - RowsRead: 120.00M (119999272) - RowsReturned: 64.69M (64687050) - RowsReturnedRate: 52.30 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.53K (8532) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 13s483ms - ScannerThreadsSysTime: 855.597ms - ScannerThreadsUserTime: 17s824ms - ScannerThreadsVoluntaryContextSwitches: 63.89K (63889) - TotalRawHdfsReadTime(*): 775.883ms - TotalReadThroughput: 40.12 MB/sec Filter 1 (16.00 MB): - Rows processed: 380.23K (380232) - Rows rejected: 3.28K (3277) - Rows total: 120.00M (119999272) Fragment F00: Instance 854183ec25551621:c (host=vb0214.halxg.cloudera.com:22000):(Total: 119.341ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/234.34 MB 10:1/253.38 MB 0:1/253.42 MB 8:1/253.39 MB 3:2/506.77 MB 1:2/506.76 MB 6:2/481.03 MB 7:5/1.18 GB 4:3/760.14 MB Filter 1 arrival: 4s646ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 747.74 MB, 747.74 MB, 747.74 MB, 747.74 MB, 747.74 MB, 747.74 MB, 747.74 MB, 765.24 MB, 765.51 MB, 766.03 MB, 765.81 MB, 765.67 MB, 765.83 MB, 678.54 MB, 670.75 MB, 670.33 MB, 670.37 MB, 670.36 MB, 670.18 MB, 670.70 MB, 575.30 MB, 575.26 MB, 575.12 MB, 575.34 MB, 575.16 MB, 575.13 MB, 519.41 MB, 478.99 MB, 391.29 MB, 365.11 MB, 341.44 MB, 341.86 MB, 355.09 MB, 361.94 MB, 362.57 MB, 403.97 MB, 403.88 MB, 388.11 MB, 364.38 MB, 356.55 MB, 340.43 MB, 316.38 MB, 308.67 MB, 284.77 MB, 244.58 MB, 189.08 MB, 141.79 MB, 79.55 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 4 - AverageThreadTokens: 11.36 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.39K (8390) - PeakMemoryUsage: 766.55 MB (803784951) - PerHostPeakMemUsage: 1.58 GB (1692730655) - RowsProduced: 65.71M (65710143) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s655ms - TotalStorageWaitTime: 687.305ms - TotalWallClockTime: 4m44s - SysTime: 1s465ms - UserTime: 33s716ms - VoluntaryContextSwitches: 65.31K (65310) Fragment Instance Lifecycle Timings: - ExecTime: 25s116ms - ExecTreeExecTime: 1s211ms - OpenTime: 63.367ms - ExecTreeOpenTime: 50.062us - PrepareTime: 55.936ms - ExecTreePrepareTime: 288.191us DataStreamSender (dst_id=7):(Total: 17s822ms, non-child: 17s822ms, % non-child: 100.00%) - BytesSent: 1.48 GB (1594081090) - NetworkThroughput(*): 257.44 MB/sec - OverallThroughput: 85.30 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 65.71M (65710143) - SerializeBatchTime: 11s898ms - TransmitDataRPCTime: 5s905ms - UncompressedRowBatchSize: 3.37 GB (3614716637) CodeGen:(Total: 93.151ms, non-child: 93.151ms, % non-child: 100.00%) - CodegenTime: 1.556ms - CompileTime: 15.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.971ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 30.113ms HDFS_SCAN_NODE (id=2):(Total: 1s167ms, non-child: 1s167ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/234.34 MB 10:1/253.38 MB 0:1/253.42 MB 8:1/253.39 MB 3:2/506.77 MB 1:2/506.76 MB 6:2/481.03 MB 7:5/1.18 GB 4:3/760.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 885ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 678.59 MB, 737.03 MB, 737.03 MB, 737.03 MB, 756.44 MB, 853.89 MB, 853.89 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB - FooterProcessingTime: (Avg: 3.648ms ; Min: 2.148ms ; Max: 10.438ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 1.01 GB (1079189381) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 GB (1079189381) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 GB (1079189381) - DecompressionTime: 3s047ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 750.09 MB (786526284) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.494ms - RowBatchQueuePutWaitTime: 3m55s - RowsRead: 121.89M (121886452) - RowsReturned: 65.71M (65710143) - RowsReturnedRate: 56.29 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.29K (6295) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 10s421ms - ScannerThreadsSysTime: 630.898ms - ScannerThreadsUserTime: 13s900ms - ScannerThreadsVoluntaryContextSwitches: 64.94K (64935) - TotalRawHdfsReadTime(*): 749.631ms - TotalReadThroughput: 41.17 MB/sec Filter 1 (16.00 MB): - Rows processed: 399.07K (399066) - Rows rejected: 3.19K (3185) - Rows total: 121.89M (121886452) Instance 854183ec25551621:f (host=vb0228.halxg.cloudera.com:22000):(Total: 117.600ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 5:4/765.48 MB 9:2/506.78 MB 0:4/951.82 MB 7:1/253.39 MB 10:3/760.17 MB 2:2/506.82 MB Filter 1 arrival: 4s638ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 773.29 MB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 774.26 MB, 790.26 MB, 792.11 MB, 792.00 MB, 792.17 MB, 792.66 MB, 791.87 MB, 792.28 MB, 704.59 MB, 697.21 MB, 696.82 MB, 696.77 MB, 696.31 MB, 696.99 MB, 696.96 MB, 609.59 MB, 601.48 MB, 601.54 MB, 601.50 MB, 601.61 MB, 601.77 MB, 577.84 MB, 513.95 MB, 481.98 MB, 410.16 MB, 323.09 MB, 315.12 MB, 314.54 MB, 275.35 MB, 219.01 MB, 254.98 MB, 334.71 MB, 335.03 MB, 334.56 MB, 294.78 MB, 295.00 MB, 286.95 MB, 255.32 MB, 255.40 MB, 239.06 MB, 166.07 MB, 118.11 MB, 78.56 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 4 - AverageThreadTokens: 11.04 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.28K (12283) - PeakMemoryUsage: 792.99 MB (831512507) - PerHostPeakMemUsage: 1.60 GB (1722137586) - RowsProduced: 62.58M (62581016) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s651ms - TotalStorageWaitTime: 558.882ms - TotalWallClockTime: 4m42s - SysTime: 2s359ms - UserTime: 40s990ms - VoluntaryContextSwitches: 62.10K (62104) Fragment Instance Lifecycle Timings: - ExecTime: 25s145ms - ExecTreeExecTime: 1s325ms - OpenTime: 66.118ms - ExecTreeOpenTime: 52.344us - PrepareTime: 51.439ms - ExecTreePrepareTime: 258.827us DataStreamSender (dst_id=7):(Total: 14s554ms, non-child: 14s554ms, % non-child: 100.00%) - BytesSent: 1.41 GB (1518547398) - NetworkThroughput(*): 465.26 MB/sec - OverallThroughput: 99.50 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 62.58M (62581016) - SerializeBatchTime: 11s418ms - TransmitDataRPCTime: 3s112ms - UncompressedRowBatchSize: 3.21 GB (3442583288) CodeGen:(Total: 92.115ms, non-child: 92.115ms, % non-child: 100.00%) - CodegenTime: 1.595ms - CompileTime: 17.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.025ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.307ms HDFS_SCAN_NODE (id=2):(Total: 1s282ms, non-child: 1s282ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 5:4/765.48 MB 9:2/506.78 MB 0:4/951.82 MB 7:1/253.39 MB 10:3/760.17 MB 2:2/506.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 883ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 761.10 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB - FooterProcessingTime: (Avg: 3.132ms ; Min: 1.938ms ; Max: 4.267ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.04 - BytesRead: 980.66 MB (1028294922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 980.66 MB (1028294922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 980.66 MB (1028294922) - DecompressionTime: 4s575ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.57 MB (814294988) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.288ms - RowBatchQueuePutWaitTime: 3m46s - RowsRead: 116.10M (116100817) - RowsReturned: 62.58M (62581016) - RowsReturnedRate: 48.78 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.15K (10146) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 16s403ms - ScannerThreadsSysTime: 1s067ms - ScannerThreadsUserTime: 21s602ms - ScannerThreadsVoluntaryContextSwitches: 61.87K (61866) - TotalRawHdfsReadTime(*): 678.820ms - TotalReadThroughput: 38.46 MB/sec Filter 1 (16.00 MB): - Rows processed: 407.73K (407728) - Rows rejected: 3.54K (3540) - Rows total: 116.10M (116100817) Instance 854183ec25551621:9 (host=vb0222.halxg.cloudera.com:22000):(Total: 113.602ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.41 MB 8:1/253.41 MB 7:1/253.40 MB 0:4/1013.57 MB 6:3/760.17 MB 1:2/506.82 MB 9:5/1.24 GB Filter 1 arrival: 4s547ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 697.15 MB, 774.25 MB, 774.25 MB, 774.25 MB, 774.25 MB, 774.25 MB, 774.25 MB, 790.25 MB, 792.11 MB, 791.87 MB, 792.01 MB, 792.03 MB, 792.27 MB, 792.27 MB, 704.60 MB, 697.03 MB, 696.70 MB, 696.31 MB, 696.81 MB, 697.21 MB, 697.11 MB, 601.82 MB, 601.73 MB, 601.12 MB, 601.53 MB, 601.39 MB, 601.47 MB, 545.68 MB, 505.23 MB, 450.09 MB, 354.17 MB, 314.49 MB, 314.41 MB, 314.72 MB, 235.09 MB, 218.93 MB, 367.34 MB, 348.53 MB, 348.73 MB, 309.06 MB, 308.93 MB, 277.27 MB, 269.42 MB, 269.26 MB, 229.21 MB, 149.50 MB, 149.58 MB, 109.69 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.12 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 11.82K (11823) - PeakMemoryUsage: 792.99 MB (831513791) - PerHostPeakMemUsage: 1.60 GB (1720553986) - RowsProduced: 63.43M (63429354) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s654ms - TotalStorageWaitTime: 720.805ms - TotalWallClockTime: 4m38s - SysTime: 2s349ms - UserTime: 39s486ms - VoluntaryContextSwitches: 62.95K (62949) Fragment Instance Lifecycle Timings: - ExecTime: 24s665ms - ExecTreeExecTime: 1s295ms - OpenTime: 66.390ms - ExecTreeOpenTime: 51.408us - PrepareTime: 47.141ms - ExecTreePrepareTime: 370.332us DataStreamSender (dst_id=7):(Total: 14s435ms, non-child: 14s435ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539713794) - NetworkThroughput(*): 482.58 MB/sec - OverallThroughput: 101.72 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.43M (63429354) - SerializeBatchTime: 11s373ms - TransmitDataRPCTime: 3s042ms - UncompressedRowBatchSize: 3.25 GB (3489250382) CodeGen:(Total: 94.385ms, non-child: 94.385ms, % non-child: 100.00%) - CodegenTime: 1.801ms - CompileTime: 17.237ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.342ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.298ms HDFS_SCAN_NODE (id=2):(Total: 1s259ms, non-child: 1s259ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.41 MB 8:1/253.41 MB 7:1/253.40 MB 0:4/1013.57 MB 6:3/760.17 MB 1:2/506.82 MB 9:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 902ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:2% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 623.12 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB - FooterProcessingTime: (Avg: 4.913ms ; Min: 2.013ms ; Max: 28.558ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.12 - BytesRead: 993.42 MB (1041678633) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.42 MB (1041678633) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.42 MB (1041678633) - DecompressionTime: 4s425ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.53 MB (814248188) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.042ms - RowBatchQueuePutWaitTime: 3m43s - RowsRead: 117.66M (117660067) - RowsReturned: 63.43M (63429354) - RowsReturnedRate: 50.37 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.71K (9714) - ScannerThreadsTotalWallClockTime: 4m13s - MaterializeTupleTime(*): 15s764ms - ScannerThreadsSysTime: 1s078ms - ScannerThreadsUserTime: 20s581ms - ScannerThreadsVoluntaryContextSwitches: 62.61K (62614) - TotalRawHdfsReadTime(*): 689.002ms - TotalReadThroughput: 39.74 MB/sec Filter 1 (16.00 MB): - Rows processed: 369.10K (369098) - Rows rejected: 3.06K (3059) - Rows total: 117.66M (117660067) Instance 854183ec25551621:3 (host=vb0224.halxg.cloudera.com:22000):(Total: 112.265ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.77 MB 1:2/506.81 MB 4:1/253.38 MB 6:1/253.38 MB 2:2/506.78 MB 0:2/506.80 MB 10:2/506.83 MB 8:1/253.39 MB 3:4/1013.55 MB 7:1/253.40 MB Filter 1 arrival: 4s556ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.20 MB, 774.20 MB, 774.20 MB, 774.20 MB, 774.20 MB, 774.20 MB, 774.20 MB, 790.77 MB, 792.08 MB, 792.35 MB, 792.06 MB, 792.15 MB, 792.26 MB, 776.18 MB, 696.93 MB, 696.72 MB, 696.82 MB, 696.94 MB, 696.49 MB, 697.17 MB, 689.08 MB, 601.78 MB, 601.21 MB, 601.70 MB, 601.68 MB, 601.75 MB, 601.22 MB, 601.37 MB, 505.72 MB, 505.74 MB, 417.74 MB, 338.37 MB, 314.54 MB, 314.54 MB, 314.79 MB, 234.47 MB, 218.24 MB, 436.19 MB, 412.25 MB, 412.15 MB, 412.21 MB, 364.10 MB, 364.39 MB, 364.47 MB, 316.91 MB, 316.85 MB, 317.00 MB, 300.73 MB, 244.97 MB, 173.19 MB, 165.13 MB, 109.73 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6 - AverageThreadTokens: 11.41 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 13.74K (13743) - PeakMemoryUsage: 792.97 MB (831489435) - PerHostPeakMemUsage: 1.60 GB (1720263834) - RowsProduced: 67.17M (67166428) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s660ms - TotalStorageWaitTime: 644.285ms - TotalWallClockTime: 5m6s - SysTime: 2s558ms - UserTime: 44s160ms - VoluntaryContextSwitches: 66.58K (66581) Fragment Instance Lifecycle Timings: - ExecTime: 27s011ms - ExecTreeExecTime: 1s375ms - OpenTime: 65.956ms - ExecTreeOpenTime: 52.408us - PrepareTime: 46.268ms - ExecTreePrepareTime: 290.724us DataStreamSender (dst_id=7):(Total: 15s849ms, non-child: 15s849ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629492770) - NetworkThroughput(*): 441.80 MB/sec - OverallThroughput: 98.05 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67166428) - SerializeBatchTime: 12s306ms - TransmitDataRPCTime: 3s517ms - UncompressedRowBatchSize: 3.44 GB (3694826916) CodeGen:(Total: 90.767ms, non-child: 90.767ms, % non-child: 100.00%) - CodegenTime: 1.605ms - CompileTime: 18.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.734ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.245ms HDFS_SCAN_NODE (id=2):(Total: 1s326ms, non-child: 1s326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/506.77 MB 1:2/506.81 MB 4:1/253.38 MB 6:1/253.38 MB 2:2/506.78 MB 0:2/506.80 MB 10:2/506.83 MB 8:1/253.39 MB 3:4/1013.55 MB 7:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:98.15% 1:1.852% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 998.90 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.775ms ; Min: 1.935ms ; Max: 10.862ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.41 - BytesRead: 1.03 GB (1102921011) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102921011) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102921011) - DecompressionTime: 4s900ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.47 MB (814182600) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.290ms - RowBatchQueuePutWaitTime: 4m6s - RowsRead: 124.58M (124581238) - RowsReturned: 67.17M (67166428) - RowsReturnedRate: 50.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.29K (11293) - ScannerThreadsTotalWallClockTime: 4m39s - MaterializeTupleTime(*): 17s491ms - ScannerThreadsSysTime: 1s187ms - ScannerThreadsUserTime: 23s030ms - ScannerThreadsVoluntaryContextSwitches: 66.35K (66354) - TotalRawHdfsReadTime(*): 825.699ms - TotalReadThroughput: 38.96 MB/sec Filter 1 (16.00 MB): - Rows processed: 361.97K (361971) - Rows rejected: 3.20K (3197) - Rows total: 124.58M (124581238) Instance 854183ec25551621:5 (host=vb0218.halxg.cloudera.com:22000):(Total: 109.278ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.38 MB 2:1/253.39 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 7:2/506.76 MB 0:5/1.24 GB 1:1/253.39 MB Filter 1 arrival: 4s500ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 448.97 MB, 774.46 MB, 774.46 MB, 774.46 MB, 774.46 MB, 774.46 MB, 774.46 MB, 790.46 MB, 791.33 MB, 792.03 MB, 792.02 MB, 791.97 MB, 792.16 MB, 792.28 MB, 776.17 MB, 696.55 MB, 697.13 MB, 697.30 MB, 696.88 MB, 696.50 MB, 696.95 MB, 673.21 MB, 601.77 MB, 601.50 MB, 601.64 MB, 601.74 MB, 601.69 MB, 601.24 MB, 585.49 MB, 506.03 MB, 489.92 MB, 410.21 MB, 314.84 MB, 314.97 MB, 314.71 MB, 290.68 MB, 218.56 MB, 218.71 MB, 348.45 MB, 348.77 MB, 348.83 MB, 309.21 MB, 309.04 MB, 308.78 MB, 268.93 MB, 269.24 MB, 269.14 MB, 221.45 MB, 149.91 MB, 141.71 MB, 29.72 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 10.96 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 14.12K (14119) - PeakMemoryUsage: 792.94 MB (831461355) - PerHostPeakMemUsage: 1.60 GB (1720539872) - RowsProduced: 63.42M (63419701) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s653ms - TotalStorageWaitTime: 626.274ms - TotalWallClockTime: 4m53s - SysTime: 1s973ms - UserTime: 45s756ms - VoluntaryContextSwitches: 62.86K (62860) Fragment Instance Lifecycle Timings: - ExecTime: 26s000ms - ExecTreeExecTime: 1s408ms - OpenTime: 67.097ms - ExecTreeOpenTime: 51.848us - PrepareTime: 42.132ms - ExecTreePrepareTime: 291.864us DataStreamSender (dst_id=7):(Total: 15s076ms, non-child: 15s076ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538790201) - NetworkThroughput(*): 424.81 MB/sec - OverallThroughput: 97.34 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.42M (63419701) - SerializeBatchTime: 11s592ms - TransmitDataRPCTime: 3s454ms - UncompressedRowBatchSize: 3.25 GB (3488719371) CodeGen:(Total: 92.887ms, non-child: 92.887ms, % non-child: 100.00%) - CodegenTime: 1.601ms - CompileTime: 18.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.631ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.255ms HDFS_SCAN_NODE (id=2):(Total: 1s358ms, non-child: 1s358ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.38 MB 2:1/253.39 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 7:2/506.76 MB 0:5/1.24 GB 1:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:98.08% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:1.923% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 347.82 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB - FooterProcessingTime: (Avg: 3.642ms ; Min: 2.199ms ; Max: 6.830ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 10.15 - BytesRead: 993.42 MB (1041676926) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.42 MB (1041676926) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.42 MB (1041676926) - DecompressionTime: 5s317ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.53 MB (814253180) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.101ms - RowBatchQueuePutWaitTime: 3m51s - RowsRead: 117.66M (117660047) - RowsReturned: 63.42M (63419701) - RowsReturnedRate: 46.67 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.66K (11663) - ScannerThreadsTotalWallClockTime: 4m27s - MaterializeTupleTime(*): 19s094ms - ScannerThreadsSysTime: 1s126ms - ScannerThreadsUserTime: 25s103ms - ScannerThreadsVoluntaryContextSwitches: 62.67K (62675) - TotalRawHdfsReadTime(*): 769.805ms - TotalReadThroughput: 37.49 MB/sec Filter 1 (16.00 MB): - Rows processed: 385.87K (385871) - Rows rejected: 3.34K (3344) - Rows total: 117.66M (117660047) Instance 854183ec25551621:d (host=vb0226.halxg.cloudera.com:22000):(Total: 108.870ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 3:1/253.39 MB 0:2/506.78 MB 5:2/506.80 MB 7:1/253.40 MB 2:1/253.38 MB 1:2/506.79 MB 9:2/506.78 MB 8:3/760.18 MB 6:3/760.20 MB Filter 1 arrival: 4s626ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 773.00 MB, 773.14 MB, 773.14 MB, 773.14 MB, 773.14 MB, 773.14 MB, 773.14 MB, 789.14 MB, 791.26 MB, 791.22 MB, 791.17 MB, 790.88 MB, 791.08 MB, 791.05 MB, 719.61 MB, 696.29 MB, 695.96 MB, 696.43 MB, 695.54 MB, 695.96 MB, 696.05 MB, 624.19 MB, 600.46 MB, 600.04 MB, 600.52 MB, 600.13 MB, 600.55 MB, 600.21 MB, 512.61 MB, 488.48 MB, 416.66 MB, 329.27 MB, 313.46 MB, 313.50 MB, 265.51 MB, 217.65 MB, 359.64 MB, 410.81 MB, 410.92 MB, 411.05 MB, 363.27 MB, 363.22 MB, 363.10 MB, 339.30 MB, 315.72 MB, 315.92 MB, 315.81 MB, 267.82 MB, 188.16 MB, 172.21 MB, 132.17 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.42 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 13.81K (13814) - PeakMemoryUsage: 791.77 MB (830230559) - PerHostPeakMemUsage: 1.60 GB (1719696027) - RowsProduced: 67.16M (67162531) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s658ms - TotalStorageWaitTime: 650.637ms - TotalWallClockTime: 4m59s - SysTime: 2s235ms - UserTime: 45s660ms - VoluntaryContextSwitches: 66.54K (66539) Fragment Instance Lifecycle Timings: - ExecTime: 26s501ms - ExecTreeExecTime: 1s383ms - OpenTime: 65.606ms - ExecTreeOpenTime: 47.700us - PrepareTime: 43.223ms - ExecTreePrepareTime: 334.016us DataStreamSender (dst_id=7):(Total: 15s520ms, non-child: 15s520ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630088368) - NetworkThroughput(*): 464.20 MB/sec - OverallThroughput: 100.17 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.16M (67162531) - SerializeBatchTime: 12s148ms - TransmitDataRPCTime: 3s348ms - UncompressedRowBatchSize: 3.44 GB (3694612537) CodeGen:(Total: 93.997ms, non-child: 93.997ms, % non-child: 100.00%) - CodegenTime: 1.605ms - CompileTime: 16.695ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.100ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.676ms HDFS_SCAN_NODE (id=2):(Total: 1s339ms, non-child: 1s339ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 3:1/253.39 MB 0:2/506.78 MB 5:2/506.80 MB 7:1/253.40 MB 2:1/253.38 MB 1:2/506.79 MB 9:2/506.78 MB 8:3/760.18 MB 6:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 876.52 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.018ms ; Min: 1.945ms ; Max: 16.377ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.42 - BytesRead: 1.03 GB (1102912239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102912239) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102912239) - DecompressionTime: 5s224ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 775.32 MB (812980400) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.517ms - RowBatchQueuePutWaitTime: 3m57s - RowsRead: 124.58M (124580858) - RowsReturned: 67.16M (67162531) - RowsReturnedRate: 50.14 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.42K (11419) - ScannerThreadsTotalWallClockTime: 4m33s - MaterializeTupleTime(*): 18s793ms - ScannerThreadsSysTime: 1s128ms - ScannerThreadsUserTime: 24s769ms - ScannerThreadsVoluntaryContextSwitches: 66.27K (66274) - TotalRawHdfsReadTime(*): 792.868ms - TotalReadThroughput: 39.69 MB/sec Filter 1 (16.00 MB): - Rows processed: 355.19K (355189) - Rows rejected: 3.31K (3305) - Rows total: 124.58M (124580858) Instance 854183ec25551621:8 (host=vb0216.halxg.cloudera.com:22000):(Total: 108.599ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 3:3/760.19 MB 0:1/253.41 MB 2:2/506.79 MB 4:2/506.80 MB 7:1/253.39 MB 6:3/760.20 MB 10:4/1013.58 MB Filter 1 arrival: 4s524ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.09 MB, 774.09 MB, 774.09 MB, 774.09 MB, 774.09 MB, 774.09 MB, 774.09 MB, 789.97 MB, 792.44 MB, 792.37 MB, 792.01 MB, 791.73 MB, 792.10 MB, 792.48 MB, 696.97 MB, 696.80 MB, 696.83 MB, 696.90 MB, 696.96 MB, 696.83 MB, 601.62 MB, 601.66 MB, 601.64 MB, 601.97 MB, 601.59 MB, 601.93 MB, 513.93 MB, 505.86 MB, 410.24 MB, 315.02 MB, 315.31 MB, 314.72 MB, 274.70 MB, 218.96 MB, 389.97 MB, 348.95 MB, 348.86 MB, 308.97 MB, 308.98 MB, 308.96 MB, 269.10 MB, 269.36 MB, 229.63 MB, 189.65 MB, 149.87 MB, 109.79 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.40 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.10K (8099) - PeakMemoryUsage: 792.88 MB (831391843) - PerHostPeakMemUsage: 1.60 GB (1720816310) - RowsProduced: 63.41M (63414740) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s653ms - TotalStorageWaitTime: 663.508ms - TotalWallClockTime: 4m29s - SysTime: 1s388ms - UserTime: 31s898ms - VoluntaryContextSwitches: 63.04K (63041) Fragment Instance Lifecycle Timings: - ExecTime: 23s964ms - ExecTreeExecTime: 1s196ms - OpenTime: 68.581ms - ExecTreeOpenTime: 56.772us - PrepareTime: 39.979ms - ExecTreePrepareTime: 278.384us DataStreamSender (dst_id=7):(Total: 17s094ms, non-child: 17s094ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539547505) - NetworkThroughput(*): 253.33 MB/sec - OverallThroughput: 85.89 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.41M (63414740) - SerializeBatchTime: 11s280ms - TransmitDataRPCTime: 5s795ms - UncompressedRowBatchSize: 3.25 GB (3488446468) CodeGen:(Total: 90.146ms, non-child: 90.146ms, % non-child: 100.00%) - CodegenTime: 1.560ms - CompileTime: 19.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.053ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 22.270ms HDFS_SCAN_NODE (id=2):(Total: 1s164ms, non-child: 1s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 3:3/760.19 MB 0:1/253.41 MB 2:2/506.79 MB 4:2/506.80 MB 7:1/253.39 MB 6:3/760.20 MB 10:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:97.92% 1:2.083% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 701.27 MB, 924.43 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB - FooterProcessingTime: (Avg: 4.024ms ; Min: 2.152ms ; Max: 7.064ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 993.45 MB (1041708915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.45 MB (1041708915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.45 MB (1041708915) - DecompressionTime: 2s915ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.47 MB (814182644) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.334ms - RowBatchQueuePutWaitTime: 3m42s - RowsRead: 117.66M (117659798) - RowsReturned: 63.41M (63414740) - RowsReturnedRate: 54.45 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.09K (6088) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 9s881ms - ScannerThreadsSysTime: 604.904ms - ScannerThreadsUserTime: 13s200ms - ScannerThreadsVoluntaryContextSwitches: 62.70K (62699) - TotalRawHdfsReadTime(*): 783.038ms - TotalReadThroughput: 41.39 MB/sec Filter 1 (16.00 MB): - Rows processed: 340.48K (340479) - Rows rejected: 2.88K (2880) - Rows total: 117.66M (117659798) Instance 854183ec25551621:e (host=vb0232.halxg.cloudera.com:22000):(Total: 108.245ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.38 MB 8:1/253.40 MB 6:2/506.79 MB 0:4/1013.60 MB 4:2/506.80 MB 3:2/506.79 MB 9:4/1013.57 MB 5:1/253.39 MB 1:1/253.41 MB Filter 1 arrival: 4s651ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.44 MB, 774.44 MB, 774.44 MB, 774.44 MB, 774.44 MB, 774.44 MB, 774.44 MB, 790.55 MB, 791.75 MB, 792.33 MB, 792.34 MB, 792.48 MB, 792.12 MB, 792.36 MB, 696.52 MB, 696.83 MB, 696.68 MB, 696.65 MB, 697.07 MB, 696.80 MB, 601.41 MB, 601.50 MB, 601.81 MB, 601.39 MB, 601.24 MB, 601.22 MB, 537.92 MB, 505.58 MB, 409.26 MB, 338.09 MB, 314.56 MB, 314.46 MB, 314.61 MB, 218.47 MB, 218.58 MB, 410.58 MB, 412.03 MB, 412.20 MB, 412.11 MB, 364.20 MB, 364.65 MB, 364.12 MB, 317.12 MB, 317.00 MB, 316.74 MB, 268.83 MB, 221.02 MB, 173.36 MB, 173.33 MB, 125.51 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.27 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.56K (8560) - PeakMemoryUsage: 793.17 MB (831698239) - PerHostPeakMemUsage: 1.60 GB (1720756569) - RowsProduced: 67.17M (67171546) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s658ms - TotalStorageWaitTime: 688.101ms - TotalWallClockTime: 4m50s - SysTime: 1s547ms - UserTime: 35s289ms - VoluntaryContextSwitches: 66.66K (66655) Fragment Instance Lifecycle Timings: - ExecTime: 25s874ms - ExecTreeExecTime: 1s239ms - OpenTime: 65.185ms - ExecTreeOpenTime: 51.920us - PrepareTime: 43.029ms - ExecTreePrepareTime: 174.524us DataStreamSender (dst_id=7):(Total: 18s074ms, non-child: 18s074ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630253745) - NetworkThroughput(*): 273.36 MB/sec - OverallThroughput: 86.02 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67171546) - SerializeBatchTime: 12s366ms - TransmitDataRPCTime: 5s687ms - UncompressedRowBatchSize: 3.44 GB (3695108458) CodeGen:(Total: 87.906ms, non-child: 87.906ms, % non-child: 100.00%) - CodegenTime: 1.566ms - CompileTime: 16.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.073ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 23.164ms HDFS_SCAN_NODE (id=2):(Total: 1s203ms, non-child: 1s203ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.38 MB 8:1/253.40 MB 6:2/506.79 MB 0:4/1013.60 MB 4:2/506.80 MB 3:2/506.79 MB 9:4/1013.57 MB 5:1/253.39 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.407ms ; Min: 2.381ms ; Max: 5.350ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 1.03 GB (1102943871) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102943871) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102943871) - DecompressionTime: 3s208ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.72 MB (814449096) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.919ms - RowBatchQueuePutWaitTime: 3m59s - RowsRead: 124.58M (124581331) - RowsReturned: 67.17M (67171546) - RowsReturnedRate: 55.83 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.36K (6360) - ScannerThreadsTotalWallClockTime: 4m24s - MaterializeTupleTime(*): 11s156ms - ScannerThreadsSysTime: 727.883ms - ScannerThreadsUserTime: 14s741ms - ScannerThreadsVoluntaryContextSwitches: 66.36K (66357) - TotalRawHdfsReadTime(*): 868.235ms - TotalReadThroughput: 40.46 MB/sec Filter 1 (16.00 MB): - Rows processed: 413.44K (413444) - Rows rejected: 3.25K (3247) - Rows total: 124.58M (124581331) Instance 854183ec25551621:4 (host=vb0234.halxg.cloudera.com:22000):(Total: 106.935ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.79 MB 6:1/253.39 MB 1:3/760.21 MB 7:1/253.40 MB 8:1/253.38 MB 10:3/760.19 MB 3:3/760.17 MB 4:4/1013.54 MB Filter 1 arrival: 4s544ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.59 MB, 774.59 MB, 774.59 MB, 774.59 MB, 774.59 MB, 774.59 MB, 774.59 MB, 790.64 MB, 792.00 MB, 791.76 MB, 792.15 MB, 792.51 MB, 792.28 MB, 697.03 MB, 697.17 MB, 696.93 MB, 696.65 MB, 696.74 MB, 697.01 MB, 680.72 MB, 601.29 MB, 601.49 MB, 601.98 MB, 601.54 MB, 601.50 MB, 601.61 MB, 505.98 MB, 490.09 MB, 402.20 MB, 314.64 MB, 314.20 MB, 314.50 MB, 219.00 MB, 218.85 MB, 410.79 MB, 412.33 MB, 412.23 MB, 364.42 MB, 364.43 MB, 364.38 MB, 324.78 MB, 316.61 MB, 316.84 MB, 309.21 MB, 245.19 MB, 173.40 MB, 173.58 MB, 125.37 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.32 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.23K (8234) - PeakMemoryUsage: 793.14 MB (831668963) - PerHostPeakMemUsage: 1.62 GB (1744038224) - RowsProduced: 67.17M (67173275) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s653ms - TotalStorageWaitTime: 737.082ms - TotalWallClockTime: 4m40s - SysTime: 1s425ms - UserTime: 33s499ms - VoluntaryContextSwitches: 66.56K (66558) Fragment Instance Lifecycle Timings: - ExecTime: 25s021ms - ExecTreeExecTime: 1s216ms - OpenTime: 64.487ms - ExecTreeOpenTime: 51.320us - PrepareTime: 42.396ms - ExecTreePrepareTime: 288.016us DataStreamSender (dst_id=7):(Total: 17s888ms, non-child: 17s888ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629972887) - NetworkThroughput(*): 262.66 MB/sec - OverallThroughput: 86.90 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67173275) - SerializeBatchTime: 11s952ms - TransmitDataRPCTime: 5s918ms - UncompressedRowBatchSize: 3.44 GB (3695203573) CodeGen:(Total: 88.669ms, non-child: 88.669ms, % non-child: 100.00%) - CodegenTime: 1.669ms - CompileTime: 16.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.407ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.395ms HDFS_SCAN_NODE (id=2):(Total: 1s182ms, non-child: 1s182ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.79 MB 6:1/253.39 MB 1:3/760.21 MB 7:1/253.40 MB 8:1/253.38 MB 10:3/760.19 MB 3:3/760.17 MB 4:4/1013.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.953ms ; Min: 1.804ms ; Max: 26.860ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 1.03 GB (1102941326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102941326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102941326) - DecompressionTime: 3s032ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.67 MB (814402416) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.983ms - RowBatchQueuePutWaitTime: 3m53s - RowsRead: 124.58M (124581346) - RowsReturned: 67.17M (67173275) - RowsReturnedRate: 56.82 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.17K (6170) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 10s278ms - ScannerThreadsSysTime: 630.898ms - ScannerThreadsUserTime: 13s758ms - ScannerThreadsVoluntaryContextSwitches: 66.26K (66264) - TotalRawHdfsReadTime(*): 838.709ms - TotalReadThroughput: 42.07 MB/sec Filter 1 (16.00 MB): - Rows processed: 415.71K (415709) - Rows rejected: 3.88K (3883) - Rows total: 124.58M (124581346) Instance 854183ec25551621:b (host=vb0206.halxg.cloudera.com:22000):(Total: 105.899ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:1/253.40 MB 8:1/253.41 MB 3:1/253.40 MB 7:2/506.80 MB 9:3/760.16 MB 10:1/253.41 MB 6:1/253.40 MB 2:3/760.21 MB Filter 1 arrival: 4s591ms MemoryUsage(500.000ms): 46.76 KB, 59.86 KB, 138.62 MB, 774.38 MB, 774.38 MB, 774.38 MB, 774.38 MB, 774.38 MB, 774.38 MB, 774.38 MB, 791.58 MB, 792.22 MB, 792.25 MB, 792.20 MB, 792.09 MB, 792.23 MB, 696.95 MB, 697.10 MB, 696.73 MB, 696.85 MB, 696.84 MB, 696.95 MB, 673.24 MB, 601.78 MB, 601.54 MB, 601.91 MB, 601.73 MB, 601.64 MB, 601.43 MB, 505.21 MB, 505.58 MB, 409.64 MB, 314.42 MB, 314.62 MB, 314.48 MB, 282.58 MB, 218.50 MB, 205.52 MB, 348.67 MB, 348.88 MB, 309.01 MB, 308.98 MB, 309.14 MB, 269.45 MB, 269.30 MB, 269.43 MB, 189.72 MB, 149.89 MB, 109.71 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.18 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.55K (8551) - PeakMemoryUsage: 793.12 MB (831651331) - PerHostPeakMemUsage: 1.60 GB (1720450783) - RowsProduced: 63.41M (63407094) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s655ms - TotalStorageWaitTime: 661.389ms - TotalWallClockTime: 4m33s - SysTime: 1s368ms - UserTime: 32s125ms - VoluntaryContextSwitches: 63.28K (63277) Fragment Instance Lifecycle Timings: - ExecTime: 24s243ms - ExecTreeExecTime: 1s216ms - OpenTime: 63.378ms - ExecTreeOpenTime: 52.196us - PrepareTime: 42.466ms - ExecTreePrepareTime: 395.564us DataStreamSender (dst_id=7):(Total: 17s167ms, non-child: 17s167ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538989902) - NetworkThroughput(*): 256.42 MB/sec - OverallThroughput: 85.49 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.41M (63407094) - SerializeBatchTime: 11s424ms - TransmitDataRPCTime: 5s723ms - UncompressedRowBatchSize: 3.25 GB (3488025858) CodeGen:(Total: 89.108ms, non-child: 89.108ms, % non-child: 100.00%) - CodegenTime: 1.535ms - CompileTime: 15.455ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.942ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.198ms HDFS_SCAN_NODE (id=2):(Total: 1s181ms, non-child: 1s181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:1/253.40 MB 8:1/253.41 MB 3:1/253.40 MB 7:2/506.80 MB 9:3/760.16 MB 10:1/253.41 MB 6:1/253.40 MB 2:3/760.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:97.92% 1:0% 2:0% 3:0% 4:2.083% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 57.17 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 709.32 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB - FooterProcessingTime: (Avg: 4.317ms ; Min: 2.332ms ; Max: 9.087ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 993.41 MB (1041661462) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.41 MB (1041661462) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.41 MB (1041661462) - DecompressionTime: 2s903ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.57 MB (814294672) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.456ms - RowBatchQueuePutWaitTime: 3m45s - RowsRead: 117.66M (117659817) - RowsReturned: 63.41M (63407094) - RowsReturnedRate: 53.66 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.54K (6541) - ScannerThreadsTotalWallClockTime: 4m9s - MaterializeTupleTime(*): 9s820ms - ScannerThreadsSysTime: 609.900ms - ScannerThreadsUserTime: 13s133ms - ScannerThreadsVoluntaryContextSwitches: 62.88K (62884) - TotalRawHdfsReadTime(*): 841.939ms - TotalReadThroughput: 40.55 MB/sec Filter 1 (16.00 MB): - Rows processed: 412.59K (412590) - Rows rejected: 3.56K (3561) - Rows total: 117.66M (117659817) Instance 854183ec25551621:7 (host=vb0220.halxg.cloudera.com:22000):(Total: 105.789ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 7:1/253.39 MB 9:1/253.41 MB 10:1/253.40 MB 6:1/253.39 MB 4:2/506.78 MB 5:1/253.38 MB 0:4/1013.57 MB 2:4/1013.58 MB Filter 1 arrival: 4s510ms MemoryUsage(500.000ms): 0, 59.86 KB, 59.86 KB, 774.29 MB, 774.29 MB, 774.29 MB, 774.29 MB, 774.29 MB, 774.29 MB, 790.29 MB, 791.06 MB, 791.97 MB, 792.02 MB, 792.00 MB, 792.04 MB, 792.16 MB, 696.89 MB, 696.64 MB, 696.93 MB, 696.72 MB, 696.93 MB, 697.13 MB, 696.82 MB, 601.21 MB, 600.96 MB, 601.32 MB, 601.46 MB, 601.28 MB, 601.51 MB, 521.43 MB, 505.52 MB, 417.93 MB, 346.33 MB, 314.13 MB, 314.00 MB, 306.67 MB, 218.56 MB, 218.60 MB, 348.57 MB, 348.41 MB, 348.69 MB, 308.87 MB, 308.81 MB, 269.46 MB, 269.24 MB, 269.32 MB, 229.48 MB, 149.92 MB, 149.92 MB, 50.26 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 11.02 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.63K (8631) - PeakMemoryUsage: 792.98 MB (831504403) - PerHostPeakMemUsage: 1.60 GB (1720867986) - RowsProduced: 63.44M (63437785) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s658ms - TotalStorageWaitTime: 607.450ms - TotalWallClockTime: 4m35s - SysTime: 1s332ms - UserTime: 32s573ms - VoluntaryContextSwitches: 63.16K (63162) Fragment Instance Lifecycle Timings: - ExecTime: 24s453ms - ExecTreeExecTime: 1s214ms - OpenTime: 63.571ms - ExecTreeOpenTime: 56.160us - PrepareTime: 42.179ms - ExecTreePrepareTime: 277.728us DataStreamSender (dst_id=7):(Total: 17s251ms, non-child: 17s251ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1540206315) - NetworkThroughput(*): 258.26 MB/sec - OverallThroughput: 85.14 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.44M (63437785) - SerializeBatchTime: 11s543ms - TransmitDataRPCTime: 5s687ms - UncompressedRowBatchSize: 3.25 GB (3489714167) CodeGen:(Total: 91.877ms, non-child: 91.877ms, % non-child: 100.00%) - CodegenTime: 1.701ms - CompileTime: 15.803ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.877ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.681ms HDFS_SCAN_NODE (id=2):(Total: 1s175ms, non-child: 1s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 7:1/253.39 MB 9:1/253.41 MB 10:1/253.40 MB 6:1/253.39 MB 4:2/506.78 MB 5:1/253.38 MB 0:4/1013.57 MB 2:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB - FooterProcessingTime: (Avg: 3.713ms ; Min: 2.076ms ; Max: 6.459ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.22 - BytesRead: 993.44 MB (1041695130) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.44 MB (1041695130) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.44 MB (1041695130) - DecompressionTime: 2s914ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.53 MB (814253000) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.089ms - RowBatchQueuePutWaitTime: 3m47s - RowsRead: 117.66M (117660134) - RowsReturned: 63.44M (63437785) - RowsReturnedRate: 53.96 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.60K (6599) - ScannerThreadsTotalWallClockTime: 4m10s - MaterializeTupleTime(*): 9s946ms - ScannerThreadsSysTime: 579.905ms - ScannerThreadsUserTime: 13s355ms - ScannerThreadsVoluntaryContextSwitches: 62.78K (62781) - TotalRawHdfsReadTime(*): 750.873ms - TotalReadThroughput: 40.55 MB/sec Filter 1 (16.00 MB): - Rows processed: 381.20K (381205) - Rows rejected: 3.34K (3336) - Rows total: 117.66M (117660134) Instance 854183ec25551621:2 (host=vb0212.halxg.cloudera.com:22000):(Total: 104.721ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:1/253.42 MB 4:1/253.39 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 8:3/760.17 MB 5:3/760.16 MB 9:1/253.39 MB 3:1/253.40 MB 2:1/253.40 MB Filter 1 arrival: 4s584ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 773.89 MB, 774.18 MB, 774.18 MB, 774.18 MB, 774.18 MB, 774.18 MB, 774.18 MB, 790.18 MB, 792.05 MB, 791.83 MB, 792.23 MB, 792.12 MB, 791.99 MB, 792.25 MB, 736.20 MB, 696.89 MB, 696.92 MB, 696.60 MB, 696.96 MB, 696.85 MB, 696.55 MB, 688.80 MB, 601.35 MB, 601.59 MB, 601.71 MB, 601.66 MB, 601.99 MB, 601.48 MB, 601.78 MB, 505.95 MB, 505.88 MB, 417.91 MB, 338.72 MB, 314.47 MB, 314.56 MB, 298.95 MB, 218.90 MB, 197.74 MB, 285.28 MB, 285.29 MB, 253.41 MB, 253.39 MB, 221.93 MB, 221.74 MB, 205.90 MB, 142.20 MB, 125.99 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 11.04 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 11.55K (11552) - PeakMemoryUsage: 792.99 MB (831515483) - PerHostPeakMemUsage: 1.60 GB (1720741123) - RowsProduced: 59.70M (59702216) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s653ms - TotalStorageWaitTime: 596.272ms - TotalWallClockTime: 4m30s - SysTime: 1s698ms - UserTime: 38s578ms - VoluntaryContextSwitches: 58.71K (58712) Fragment Instance Lifecycle Timings: - ExecTime: 24s549ms - ExecTreeExecTime: 1s329ms - OpenTime: 62.879ms - ExecTreeOpenTime: 52.472us - PrepareTime: 41.800ms - ExecTreePrepareTime: 314.614us DataStreamSender (dst_id=7):(Total: 15s058ms, non-child: 15s058ms, % non-child: 100.00%) - BytesSent: 1.35 GB (1448798531) - NetworkThroughput(*): 346.76 MB/sec - OverallThroughput: 91.75 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 59.70M (59702216) - SerializeBatchTime: 11s050ms - TransmitDataRPCTime: 3s984ms - UncompressedRowBatchSize: 3.06 GB (3284220428) CodeGen:(Total: 90.273ms, non-child: 90.273ms, % non-child: 100.00%) - CodegenTime: 1.629ms - CompileTime: 15.847ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.248ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.678ms HDFS_SCAN_NODE (id=2):(Total: 1s288ms, non-child: 1s288ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:1/253.42 MB 4:1/253.39 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 8:3/760.17 MB 5:3/760.16 MB 9:1/253.39 MB 3:1/253.40 MB 2:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.33 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB - FooterProcessingTime: (Avg: 3.850ms ; Min: 2.088ms ; Max: 5.357ms ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.04 - BytesRead: 934.98 MB (980401417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.98 MB (980401417) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.98 MB (980401417) - DecompressionTime: 4s125ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.51 MB (814229404) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.820ms - RowBatchQueuePutWaitTime: 3m45s - RowsRead: 110.74M (110738621) - RowsReturned: 59.70M (59702216) - RowsReturnedRate: 46.34 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 9.34K (9341) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 14s653ms - ScannerThreadsSysTime: 855.864ms - ScannerThreadsUserTime: 19s381ms - ScannerThreadsVoluntaryContextSwitches: 58.48K (58477) - TotalRawHdfsReadTime(*): 837.376ms - TotalReadThroughput: 38.16 MB/sec Filter 1 (16.00 MB): - Rows processed: 280.35K (280354) - Rows rejected: 2.49K (2489) - Rows total: 110.74M (110738621) Instance 854183ec25551621:6 (host=vb0204.halxg.cloudera.com:22000):(Total: 98.527ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.15 MB 2:2/506.79 MB 5:1/253.39 MB 7:2/506.77 MB 8:4/1013.58 MB 4:4/1013.59 MB 0:2/506.81 MB Filter 1 arrival: 4s463ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 711.01 MB, 711.01 MB, 711.01 MB, 711.01 MB, 711.01 MB, 711.01 MB, 727.01 MB, 728.11 MB, 729.07 MB, 728.59 MB, 728.94 MB, 728.72 MB, 728.75 MB, 642.01 MB, 641.39 MB, 641.61 MB, 641.08 MB, 641.32 MB, 641.45 MB, 553.80 MB, 553.43 MB, 553.47 MB, 553.39 MB, 553.53 MB, 529.93 MB, 466.03 MB, 378.28 MB, 306.70 MB, 290.96 MB, 290.80 MB, 251.29 MB, 202.98 MB, 480.54 MB, 475.48 MB, 475.59 MB, 475.37 MB, 419.78 MB, 420.16 MB, 419.51 MB, 412.07 MB, 364.07 MB, 363.61 MB, 364.24 MB, 315.60 MB, 260.01 MB, 196.75 MB, 196.47 MB, 140.57 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 10, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.76 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 11.64K (11642) - PeakMemoryUsage: 729.56 MB (764995811) - PerHostPeakMemUsage: 1.54 GB (1654113004) - RowsProduced: 67.15M (67148043) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s647ms - TotalStorageWaitTime: 546.181ms - TotalWallClockTime: 4m29s - SysTime: 1s767ms - UserTime: 35s543ms - VoluntaryContextSwitches: 66.51K (66513) Fragment Instance Lifecycle Timings: - ExecTime: 25s338ms - ExecTreeExecTime: 1s266ms - OpenTime: 64.834ms - ExecTreeOpenTime: 55.120us - PrepareTime: 33.664ms - ExecTreePrepareTime: 293.963us DataStreamSender (dst_id=7):(Total: 15s172ms, non-child: 15s172ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629856229) - NetworkThroughput(*): 476.51 MB/sec - OverallThroughput: 102.44 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.15M (67148043) - SerializeBatchTime: 11s888ms - TransmitDataRPCTime: 3s261ms - UncompressedRowBatchSize: 3.44 GB (3693815553) CodeGen:(Total: 90.979ms, non-child: 90.979ms, % non-child: 100.00%) - CodegenTime: 1.664ms - CompileTime: 16.790ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.104ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.553ms HDFS_SCAN_NODE (id=2):(Total: 1s227ms, non-child: 1s227ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/760.15 MB 2:2/506.79 MB 5:1/253.39 MB 7:2/506.77 MB 8:4/1013.58 MB 4:4/1013.59 MB 0:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:2% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 642.81 MB, 1.01 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.011ms ; Min: 1.908ms ; Max: 4.946ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 9.76 - BytesRead: 1.03 GB (1102950275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102950275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102950275) - DecompressionTime: 3s212ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 713.05 MB (747687008) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.097ms - RowBatchQueuePutWaitTime: 3m39s - RowsRead: 124.58M (124581250) - RowsReturned: 67.15M (67148043) - RowsReturnedRate: 54.69 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.46K (9465) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 12s027ms - ScannerThreadsSysTime: 759.878ms - ScannerThreadsUserTime: 15s695ms - ScannerThreadsVoluntaryContextSwitches: 66.35K (66351) - TotalRawHdfsReadTime(*): 641.275ms - TotalReadThroughput: 42.07 MB/sec Filter 1 (16.00 MB): - Rows processed: 341.03K (341032) - Rows rejected: 3.07K (3066) - Rows total: 124.58M (124581250) Instance 854183ec25551621:a (host=vb0208.halxg.cloudera.com:22000):(Total: 98.358ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 2:2/506.77 MB 5:2/506.81 MB 6:4/1013.59 MB 7:2/479.24 MB 9:1/253.40 MB 10:2/440.61 MB 0:4/1013.59 MB Filter 1 arrival: 4s615ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 750.17 MB, 751.02 MB, 751.02 MB, 751.02 MB, 751.02 MB, 751.02 MB, 751.02 MB, 767.02 MB, 768.77 MB, 768.94 MB, 769.43 MB, 769.11 MB, 769.22 MB, 769.12 MB, 673.56 MB, 674.18 MB, 673.90 MB, 673.46 MB, 673.93 MB, 673.97 MB, 642.17 MB, 578.16 MB, 578.35 MB, 578.40 MB, 578.61 MB, 578.69 MB, 570.45 MB, 490.67 MB, 514.29 MB, 434.81 MB, 363.57 MB, 347.35 MB, 348.03 MB, 370.22 MB, 313.58 MB, 339.33 MB, 404.18 MB, 404.39 MB, 396.25 MB, 356.67 MB, 356.58 MB, 348.23 MB, 308.39 MB, 300.75 MB, 292.80 MB, 252.79 MB, 174.35 MB, 149.56 MB, 103.23 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 5 - AverageThreadTokens: 11.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.77K (12766) - PeakMemoryUsage: 770.10 MB (807503679) - PerHostPeakMemUsage: 1.58 GB (1696780208) - RowsProduced: 65.76M (65760637) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s644ms - TotalStorageWaitTime: 726.323ms - TotalWallClockTime: 4m46s - SysTime: 2s472ms - UserTime: 41s601ms - VoluntaryContextSwitches: 65.29K (65286) Fragment Instance Lifecycle Timings: - ExecTime: 25s291ms - ExecTreeExecTime: 1s312ms - OpenTime: 65.228ms - ExecTreeOpenTime: 48.208us - PrepareTime: 33.084ms - ExecTreePrepareTime: 283.736us DataStreamSender (dst_id=7):(Total: 14s963ms, non-child: 14s963ms, % non-child: 100.00%) - BytesSent: 1.49 GB (1595967263) - NetworkThroughput(*): 465.89 MB/sec - OverallThroughput: 101.71 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 65.76M (65760637) - SerializeBatchTime: 11s675ms - TransmitDataRPCTime: 3s266ms - UncompressedRowBatchSize: 3.37 GB (3617494319) CodeGen:(Total: 91.746ms, non-child: 91.746ms, % non-child: 100.00%) - CodegenTime: 1.730ms - CompileTime: 17.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.209ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.819ms HDFS_SCAN_NODE (id=2):(Total: 1s273ms, non-child: 1s273ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 2:2/506.77 MB 5:2/506.81 MB 6:4/1013.59 MB 7:2/479.24 MB 9:1/253.40 MB 10:2/440.61 MB 0:4/1013.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 679.68 MB, 738.12 MB, 738.12 MB, 738.12 MB, 738.12 MB, 738.12 MB, 796.56 MB, 796.56 MB, 854.99 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB - FooterProcessingTime: (Avg: 3.419ms ; Min: 2.221ms ; Max: 5.337ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.16 - BytesRead: 1.01 GB (1080355072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 GB (1080355072) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 GB (1080355072) - DecompressionTime: 4s705ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 753.63 MB (790238376) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.982ms - RowBatchQueuePutWaitTime: 3m48s - RowsRead: 122.02M (122016885) - RowsReturned: 65.76M (65760637) - RowsReturnedRate: 51.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.56K (10564) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 16s786ms - ScannerThreadsSysTime: 1s212ms - ScannerThreadsUserTime: 22s062ms - ScannerThreadsVoluntaryContextSwitches: 65.01K (65012) - TotalRawHdfsReadTime(*): 824.765ms - TotalReadThroughput: 40.40 MB/sec Filter 1 (16.00 MB): - Rows processed: 398.19K (398195) - Rows rejected: 3.18K (3182) - Rows total: 122.02M (122016885) Instance 854183ec25551621:1 (host=vb0230.halxg.cloudera.com:22000):(Total: 95.005ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 9:1/253.39 MB 6:2/506.80 MB 3:1/7.47 MB 5:2/506.78 MB 0:2/506.78 MB 7:2/260.78 MB 2:2/506.80 MB 8:4/1013.57 MB 4:2/506.81 MB Filter 1 arrival: 4s535ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 186.62 MB, 716.47 MB, 716.47 MB, 716.47 MB, 716.47 MB, 716.47 MB, 716.47 MB, 732.47 MB, 732.25 MB, 791.98 MB, 792.36 MB, 792.46 MB, 792.07 MB, 791.95 MB, 704.52 MB, 697.22 MB, 697.31 MB, 696.81 MB, 696.79 MB, 696.96 MB, 617.21 MB, 601.73 MB, 601.42 MB, 601.55 MB, 601.36 MB, 601.56 MB, 593.45 MB, 513.34 MB, 433.57 MB, 385.79 MB, 314.56 MB, 314.47 MB, 314.61 MB, 227.14 MB, 219.03 MB, 364.13 MB, 348.61 MB, 348.51 MB, 308.98 MB, 309.20 MB, 269.18 MB, 269.25 MB, 269.26 MB, 229.22 MB, 149.72 MB, 149.63 MB, 109.48 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.06 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.31K (8312) - PeakMemoryUsage: 793.10 MB (831621943) - PerHostPeakMemUsage: 1.59 GB (1709741976) - RowsProduced: 63.62M (63621251) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s650ms - TotalStorageWaitTime: 626.869ms - TotalWallClockTime: 4m29s - SysTime: 1s414ms - UserTime: 31s816ms - VoluntaryContextSwitches: 63.14K (63142) Fragment Instance Lifecycle Timings: - ExecTime: 24s032ms - ExecTreeExecTime: 1s207ms - OpenTime: 64.331ms - ExecTreeOpenTime: 47.500us - PrepareTime: 30.646ms - ExecTreePrepareTime: 185.500us DataStreamSender (dst_id=7):(Total: 17s209ms, non-child: 17s209ms, % non-child: 100.00%) - BytesSent: 1.44 GB (1543751917) - NetworkThroughput(*): 251.02 MB/sec - OverallThroughput: 85.55 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.62M (63621251) - SerializeBatchTime: 11s324ms - TransmitDataRPCTime: 5s864ms - UncompressedRowBatchSize: 3.26 GB (3499806641) CodeGen:(Total: 87.599ms, non-child: 87.599ms, % non-child: 100.00%) - CodegenTime: 1.534ms - CompileTime: 16.928ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.412ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 23.728ms HDFS_SCAN_NODE (id=2):(Total: 1s175ms, non-child: 1s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 9:1/253.39 MB 6:2/506.80 MB 3:1/7.47 MB 5:2/506.78 MB 0:2/506.78 MB 7:2/260.78 MB 2:2/506.80 MB 8:4/1013.57 MB 4:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 924ms Hdfs Read Thread Concurrency Bucket: 0:97.92% 1:0% 2:0% 3:0% 4:2.083% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(500.000ms): 0, 0, 128.26 MB, 646.63 MB, 646.63 MB, 646.63 MB, 646.63 MB, 646.63 MB, 646.63 MB, 646.63 MB, 646.63 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 705.07 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB - FooterProcessingTime: (Avg: 3.250ms ; Min: 1.807ms ; Max: 5.094ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 997.24 MB (1045686580) - BytesReadDataNodeCache: 0 - BytesReadLocal: 997.24 MB (1045686580) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 997.24 MB (1045686580) - DecompressionTime: 2s873ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.59 MB (814313416) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.534ms - RowBatchQueuePutWaitTime: 3m43s - RowsRead: 118.04M (118040430) - RowsReturned: 63.62M (63621251) - RowsReturnedRate: 54.14 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.33K (6328) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 9s732ms - ScannerThreadsSysTime: 630.898ms - ScannerThreadsUserTime: 13s054ms - ScannerThreadsVoluntaryContextSwitches: 62.81K (62806) - TotalRawHdfsReadTime(*): 746.212ms - TotalReadThroughput: 40.70 MB/sec Filter 1 (16.00 MB): - Rows processed: 441.56K (441556) - Rows rejected: 3.89K (3894) - Rows total: 118.04M (118040430) Averaged Fragment F01:(Total: 110.368ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 138.37 MB completion times: min:2s929ms max:4s172ms mean: 3s526ms stddev:335.592ms execution rates: min:345.59 MB/sec max:385.54 MB/sec mean:364.04 MB/sec stddev:12.59 MB/sec num instances: 15 - AverageThreadTokens: 5.78 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.97K (1974) - PeakMemoryUsage: 377.80 MB (396154544) - PerHostPeakMemUsage: 1.52 GB (1633872201) - RowsProduced: 7.37M (7367283) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.250ms - TotalStorageWaitTime: 167.579ms - TotalWallClockTime: 19s881ms - SysTime: 302.884ms - UserTime: 8s798ms - VoluntaryContextSwitches: 7.15K (7152) Fragment Instance Lifecycle Timings: - ExecTime: 3s414ms - ExecTreeExecTime: 630.753ms - OpenTime: 67.257ms - ExecTreeOpenTime: 54.695us - PrepareTime: 43.072ms - ExecTreePrepareTime: 227.922us DataStreamSender (dst_id=8):(Total: 1s857ms, non-child: 1s857ms, % non-child: 100.00%) - BytesSent: 174.40 MB (182870894) - NetworkThroughput(*): 354.94 MB/sec - OverallThroughput: 94.37 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.37M (7367283) - SerializeBatchTime: 1s339ms - TransmitDataRPCTime: 515.068ms - UncompressedRowBatchSize: 386.50 MB (405274453) CodeGen:(Total: 95.349ms, non-child: 95.349ms, % non-child: 100.00%) - CodegenTime: 1.735ms - CompileTime: 16.698ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 49.591ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.516ms HDFS_SCAN_NODE (id=1):(Total: 625.979ms, non-child: 625.979ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 4.92 - BytesRead: 322.02 MB (337667513) - BytesReadDataNodeCache: 0 - BytesReadLocal: 322.02 MB (337667513) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 322.02 MB (337667513) - DecompressionTime: 1s094ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 373.26 MB (391389132) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.051ms - RowBatchQueuePutWaitTime: 7s973ms - RowsRead: 30.00M (30000000) - RowsReturned: 7.37M (7367283) - RowsReturnedRate: 11.78 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1643) - ScannerThreadsTotalWallClockTime: 16s399ms - MaterializeTupleTime(*): 4s976ms - ScannerThreadsSysTime: 165.105ms - ScannerThreadsUserTime: 6s052ms - ScannerThreadsVoluntaryContextSwitches: 7.08K (7077) - TotalRawHdfsReadTime(*): 217.696ms - TotalReadThroughput: 92.87 MB/sec Filter 0 (4.00 MB): - Rows processed: 30.00M (30000000) - Rows rejected: 14.84M (14836390) - Rows total: 30.00M (30000000) Fragment F01: Instance 854183ec25551621:15 (host=vb0224.halxg.cloudera.com:22000):(Total: 128.893ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/78.16 MB 2:1/253.11 MB 0:1/93.74 MB 8:1/253.09 MB 1:2/506.15 MB Filter 0 arrival: 645ms MemoryUsage(500.000ms): 59.86 KB, 418.80 MB, 419.00 MB, 363.35 MB, 274.17 MB, 249.81 MB, 170.03 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 6, 6, 6 - AverageThreadTokens: 7.14 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.05K (2053) - PeakMemoryUsage: 419.53 MB (439908995) - PerHostPeakMemUsage: 1.58 GB (1699854813) - RowsProduced: 8.24M (8243657) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.941ms - TotalStorageWaitTime: 225.099ms - TotalWallClockTime: 24s551ms - SysTime: 262.957ms - UserTime: 8s766ms - VoluntaryContextSwitches: 8.16K (8160) Fragment Instance Lifecycle Timings: - ExecTime: 3s634ms - ExecTreeExecTime: 599.285ms - OpenTime: 74.684ms - ExecTreeOpenTime: 61.232us - PrepareTime: 54.179ms - ExecTreePrepareTime: 142.744us DataStreamSender (dst_id=8):(Total: 2s149ms, non-child: 2s149ms, % non-child: 100.00%) - BytesSent: 195.27 MB (204751266) - NetworkThroughput(*): 293.58 MB/sec - OverallThroughput: 90.85 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.24M (8243657) - SerializeBatchTime: 1s481ms - TransmitDataRPCTime: 665.130ms - UncompressedRowBatchSize: 432.48 MB (453483811) CodeGen:(Total: 110.414ms, non-child: 110.414ms, % non-child: 100.00%) - CodegenTime: 2.181ms - CompileTime: 15.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 57.852ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 36.139ms HDFS_SCAN_NODE (id=1):(Total: 594.406ms, non-child: 594.406ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/78.16 MB 2:1/253.11 MB 0:1/93.74 MB 8:1/253.09 MB 1:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:28 BytesRead(500.000ms): 0, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB - FooterProcessingTime: (Avg: 3.674ms ; Min: 2.862ms ; Max: 5.486ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.14 - BytesRead: 360.40 MB (377905027) - BytesReadDataNodeCache: 0 - BytesReadLocal: 360.40 MB (377905027) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 360.40 MB (377905027) - DecompressionTime: 1s057ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 415.05 MB (435206932) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.829ms - RowBatchQueuePutWaitTime: 11s894ms - RowsRead: 33.55M (33551637) - RowsReturned: 8.24M (8243657) - RowsReturnedRate: 13.87 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1710) - ScannerThreadsTotalWallClockTime: 20s843ms - MaterializeTupleTime(*): 4s665ms - ScannerThreadsSysTime: 148.974ms - ScannerThreadsUserTime: 5s743ms - ScannerThreadsVoluntaryContextSwitches: 8.09K (8086) - TotalRawHdfsReadTime(*): 246.000ms - TotalReadThroughput: 102.97 MB/sec Filter 0 (4.00 MB): - Rows processed: 33.55M (33551637) - Rows rejected: 16.59M (16588559) - Rows total: 33.55M (33551637) Instance 854183ec25551621:18 (host=vb0208.halxg.cloudera.com:22000):(Total: 126.491ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 8:1/253.09 MB 3:2/506.18 MB 6:1/253.08 MB Filter 0 arrival: 655ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 369.33 MB, 305.50 MB, 258.03 MB, 202.10 MB, 154.32 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.95K (1954) - PeakMemoryUsage: 369.93 MB (387902739) - PerHostPeakMemUsage: 1.49 GB (1598173851) - RowsProduced: 7.25M (7253437) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.742ms - TotalStorageWaitTime: 167.918ms - TotalWallClockTime: 19s315ms - SysTime: 331.947ms - UserTime: 8s624ms - VoluntaryContextSwitches: 6.94K (6940) Fragment Instance Lifecycle Timings: - ExecTime: 3s350ms - ExecTreeExecTime: 621.885ms - OpenTime: 81.660ms - ExecTreeOpenTime: 63.240us - PrepareTime: 44.782ms - ExecTreePrepareTime: 231.216us DataStreamSender (dst_id=8):(Total: 1s748ms, non-child: 1s748ms, % non-child: 100.00%) - BytesSent: 171.66 MB (179998600) - NetworkThroughput(*): 384.89 MB/sec - OverallThroughput: 98.19 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7253437) - SerializeBatchTime: 1s299ms - TransmitDataRPCTime: 445.999ms - UncompressedRowBatchSize: 380.53 MB (399011783) CodeGen:(Total: 116.062ms, non-child: 116.062ms, % non-child: 100.00%) - CodegenTime: 2.201ms - CompileTime: 16.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 63.953ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 34.825ms HDFS_SCAN_NODE (id=1):(Total: 616.432ms, non-child: 616.432ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 8:1/253.09 MB 3:2/506.18 MB 6:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB - FooterProcessingTime: (Avg: 3.695ms ; Min: 3.051ms ; Max: 5.059ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.29 - BytesRead: 317.11 MB (332513220) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.11 MB (332513220) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.11 MB (332513220) - DecompressionTime: 1s128ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.35 MB (383102412) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.109ms - RowBatchQueuePutWaitTime: 7s056ms - RowsRead: 29.55M (29549430) - RowsReturned: 7.25M (7253437) - RowsReturnedRate: 11.77 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1635) - ScannerThreadsTotalWallClockTime: 15s883ms - MaterializeTupleTime(*): 4s854ms - ScannerThreadsSysTime: 213.965ms - ScannerThreadsUserTime: 5s894ms - ScannerThreadsVoluntaryContextSwitches: 6.87K (6872) - TotalRawHdfsReadTime(*): 213.687ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29549430) - Rows rejected: 14.62M (14617454) - Rows total: 29.55M (29549430) Instance 854183ec25551621:14 (host=vb0214.halxg.cloudera.com:22000):(Total: 116.907ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 10:1/253.10 MB 8:1/253.08 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Filter 0 arrival: 650ms MemoryUsage(500.000ms): 59.86 KB, 407.39 MB, 407.46 MB, 311.96 MB, 250.45 MB, 225.95 MB, 161.90 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 6, 6, 6 - AverageThreadTokens: 6.57 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.18K (2177) - PeakMemoryUsage: 408.03 MB (427854207) - PerHostPeakMemUsage: 1.56 GB (1670112472) - RowsProduced: 7.99M (7994104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.875ms - TotalStorageWaitTime: 194.871ms - TotalWallClockTime: 23s105ms - SysTime: 442.930ms - UserTime: 9s702ms - VoluntaryContextSwitches: 7.76K (7759) Fragment Instance Lifecycle Timings: - ExecTime: 3s668ms - ExecTreeExecTime: 627.298ms - OpenTime: 66.881ms - ExecTreeOpenTime: 53.430us - PrepareTime: 49.982ms - ExecTreePrepareTime: 191.796us DataStreamSender (dst_id=8):(Total: 1s864ms, non-child: 1s864ms, % non-child: 100.00%) - BytesSent: 189.24 MB (198435724) - NetworkThroughput(*): 438.83 MB/sec - OverallThroughput: 101.50 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.99M (7994104) - SerializeBatchTime: 1s430ms - TransmitDataRPCTime: 431.241ms - UncompressedRowBatchSize: 419.38 MB (439755892) CodeGen:(Total: 92.483ms, non-child: 92.483ms, % non-child: 100.00%) - CodegenTime: 1.551ms - CompileTime: 18.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.674ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.921ms HDFS_SCAN_NODE (id=1):(Total: 621.668ms, non-child: 621.668ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 10:1/253.10 MB 8:1/253.08 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB - FooterProcessingTime: (Avg: 3.639ms ; Min: 3.199ms ; Max: 4.175ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.57 - BytesRead: 349.51 MB (366484495) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.51 MB (366484495) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.51 MB (366484495) - DecompressionTime: 1s274ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 403.47 MB (423070216) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.161ms - RowBatchQueuePutWaitTime: 9s716ms - RowsRead: 32.56M (32556938) - RowsReturned: 7.99M (7994104) - RowsReturnedRate: 12.86 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1806) - ScannerThreadsTotalWallClockTime: 19s369ms - MaterializeTupleTime(*): 5s543ms - ScannerThreadsSysTime: 222.963ms - ScannerThreadsUserTime: 6s777ms - ScannerThreadsVoluntaryContextSwitches: 7.68K (7678) - TotalRawHdfsReadTime(*): 277.186ms - TotalReadThroughput: 99.86 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.56M (32556938) - Rows rejected: 16.10M (16099787) - Rows total: 32.56M (32556938) Instance 854183ec25551621:17 (host=vb0232.halxg.cloudera.com:22000):(Total: 113.724ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 2:1/129.89 MB 3:2/506.17 MB 6:1/253.09 MB Filter 0 arrival: 643ms MemoryUsage(500.000ms): 59.86 KB, 407.69 MB, 407.99 MB, 360.30 MB, 296.50 MB, 249.84 MB, 169.81 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.62K (2622) - PeakMemoryUsage: 408.60 MB (428448207) - PerHostPeakMemUsage: 1.58 GB (1697750111) - RowsProduced: 8.00M (7996520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.395ms - TotalStorageWaitTime: 193.889ms - TotalWallClockTime: 22s786ms - SysTime: 392.937ms - UserTime: 9s394ms - VoluntaryContextSwitches: 7.72K (7725) Fragment Instance Lifecycle Timings: - ExecTime: 3s634ms - ExecTreeExecTime: 617.832ms - OpenTime: 68.054ms - ExecTreeOpenTime: 56.092us - PrepareTime: 45.639ms - ExecTreePrepareTime: 101.708us DataStreamSender (dst_id=8):(Total: 1s940ms, non-child: 1s940ms, % non-child: 100.00%) - BytesSent: 189.28 MB (198473095) - NetworkThroughput(*): 388.91 MB/sec - OverallThroughput: 97.56 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.00M (7996520) - SerializeBatchTime: 1s449ms - TransmitDataRPCTime: 486.686ms - UncompressedRowBatchSize: 419.51 MB (439888796) CodeGen:(Total: 95.201ms, non-child: 95.201ms, % non-child: 100.00%) - CodegenTime: 1.973ms - CompileTime: 17.316ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 49.659ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.687ms HDFS_SCAN_NODE (id=1):(Total: 611.846ms, non-child: 611.846ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 2:1/129.89 MB 3:2/506.17 MB 6:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 541ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB - FooterProcessingTime: (Avg: 3.600ms ; Min: 2.710ms ; Max: 5.040ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.71 - BytesRead: 349.72 MB (366706943) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.72 MB (366706943) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.72 MB (366706943) - DecompressionTime: 1s155ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 404.00 MB (423624272) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.581ms - RowBatchQueuePutWaitTime: 9s702ms - RowsRead: 32.58M (32577610) - RowsReturned: 8.00M (7996520) - RowsReturnedRate: 13.07 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.20K (2204) - ScannerThreadsTotalWallClockTime: 19s083ms - MaterializeTupleTime(*): 5s428ms - ScannerThreadsSysTime: 221.963ms - ScannerThreadsUserTime: 6s454ms - ScannerThreadsVoluntaryContextSwitches: 7.64K (7644) - TotalRawHdfsReadTime(*): 220.031ms - TotalReadThroughput: 99.92 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.58M (32577610) - Rows rejected: 16.12M (16119523) - Rows total: 32.58M (32577610) Instance 854183ec25551621:11 (host=vb0216.halxg.cloudera.com:22000):(Total: 113.395ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.13 MB 7:1/253.09 MB 3:1/114.22 MB 5:1/253.08 MB Filter 0 arrival: 643ms MemoryUsage(500.000ms): 59.86 KB, 336.50 MB, 320.78 MB, 256.84 MB, 207.47 MB, 143.94 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.67 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.47K (1472) - PeakMemoryUsage: 337.11 MB (353489211) - PerHostPeakMemUsage: 1.48 GB (1586196040) - RowsProduced: 6.46M (6462494) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.534ms - TotalStorageWaitTime: 133.835ms - TotalWallClockTime: 16s207ms - SysTime: 235.963ms - UserTime: 7s288ms - VoluntaryContextSwitches: 6.28K (6278) Fragment Instance Lifecycle Timings: - ExecTime: 3s068ms - ExecTreeExecTime: 612.349ms - OpenTime: 67.180ms - ExecTreeOpenTime: 58.052us - PrepareTime: 46.176ms - ExecTreePrepareTime: 180.164us DataStreamSender (dst_id=8):(Total: 1s824ms, non-child: 1s824ms, % non-child: 100.00%) - BytesSent: 152.94 MB (160364123) - NetworkThroughput(*): 250.50 MB/sec - OverallThroughput: 83.84 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.46M (6462494) - SerializeBatchTime: 1s210ms - TransmitDataRPCTime: 610.512ms - UncompressedRowBatchSize: 339.03 MB (355501994) CodeGen:(Total: 93.832ms, non-child: 93.832ms, % non-child: 100.00%) - CodegenTime: 1.578ms - CompileTime: 18.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.526ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.020ms HDFS_SCAN_NODE (id=1):(Total: 608.442ms, non-child: 608.442ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.13 MB 7:1/253.09 MB 3:1/114.22 MB 5:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB - FooterProcessingTime: (Avg: 3.566ms ; Min: 3.273ms ; Max: 3.731ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.67 - BytesRead: 282.41 MB (296127991) - BytesReadDataNodeCache: 0 - BytesReadLocal: 282.41 MB (296127991) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 282.41 MB (296127991) - DecompressionTime: 846.869ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 332.64 MB (348798396) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.651ms - RowBatchQueuePutWaitTime: 5s936ms - RowsRead: 26.30M (26303132) - RowsReturned: 6.46M (6462494) - RowsReturnedRate: 10.62 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1202) - ScannerThreadsTotalWallClockTime: 13s071ms - MaterializeTupleTime(*): 4s009ms - ScannerThreadsSysTime: 138.977ms - ScannerThreadsUserTime: 4s834ms - ScannerThreadsVoluntaryContextSwitches: 6.21K (6206) - TotalRawHdfsReadTime(*): 209.430ms - TotalReadThroughput: 94.14 MB/sec Filter 0 (4.00 MB): - Rows processed: 26.30M (26303132) - Rows rejected: 13.01M (13005478) - Rows total: 26.30M (26303132) Instance 854183ec25551621:1d (host=vb0228.halxg.cloudera.com:22000):(Total: 110.603ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/144.90 MB 8:2/506.14 MB 4:1/253.09 MB 1:2/506.18 MB Filter 0 arrival: 668ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 415.06 MB, 367.34 MB, 319.69 MB, 249.49 MB, 170.00 MB, 27.99 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 6, 6, 1 - AverageThreadTokens: 5.25 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.19K (2189) - PeakMemoryUsage: 415.47 MB (435649983) - PerHostPeakMemUsage: 1.58 GB (1697466173) - RowsProduced: 8.09M (8085997) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.232ms - TotalStorageWaitTime: 192.869ms - TotalWallClockTime: 22s456ms - SysTime: 354.943ms - UserTime: 11s126ms - VoluntaryContextSwitches: 7.93K (7934) Fragment Instance Lifecycle Timings: - ExecTime: 3s545ms - ExecTreeExecTime: 642.588ms - OpenTime: 63.738ms - ExecTreeOpenTime: 48.720us - PrepareTime: 46.812ms - ExecTreePrepareTime: 201.944us DataStreamSender (dst_id=8):(Total: 1s836ms, non-child: 1s836ms, % non-child: 100.00%) - BytesSent: 191.50 MB (200802459) - NetworkThroughput(*): 424.16 MB/sec - OverallThroughput: 104.28 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.09M (8085997) - SerializeBatchTime: 1s382ms - TransmitDataRPCTime: 451.477ms - UncompressedRowBatchSize: 424.20 MB (444810931) CodeGen:(Total: 89.874ms, non-child: 89.874ms, % non-child: 100.00%) - CodegenTime: 1.641ms - CompileTime: 15.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.944ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.516ms HDFS_SCAN_NODE (id=1):(Total: 638.084ms, non-child: 638.084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/144.90 MB 8:2/506.14 MB 4:1/253.09 MB 1:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 0, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB - FooterProcessingTime: (Avg: 3.861ms ; Min: 3.157ms ; Max: 5.253ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.25 - BytesRead: 353.47 MB (370644173) - BytesReadDataNodeCache: 0 - BytesReadLocal: 353.47 MB (370644173) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 353.47 MB (370644173) - DecompressionTime: 1s558ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 411.00 MB (430964304) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.812ms - RowBatchQueuePutWaitTime: 7s797ms - RowsRead: 32.93M (32927525) - RowsReturned: 8.09M (8085997) - RowsReturnedRate: 12.67 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.86K (1863) - ScannerThreadsTotalWallClockTime: 18s847ms - MaterializeTupleTime(*): 6s705ms - ScannerThreadsSysTime: 196.967ms - ScannerThreadsUserTime: 8s275ms - ScannerThreadsVoluntaryContextSwitches: 7.85K (7852) - TotalRawHdfsReadTime(*): 207.818ms - TotalReadThroughput: 88.37 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.93M (32927525) - Rows rejected: 16.28M (16283549) - Rows total: 32.93M (32927525) Instance 854183ec25551621:12 (host=vb0220.halxg.cloudera.com:22000):(Total: 109.686ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 9:1/253.07 MB 4:2/506.17 MB 0:1/253.08 MB 2:1/141.46 MB Filter 0 arrival: 629ms MemoryUsage(500.000ms): 59.86 KB, 415.14 MB, 414.72 MB, 319.63 MB, 271.83 MB, 242.14 MB, 170.06 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.95K (2954) - PeakMemoryUsage: 415.54 MB (435727783) - PerHostPeakMemUsage: 1.58 GB (1697919771) - RowsProduced: 8.07M (8065631) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.476ms - TotalStorageWaitTime: 190.978ms - TotalWallClockTime: 23s907ms - SysTime: 313.949ms - UserTime: 10s685ms - VoluntaryContextSwitches: 7.89K (7888) Fragment Instance Lifecycle Timings: - ExecTime: 3s821ms - ExecTreeExecTime: 614.463ms - OpenTime: 67.453ms - ExecTreeOpenTime: 48.352us - PrepareTime: 42.195ms - ExecTreePrepareTime: 1.129ms DataStreamSender (dst_id=8):(Total: 1s922ms, non-child: 1s922ms, % non-child: 100.00%) - BytesSent: 190.96 MB (200236923) - NetworkThroughput(*): 440.00 MB/sec - OverallThroughput: 99.32 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.07M (8065631) - SerializeBatchTime: 1s485ms - TransmitDataRPCTime: 434.003ms - UncompressedRowBatchSize: 423.14 MB (443690601) CodeGen:(Total: 97.271ms, non-child: 97.271ms, % non-child: 100.00%) - CodegenTime: 1.675ms - CompileTime: 17.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 49.131ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 30.153ms HDFS_SCAN_NODE (id=1):(Total: 610.370ms, non-child: 610.370ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 9:1/253.07 MB 4:2/506.17 MB 0:1/253.08 MB 2:1/141.46 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB - FooterProcessingTime: (Avg: 3.195ms ; Min: 2.676ms ; Max: 4.612ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.71 - BytesRead: 352.61 MB (369737350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 352.61 MB (369737350) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 352.61 MB (369737350) - DecompressionTime: 1s370ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 411.01 MB (430976568) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.458ms - RowBatchQueuePutWaitTime: 10s107ms - RowsRead: 32.85M (32847511) - RowsReturned: 8.07M (8065631) - RowsReturnedRate: 13.21 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.57K (2570) - ScannerThreadsTotalWallClockTime: 20s018ms - MaterializeTupleTime(*): 6s168ms - ScannerThreadsSysTime: 190.967ms - ScannerThreadsUserTime: 7s494ms - ScannerThreadsVoluntaryContextSwitches: 7.82K (7817) - TotalRawHdfsReadTime(*): 243.766ms - TotalReadThroughput: 100.75 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.85M (32847511) - Rows rejected: 16.25M (16247271) - Rows total: 32.85M (32847511) Instance 854183ec25551621:1b (host=vb0218.halxg.cloudera.com:22000):(Total: 108.398ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Filter 0 arrival: 666ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 368.99 MB, 329.34 MB, 258.35 MB, 218.24 MB, 138.69 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.67K (1670) - PeakMemoryUsage: 369.94 MB (387910931) - PerHostPeakMemUsage: 1.51 GB (1622024758) - RowsProduced: 7.26M (7259174) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.286ms - TotalStorageWaitTime: 124.696ms - TotalWallClockTime: 18s401ms - SysTime: 207.965ms - UserTime: 7s387ms - VoluntaryContextSwitches: 7.08K (7080) Fragment Instance Lifecycle Timings: - ExecTime: 3s187ms - ExecTreeExecTime: 627.261ms - OpenTime: 63.164ms - ExecTreeOpenTime: 60.632us - PrepareTime: 45.192ms - ExecTreePrepareTime: 189.972us DataStreamSender (dst_id=8):(Total: 1s940ms, non-child: 1s940ms, % non-child: 100.00%) - BytesSent: 171.82 MB (180166640) - NetworkThroughput(*): 265.38 MB/sec - OverallThroughput: 88.56 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.26M (7259174) - SerializeBatchTime: 1s290ms - TransmitDataRPCTime: 647.445ms - UncompressedRowBatchSize: 380.83 MB (399327370) CodeGen:(Total: 92.887ms, non-child: 92.887ms, % non-child: 100.00%) - CodegenTime: 1.597ms - CompileTime: 14.862ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.413ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 30.084ms HDFS_SCAN_NODE (id=1):(Total: 623.112ms, non-child: 623.112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB - FooterProcessingTime: (Avg: 3.484ms ; Min: 3.030ms ; Max: 3.964ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.11 MB (332515761) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.11 MB (332515761) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.11 MB (332515761) - DecompressionTime: 910.340ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.35 MB (383094220) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.070ms - RowBatchQueuePutWaitTime: 7s685ms - RowsRead: 29.55M (29549877) - RowsReturned: 7.26M (7259174) - RowsReturnedRate: 11.65 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1387) - ScannerThreadsTotalWallClockTime: 15s150ms - MaterializeTupleTime(*): 3s888ms - ScannerThreadsSysTime: 113.980ms - ScannerThreadsUserTime: 4s834ms - ScannerThreadsVoluntaryContextSwitches: 7.00K (6998) - TotalRawHdfsReadTime(*): 215.261ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29549877) - Rows rejected: 14.61M (14608642) - Rows total: 29.55M (29549877) Instance 854183ec25551621:1a (host=vb0204.halxg.cloudera.com:22000):(Total: 108.345ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.07 MB 1:1/253.10 MB 8:1/253.08 MB 7:2/506.14 MB Filter 0 arrival: 657ms MemoryUsage(500.000ms): 59.86 KB, 369.04 MB, 329.38 MB, 289.68 MB, 249.78 MB, 170.27 MB, 130.53 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.87K (1870) - PeakMemoryUsage: 369.98 MB (387954971) - PerHostPeakMemUsage: 1.48 GB (1585451909) - RowsProduced: 7.25M (7254572) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.653ms - TotalStorageWaitTime: 131.821ms - TotalWallClockTime: 20s161ms - SysTime: 238.961ms - UserTime: 8s906ms - VoluntaryContextSwitches: 7.04K (7044) Fragment Instance Lifecycle Timings: - ExecTime: 3s533ms - ExecTreeExecTime: 630.069ms - OpenTime: 68.432ms - ExecTreeOpenTime: 53.504us - PrepareTime: 39.882ms - ExecTreePrepareTime: 182.846us DataStreamSender (dst_id=8):(Total: 2s026ms, non-child: 2s026ms, % non-child: 100.00%) - BytesSent: 171.71 MB (180045928) - NetworkThroughput(*): 273.09 MB/sec - OverallThroughput: 84.72 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7254572) - SerializeBatchTime: 1s395ms - TransmitDataRPCTime: 628.757ms - UncompressedRowBatchSize: 380.59 MB (399074216) CodeGen:(Total: 101.464ms, non-child: 101.464ms, % non-child: 100.00%) - CodegenTime: 2.363ms - CompileTime: 15.113ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 51.610ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 34.053ms HDFS_SCAN_NODE (id=1):(Total: 625.478ms, non-child: 625.478ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.07 MB 1:1/253.10 MB 8:1/253.08 MB 7:2/506.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB - FooterProcessingTime: (Avg: 2.926ms ; Min: 2.135ms ; Max: 4.020ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.09 MB (332490978) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.09 MB (332490978) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.09 MB (332490978) - DecompressionTime: 955.845ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.45 MB (383205796) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.788ms - RowBatchQueuePutWaitTime: 8s189ms - RowsRead: 29.55M (29547112) - RowsReturned: 7.25M (7254572) - RowsReturnedRate: 11.60 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.56K (1556) - ScannerThreadsTotalWallClockTime: 16s559ms - MaterializeTupleTime(*): 5s038ms - ScannerThreadsSysTime: 113.980ms - ScannerThreadsUserTime: 6s030ms - ScannerThreadsVoluntaryContextSwitches: 6.97K (6968) - TotalRawHdfsReadTime(*): 193.059ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29547112) - Rows rejected: 14.61M (14612646) - Rows total: 29.55M (29547112) Instance 854183ec25551621:16 (host=vb0222.halxg.cloudera.com:22000):(Total: 107.001ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 10:1/253.10 MB Filter 0 arrival: 644ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 340.58 MB, 284.83 MB, 207.49 MB, 143.71 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 5, 5 - AverageThreadTokens: 4.83 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.32K (1325) - PeakMemoryUsage: 341.31 MB (357892379) - PerHostPeakMemUsage: 1.48 GB (1583999421) - RowsProduced: 6.52M (6516139) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.735ms - TotalStorageWaitTime: 181.252ms - TotalWallClockTime: 15s435ms - SysTime: 195.967ms - UserTime: 6s743ms - VoluntaryContextSwitches: 6.30K (6304) Fragment Instance Lifecycle Timings: - ExecTime: 2s944ms - ExecTreeExecTime: 610.265ms - OpenTime: 64.263ms - ExecTreeOpenTime: 59.180us - PrepareTime: 42.712ms - ExecTreePrepareTime: 107.088us DataStreamSender (dst_id=8):(Total: 1s658ms, non-child: 1s658ms, % non-child: 100.00%) - BytesSent: 154.23 MB (161724955) - NetworkThroughput(*): 303.49 MB/sec - OverallThroughput: 92.99 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.52M (6516139) - SerializeBatchTime: 1s148ms - TransmitDataRPCTime: 508.195ms - UncompressedRowBatchSize: 341.85 MB (358453005) CodeGen:(Total: 89.403ms, non-child: 89.403ms, % non-child: 100.00%) - CodegenTime: 1.501ms - CompileTime: 15.946ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.369ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.565ms HDFS_SCAN_NODE (id=1):(Total: 606.763ms, non-child: 606.763ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 10:1/253.10 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 284.77 MB, 284.77 MB, 284.77 MB, 284.77 MB - FooterProcessingTime: (Avg: 4.542ms ; Min: 3.541ms ; Max: 7.128ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.83 - BytesRead: 284.77 MB (298605909) - BytesReadDataNodeCache: 0 - BytesReadLocal: 284.77 MB (298605909) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 284.77 MB (298605909) - DecompressionTime: 794.535ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 336.70 MB (353059284) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.839ms - RowBatchQueuePutWaitTime: 5s962ms - RowsRead: 26.52M (26524501) - RowsReturned: 6.52M (6516139) - RowsReturnedRate: 10.74 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.07K (1071) - ScannerThreadsTotalWallClockTime: 12s426ms - MaterializeTupleTime(*): 3s599ms - ScannerThreadsSysTime: 105.981ms - ScannerThreadsUserTime: 4s411ms - ScannerThreadsVoluntaryContextSwitches: 6.23K (6234) - TotalRawHdfsReadTime(*): 194.651ms - TotalReadThroughput: 94.92 MB/sec Filter 0 (4.00 MB): - Rows processed: 26.52M (26524501) - Rows rejected: 13.12M (13115129) - Rows total: 26.52M (26524501) Instance 854183ec25551621:13 (host=vb0226.halxg.cloudera.com:22000):(Total: 106.738ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.09 MB 6:1/253.08 MB 3:2/506.18 MB Filter 0 arrival: 653ms MemoryUsage(500.000ms): 59.86 KB, 147.00 MB, 300.76 MB, 237.24 MB, 189.39 MB, 125.33 MB ThreadUsage(500.000ms): 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.39K (1385) - PeakMemoryUsage: 301.19 MB (315821159) - PerHostPeakMemUsage: 1.42 GB (1522073978) - RowsProduced: 5.80M (5801549) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.068ms - TotalStorageWaitTime: 142.325ms - TotalWallClockTime: 13s587ms - SysTime: 239.961ms - UserTime: 6s840ms - VoluntaryContextSwitches: 5.59K (5591) Fragment Instance Lifecycle Timings: - ExecTime: 2s821ms - ExecTreeExecTime: 639.489ms - OpenTime: 65.310ms - ExecTreeOpenTime: 42.492us - PrepareTime: 41.385ms - ExecTreePrepareTime: 156.496us DataStreamSender (dst_id=8):(Total: 1s351ms, non-child: 1s351ms, % non-child: 100.00%) - BytesSent: 137.29 MB (143954466) - NetworkThroughput(*): 443.46 MB/sec - OverallThroughput: 101.60 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 5.80M (5801549) - SerializeBatchTime: 1s039ms - TransmitDataRPCTime: 309.578ms - UncompressedRowBatchSize: 304.36 MB (319143379) CodeGen:(Total: 93.252ms, non-child: 93.252ms, % non-child: 100.00%) - CodegenTime: 1.556ms - CompileTime: 16.696ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.850ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.230ms HDFS_SCAN_NODE (id=1):(Total: 634.859ms, non-child: 634.859ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.09 MB 6:1/253.08 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:0% 2:16.67% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 113.35 MB, 253.67 MB, 253.67 MB, 253.67 MB, 253.67 MB - FooterProcessingTime: (Avg: 4.136ms ; Min: 3.176ms ; Max: 5.969ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 253.67 MB (265995099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.67 MB (265995099) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.67 MB (265995099) - DecompressionTime: 838.962ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 296.70 MB (311116024) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.239ms - RowBatchQueuePutWaitTime: 3s735ms - RowsRead: 23.64M (23638435) - RowsReturned: 5.80M (5801549) - RowsReturnedRate: 9.14 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.11K (1112) - ScannerThreadsTotalWallClockTime: 10s700ms - MaterializeTupleTime(*): 3s861ms - ScannerThreadsSysTime: 159.973ms - ScannerThreadsUserTime: 4s642ms - ScannerThreadsVoluntaryContextSwitches: 5.53K (5525) - TotalRawHdfsReadTime(*): 172.643ms - TotalReadThroughput: 84.56 MB/sec Filter 0 (4.00 MB): - Rows processed: 23.64M (23638435) - Rows rejected: 11.69M (11692207) - Rows total: 23.64M (23638435) Instance 854183ec25551621:19 (host=vb0206.halxg.cloudera.com:22000):(Total: 106.695ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 6:1/253.08 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Filter 0 arrival: 661ms MemoryUsage(500.000ms): 46.76 KB, 59.86 KB, 369.30 MB, 329.44 MB, 273.81 MB, 241.73 MB, 169.91 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.03K (2031) - PeakMemoryUsage: 369.94 MB (387909915) - PerHostPeakMemUsage: 1.52 GB (1630608365) - RowsProduced: 7.25M (7254751) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.083ms - TotalStorageWaitTime: 128.001ms - TotalWallClockTime: 18s987ms - SysTime: 444.930ms - UserTime: 9s883ms - VoluntaryContextSwitches: 6.92K (6920) Fragment Instance Lifecycle Timings: - ExecTime: 3s398ms - ExecTreeExecTime: 641.558ms - OpenTime: 67.883ms - ExecTreeOpenTime: 65.300us - PrepareTime: 38.787ms - ExecTreePrepareTime: 101.952us DataStreamSender (dst_id=8):(Total: 1s714ms, non-child: 1s714ms, % non-child: 100.00%) - BytesSent: 171.72 MB (180056735) - NetworkThroughput(*): 420.34 MB/sec - OverallThroughput: 100.17 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7254751) - SerializeBatchTime: 1s302ms - TransmitDataRPCTime: 408.515ms - UncompressedRowBatchSize: 380.60 MB (399084065) CodeGen:(Total: 93.139ms, non-child: 93.139ms, % non-child: 100.00%) - CodegenTime: 1.602ms - CompileTime: 18.667ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.355ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.625ms HDFS_SCAN_NODE (id=1):(Total: 636.403ms, non-child: 636.403ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 6:1/253.08 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB - FooterProcessingTime: (Avg: 2.932ms ; Min: 2.429ms ; Max: 3.145ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.10 MB (332501203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.10 MB (332501203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.10 MB (332501203) - DecompressionTime: 1s298ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.33 MB (383079844) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.919ms - RowBatchQueuePutWaitTime: 5s776ms - RowsRead: 29.55M (29548399) - RowsReturned: 7.25M (7254751) - RowsReturnedRate: 11.40 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1635) - ScannerThreadsTotalWallClockTime: 15s521ms - MaterializeTupleTime(*): 6s032ms - ScannerThreadsSysTime: 188.969ms - ScannerThreadsUserTime: 7s284ms - ScannerThreadsVoluntaryContextSwitches: 6.85K (6847) - TotalRawHdfsReadTime(*): 218.941ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29548399) - Rows rejected: 14.61M (14614391) - Rows total: 29.55M (29548399) Instance 854183ec25551621:10 (host=vb0212.halxg.cloudera.com:22000):(Total: 105.393ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:2/506.17 MB Filter 0 arrival: 649ms MemoryUsage(500.000ms): 59.86 KB, 44.77 MB, 369.29 MB, 329.38 MB, 249.80 MB, 241.84 MB, 170.45 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.95K (1954) - PeakMemoryUsage: 369.98 MB (387952923) - PerHostPeakMemUsage: 1.53 GB (1646972693) - RowsProduced: 7.26M (7255948) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.789ms - TotalStorageWaitTime: 174.528ms - TotalWallClockTime: 17s651ms - SysTime: 324.949ms - UserTime: 9s648ms - VoluntaryContextSwitches: 6.88K (6882) Fragment Instance Lifecycle Timings: - ExecTime: 3s490ms - ExecTreeExecTime: 644.373ms - OpenTime: 63.322ms - ExecTreeOpenTime: 36.842us - PrepareTime: 42.027ms - ExecTreePrepareTime: 193.323us DataStreamSender (dst_id=8):(Total: 1s676ms, non-child: 1s676ms, % non-child: 100.00%) - BytesSent: 171.75 MB (180088954) - NetworkThroughput(*): 460.96 MB/sec - OverallThroughput: 102.44 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.26M (7255948) - SerializeBatchTime: 1s301ms - TransmitDataRPCTime: 372.586ms - UncompressedRowBatchSize: 380.66 MB (399149916) CodeGen:(Total: 91.114ms, non-child: 91.114ms, % non-child: 100.00%) - CodegenTime: 1.542ms - CompileTime: 15.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.742ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.158ms HDFS_SCAN_NODE (id=1):(Total: 639.237ms, non-child: 639.237ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:2/506.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 24.49 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB - FooterProcessingTime: (Avg: 3.949ms ; Min: 2.984ms ; Max: 5.381ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 4.29 - BytesRead: 317.10 MB (332499940) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.10 MB (332499940) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.10 MB (332499940) - DecompressionTime: 1s249ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.51 MB (383267244) - PerReadThreadRawHdfsThroughput: 1.64 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.692ms - RowBatchQueuePutWaitTime: 6s910ms - RowsRead: 29.55M (29548710) - RowsReturned: 7.26M (7255948) - RowsReturnedRate: 11.35 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.58K (1584) - ScannerThreadsTotalWallClockTime: 14s097ms - MaterializeTupleTime(*): 5s625ms - ScannerThreadsSysTime: 154.975ms - ScannerThreadsUserTime: 6s868ms - ScannerThreadsVoluntaryContextSwitches: 6.81K (6809) - TotalRawHdfsReadTime(*): 189.302ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29548710) - Rows rejected: 14.62M (14615105) - Rows total: 29.55M (29548710) Instance 854183ec25551621:1c (host=vb0234.halxg.cloudera.com:22000):(Total: 102.717ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.08 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Filter 0 arrival: 672ms MemoryUsage(500.000ms): 59.86 KB, 436.02 MB, 435.65 MB, 347.73 MB, 300.41 MB, 292.58 MB, 196.47 MB, 157.58 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 7.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.59K (2586) - PeakMemoryUsage: 436.28 MB (457471439) - PerHostPeakMemUsage: 1.62 GB (1744038224) - RowsProduced: 8.71M (8710542) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.031ms - TotalStorageWaitTime: 160.431ms - TotalWallClockTime: 26s332ms - SysTime: 331.946ms - UserTime: 9s832ms - VoluntaryContextSwitches: 8.56K (8565) Fragment Instance Lifecycle Timings: - ExecTime: 4s068ms - ExecTreeExecTime: 661.462ms - OpenTime: 63.248ms - ExecTreeOpenTime: 56.332us - PrepareTime: 39.419ms - ExecTreePrepareTime: 208.796us DataStreamSender (dst_id=8):(Total: 2s451ms, non-child: 2s451ms, % non-child: 100.00%) - BytesSent: 206.20 MB (216217279) - NetworkThroughput(*): 273.75 MB/sec - OverallThroughput: 84.10 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.71M (8710542) - SerializeBatchTime: 1s695ms - TransmitDataRPCTime: 753.258ms - UncompressedRowBatchSize: 456.97 MB (479167158) CodeGen:(Total: 87.188ms, non-child: 87.188ms, % non-child: 100.00%) - CodegenTime: 1.543ms - CompileTime: 16.340ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 45.974ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.396ms HDFS_SCAN_NODE (id=1):(Total: 655.481ms, non-child: 655.481ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.08 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 582ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB - FooterProcessingTime: (Avg: 3.819ms ; Min: 3.430ms ; Max: 4.201ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 380.51 MB (398991806) - BytesReadDataNodeCache: 0 - BytesReadLocal: 380.51 MB (398991806) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 380.51 MB (398991806) - DecompressionTime: 1s167ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 431.65 MB (452621904) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.188ms - RowBatchQueuePutWaitTime: 13s665ms - RowsRead: 35.46M (35457891) - RowsReturned: 8.71M (8710542) - RowsReturnedRate: 13.29 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 2.19K (2194) - ScannerThreadsTotalWallClockTime: 22s201ms - MaterializeTupleTime(*): 5s276ms - ScannerThreadsSysTime: 183.969ms - ScannerThreadsUserTime: 6s474ms - ScannerThreadsVoluntaryContextSwitches: 8.48K (8482) - TotalRawHdfsReadTime(*): 272.005ms - TotalReadThroughput: 95.13 MB/sec Filter 0 (4.00 MB): - Rows processed: 35.46M (35457891) - Rows rejected: 17.53M (17531363) - Rows total: 35.46M (35457891) Instance 854183ec25551621:1e (host=vb0230.halxg.cloudera.com:22000):(Total: 90.532ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 0:2/348.96 MB 9:1/253.09 MB 2:1/253.08 MB Filter 0 arrival: 674ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 333.59 MB, 293.72 MB, 207.63 MB, 143.90 MB, 93.76 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 5, 5, 4 - AverageThreadTokens: 4.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.37K (1371) - PeakMemoryUsage: 334.19 MB (350423323) - PerHostPeakMemUsage: 1.42 GB (1525440444) - RowsProduced: 6.35M (6354730) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.911ms - TotalStorageWaitTime: 171.171ms - TotalWallClockTime: 15s331ms - SysTime: 222.964ms - UserTime: 7s140ms - VoluntaryContextSwitches: 6.22K (6224) Fragment Instance Lifecycle Timings: - ExecTime: 3s055ms - ExecTreeExecTime: 671.113ms - OpenTime: 63.584ms - ExecTreeOpenTime: 57.028us - PrepareTime: 26.917ms - ExecTreePrepareTime: 99.408us DataStreamSender (dst_id=8):(Total: 1s761ms, non-child: 1s761ms, % non-child: 100.00%) - BytesSent: 150.44 MB (157746272) - NetworkThroughput(*): 262.71 MB/sec - OverallThroughput: 85.39 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.35M (6354730) - SerializeBatchTime: 1s186ms - TransmitDataRPCTime: 572.634ms - UncompressedRowBatchSize: 333.38 MB (349573890) CodeGen:(Total: 86.654ms, non-child: 86.654ms, % non-child: 100.00%) - CodegenTime: 1.519ms - CompileTime: 16.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 45.817ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 23.370ms HDFS_SCAN_NODE (id=1):(Total: 667.105ms, non-child: 667.105ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 0:2/348.96 MB 9:1/253.09 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 602ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 277.80 MB, 277.80 MB, 277.80 MB, 277.80 MB, 277.80 MB - FooterProcessingTime: (Avg: 3.369ms ; Min: 2.612ms ; Max: 5.602ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.33 - BytesRead: 277.80 MB (291292814) - BytesReadDataNodeCache: 0 - BytesReadLocal: 277.80 MB (291292814) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 277.80 MB (291292814) - DecompressionTime: 816.557ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 329.64 MB (345649564) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.429ms - RowBatchQueuePutWaitTime: 5s460ms - RowsRead: 25.87M (25871292) - RowsReturned: 6.35M (6354730) - RowsReturnedRate: 9.53 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.12K (1117) - ScannerThreadsTotalWallClockTime: 12s212ms - MaterializeTupleTime(*): 3s943ms - ScannerThreadsSysTime: 119.979ms - ScannerThreadsUserTime: 4s767ms - ScannerThreadsVoluntaryContextSwitches: 6.14K (6144) - TotalRawHdfsReadTime(*): 191.658ms - TotalReadThroughput: 79.37 MB/sec Filter 0 (4.00 MB): - Rows processed: 25.87M (25871292) - Rows rejected: 12.79M (12794754) - Rows total: 25.87M (25871292) Averaged Fragment F03:(Total: 69.800ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 143.95 MB, max: 396.14 MB, avg: 257.24 MB, stddev: 74.80 MB completion times: min:154.689ms max:385.437ms mean: 249.998ms stddev:61.891ms execution rates: min:871.84 MB/sec max:1.13 GB/sec mean:1017.47 MB/sec stddev:74.98 MB/sec num instances: 14 - AverageThreadTokens: 0.71 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 55 (55) - PeakMemoryUsage: 27.04 MB (28357062) - PerHostPeakMemUsage: 50.20 MB (52642386) - RowsProduced: 642.56K (642562) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.784ms - TotalStorageWaitTime: 11.335ms - TotalWallClockTime: 420.651ms - SysTime: 16.568ms - UserTime: 344.590ms - VoluntaryContextSwitches: 183 (183) Fragment Instance Lifecycle Timings: - ExecTime: 179.047ms - ExecTreeExecTime: 15.821ms - OpenTime: 32.879ms - ExecTreeOpenTime: 53.352us - PrepareTime: 36.875ms - ExecTreePrepareTime: 448.058us DataStreamSender (dst_id=10):(Total: 90.029ms, non-child: 90.029ms, % non-child: 100.00%) - BytesSent: 7.97 MB (8358653) - NetworkThroughput(*): 331.56 MB/sec - OverallThroughput: 89.05 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 642.56K (642562) - SerializeBatchTime: 65.669ms - TransmitDataRPCTime: 24.163ms - UncompressedRowBatchSize: 22.68 MB (23778751) CodeGen:(Total: 57.533ms, non-child: 57.533ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 7.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.489ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.006ms HDFS_SCAN_NODE (id=0):(Total: 16.357ms, non-child: 16.357ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.29 - BytesRead: 13.68 MB (14346276) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.68 MB (14346276) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.68 MB (14346276) - DecompressionTime: 48.973ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 26.56 MB (27854444) - PerReadThreadRawHdfsThroughput: 2.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.090ms - RowBatchQueuePutWaitTime: 29.457ms - RowsRead: 3.21M (3214285) - RowsReturned: 642.56K (642562) - RowsReturnedRate: 40.15 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 27 (27) - ScannerThreadsTotalWallClockTime: 208.758ms - MaterializeTupleTime(*): 112.741ms - ScannerThreadsSysTime: 8.498ms - ScannerThreadsUserTime: 157.975ms - ScannerThreadsVoluntaryContextSwitches: 115 (115) - TotalRawHdfsReadTime(*): 6.419ms - TotalReadThroughput: 5.30 MB/sec Fragment F03: Instance 854183ec25551621:2f (host=vb0228.halxg.cloudera.com:22000):(Total: 80.750ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/252.21 MB MemoryUsage(500.000ms): 19.82 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 87 (87) - PeakMemoryUsage: 20.12 MB (21093017) - PerHostPeakMemUsage: 45.35 MB (47555871) - RowsProduced: 631.37K (631372) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.657ms - TotalStorageWaitTime: 8.658ms - TotalWallClockTime: 401.904ms - SysTime: 9.998ms - UserTime: 359.946ms - VoluntaryContextSwitches: 99 (99) Fragment Instance Lifecycle Timings: - ExecTime: 187.116ms - ExecTreeExecTime: 16.260ms - OpenTime: 32.911ms - ExecTreeOpenTime: 49.412us - PrepareTime: 47.799ms - ExecTreePrepareTime: 102.352us DataStreamSender (dst_id=10):(Total: 102.494ms, non-child: 102.494ms, % non-child: 100.00%) - BytesSent: 8.03 MB (8415637) - NetworkThroughput(*): 325.61 MB/sec - OverallThroughput: 78.30 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 631.37K (631372) - SerializeBatchTime: 77.627ms - TransmitDataRPCTime: 24.648ms - UncompressedRowBatchSize: 22.28 MB (23364656) CodeGen:(Total: 58.088ms, non-child: 58.088ms, % non-child: 100.00%) - CodegenTime: 1.056ms - CompileTime: 7.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.325ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.604ms HDFS_SCAN_NODE (id=0):(Total: 16.138ms, non-child: 16.138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/252.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 13.38 MB - FooterProcessingTime: (Avg: 1.953ms ; Min: 1.953ms ; Max: 1.953ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 13.38 MB (14026723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14026723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14026723) - DecompressionTime: 49.923ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.67 MB (20626910) - PerReadThreadRawHdfsThroughput: 2.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.068ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3153576) - RowsReturned: 631.37K (631372) - RowsReturnedRate: 39.12 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 20 (20) - ScannerThreadsTotalWallClockTime: 181.926ms - MaterializeTupleTime(*): 118.156ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 169.974ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 6.207ms - TotalReadThroughput: 26.75 MB/sec Instance 854183ec25551621:33 (host=vb0214.halxg.cloudera.com:22000):(Total: 77.095ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 53 (53) - PeakMemoryUsage: 20.58 MB (21584635) - PerHostPeakMemUsage: 42.30 MB (44359323) - RowsProduced: 629.43K (629430) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.691ms - TotalStorageWaitTime: 9.080ms - TotalWallClockTime: 347.942ms - SysTime: 9.998ms - UserTime: 309.952ms - VoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 160.147ms - ExecTreeExecTime: 14.888ms - OpenTime: 32.433ms - ExecTreeOpenTime: 47.081us - PrepareTime: 44.589ms - ExecTreePrepareTime: 978.767us DataStreamSender (dst_id=10):(Total: 88.686ms, non-child: 88.686ms, % non-child: 100.00%) - BytesSent: 7.74 MB (8120091) - NetworkThroughput(*): 335.68 MB/sec - OverallThroughput: 87.32 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 629.43K (629430) - SerializeBatchTime: 65.392ms - TransmitDataRPCTime: 23.069ms - UncompressedRowBatchSize: 22.21 MB (23292786) CodeGen:(Total: 56.783ms, non-child: 56.783ms, % non-child: 100.00%) - CodegenTime: 1.088ms - CompileTime: 7.210ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.288ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 24.783ms HDFS_SCAN_NODE (id=0):(Total: 16.457ms, non-child: 16.457ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.266ms ; Min: 2.266ms ; Max: 2.266ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14022303) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14022303) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14022303) - DecompressionTime: 44.577ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.18 MB (21160422) - PerReadThreadRawHdfsThroughput: 2.11 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.691ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152634) - RowsReturned: 629.43K (629430) - RowsReturnedRate: 38.25 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 155.399ms - MaterializeTupleTime(*): 96.685ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 142.978ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 6.192ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:2e (host=vb0222.halxg.cloudera.com:22000):(Total: 74.941ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/156.02 MB 8:1/143.97 MB MemoryUsage(500.000ms): 42.26 MB ThreadUsage(500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 66 (66) - PeakMemoryUsage: 44.02 MB (46158181) - PerHostPeakMemUsage: 71.82 MB (75312624) - RowsProduced: 748.10K (748102) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.659ms - TotalStorageWaitTime: 16.465ms - TotalWallClockTime: 573.632ms - SysTime: 28.995ms - UserTime: 401.938ms - VoluntaryContextSwitches: 480 (480) Fragment Instance Lifecycle Timings: - ExecTime: 213.242ms - ExecTreeExecTime: 13.850ms - OpenTime: 33.480ms - ExecTreeOpenTime: 54.524us - PrepareTime: 41.422ms - ExecTreePrepareTime: 256.464us DataStreamSender (dst_id=10):(Total: 98.898ms, non-child: 98.898ms, % non-child: 100.00%) - BytesSent: 9.21 MB (9653323) - NetworkThroughput(*): 340.79 MB/sec - OverallThroughput: 93.09 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 748.10K (748102) - SerializeBatchTime: 71.685ms - TransmitDataRPCTime: 27.014ms - UncompressedRowBatchSize: 26.40 MB (27684370) CodeGen:(Total: 58.182ms, non-child: 58.182ms, % non-child: 100.00%) - CodegenTime: 1.075ms - CompileTime: 7.584ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.890ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.195ms HDFS_SCAN_NODE (id=0):(Total: 14.031ms, non-child: 14.031ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/156.02 MB 8:1/143.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 16.03 MB - FooterProcessingTime: (Avg: 2.049ms ; Min: 2.039ms ; Max: 2.059ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 16.03 MB (16807204) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.03 MB (16807204) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.03 MB (16807204) - DecompressionTime: 54.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 43.41 MB (45520976) - PerReadThreadRawHdfsThroughput: 2.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.148ms - RowBatchQueuePutWaitTime: 112.516ms - RowsRead: 3.75M (3745028) - RowsReturned: 748.10K (748102) - RowsReturnedRate: 53.32 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 40 (40) - ScannerThreadsTotalWallClockTime: 326.946ms - MaterializeTupleTime(*): 134.592ms - ScannerThreadsSysTime: 19.996ms - ScannerThreadsUserTime: 177.972ms - ScannerThreadsVoluntaryContextSwitches: 440 (440) - TotalRawHdfsReadTime(*): 7.612ms - TotalReadThroughput: 32.06 MB/sec Instance 854183ec25551621:3a (host=vb0232.halxg.cloudera.com:22000):(Total: 73.851ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.18 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 41 (41) - PeakMemoryUsage: 20.05 MB (21019371) - PerHostPeakMemUsage: 42.13 MB (44180868) - RowsProduced: 630.52K (630516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.702ms - TotalStorageWaitTime: 9.548ms - TotalWallClockTime: 353.014ms - SysTime: 16.997ms - UserTime: 303.953ms - VoluntaryContextSwitches: 121 (121) Fragment Instance Lifecycle Timings: - ExecTime: 162.218ms - ExecTreeExecTime: 18.660ms - OpenTime: 34.685ms - ExecTreeOpenTime: 55.024us - PrepareTime: 39.131ms - ExecTreePrepareTime: 800.904us DataStreamSender (dst_id=10):(Total: 84.830ms, non-child: 84.830ms, % non-child: 100.00%) - BytesSent: 7.80 MB (8180292) - NetworkThroughput(*): 365.28 MB/sec - OverallThroughput: 91.96 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.52K (630516) - SerializeBatchTime: 63.307ms - TransmitDataRPCTime: 21.357ms - UncompressedRowBatchSize: 22.25 MB (23332976) CodeGen:(Total: 61.356ms, non-child: 61.356ms, % non-child: 100.00%) - CodegenTime: 1.094ms - CompileTime: 7.853ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 25.809ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 26.988ms HDFS_SCAN_NODE (id=0):(Total: 19.975ms, non-child: 19.975ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.240ms ; Min: 2.240ms ; Max: 2.240ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14024611) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14024611) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14024611) - DecompressionTime: 46.322ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.67 MB (20626909) - PerReadThreadRawHdfsThroughput: 1.89 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.563ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152861) - RowsReturned: 630.52K (630516) - RowsReturnedRate: 31.56 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 156.147ms - MaterializeTupleTime(*): 94.976ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 135.979ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 6.908ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:37 (host=vb0234.halxg.cloudera.com:22000):(Total: 73.232ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.19 MB 2:1/143.95 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 87 (87) - PeakMemoryUsage: 53.07 MB (55643491) - PerHostPeakMemUsage: 81.04 MB (84975950) - RowsProduced: 989.16K (989165) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.703ms - TotalStorageWaitTime: 17.263ms - TotalWallClockTime: 787.202ms - SysTime: 38.993ms - UserTime: 614.905ms - VoluntaryContextSwitches: 446 (446) Fragment Instance Lifecycle Timings: - ExecTime: 310.360ms - ExecTreeExecTime: 17.137ms - OpenTime: 31.735ms - ExecTreeOpenTime: 48.632us - PrepareTime: 41.448ms - ExecTreePrepareTime: 291.480us DataStreamSender (dst_id=10):(Total: 137.635ms, non-child: 137.635ms, % non-child: 100.00%) - BytesSent: 12.17 MB (12755990) - NetworkThroughput(*): 329.72 MB/sec - OverallThroughput: 88.39 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 989.16K (989165) - SerializeBatchTime: 100.472ms - TransmitDataRPCTime: 36.895ms - UncompressedRowBatchSize: 34.91 MB (36605177) CodeGen:(Total: 58.957ms, non-child: 58.957ms, % non-child: 100.00%) - CodegenTime: 1.085ms - CompileTime: 7.070ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.769ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 27.610ms HDFS_SCAN_NODE (id=0):(Total: 17.065ms, non-child: 17.065ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.19 MB 2:1/143.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 2.129ms ; Min: 2.128ms ; Max: 2.129ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 21.07 MB (22098342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 21.07 MB (22098342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21.07 MB (22098342) - DecompressionTime: 96.362ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 52.42 MB (54969504) - PerReadThreadRawHdfsThroughput: 2.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.061ms - RowBatchQueuePutWaitTime: 97.608ms - RowsRead: 4.95M (4950000) - RowsReturned: 989.16K (989165) - RowsReturnedRate: 57.96 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 45 (45) - ScannerThreadsTotalWallClockTime: 445.154ms - MaterializeTupleTime(*): 221.710ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 312.951ms - ScannerThreadsVoluntaryContextSwitches: 407 (407) - TotalRawHdfsReadTime(*): 9.555ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:30 (host=vb0224.halxg.cloudera.com:22000):(Total: 71.987ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/252.20 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 39 (39) - PeakMemoryUsage: 19.78 MB (20739810) - PerHostPeakMemUsage: 41.57 MB (43588536) - RowsProduced: 630.60K (630601) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.547ms - TotalStorageWaitTime: 8.476ms - TotalWallClockTime: 353.487ms - SysTime: 9.999ms - UserTime: 312.953ms - VoluntaryContextSwitches: 134 (134) Fragment Instance Lifecycle Timings: - ExecTime: 163.003ms - ExecTreeExecTime: 20.288ms - OpenTime: 32.352ms - ExecTreeOpenTime: 47.048us - PrepareTime: 39.568ms - ExecTreePrepareTime: 1.033ms DataStreamSender (dst_id=10):(Total: 89.260ms, non-child: 89.260ms, % non-child: 100.00%) - BytesSent: 8.06 MB (8450666) - NetworkThroughput(*): 329.79 MB/sec - OverallThroughput: 90.29 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.60K (630601) - SerializeBatchTime: 64.632ms - TransmitDataRPCTime: 24.437ms - UncompressedRowBatchSize: 22.26 MB (23336117) CodeGen:(Total: 57.005ms, non-child: 57.005ms, % non-child: 100.00%) - CodegenTime: 1.089ms - CompileTime: 7.068ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.551ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 24.890ms HDFS_SCAN_NODE (id=0):(Total: 21.723ms, non-child: 21.723ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/252.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.052ms ; Min: 2.052ms ; Max: 2.052ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14025713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14025713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14025713) - DecompressionTime: 44.317ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.43 MB (20373973) - PerReadThreadRawHdfsThroughput: 2.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.040ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3153218) - RowsReturned: 630.60K (630601) - RowsReturnedRate: 29.03 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 158.158ms - MaterializeTupleTime(*): 100.030ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 143.978ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 6.344ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:32 (host=vb0206.halxg.cloudera.com:22000):(Total: 69.989ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/252.17 MB MemoryUsage(500.000ms): 76.76 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 37 (37) - PeakMemoryUsage: 19.92 MB (20883170) - PerHostPeakMemUsage: 41.45 MB (43460455) - RowsProduced: 630.05K (630049) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.464ms - TotalStorageWaitTime: 8.516ms - TotalWallClockTime: 358.603ms - SysTime: 5.999ms - UserTime: 325.950ms - VoluntaryContextSwitches: 88 (88) Fragment Instance Lifecycle Timings: - ExecTime: 165.183ms - ExecTreeExecTime: 15.079ms - OpenTime: 33.324ms - ExecTreeOpenTime: 53.864us - PrepareTime: 36.608ms - ExecTreePrepareTime: 951.926us DataStreamSender (dst_id=10):(Total: 82.348ms, non-child: 82.348ms, % non-child: 100.00%) - BytesSent: 7.86 MB (8237588) - NetworkThroughput(*): 352.21 MB/sec - OverallThroughput: 95.40 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.05K (630049) - SerializeBatchTime: 59.860ms - TransmitDataRPCTime: 22.304ms - UncompressedRowBatchSize: 22.24 MB (23315693) CodeGen:(Total: 57.978ms, non-child: 57.978ms, % non-child: 100.00%) - CodegenTime: 936.920us - CompileTime: 7.866ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.500ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.093ms HDFS_SCAN_NODE (id=0):(Total: 16.781ms, non-child: 16.781ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/252.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 1.922ms ; Min: 1.922ms ; Max: 1.922ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14019753) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14019753) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14019753) - DecompressionTime: 43.394ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.50 MB (20450773) - PerReadThreadRawHdfsThroughput: 2.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.885ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152011) - RowsReturned: 630.05K (630049) - RowsReturnedRate: 37.54 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 160.130ms - MaterializeTupleTime(*): 103.181ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 149.977ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 6.247ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:39 (host=vb0220.halxg.cloudera.com:22000):(Total: 68.978ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/155.93 MB 8:1/143.90 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 67 (67) - PeakMemoryUsage: 44.00 MB (46136756) - PerHostPeakMemUsage: 72.38 MB (75894654) - RowsProduced: 749.46K (749458) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.094ms - TotalStorageWaitTime: 20.982ms - TotalWallClockTime: 598.170ms - SysTime: 21.996ms - UserTime: 420.935ms - VoluntaryContextSwitches: 469 (469) Fragment Instance Lifecycle Timings: - ExecTime: 220.880ms - ExecTreeExecTime: 16.123ms - OpenTime: 32.592ms - ExecTreeOpenTime: 56.176us - PrepareTime: 36.360ms - ExecTreePrepareTime: 69.516us DataStreamSender (dst_id=10):(Total: 102.236ms, non-child: 102.236ms, % non-child: 100.00%) - BytesSent: 9.23 MB (9677200) - NetworkThroughput(*): 306.51 MB/sec - OverallThroughput: 90.27 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 749.46K (749458) - SerializeBatchTime: 71.926ms - TransmitDataRPCTime: 30.109ms - UncompressedRowBatchSize: 26.45 MB (27734546) CodeGen:(Total: 59.706ms, non-child: 59.706ms, % non-child: 100.00%) - CodegenTime: 997.408us - CompileTime: 7.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.044ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 27.588ms HDFS_SCAN_NODE (id=0):(Total: 15.876ms, non-child: 15.876ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/155.93 MB 8:1/143.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 1.885ms ; Min: 1.870ms ; Max: 1.901ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 16.02 MB (16801537) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.02 MB (16801537) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.02 MB (16801537) - DecompressionTime: 56.699ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 43.42 MB (45532319) - PerReadThreadRawHdfsThroughput: 2.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.368ms - RowBatchQueuePutWaitTime: 115.919ms - RowsRead: 3.74M (3743821) - RowsReturned: 749.46K (749458) - RowsReturnedRate: 47.20 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 41 (41) - ScannerThreadsTotalWallClockTime: 344.730ms - MaterializeTupleTime(*): 140.674ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 190.970ms - ScannerThreadsVoluntaryContextSwitches: 429 (429) - TotalRawHdfsReadTime(*): 7.021ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:36 (host=vb0218.halxg.cloudera.com:22000):(Total: 68.885ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/155.97 MB MemoryUsage(500.000ms): 84.76 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 29 (29) - PeakMemoryUsage: 10.73 MB (11253502) - PerHostPeakMemUsage: 31.80 MB (33344128) - RowsProduced: 388.47K (388469) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.493ms - TotalStorageWaitTime: 8.100ms - TotalWallClockTime: 244.633ms - SysTime: 10.999ms - UserTime: 200.969ms - VoluntaryContextSwitches: 153 (153) Fragment Instance Lifecycle Timings: - ExecTime: 108.708ms - ExecTreeExecTime: 21.954ms - OpenTime: 32.058ms - ExecTreeOpenTime: 49.012us - PrepareTime: 36.766ms - ExecTreePrepareTime: 220.812us DataStreamSender (dst_id=10):(Total: 52.226ms, non-child: 52.226ms, % non-child: 100.00%) - BytesSent: 4.84 MB (5079124) - NetworkThroughput(*): 333.05 MB/sec - OverallThroughput: 92.75 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 388.47K (388469) - SerializeBatchTime: 37.535ms - TransmitDataRPCTime: 14.543ms - UncompressedRowBatchSize: 13.71 MB (14375753) CodeGen:(Total: 56.890ms, non-child: 56.890ms, % non-child: 100.00%) - CodegenTime: 1.298ms - CompileTime: 7.161ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.087ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 25.042ms HDFS_SCAN_NODE (id=0):(Total: 22.268ms, non-child: 22.268ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/155.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.064ms ; Min: 2.064ms ; Max: 2.064ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 8.33 MB (8731657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.33 MB (8731657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.33 MB (8731657) - DecompressionTime: 28.661ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.41 MB (10911217) - PerReadThreadRawHdfsThroughput: 2.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.560ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.95M (1947366) - RowsReturned: 388.47K (388469) - RowsReturnedRate: 17.45 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 103.897ms - MaterializeTupleTime(*): 62.990ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 87.986ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 3.706ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:38 (host=vb0216.halxg.cloudera.com:22000):(Total: 66.655ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 23.28 MB (24412062) - PerHostPeakMemUsage: 45.19 MB (47387575) - RowsProduced: 630.97K (630965) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.445ms - TotalStorageWaitTime: 8.793ms - TotalWallClockTime: 358.328ms - SysTime: 17.996ms - UserTime: 315.952ms - VoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 170.831ms - ExecTreeExecTime: 14.052ms - OpenTime: 33.415ms - ExecTreeOpenTime: 58.932us - PrepareTime: 33.199ms - ExecTreePrepareTime: 1.041ms DataStreamSender (dst_id=10):(Total: 89.304ms, non-child: 89.304ms, % non-child: 100.00%) - BytesSent: 7.77 MB (8152550) - NetworkThroughput(*): 325.31 MB/sec - OverallThroughput: 87.06 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.97K (630965) - SerializeBatchTime: 65.206ms - TransmitDataRPCTime: 23.900ms - UncompressedRowBatchSize: 22.27 MB (23349589) CodeGen:(Total: 54.946ms, non-child: 54.946ms, % non-child: 100.00%) - CodegenTime: 1.335ms - CompileTime: 7.904ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.715ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 21.808ms HDFS_SCAN_NODE (id=0):(Total: 15.723ms, non-child: 15.723ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.059ms ; Min: 2.059ms ; Max: 2.059ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14024819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14024819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14024819) - DecompressionTime: 44.248ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 22.78 MB (23884342) - PerReadThreadRawHdfsThroughput: 1.98 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.368ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152961) - RowsReturned: 630.97K (630965) - RowsReturnedRate: 40.13 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 154.112ms - MaterializeTupleTime(*): 96.391ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 135.979ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 6.597ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:34 (host=vb0226.halxg.cloudera.com:22000):(Total: 66.298ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/143.95 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 21 (21) - PeakMemoryUsage: 12.41 MB (13011216) - PerHostPeakMemUsage: 31.00 MB (32510265) - RowsProduced: 358.59K (358588) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.015ms - TotalStorageWaitTime: 7.503ms - TotalWallClockTime: 210.049ms - SysTime: 1.000ms - UserTime: 187.971ms - VoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 92.705ms - ExecTreeExecTime: 11.064ms - OpenTime: 33.036ms - ExecTreeOpenTime: 54.024us - PrepareTime: 33.235ms - ExecTreePrepareTime: 126.292us DataStreamSender (dst_id=10):(Total: 48.865ms, non-child: 48.865ms, % non-child: 100.00%) - BytesSent: 4.52 MB (4735221) - NetworkThroughput(*): 351.33 MB/sec - OverallThroughput: 92.41 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 358.59K (358588) - SerializeBatchTime: 35.890ms - TransmitDataRPCTime: 12.853ms - UncompressedRowBatchSize: 12.66 MB (13269976) CodeGen:(Total: 55.103ms, non-child: 55.103ms, % non-child: 100.00%) - CodegenTime: 1.029ms - CompileTime: 7.577ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.685ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 22.341ms HDFS_SCAN_NODE (id=0):(Total: 11.212ms, non-child: 11.212ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/143.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.988ms ; Min: 1.988ms ; Max: 1.988ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 7.70 MB (8073491) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.70 MB (8073491) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.70 MB (8073491) - DecompressionTime: 24.246ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 11.93 MB (12513283) - PerReadThreadRawHdfsThroughput: 2.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.806ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1797139) - RowsReturned: 358.59K (358588) - RowsReturnedRate: 31.98 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 84.337ms - MaterializeTupleTime(*): 49.566ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 75.988ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 3.291ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:35 (host=vb0204.halxg.cloudera.com:22000):(Total: 62.416ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 25.49 MB (26729352) - PerHostPeakMemUsage: 47.00 MB (49280677) - RowsProduced: 629.82K (629818) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.776ms - TotalStorageWaitTime: 10.579ms - TotalWallClockTime: 365.845ms - SysTime: 27.995ms - UserTime: 309.952ms - VoluntaryContextSwitches: 51 (51) Fragment Instance Lifecycle Timings: - ExecTime: 178.223ms - ExecTreeExecTime: 15.572ms - OpenTime: 33.028ms - ExecTreeOpenTime: 60.312us - PrepareTime: 29.337ms - ExecTreePrepareTime: 130.582us DataStreamSender (dst_id=10):(Total: 92.056ms, non-child: 92.056ms, % non-child: 100.00%) - BytesSent: 7.72 MB (8090717) - NetworkThroughput(*): 312.03 MB/sec - OverallThroughput: 83.82 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 629.82K (629818) - SerializeBatchTime: 67.115ms - TransmitDataRPCTime: 24.728ms - UncompressedRowBatchSize: 22.23 MB (23307150) CodeGen:(Total: 57.146ms, non-child: 57.146ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 7.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.683ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 24.383ms HDFS_SCAN_NODE (id=0):(Total: 15.437ms, non-child: 15.437ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.734ms ; Min: 2.734ms ; Max: 2.734ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14024538) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14024538) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14024538) - DecompressionTime: 44.247ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 24.93 MB (26141299) - PerReadThreadRawHdfsThroughput: 1.94 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.877ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152826) - RowsReturned: 629.82K (629818) - RowsReturnedRate: 40.80 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 154.621ms - MaterializeTupleTime(*): 95.521ms - ScannerThreadsSysTime: 15.997ms - ScannerThreadsUserTime: 126.980ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 6.740ms - TotalReadThroughput: 0.00 /sec Instance 854183ec25551621:31 (host=vb0208.halxg.cloudera.com:22000):(Total: 61.192ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/143.96 MB MemoryUsage(500.000ms): 11.86 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 22 (22) - PeakMemoryUsage: 12.19 MB (12781876) - PerHostPeakMemUsage: 30.28 MB (31751115) - RowsProduced: 359.83K (359831) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.242ms - TotalStorageWaitTime: 7.617ms - TotalWallClockTime: 211.524ms - SysTime: 7.998ms - UserTime: 181.972ms - VoluntaryContextSwitches: 51 (51) Fragment Instance Lifecycle Timings: - ExecTime: 92.656ms - ExecTreeExecTime: 11.124ms - OpenTime: 33.305ms - ExecTreeOpenTime: 62.864us - PrepareTime: 27.856ms - ExecTreePrepareTime: 108.756us DataStreamSender (dst_id=10):(Total: 50.376ms, non-child: 50.376ms, % non-child: 100.00%) - BytesSent: 4.52 MB (4737622) - NetworkThroughput(*): 316.06 MB/sec - OverallThroughput: 89.69 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 359.83K (359831) - SerializeBatchTime: 35.980ms - TransmitDataRPCTime: 14.295ms - UncompressedRowBatchSize: 12.70 MB (13315971) CodeGen:(Total: 55.513ms, non-child: 55.513ms, % non-child: 100.00%) - CodegenTime: 1.010ms - CompileTime: 7.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.511ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 22.608ms HDFS_SCAN_NODE (id=0):(Total: 11.252ms, non-child: 11.252ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/143.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 7.70 MB - FooterProcessingTime: (Avg: 2.017ms ; Min: 2.017ms ; Max: 2.017ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.70 MB (8072992) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.70 MB (8072992) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.70 MB (8072992) - DecompressionTime: 24.858ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 11.75 MB (12317735) - PerReadThreadRawHdfsThroughput: 2.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.960ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1797174) - RowsReturned: 359.83K (359831) - RowsReturnedRate: 31.98 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 85.593ms - MaterializeTupleTime(*): 50.080ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 74.988ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 3.295ms - TotalReadThroughput: 15.40 MB/sec Instance 854183ec25551621:3b (host=vb0230.halxg.cloudera.com:22000):(Total: 60.934ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/252.21 MB 2:1/143.90 MB MemoryUsage(500.000ms): 229.26 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 141 (141) - PeakMemoryUsage: 52.98 MB (55552437) - PerHostPeakMemUsage: 79.53 MB (83391368) - RowsProduced: 989.50K (989505) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.487ms - TotalStorageWaitTime: 17.108ms - TotalWallClockTime: 724.774ms - SysTime: 22.995ms - UserTime: 576.912ms - VoluntaryContextSwitches: 315 (315) Fragment Instance Lifecycle Timings: - ExecTime: 281.382ms - ExecTreeExecTime: 15.438ms - OpenTime: 31.958ms - ExecTreeOpenTime: 50.028us - PrepareTime: 28.932ms - ExecTreePrepareTime: 160.008us DataStreamSender (dst_id=10):(Total: 141.193ms, non-child: 141.193ms, % non-child: 100.00%) - BytesSent: 12.15 MB (12735121) - NetworkThroughput(*): 318.49 MB/sec - OverallThroughput: 86.02 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 989.50K (989505) - SerializeBatchTime: 102.739ms - TransmitDataRPCTime: 38.133ms - UncompressedRowBatchSize: 34.92 MB (36617757) CodeGen:(Total: 57.807ms, non-child: 57.807ms, % non-child: 100.00%) - CodegenTime: 1.018ms - CompileTime: 7.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.981ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 26.156ms HDFS_SCAN_NODE (id=0):(Total: 15.054ms, non-child: 15.054ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/252.21 MB 2:1/143.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.085ms ; Min: 2.058ms ; Max: 2.112ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 21.07 MB (22094188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 21.07 MB (22094188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21.07 MB (22094188) - DecompressionTime: 82.768ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 52.39 MB (54932559) - PerReadThreadRawHdfsThroughput: 2.03 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.872ms - RowBatchQueuePutWaitTime: 86.354ms - RowsRead: 4.95M (4949385) - RowsReturned: 989.50K (989505) - RowsReturnedRate: 65.73 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 110 (110) - ScannerThreadsTotalWallClockTime: 411.468ms - MaterializeTupleTime(*): 213.826ms - ScannerThreadsSysTime: 16.996ms - ScannerThreadsUserTime: 284.956ms - ScannerThreadsVoluntaryContextSwitches: 272 (272) - TotalRawHdfsReadTime(*): 10.153ms - TotalReadThroughput: 0.00 /sec ================================================================================ ================================================================================ SUMMARY: +---------------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +---------------------+--------+----------+---------+----------+---------+-----------+ | 13:MERGING-EXCHANGE | 1 | 119.29us | 0ns | 119.29us | 10 | 10 | | 06:TOP-N | 15 | 8.80ms | 0ns | 10.82ms | 150 | 10 | | 12:AGGREGATE | 15 | 81.37ms | 0ns | 107.91ms | 3.39M | 5.08M | | 11:EXCHANGE | 15 | 15.53ms | 0ns | 19.20ms | 3.39M | 5.08M | | 05:AGGREGATE | 15 | 215.27ms | 0ns | 256.53ms | 3.39M | 5.08M | | 04:HASH JOIN | 15 | 229.05ms | 0ns | 264.57ms | 8.97M | 5.08M | | |--10:EXCHANGE | 15 | 13.31ms | 0ns | 15.23ms | 9.00M | 9.00M | | | 00:SCAN HDFS | 14 | 15.12ms | 0ns | 21.81ms | 9.00M | 9.00M | | 09:EXCHANGE | 15 | 101.72ms | 0ns | 118.13ms | 22.69M | 18.00M | | 03:HASH JOIN | 15 | 6.86s | 0ns | 7.48s | 22.69M | 18.00M | | |--08:EXCHANGE | 15 | 442.73ms | 0ns | 515.75ms | 110.51M | 45.00M | | | 01:SCAN HDFS | 15 | 608.47ms | 0ns | 651.53ms | 110.51M | 45.00M | | 07:EXCHANGE | 15 | 5.29s | 0ns | 7.17s | 970.31M | 180.00M | | 02:SCAN HDFS | 15 | 1.22s | 0ns | 1.33s | 970.31M | 180.00M | +---------------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=c84bf4bc19372552:caad0ddf00000000): Summary: Session ID: 694109817cb973e6:d4c786710cbdd09c Session Type: BEESWAX Start Time: 2016-11-29 13:09:53.251718000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build f6f910016b442fd621cde4a536c7ce61b02897e0) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:53467 Default Db: tpch_300_parquet Sql Statement: select l_orderkey, sum(l_extendedprice * (1 - l_discount)) as revenue, o_orderdate, o_shippriority from customer, orders, lineitem where c_mktsegment = 'BUILDING' and c_custkey = o_custkey and l_orderkey = o_orderkey and o_orderdate < '1995-03-15' and l_shipdate > '1995-03-15' group by l_orderkey, o_orderdate, o_shippriority order by revenue desc, o_orderdate limit 10 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.12GB VCores=4 PLAN-ROOT SINK | 13:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | limit: 10 | hosts=15 per-host-mem=unavailable | tuple-ids=4 row-size=58B cardinality=10 | 06:TOP-N [LIMIT=10] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | hosts=15 per-host-mem=580B | tuple-ids=4 row-size=58B cardinality=10 | 12:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | hosts=15 per-host-mem=308.87MB | tuple-ids=3 row-size=58B cardinality=5076417 | 11:EXCHANGE [HASH(l_orderkey,o_orderdate,o_shippriority)] | hosts=15 per-host-mem=0B | tuple-ids=3 row-size=58B cardinality=5076417 | 05:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: l_orderkey, o_orderdate, o_shippriority | hosts=15 per-host-mem=308.87MB | tuple-ids=3 row-size=58B cardinality=5076417 | 04:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: o_custkey = c_custkey | runtime filters: RF000 <- c_custkey | hosts=15 per-host-mem=20.77MB | tuple-ids=2,1,0 row-size=133B cardinality=5076417 | |--10:EXCHANGE [HASH(c_custkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=0 row-size=33B cardinality=9000000 | | | 00:SCAN HDFS [tpch_300_parquet.customer, RANDOM] | partitions=1/1 files=18 size=3.52GB | predicates: c_mktsegment = 'BUILDING' | table stats: 45000000 rows total | column stats: all | hosts=15 per-host-mem=176.00MB | tuple-ids=0 row-size=33B cardinality=9000000 | 09:EXCHANGE [HASH(o_custkey)] | hosts=15 per-host-mem=0B | tuple-ids=2,1 row-size=100B cardinality=17999891 | 03:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF001 <- o_orderkey | hosts=15 per-host-mem=157.36MB | tuple-ids=2,1 row-size=100B cardinality=17999891 | |--08:EXCHANGE [HASH(o_orderkey)] | | hosts=15 per-host-mem=0B | | tuple-ids=1 row-size=50B cardinality=45000000 | | | 01:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o_orderdate < '1995-03-15' | runtime filters: RF000 -> o_custkey | table stats: 450000000 rows total | column stats: all | hosts=15 per-host-mem=352.00MB | tuple-ids=1 row-size=50B cardinality=45000000 | 07:EXCHANGE [HASH(l_orderkey)] | hosts=15 per-host-mem=0B | tuple-ids=2 row-size=50B cardinality=179998909 | 02:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate > '1995-03-15' runtime filters: RF001 -> l_orderkey table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=352.00MB tuple-ids=2 row-size=50B cardinality=179998909 ---------------- Estimated Per-Host Mem: 1203629695 Estimated Per-Host VCores: 4 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 17.815ms - Analysis finished: 7.160ms (7.160ms) - Equivalence classes computed: 7.469ms (309.204us) - Single node plan created: 11.150ms (3.680ms) - Runtime filters computed: 11.474ms (324.285us) - Distributed plan created: 13.412ms (1.937ms) - Lineage info computed: 14.272ms (860.690us) - Planning finished: 17.815ms (3.542ms) Query Timeline: 27s800ms - Query submitted: 68.759us (68.759us) - Planning finished: 21.883ms (21.814ms) - Submit for admission: 23.822ms (1.938ms) - Completed admission: 23.899ms (76.891us) - Ready to start 90 fragment instances: 24.208ms (309.634us) - All 90 fragment instances started: 40.497ms (16.289ms) - First dynamic filter received: 564.535ms (524.037ms) - Rows available: 27s742ms (27s178ms) - First row fetched: 27s778ms (36.274ms) - ComputeScanRangeAssignmentTimer: 779.988us ImpalaServer: - ClientFetchWaitTimer: 36.287ms - RowMaterializationTimer: 12.572ms Execution Profile c84bf4bc19372552:caad0ddf00000000:(Total: 27s730ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 1 3 2 15 REMOTE false 15 (15) N/A N/A true 0 4 1 15 REMOTE false 15 (15) N/A N/A true Fragment instance start latencies: Count: 90, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 5ms Per Node Peak Memory Usage: vb0232.halxg.cloudera.com:22000(1.60 GB) vb0226.halxg.cloudera.com:22000(1.60 GB) vb0214.halxg.cloudera.com:22000(1.59 GB) vb0216.halxg.cloudera.com:22000(1.60 GB) vb0228.halxg.cloudera.com:22000(1.58 GB) vb0206.halxg.cloudera.com:22000(1.60 GB) vb0220.halxg.cloudera.com:22000(1.60 GB) vb0218.halxg.cloudera.com:22000(1.60 GB) vb0234.halxg.cloudera.com:22000(1.63 GB) vb0222.halxg.cloudera.com:22000(1.60 GB) vb0224.halxg.cloudera.com:22000(1.60 GB) vb0212.halxg.cloudera.com:22000(1.60 GB) vb0208.halxg.cloudera.com:22000(1.60 GB) vb0230.halxg.cloudera.com:22000(1.59 GB) vb0204.halxg.cloudera.com:22000(1.54 GB) - FiltersReceived: 30 (30) - FinalizationTimer: 0.000ns Coordinator Fragment F06: Instance c84bf4bc19372552:caad0ddf00000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 27s717ms, non-child: 932.935us, % non-child: 0.00%) MemoryUsage(500.000ms): 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 7 (7) - PeakMemoryUsage: 304.50 KB (311808) - PerHostPeakMemUsage: 1.54 GB (1654437808) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s718ms - SysTime: 2.000ms - UserTime: 64.989ms - VoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 36.425ms - ExecTreeExecTime: 238.089us - OpenTime: 27s681ms - ExecTreeOpenTime: 27s614ms - PrepareTime: 35.727ms - ExecTreePrepareTime: 45.570us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 101.679ms, non-child: 101.679ms, % non-child: 100.00%) - CodegenTime: 1.090ms - CompileTime: 10.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 29 (29) - NumInstructions: 593 (593) - OptimizationTime: 55.447ms - PeakMemoryUsage: 296.50 KB (303616) - PrepareTime: 35.211ms EXCHANGE_NODE (id=13):(Total: 27s614ms, non-child: 119.293us, % non-child: 0.00%) ExecOption: Codegen Enabled BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 5.21 KB (5331) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 112.489us - FirstBatchArrivalWaitTime: 27s614ms - MergeGetNext: 232.377us - MergeGetNextBatch: 191.913us - PeakMemoryUsage: 0 - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F05:(Total: 27s713ms, non-child: 3.603ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:27s710ms max:27s717ms mean: 27s714ms stddev:1.920ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.41 MB (153521511) - PerHostPeakMemUsage: 1.60 GB (1714262543) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s292ms - TotalNetworkSendTime: 281.359us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s666ms - SysTime: 19.463ms - UserTime: 356.279ms - VoluntaryContextSwitches: 344 (344) Fragment Instance Lifecycle Timings: - ExecTime: 522.616us - ExecTreeExecTime: 4.324us - OpenTime: 27s665ms - ExecTreeOpenTime: 27s387ms - PrepareTime: 47.097ms - ExecTreePrepareTime: 921.182us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 75.361us, non-child: 75.361us, % non-child: 100.00%) - BytesSent: 355.00 B (355) - NetworkThroughput(*): 11.13 MB/sec - OverallThroughput: 4.59 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.900us - TransmitDataRPCTime: 32.497us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 320.712ms, non-child: 320.712ms, % non-child: 100.00%) - CodegenTime: 4.410ms - CompileTime: 61.249ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 215.856ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 42.881ms SORT_NODE (id=6):(Total: 27s388ms, non-child: 8.796ms, % non-child: 0.03%) - InsertBatchTime: 8.575ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s379ms, non-child: 81.367ms, % non-child: 0.30%) - BuildTime: 65.423ms - GetNewBlockTime: 340.962us - GetResultsTime: 10.904ms - HTResizeTime: 16.663ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153470216) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.065us EXCHANGE_NODE (id=11):(Total: 27s298ms, non-child: 27s298ms, % non-child: 100.00%) - BytesReceived: 6.20 MB (6497202) - ConvertRowBatchTime: 5.364ms - DeserializeRowBatchTimer: 31.533ms - FirstBatchArrivalWaitTime: 27s227ms - PeakMemoryUsage: 0 - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.29 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F05: Instance c84bf4bc19372552:54 (host=vb0208.halxg.cloudera.com:22000):(Total: 27s715ms, non-child: 3.516ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 47.82 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 39 (39) - PeakMemoryUsage: 146.43 MB (153544297) - PerHostPeakMemUsage: 1.60 GB (1713159721) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s314ms - TotalNetworkSendTime: 301.220us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s666ms - SysTime: 20.997ms - UserTime: 333.949ms - VoluntaryContextSwitches: 434 (434) Fragment Instance Lifecycle Timings: - ExecTime: 584.248us - ExecTreeExecTime: 4.628us - OpenTime: 27s665ms - ExecTreeOpenTime: 27s394ms - PrepareTime: 50.206ms - ExecTreePrepareTime: 795.912us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 76.176us, non-child: 76.176us, % non-child: 100.00%) - BytesSent: 371.00 B (371) - NetworkThroughput(*): 11.33 MB/sec - OverallThroughput: 4.64 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.524us - TransmitDataRPCTime: 31.224us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 317.129ms, non-child: 317.129ms, % non-child: 100.00%) - CodegenTime: 4.140ms - CompileTime: 58.895ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 211.237ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 46.417ms SORT_NODE (id=6):(Total: 27s395ms, non-child: 9.017ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.811ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s386ms, non-child: 66.919ms, % non-child: 0.24%) ExecOption: Codegen Enabled - BuildTime: 49.835ms - GetNewBlockTime: 230.488us - GetResultsTime: 11.567ms - HTResizeTime: 11.993ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.37 MB (153479575) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.99K (226986) - RowsReturnedRate: 8.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.084us EXCHANGE_NODE (id=11):(Total: 27s319ms, non-child: 18.343ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.96 MB - BytesReceived: 6.22 MB (6518831) - ConvertRowBatchTime: 4.241ms - DeserializeRowBatchTimer: 37.740ms - FirstBatchArrivalWaitTime: 27s231ms - PeakMemoryUsage: 0 - RowsReturned: 226.99K (226986) - RowsReturnedRate: 8.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:59 (host=vb0228.halxg.cloudera.com:22000):(Total: 27s715ms, non-child: 3.286ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 22.05 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 42 (42) - PeakMemoryUsage: 146.42 MB (153532910) - PerHostPeakMemUsage: 1.58 GB (1695392252) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s272ms - TotalNetworkSendTime: 344.036us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s664ms - SysTime: 22.996ms - UserTime: 364.944ms - VoluntaryContextSwitches: 254 (254) Fragment Instance Lifecycle Timings: - ExecTime: 599.168us - ExecTreeExecTime: 3.900us - OpenTime: 27s663ms - ExecTreeOpenTime: 27s390ms - PrepareTime: 52.164ms - ExecTreePrepareTime: 926.540us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 88.268us, non-child: 88.268us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 10.82 MB/sec - OverallThroughput: 3.87 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 30.844us - TransmitDataRPCTime: 31.548us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 321.418ms, non-child: 321.418ms, % non-child: 100.00%) - CodegenTime: 3.924ms - CompileTime: 62.331ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 210.153ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 48.317ms SORT_NODE (id=6):(Total: 27s391ms, non-child: 9.008ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.778ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s382ms, non-child: 102.249ms, % non-child: 0.37%) ExecOption: Codegen Enabled - BuildTime: 86.667ms - GetNewBlockTime: 293.084us - GetResultsTime: 10.728ms - HTResizeTime: 25.841ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153468188) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.35K (226347) - RowsReturnedRate: 8.27 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.584us EXCHANGE_NODE (id=11):(Total: 27s279ms, non-child: 13.630ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.19 MB - BytesReceived: 6.20 MB (6500964) - ConvertRowBatchTime: 6.517ms - DeserializeRowBatchTimer: 23.479ms - FirstBatchArrivalWaitTime: 27s226ms - PeakMemoryUsage: 0 - RowsReturned: 226.35K (226347) - RowsReturnedRate: 8.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:51 (host=vb0220.halxg.cloudera.com:22000):(Total: 27s714ms, non-child: 4.266ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 48 (48) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1720645053) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s290ms - TotalNetworkSendTime: 434.296us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s658ms - SysTime: 14.998ms - UserTime: 357.945ms - VoluntaryContextSwitches: 417 (417) Fragment Instance Lifecycle Timings: - ExecTime: 704.984us - ExecTreeExecTime: 4.776us - OpenTime: 27s658ms - ExecTreeOpenTime: 27s373ms - PrepareTime: 56.651ms - ExecTreePrepareTime: 786.988us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 72.220us, non-child: 72.220us, % non-child: 100.00%) - BytesSent: 368.00 B (368) - NetworkThroughput(*): 15.29 MB/sec - OverallThroughput: 4.86 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 25.896us - TransmitDataRPCTime: 22.960us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 336.795ms, non-child: 336.795ms, % non-child: 100.00%) - CodegenTime: 5.678ms - CompileTime: 60.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 223.373ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 52.153ms SORT_NODE (id=6):(Total: 27s373ms, non-child: 10.816ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 10.582ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s363ms, non-child: 67.254ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 51.180ms - GetNewBlockTime: 382.660us - GetResultsTime: 10.969ms - HTResizeTime: 11.627ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.65K (225653) - RowsReturnedRate: 8.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.076us EXCHANGE_NODE (id=11):(Total: 27s295ms, non-child: 19.005ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6479578) - ConvertRowBatchTime: 4.386ms - DeserializeRowBatchTimer: 38.424ms - FirstBatchArrivalWaitTime: 27s211ms - PeakMemoryUsage: 0 - RowsReturned: 225.65K (225653) - RowsReturnedRate: 8.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:4f (host=vb0218.halxg.cloudera.com:22000):(Total: 27s714ms, non-child: 3.336ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.29 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 41 (41) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1721325092) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s273ms - TotalNetworkSendTime: 366.088us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s663ms - SysTime: 23.996ms - UserTime: 366.944ms - VoluntaryContextSwitches: 228 (228) Fragment Instance Lifecycle Timings: - ExecTime: 811.636us - ExecTreeExecTime: 4.880us - OpenTime: 27s662ms - ExecTreeOpenTime: 27s390ms - PrepareTime: 51.424ms - ExecTreePrepareTime: 922.384us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 104.100us, non-child: 104.100us, % non-child: 100.00%) - BytesSent: 353.00 B (353) - NetworkThroughput(*): 6.02 MB/sec - OverallThroughput: 3.23 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 15.940us - TransmitDataRPCTime: 55.948us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 319.149ms, non-child: 319.149ms, % non-child: 100.00%) - CodegenTime: 4.195ms - CompileTime: 58.467ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 212.516ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 47.540ms SORT_NODE (id=6):(Total: 27s391ms, non-child: 9.681ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 9.386ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s381ms, non-child: 100.565ms, % non-child: 0.37%) ExecOption: Codegen Enabled - BuildTime: 82.852ms - GetNewBlockTime: 347.432us - GetResultsTime: 12.304ms - HTResizeTime: 20.820ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.56K (226556) - RowsReturnedRate: 8.27 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.852us EXCHANGE_NODE (id=11):(Total: 27s281ms, non-child: 15.890ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6505017) - ConvertRowBatchTime: 6.981ms - DeserializeRowBatchTimer: 29.698ms - FirstBatchArrivalWaitTime: 27s230ms - PeakMemoryUsage: 0 - RowsReturned: 226.56K (226556) - RowsReturnedRate: 8.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:50 (host=vb0204.halxg.cloudera.com:22000):(Total: 27s714ms, non-child: 5.302ms, % non-child: 0.02%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 42 (42) - PeakMemoryUsage: 146.40 MB (153516019) - PerHostPeakMemUsage: 1.54 GB (1654437808) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s271ms - TotalNetworkSendTime: 227.281us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s679ms - SysTime: 18.997ms - UserTime: 390.941ms - VoluntaryContextSwitches: 192 (192) Fragment Instance Lifecycle Timings: - ExecTime: 366.128us - ExecTreeExecTime: 4.237us - OpenTime: 27s678ms - ExecTreeOpenTime: 27s395ms - PrepareTime: 35.301ms - ExecTreePrepareTime: 1.625ms DataStreamSender (dst_id=13):(Total: 75.111us, non-child: 75.111us, % non-child: 100.00%) - BytesSent: 349.00 B (349) - NetworkThroughput(*): 9.76 MB/sec - OverallThroughput: 4.43 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.386us - TransmitDataRPCTime: 34.094us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 311.843ms, non-child: 311.843ms, % non-child: 100.00%) - CodegenTime: 6.333ms - CompileTime: 60.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 221.797ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 28.909ms SORT_NODE (id=6):(Total: 27s396ms, non-child: 9.482ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 9.232ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s387ms, non-child: 107.912ms, % non-child: 0.39%) ExecOption: Codegen Enabled - BuildTime: 89.760ms - GetNewBlockTime: 771.924us - GetResultsTime: 12.324ms - HTResizeTime: 20.466ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153473675) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.75K (225750) - RowsReturnedRate: 8.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.498us EXCHANGE_NODE (id=11):(Total: 27s279ms, non-child: 19.196ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6481956) - ConvertRowBatchTime: 7.392ms - DeserializeRowBatchTimer: 36.166ms - FirstBatchArrivalWaitTime: 27s234ms - PeakMemoryUsage: 0 - RowsReturned: 225.75K (225750) - RowsReturnedRate: 8.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:4c (host=vb0212.halxg.cloudera.com:22000):(Total: 27s713ms, non-child: 3.272ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 102.56 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 46 (46) - PeakMemoryUsage: 146.44 MB (153552810) - PerHostPeakMemUsage: 1.60 GB (1720996548) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s298ms - TotalNetworkSendTime: 211.452us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s669ms - SysTime: 21.996ms - UserTime: 350.946ms - VoluntaryContextSwitches: 408 (408) Fragment Instance Lifecycle Timings: - ExecTime: 450.027us - ExecTreeExecTime: 3.815us - OpenTime: 27s668ms - ExecTreeOpenTime: 27s382ms - PrepareTime: 45.006ms - ExecTreePrepareTime: 1.106ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 59.273us, non-child: 59.273us, % non-child: 100.00%) - BytesSent: 348.00 B (348) - NetworkThroughput(*): 10.94 MB/sec - OverallThroughput: 5.60 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.415us - TransmitDataRPCTime: 30.336us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 326.600ms, non-child: 326.600ms, % non-child: 100.00%) - CodegenTime: 4.229ms - CompileTime: 61.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 223.913ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 40.660ms SORT_NODE (id=6):(Total: 27s383ms, non-child: 10.172ms, % non-child: 0.04%) ExecOption: Codegen Enabled - InsertBatchTime: 9.944ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s373ms, non-child: 70.518ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 52.918ms - GetNewBlockTime: 231.600us - GetResultsTime: 12.234ms - HTResizeTime: 14.020ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.55K (226547) - RowsReturnedRate: 8.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.963us EXCHANGE_NODE (id=11):(Total: 27s303ms, non-child: 8.743ms, % non-child: 0.03%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.49 MB - BytesReceived: 6.21 MB (6508033) - ConvertRowBatchTime: 4.104ms - DeserializeRowBatchTimer: 20.379ms - FirstBatchArrivalWaitTime: 27s222ms - PeakMemoryUsage: 0 - RowsReturned: 226.55K (226547) - RowsReturnedRate: 8.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:55 (host=vb0206.halxg.cloudera.com:22000):(Total: 27s713ms, non-child: 3.539ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 42 (42) - PeakMemoryUsage: 146.42 MB (153530432) - PerHostPeakMemUsage: 1.60 GB (1721148052) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s309ms - TotalNetworkSendTime: 281.822us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s664ms - SysTime: 15.998ms - UserTime: 339.948ms - VoluntaryContextSwitches: 426 (426) Fragment Instance Lifecycle Timings: - ExecTime: 460.896us - ExecTreeExecTime: 4.952us - OpenTime: 27s663ms - ExecTreeOpenTime: 27s389ms - PrepareTime: 49.559ms - ExecTreePrepareTime: 929.968us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 73.916us, non-child: 73.916us, % non-child: 100.00%) - BytesSent: 346.00 B (346) - NetworkThroughput(*): 9.89 MB/sec - OverallThroughput: 4.46 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.484us - TransmitDataRPCTime: 33.356us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 319.191ms, non-child: 319.191ms, % non-child: 100.00%) - CodegenTime: 4.337ms - CompileTime: 59.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.433ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 45.391ms SORT_NODE (id=6):(Total: 27s390ms, non-child: 8.280ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.074ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s382ms, non-child: 67.672ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 51.924ms - GetNewBlockTime: 300.214us - GetResultsTime: 10.822ms - HTResizeTime: 14.008ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 227.03K (227034) - RowsReturnedRate: 8.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.066us EXCHANGE_NODE (id=11):(Total: 27s314ms, non-child: 17.272ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.22 MB (6517805) - ConvertRowBatchTime: 4.141ms - DeserializeRowBatchTimer: 39.411ms - FirstBatchArrivalWaitTime: 27s228ms - PeakMemoryUsage: 0 - RowsReturned: 227.03K (227034) - RowsReturnedRate: 8.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:53 (host=vb0222.halxg.cloudera.com:22000):(Total: 27s712ms, non-child: 3.593ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 30.75 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.41 MB (153517317) - PerHostPeakMemUsage: 1.60 GB (1721390396) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s303ms - TotalNetworkSendTime: 260.464us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s661ms - SysTime: 13.998ms - UserTime: 345.948ms - VoluntaryContextSwitches: 432 (432) Fragment Instance Lifecycle Timings: - ExecTime: 501.468us - ExecTreeExecTime: 4.752us - OpenTime: 27s660ms - ExecTreeOpenTime: 27s382ms - PrepareTime: 52.019ms - ExecTreePrepareTime: 786.832us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 72.232us, non-child: 72.232us, % non-child: 100.00%) - BytesSent: 339.00 B (339) - NetworkThroughput(*): 11.55 MB/sec - OverallThroughput: 4.48 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 18.768us - TransmitDataRPCTime: 28.000us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 325.741ms, non-child: 325.741ms, % non-child: 100.00%) - CodegenTime: 4.129ms - CompileTime: 61.648ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 215.278ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 48.212ms SORT_NODE (id=6):(Total: 27s383ms, non-child: 7.730ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.528ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s375ms, non-child: 67.219ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 51.457ms - GetNewBlockTime: 269.268us - GetResultsTime: 11.104ms - HTResizeTime: 11.876ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.37 MB (153474973) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.84K (226843) - RowsReturnedRate: 8.29 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.104us EXCHANGE_NODE (id=11):(Total: 27s308ms, non-child: 14.067ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.49 MB - BytesReceived: 6.21 MB (6513184) - ConvertRowBatchTime: 4.292ms - DeserializeRowBatchTimer: 32.549ms - FirstBatchArrivalWaitTime: 27s222ms - PeakMemoryUsage: 0 - RowsReturned: 226.84K (226843) - RowsReturnedRate: 8.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:58 (host=vb0232.halxg.cloudera.com:22000):(Total: 27s712ms, non-child: 3.141ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.41 MB (153521615) - PerHostPeakMemUsage: 1.60 GB (1720112795) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s324ms - TotalNetworkSendTime: 311.004us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s680ms - SysTime: 19.996ms - UserTime: 338.949ms - VoluntaryContextSwitches: 413 (413) Fragment Instance Lifecycle Timings: - ExecTime: 554.632us - ExecTreeExecTime: 3.780us - OpenTime: 27s679ms - ExecTreeOpenTime: 27s399ms - PrepareTime: 32.673ms - ExecTreePrepareTime: 534.908us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 62.764us, non-child: 62.764us, % non-child: 100.00%) - BytesSent: 337.00 B (337) - NetworkThroughput(*): 11.57 MB/sec - OverallThroughput: 5.12 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.644us - TransmitDataRPCTime: 27.768us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 309.170ms, non-child: 309.170ms, % non-child: 100.00%) - CodegenTime: 4.173ms - CompileTime: 62.910ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 216.006ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 29.673ms SORT_NODE (id=6):(Total: 27s400ms, non-child: 8.074ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.894ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s392ms, non-child: 63.241ms, % non-child: 0.23%) ExecOption: Codegen Enabled - BuildTime: 49.620ms - GetNewBlockTime: 191.280us - GetResultsTime: 9.405ms - HTResizeTime: 12.864ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.37 MB (153479271) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.89K (225894) - RowsReturnedRate: 8.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.432us EXCHANGE_NODE (id=11):(Total: 27s328ms, non-child: 9.652ms, % non-child: 0.04%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.18 MB (6484767) - ConvertRowBatchTime: 3.987ms - DeserializeRowBatchTimer: 22.320ms - FirstBatchArrivalWaitTime: 27s240ms - PeakMemoryUsage: 0 - RowsReturned: 225.89K (225894) - RowsReturnedRate: 8.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:4e (host=vb0234.halxg.cloudera.com:22000):(Total: 27s712ms, non-child: 3.492ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.63 GB (1747877666) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s293ms - TotalNetworkSendTime: 190.572us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s664ms - SysTime: 13.997ms - UserTime: 361.945ms - VoluntaryContextSwitches: 405 (405) Fragment Instance Lifecycle Timings: - ExecTime: 415.468us - ExecTreeExecTime: 4.784us - OpenTime: 27s664ms - ExecTreeOpenTime: 27s379ms - PrepareTime: 47.757ms - ExecTreePrepareTime: 858.736us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 67.848us, non-child: 67.848us, % non-child: 100.00%) - BytesSent: 354.00 B (354) - NetworkThroughput(*): 12.56 MB/sec - OverallThroughput: 4.98 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 16.972us - TransmitDataRPCTime: 26.872us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 328.342ms, non-child: 328.342ms, % non-child: 100.00%) - CodegenTime: 3.979ms - CompileTime: 62.892ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 221.052ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 43.794ms SORT_NODE (id=6):(Total: 27s380ms, non-child: 9.147ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.929ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s371ms, non-child: 72.574ms, % non-child: 0.27%) ExecOption: Codegen Enabled - BuildTime: 55.789ms - GetNewBlockTime: 368.572us - GetResultsTime: 11.669ms - HTResizeTime: 12.332ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.51K (226511) - RowsReturnedRate: 8.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.864us EXCHANGE_NODE (id=11):(Total: 27s298ms, non-child: 18.735ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6502104) - ConvertRowBatchTime: 4.479ms - DeserializeRowBatchTimer: 38.356ms - FirstBatchArrivalWaitTime: 27s220ms - PeakMemoryUsage: 0 - RowsReturned: 226.51K (226511) - RowsReturnedRate: 8.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:56 (host=vb0214.halxg.cloudera.com:22000):(Total: 27s712ms, non-child: 3.336ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 43 (43) - PeakMemoryUsage: 146.41 MB (153520553) - PerHostPeakMemUsage: 1.59 GB (1707502940) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s306ms - TotalNetworkSendTime: 257.632us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s665ms - SysTime: 17.997ms - UserTime: 342.948ms - VoluntaryContextSwitches: 412 (412) Fragment Instance Lifecycle Timings: - ExecTime: 466.233us - ExecTreeExecTime: 4.166us - OpenTime: 27s665ms - ExecTreeOpenTime: 27s387ms - PrepareTime: 46.889ms - ExecTreePrepareTime: 872.345us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 97.061us, non-child: 97.061us, % non-child: 100.00%) - BytesSent: 361.00 B (361) - NetworkThroughput(*): 6.25 MB/sec - OverallThroughput: 3.55 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.326us - TransmitDataRPCTime: 55.066us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 320.820ms, non-child: 320.820ms, % non-child: 100.00%) - CodegenTime: 4.159ms - CompileTime: 64.197ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.025ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 42.988ms SORT_NODE (id=6):(Total: 27s388ms, non-child: 8.039ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.823ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s379ms, non-child: 68.093ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 53.912ms - GetNewBlockTime: 395.682us - GetResultsTime: 9.217ms - HTResizeTime: 15.217ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.37 MB (153478209) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.91K (225907) - RowsReturnedRate: 8.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.979us EXCHANGE_NODE (id=11):(Total: 27s311ms, non-child: 19.133ms, % non-child: 0.07%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.19 MB (6486715) - ConvertRowBatchTime: 4.384ms - DeserializeRowBatchTimer: 39.905ms - FirstBatchArrivalWaitTime: 27s227ms - PeakMemoryUsage: 0 - RowsReturned: 225.91K (225907) - RowsReturnedRate: 8.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:52 (host=vb0216.halxg.cloudera.com:22000):(Total: 27s712ms, non-child: 3.581ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.42 MB (153530432) - PerHostPeakMemUsage: 1.60 GB (1720128972) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s275ms - TotalNetworkSendTime: 302.984us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s664ms - SysTime: 24.997ms - UserTime: 364.944ms - VoluntaryContextSwitches: 243 (243) Fragment Instance Lifecycle Timings: - ExecTime: 523.100us - ExecTreeExecTime: 3.608us - OpenTime: 27s664ms - ExecTreeOpenTime: 27s389ms - PrepareTime: 48.092ms - ExecTreePrepareTime: 863.112us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 71.704us, non-child: 71.704us, % non-child: 100.00%) - BytesSent: 355.00 B (355) - NetworkThroughput(*): 12.11 MB/sec - OverallThroughput: 4.72 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.480us - TransmitDataRPCTime: 27.956us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 317.771ms, non-child: 317.771ms, % non-child: 100.00%) - CodegenTime: 4.310ms - CompileTime: 60.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 212.892ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 43.979ms SORT_NODE (id=6):(Total: 27s390ms, non-child: 8.150ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 7.916ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s382ms, non-child: 98.667ms, % non-child: 0.36%) ExecOption: Codegen Enabled - BuildTime: 82.770ms - GetNewBlockTime: 272.408us - GetResultsTime: 10.759ms - HTResizeTime: 20.015ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.39K (226386) - RowsReturnedRate: 8.27 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.004us EXCHANGE_NODE (id=11):(Total: 27s284ms, non-child: 13.867ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6499024) - ConvertRowBatchTime: 7.248ms - DeserializeRowBatchTimer: 24.495ms - FirstBatchArrivalWaitTime: 27s232ms - PeakMemoryUsage: 0 - RowsReturned: 226.39K (226386) - RowsReturnedRate: 8.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:57 (host=vb0226.halxg.cloudera.com:22000):(Total: 27s711ms, non-child: 3.565ms, % non-child: 0.01%) MemoryUsage(500.000ms): 3.50 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 145.87 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 42 (42) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.60 GB (1719830126) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s280ms - TotalNetworkSendTime: 308.980us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s668ms - SysTime: 21.997ms - UserTime: 360.945ms - VoluntaryContextSwitches: 264 (264) Fragment Instance Lifecycle Timings: - ExecTime: 547.312us - ExecTreeExecTime: 3.764us - OpenTime: 27s667ms - ExecTreeOpenTime: 27s393ms - PrepareTime: 43.672ms - ExecTreePrepareTime: 859.144us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 77.508us, non-child: 77.508us, % non-child: 100.00%) - BytesSent: 365.00 B (365) - NetworkThroughput(*): 10.32 MB/sec - OverallThroughput: 4.49 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.488us - TransmitDataRPCTime: 33.728us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 313.415ms, non-child: 313.415ms, % non-child: 100.00%) - CodegenTime: 4.391ms - CompileTime: 59.456ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 213.761ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 39.633ms SORT_NODE (id=6):(Total: 27s394ms, non-child: 7.056ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 6.843ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s387ms, non-child: 99.227ms, % non-child: 0.36%) ExecOption: Codegen Enabled - BuildTime: 84.662ms - GetNewBlockTime: 349.624us - GetResultsTime: 9.786ms - HTResizeTime: 25.958ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.04K (226044) - RowsReturnedRate: 8.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.464us EXCHANGE_NODE (id=11):(Total: 27s288ms, non-child: 13.402ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.05 MB - BytesReceived: 6.19 MB (6490552) - ConvertRowBatchTime: 6.564ms - DeserializeRowBatchTimer: 27.793ms - FirstBatchArrivalWaitTime: 27s234ms - PeakMemoryUsage: 0 - RowsReturned: 226.04K (226044) - RowsReturnedRate: 8.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:4b (host=vb0230.halxg.cloudera.com:22000):(Total: 27s709ms, non-child: 3.402ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153508054) - PerHostPeakMemUsage: 1.59 GB (1709595022) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s304ms - TotalNetworkSendTime: 215.760us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s660ms - SysTime: 13.998ms - UserTime: 347.947ms - VoluntaryContextSwitches: 416 (416) Fragment Instance Lifecycle Timings: - ExecTime: 447.376us - ExecTreeExecTime: 4.484us - OpenTime: 27s660ms - ExecTreeOpenTime: 27s382ms - PrepareTime: 49.221ms - ExecTreePrepareTime: 1.004ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 66.364us, non-child: 66.364us, % non-child: 100.00%) - BytesSent: 358.00 B (358) - NetworkThroughput(*): 14.12 MB/sec - OverallThroughput: 5.14 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.748us - TransmitDataRPCTime: 24.176us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 322.977ms, non-child: 322.977ms, % non-child: 100.00%) - CodegenTime: 4.086ms - CompileTime: 62.044ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 215.153ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 43.763ms SORT_NODE (id=6):(Total: 27s383ms, non-child: 8.792ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.580ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s374ms, non-child: 65.294ms, % non-child: 0.24%) ExecOption: Codegen Enabled - BuildTime: 49.807ms - GetNewBlockTime: 307.900us - GetResultsTime: 10.542ms - HTResizeTime: 11.289ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153465710) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 225.06K (225064) - RowsReturnedRate: 8.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.128us EXCHANGE_NODE (id=11):(Total: 27s309ms, non-child: 17.239ms, % non-child: 0.06%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.16 MB (6463318) - ConvertRowBatchTime: 4.406ms - DeserializeRowBatchTimer: 37.766ms - FirstBatchArrivalWaitTime: 27s225ms - PeakMemoryUsage: 0 - RowsReturned: 225.06K (225064) - RowsReturnedRate: 8.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:4d (host=vb0224.halxg.cloudera.com:22000):(Total: 27s709ms, non-child: 3.416ms, % non-child: 0.01%) MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 44 (44) - PeakMemoryUsage: 146.40 MB (153516019) - PerHostPeakMemUsage: 1.60 GB (1720395712) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 27s265ms - TotalNetworkSendTime: 206.804us - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s663ms - SysTime: 24.996ms - UserTime: 374.943ms - VoluntaryContextSwitches: 218 (218) Fragment Instance Lifecycle Timings: - ExecTime: 406.568us - ExecTreeExecTime: 4.348us - OpenTime: 27s663ms - ExecTreeOpenTime: 27s384ms - PrepareTime: 45.815ms - ExecTreePrepareTime: 943.524us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 208 (208) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 920.50 MB (965214208) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 65.884us, non-child: 65.884us, % non-child: 100.00%) - BytesSent: 369.00 B (369) - NetworkThroughput(*): 14.41 MB/sec - OverallThroughput: 5.34 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 10 (10) - SerializeBatchTime: 17.596us - TransmitDataRPCTime: 24.428us - UncompressedRowBatchSize: 634.00 B (634) CodeGen:(Total: 320.311ms, non-child: 320.311ms, % non-child: 100.00%) - CodegenTime: 4.091ms - CompileTime: 63.660ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 118 (118) - NumInstructions: 2.44K (2445) - OptimizationTime: 214.252ms - PeakMemoryUsage: 1.19 MB (1251840) - PrepareTime: 41.779ms SORT_NODE (id=6):(Total: 27s385ms, non-child: 8.501ms, % non-child: 0.03%) ExecOption: Codegen Enabled - InsertBatchTime: 8.300ms - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 10 (10) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 27s377ms, non-child: 103.093ms, % non-child: 0.38%) ExecOption: Codegen Enabled - BuildTime: 88.195ms - GetNewBlockTime: 402.308us - GetResultsTime: 10.122ms - HTResizeTime: 21.613ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 146.36 MB (153473675) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 226.57K (226574) - RowsReturnedRate: 8.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.888us EXCHANGE_NODE (id=11):(Total: 27s273ms, non-child: 14.725ms, % non-child: 0.05%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 6.20 MB (6506190) - ConvertRowBatchTime: 7.341ms - DeserializeRowBatchTimer: 24.512ms - FirstBatchArrivalWaitTime: 27s229ms - PeakMemoryUsage: 0 - RowsReturned: 226.57K (226574) - RowsReturnedRate: 8.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 4s646ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:27s665ms max:27s693ms mean: 27s673ms stddev:7.139ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 293 (293) - PeakMemoryUsage: 302.81 MB (317519085) - PerHostPeakMemUsage: 1.60 GB (1714262543) - RowsProduced: 226.27K (226273) - TotalNetworkReceiveTime: 26s624ms - TotalNetworkSendTime: 3.368ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s758ms - SysTime: 105.516ms - UserTime: 1s167ms - VoluntaryContextSwitches: 7.55K (7552) Fragment Instance Lifecycle Timings: - ExecTime: 23s025ms - ExecTreeExecTime: 22s918ms - OpenTime: 4s591ms - ExecTreeOpenTime: 4s204ms - PrepareTime: 54.831ms - ExecTreePrepareTime: 1.084ms DataStreamSender (dst_id=11):(Total: 65.839ms, non-child: 65.839ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6497202) - NetworkThroughput(*): 338.45 MB/sec - OverallThroughput: 94.86 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.27K (226273) - SerializeBatchTime: 46.034ms - TransmitDataRPCTime: 19.646ms - UncompressedRowBatchSize: 13.60 MB (14257945) CodeGen:(Total: 423.449ms, non-child: 423.449ms, % non-child: 100.00%) - CodegenTime: 7.858ms - CompileTime: 109.763ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 275.716ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 37.424ms AGGREGATION_NODE (id=5):(Total: 27s124ms, non-child: 215.265ms, % non-child: 0.79%) - GetNewBlockTime: 520.993us - GetResultsTime: 10.136ms - HTResizeTime: 20.575ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.58 MB (152649136) - PinTime: 0.000ns - ReductionFactorEstimate: 17.47 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.27K (226273) - RowsReturnedRate: 8.34 K/sec - StreamingTime: 196.024ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s909ms, non-child: 229.051ms, % non-child: 0.85%) - BuildRows: 599.72K (599724) - BuildTime: 122.382ms - PeakMemoryUsage: 153.17 MB (160606249) - ProbeRows: 1.51M (1512369) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 216.023ms - RowsReturned: 597.67K (597671) - RowsReturnedRate: 22.21 K/sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 77.416ms - BuildRowsPartitioned: 599.72K (599724) - GetNewBlockTime: 215.901us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.972ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.305ms, non-child: 13.305ms, % non-child: 100.00%) - BytesReceived: 7.45 MB (7812826) - ConvertRowBatchTime: 10.359ms - DeserializeRowBatchTimer: 43.576ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.72K (599724) - RowsReturnedRate: 45.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s680ms, non-child: 26s680ms, % non-child: 100.00%) - BytesReceived: 66.34 MB (69567279) - ConvertRowBatchTime: 46.106ms - DeserializeRowBatchTimer: 381.824ms - FirstBatchArrivalWaitTime: 4s179ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512369) - RowsReturnedRate: 56.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F04: Instance c84bf4bc19372552:41 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s652ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.86 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.83 MB, 159.22 MB, 159.37 MB, 167.47 MB, 167.51 MB, 167.33 MB, 168.31 MB, 168.35 MB, 168.49 MB, 168.37 MB, 168.29 MB, 168.43 MB, 168.41 MB, 168.41 MB, 168.56 MB, 170.33 MB, 170.35 MB, 170.41 MB, 170.56 MB, 170.37 MB, 170.51 MB, 170.45 MB, 170.51 MB, 170.29 MB, 170.43 MB, 170.58 MB, 170.58 MB, 170.37 MB, 178.33 MB, 298.35 MB, 298.31 MB, 298.49 MB, 299.56 MB, 302.53 MB, 302.53 MB, 302.31 MB, 302.41 MB, 302.37 MB, 302.47 MB, 302.33 MB, 302.39 MB, 302.37 MB, 302.58 MB, 302.47 MB, 302.37 MB, 302.43 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 342 (342) - PeakMemoryUsage: 302.83 MB (317543947) - PerHostPeakMemUsage: 1.54 GB (1654437808) - RowsProduced: 226.01K (226011) - TotalNetworkReceiveTime: 26s638ms - TotalNetworkSendTime: 2.780ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s762ms - SysTime: 89.985ms - UserTime: 1s139ms - VoluntaryContextSwitches: 7.54K (7539) Fragment Instance Lifecycle Timings: - ExecTime: 23s010ms - ExecTreeExecTime: 22s907ms - OpenTime: 4s595ms - ExecTreeOpenTime: 4s201ms - PrepareTime: 57.048ms - ExecTreePrepareTime: 1.027ms DataStreamSender (dst_id=11):(Total: 71.044ms, non-child: 71.044ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490532) - NetworkThroughput(*): 239.06 MB/sec - OverallThroughput: 87.13 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226011) - SerializeBatchTime: 45.032ms - TransmitDataRPCTime: 25.892ms - UncompressedRowBatchSize: 13.58 MB (14241429) CodeGen:(Total: 432.376ms, non-child: 432.376ms, % non-child: 100.00%) - CodegenTime: 11.027ms - CompileTime: 108.572ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 283.838ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 39.304ms AGGREGATION_NODE (id=5):(Total: 27s110ms, non-child: 191.949ms, % non-child: 0.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 370.453us - GetResultsTime: 9.213ms - HTResizeTime: 16.234ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.53 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226011) - RowsReturnedRate: 8.34 K/sec - StreamingTime: 173.898ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s918ms, non-child: 231.634ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.14K (600137) - BuildTime: 131.373ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1511370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 218.877ms - RowsReturned: 597.66K (597663) - RowsReturnedRate: 22.20 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 84.121ms - BuildRowsPartitioned: 600.14K (600137) - GetNewBlockTime: 165.945us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.866ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 15.227ms, non-child: 15.227ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7816417) - ConvertRowBatchTime: 11.220ms - DeserializeRowBatchTimer: 44.673ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.14K (600137) - RowsReturnedRate: 39.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s686ms, non-child: 87.666ms, % non-child: 0.33%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.06 MB, 2.62 MB, 4.22 MB, 5.83 MB, 7.42 MB, 9.00 MB, 10.57 MB, 12.16 MB, 13.79 MB, 15.44 MB, 17.03 MB, 18.66 MB, 20.27 MB, 21.88 MB, 23.52 MB, 25.13 MB, 26.75 MB, 28.39 MB, 30.04 MB, 31.66 MB, 33.29 MB, 34.88 MB, 36.48 MB, 38.09 MB, 39.72 MB, 41.36 MB, 42.98 MB, 44.59 MB, 46.24 MB, 47.87 MB, 49.51 MB, 51.17 MB, 52.82 MB, 54.51 MB, 56.13 MB, 57.74 MB, 59.40 MB, 60.99 MB, 62.52 MB, 63.68 MB, 64.60 MB, 65.35 MB, 65.81 MB, 65.98 MB, 66.08 MB, 66.19 MB - BytesReceived: 66.30 MB (69523195) - ConvertRowBatchTime: 41.436ms - DeserializeRowBatchTimer: 260.501ms - FirstBatchArrivalWaitTime: 4s171ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1511370) - RowsReturnedRate: 56.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:42 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s652ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.84 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.89 MB, 159.22 MB, 159.45 MB, 167.33 MB, 167.56 MB, 167.33 MB, 168.31 MB, 168.37 MB, 168.45 MB, 168.31 MB, 168.43 MB, 168.60 MB, 168.39 MB, 168.37 MB, 168.55 MB, 170.51 MB, 170.33 MB, 170.49 MB, 170.31 MB, 170.35 MB, 170.49 MB, 170.51 MB, 170.35 MB, 170.43 MB, 170.54 MB, 170.37 MB, 170.37 MB, 170.45 MB, 194.33 MB, 290.29 MB, 298.43 MB, 298.43 MB, 300.33 MB, 302.49 MB, 302.39 MB, 302.53 MB, 302.39 MB, 302.43 MB, 302.54 MB, 302.31 MB, 302.35 MB, 302.58 MB, 302.39 MB, 302.53 MB, 302.31 MB, 302.56 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 273 (273) - PeakMemoryUsage: 302.83 MB (317543947) - PerHostPeakMemUsage: 1.60 GB (1720645053) - RowsProduced: 226.65K (226652) - TotalNetworkReceiveTime: 26s641ms - TotalNetworkSendTime: 3.801ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s759ms - SysTime: 88.986ms - UserTime: 1s167ms - VoluntaryContextSwitches: 7.59K (7592) Fragment Instance Lifecycle Timings: - ExecTime: 23s016ms - ExecTreeExecTime: 22s911ms - OpenTime: 4s597ms - ExecTreeOpenTime: 4s172ms - PrepareTime: 55.567ms - ExecTreePrepareTime: 1.336ms DataStreamSender (dst_id=11):(Total: 71.785ms, non-child: 71.785ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6508261) - NetworkThroughput(*): 253.85 MB/sec - OverallThroughput: 86.46 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.65K (226652) - SerializeBatchTime: 47.179ms - TransmitDataRPCTime: 24.450ms - UncompressedRowBatchSize: 13.62 MB (14281816) CodeGen:(Total: 457.135ms, non-child: 457.135ms, % non-child: 100.00%) - CodegenTime: 7.131ms - CompileTime: 109.065ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 313.906ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 33.607ms AGGREGATION_NODE (id=5):(Total: 27s085ms, non-child: 192.948ms, % non-child: 0.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 654.320us - GetResultsTime: 10.141ms - HTResizeTime: 18.014ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.43 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.65K (226652) - RowsReturnedRate: 8.37 K/sec - StreamingTime: 173.879ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s892ms, non-child: 204.455ms, % non-child: 0.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.59K (599586) - BuildTime: 125.310ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.52M (1515016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 192.364ms - RowsReturned: 597.96K (597959) - RowsReturnedRate: 22.23 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 80.572ms - BuildRowsPartitioned: 599.59K (599586) - GetNewBlockTime: 181.148us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.556ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.323ms, non-child: 13.323ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7811305) - ConvertRowBatchTime: 10.056ms - DeserializeRowBatchTimer: 45.577ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.59K (599586) - RowsReturnedRate: 45.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s688ms, non-child: 91.661ms, % non-child: 0.34%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.08 MB, 2.67 MB, 4.25 MB, 5.86 MB, 7.45 MB, 9.05 MB, 10.66 MB, 12.26 MB, 13.91 MB, 15.52 MB, 17.14 MB, 18.84 MB, 20.45 MB, 22.06 MB, 23.70 MB, 25.31 MB, 26.94 MB, 28.58 MB, 30.20 MB, 31.79 MB, 33.42 MB, 35.05 MB, 36.68 MB, 38.29 MB, 39.92 MB, 41.59 MB, 43.20 MB, 44.81 MB, 46.47 MB, 48.07 MB, 49.70 MB, 51.37 MB, 53.03 MB, 54.67 MB, 56.34 MB, 57.97 MB, 59.62 MB, 61.21 MB, 62.73 MB, 63.89 MB, 64.80 MB, 65.49 MB, 65.99 MB, 66.15 MB, 66.27 MB, 66.38 MB - BytesReceived: 66.46 MB (69691475) - ConvertRowBatchTime: 38.905ms - DeserializeRowBatchTimer: 468.482ms - FirstBatchArrivalWaitTime: 4s144ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1515016) - RowsReturnedRate: 56.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:3f (host=vb0234.halxg.cloudera.com:22000):(Total: 4s652ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.82 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.08 MB, 159.16 MB, 159.29 MB, 166.54 MB, 167.31 MB, 167.43 MB, 168.49 MB, 168.56 MB, 168.53 MB, 168.43 MB, 168.54 MB, 168.33 MB, 168.37 MB, 168.41 MB, 168.47 MB, 170.30 MB, 170.35 MB, 170.53 MB, 170.39 MB, 170.43 MB, 170.39 MB, 170.39 MB, 170.47 MB, 170.37 MB, 170.45 MB, 170.37 MB, 170.51 MB, 170.39 MB, 170.35 MB, 290.51 MB, 298.54 MB, 298.43 MB, 299.33 MB, 302.58 MB, 302.37 MB, 302.51 MB, 302.33 MB, 302.29 MB, 302.29 MB, 302.37 MB, 302.37 MB, 302.37 MB, 302.45 MB, 302.39 MB, 302.31 MB, 302.37 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 289 (289) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.63 GB (1747877666) - RowsProduced: 225.71K (225710) - TotalNetworkReceiveTime: 26s535ms - TotalNetworkSendTime: 3.976ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s742ms - SysTime: 122.980ms - UserTime: 1s254ms - VoluntaryContextSwitches: 7.48K (7483) Fragment Instance Lifecycle Timings: - ExecTime: 23s014ms - ExecTreeExecTime: 22s911ms - OpenTime: 4s598ms - ExecTreeOpenTime: 4s214ms - PrepareTime: 54.094ms - ExecTreePrepareTime: 1.186ms DataStreamSender (dst_id=11):(Total: 71.572ms, non-child: 71.572ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6479193) - NetworkThroughput(*): 247.19 MB/sec - OverallThroughput: 86.33 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.71K (225710) - SerializeBatchTime: 46.432ms - TransmitDataRPCTime: 24.996ms - UncompressedRowBatchSize: 13.56 MB (14222462) CodeGen:(Total: 424.182ms, non-child: 424.182ms, % non-child: 100.00%) - CodegenTime: 7.120ms - CompileTime: 113.808ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 269.085ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 40.774ms AGGREGATION_NODE (id=5):(Total: 27s126ms, non-child: 255.631ms, % non-child: 0.94%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 527.444us - GetResultsTime: 9.474ms - HTResizeTime: 27.729ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.71K (225710) - RowsReturnedRate: 8.32 K/sec - StreamingTime: 236.973ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s870ms, non-child: 264.567ms, % non-child: 0.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.10K (599100) - BuildTime: 111.580ms - PeakMemoryUsage: 153.17 MB (160610402) - ProbeRows: 1.51M (1512589) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 250.354ms - RowsReturned: 597.23K (597231) - RowsReturnedRate: 22.23 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 68.199ms - BuildRowsPartitioned: 599.10K (599100) - GetNewBlockTime: 243.468us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.303ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.787ms, non-child: 12.787ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7801640) - ConvertRowBatchTime: 10.161ms - DeserializeRowBatchTimer: 44.630ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.10K (599100) - RowsReturnedRate: 46.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s606ms, non-child: 117.244ms, % non-child: 0.44%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 964.75 KB, 2.55 MB, 4.10 MB, 5.69 MB, 7.29 MB, 8.91 MB, 10.51 MB, 12.12 MB, 13.73 MB, 15.34 MB, 16.96 MB, 18.58 MB, 20.21 MB, 21.84 MB, 23.43 MB, 25.03 MB, 26.66 MB, 28.27 MB, 29.91 MB, 31.55 MB, 33.19 MB, 34.80 MB, 36.41 MB, 38.03 MB, 39.63 MB, 41.30 MB, 42.93 MB, 44.55 MB, 46.15 MB, 47.79 MB, 49.43 MB, 51.09 MB, 52.73 MB, 54.39 MB, 56.04 MB, 57.68 MB, 59.31 MB, 60.86 MB, 62.43 MB, 63.64 MB, 64.58 MB, 65.34 MB, 65.83 MB, 66.02 MB, 66.12 MB, 66.24 MB - BytesReceived: 66.34 MB (69563641) - ConvertRowBatchTime: 58.304ms - DeserializeRowBatchTimer: 301.052ms - FirstBatchArrivalWaitTime: 4s186ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512589) - RowsReturnedRate: 56.85 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:3d (host=vb0212.halxg.cloudera.com:22000):(Total: 4s646ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 8.49 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.44 MB, 158.93 MB, 159.39 MB, 159.41 MB, 167.43 MB, 167.35 MB, 167.55 MB, 168.58 MB, 168.35 MB, 168.47 MB, 168.58 MB, 168.51 MB, 168.49 MB, 168.54 MB, 168.58 MB, 168.78 MB, 170.47 MB, 170.43 MB, 170.56 MB, 170.56 MB, 170.54 MB, 170.43 MB, 170.43 MB, 170.37 MB, 170.35 MB, 170.41 MB, 170.35 MB, 170.33 MB, 170.35 MB, 194.56 MB, 298.43 MB, 298.53 MB, 298.45 MB, 301.03 MB, 302.41 MB, 302.31 MB, 302.51 MB, 302.35 MB, 302.43 MB, 302.31 MB, 302.39 MB, 302.45 MB, 302.56 MB, 302.37 MB, 302.39 MB, 302.47 MB, 40.64 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 293 (293) - PeakMemoryUsage: 302.76 MB (317462755) - PerHostPeakMemUsage: 1.60 GB (1720996548) - RowsProduced: 226.01K (226006) - TotalNetworkReceiveTime: 26s656ms - TotalNetworkSendTime: 3.183ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s746ms - SysTime: 98.985ms - UserTime: 1s131ms - VoluntaryContextSwitches: 7.54K (7545) Fragment Instance Lifecycle Timings: - ExecTime: 23s020ms - ExecTreeExecTime: 22s915ms - OpenTime: 4s589ms - ExecTreeOpenTime: 4s219ms - PrepareTime: 56.695ms - ExecTreePrepareTime: 998.810us DataStreamSender (dst_id=11):(Total: 57.987ms, non-child: 57.987ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6490857) - NetworkThroughput(*): 421.08 MB/sec - OverallThroughput: 106.75 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226006) - SerializeBatchTime: 43.112ms - TransmitDataRPCTime: 14.700ms - UncompressedRowBatchSize: 13.58 MB (14241118) CodeGen:(Total: 401.096ms, non-child: 401.096ms, % non-child: 100.00%) - CodegenTime: 7.649ms - CompileTime: 108.232ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 260.517ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 31.783ms AGGREGATION_NODE (id=5):(Total: 27s136ms, non-child: 198.676ms, % non-child: 0.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 419.099us - GetResultsTime: 10.015ms - HTResizeTime: 16.074ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.53 MB (152601774) - PinTime: 0.000ns - ReductionFactorEstimate: 17.42 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226006) - RowsReturnedRate: 8.33 K/sec - StreamingTime: 179.119ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s937ms, non-child: 231.596ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.51K (599515) - BuildTime: 117.331ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1509753) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 218.961ms - RowsReturned: 595.84K (595842) - RowsReturnedRate: 22.12 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.379ms - BuildRowsPartitioned: 599.51K (599515) - GetNewBlockTime: 243.051us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.777ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.183ms, non-child: 13.183ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.51 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7808661) - ConvertRowBatchTime: 10.280ms - DeserializeRowBatchTimer: 40.002ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.51K (599515) - RowsReturnedRate: 45.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s706ms, non-child: 97.202ms, % non-child: 0.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 17.68 KB, 1.73 MB, 3.28 MB, 4.86 MB, 6.44 MB, 8.02 MB, 9.63 MB, 11.23 MB, 12.84 MB, 14.46 MB, 16.08 MB, 17.66 MB, 19.28 MB, 20.92 MB, 22.51 MB, 24.13 MB, 25.78 MB, 27.38 MB, 29.01 MB, 30.62 MB, 32.24 MB, 33.89 MB, 35.50 MB, 37.10 MB, 38.70 MB, 40.34 MB, 41.98 MB, 43.59 MB, 45.21 MB, 46.84 MB, 48.48 MB, 50.11 MB, 51.78 MB, 53.43 MB, 55.04 MB, 56.70 MB, 58.36 MB, 60.00 MB, 61.56 MB, 62.99 MB, 64.01 MB, 64.84 MB, 65.48 MB, 65.85 MB, 65.98 MB, 66.02 MB - BytesReceived: 66.23 MB (69444539) - ConvertRowBatchTime: 41.267ms - DeserializeRowBatchTimer: 456.742ms - FirstBatchArrivalWaitTime: 4s197ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1509753) - RowsReturnedRate: 56.53 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:3e (host=vb0224.halxg.cloudera.com:22000):(Total: 4s646ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.84 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.85 MB, 158.95 MB, 159.53 MB, 167.29 MB, 167.29 MB, 167.47 MB, 168.41 MB, 168.51 MB, 168.45 MB, 168.43 MB, 168.33 MB, 168.33 MB, 168.43 MB, 168.47 MB, 168.43 MB, 170.29 MB, 170.58 MB, 170.49 MB, 170.35 MB, 170.60 MB, 170.37 MB, 170.37 MB, 170.47 MB, 170.35 MB, 170.47 MB, 170.56 MB, 170.45 MB, 170.49 MB, 170.37 MB, 290.47 MB, 298.56 MB, 298.41 MB, 299.35 MB, 302.37 MB, 302.43 MB, 302.37 MB, 302.58 MB, 302.43 MB, 302.33 MB, 302.47 MB, 302.51 MB, 302.41 MB, 302.54 MB, 302.41 MB, 302.35 MB, 302.39 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 219 (219) - PeakMemoryUsage: 302.88 MB (317587727) - PerHostPeakMemUsage: 1.60 GB (1720395712) - RowsProduced: 225.92K (225919) - TotalNetworkReceiveTime: 26s599ms - TotalNetworkSendTime: 3.134ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s757ms - SysTime: 102.983ms - UserTime: 1s182ms - VoluntaryContextSwitches: 7.57K (7567) Fragment Instance Lifecycle Timings: - ExecTime: 23s023ms - ExecTreeExecTime: 22s916ms - OpenTime: 4s594ms - ExecTreeOpenTime: 4s215ms - PrepareTime: 52.067ms - ExecTreePrepareTime: 1.055ms DataStreamSender (dst_id=11):(Total: 58.962ms, non-child: 58.962ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6485414) - NetworkThroughput(*): 453.30 MB/sec - OverallThroughput: 104.90 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.92K (225919) - SerializeBatchTime: 45.148ms - TransmitDataRPCTime: 13.644ms - UncompressedRowBatchSize: 13.58 MB (14235637) CodeGen:(Total: 413.862ms, non-child: 413.862ms, % non-child: 100.00%) - CodegenTime: 7.648ms - CompileTime: 109.448ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 267.642ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 36.273ms AGGREGATION_NODE (id=5):(Total: 27s133ms, non-child: 230.283ms, % non-child: 0.85%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 676.876us - GetResultsTime: 10.440ms - HTResizeTime: 23.581ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.48 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.92K (225919) - RowsReturnedRate: 8.33 K/sec - StreamingTime: 210.427ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s902ms, non-child: 244.651ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.57K (600572) - BuildTime: 121.479ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510897) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 232.259ms - RowsReturned: 596.62K (596623) - RowsReturnedRate: 22.18 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.454ms - BuildRowsPartitioned: 600.57K (600572) - GetNewBlockTime: 228.764us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.823ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.024ms, non-child: 13.024ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB - BytesReceived: 7.46 MB (7823303) - ConvertRowBatchTime: 10.178ms - DeserializeRowBatchTimer: 45.032ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.57K (600572) - RowsReturnedRate: 46.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s658ms, non-child: 107.132ms, % non-child: 0.40%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 947.69 KB, 2.45 MB, 4.06 MB, 5.67 MB, 7.28 MB, 8.85 MB, 10.44 MB, 12.05 MB, 13.69 MB, 15.30 MB, 16.96 MB, 18.58 MB, 20.20 MB, 21.83 MB, 23.43 MB, 25.07 MB, 26.68 MB, 28.31 MB, 29.95 MB, 31.54 MB, 33.15 MB, 34.76 MB, 36.42 MB, 38.04 MB, 39.66 MB, 41.27 MB, 42.88 MB, 44.51 MB, 46.17 MB, 47.79 MB, 49.40 MB, 51.04 MB, 52.72 MB, 54.35 MB, 55.99 MB, 57.62 MB, 59.29 MB, 60.84 MB, 62.37 MB, 63.59 MB, 64.51 MB, 65.28 MB, 65.78 MB, 65.95 MB, 66.06 MB, 66.17 MB - BytesReceived: 66.28 MB (69495856) - ConvertRowBatchTime: 49.049ms - DeserializeRowBatchTimer: 469.958ms - FirstBatchArrivalWaitTime: 4s193ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510897) - RowsReturnedRate: 56.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:40 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.38 MB, 152.04 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.97 MB, 159.43 MB, 159.31 MB, 167.37 MB, 167.39 MB, 167.39 MB, 168.43 MB, 168.45 MB, 168.39 MB, 168.47 MB, 168.29 MB, 168.33 MB, 168.39 MB, 168.39 MB, 168.59 MB, 170.43 MB, 170.58 MB, 170.47 MB, 170.37 MB, 170.39 MB, 170.49 MB, 170.29 MB, 170.59 MB, 170.29 MB, 170.45 MB, 170.41 MB, 170.43 MB, 170.35 MB, 194.39 MB, 298.35 MB, 298.35 MB, 298.56 MB, 300.83 MB, 302.43 MB, 302.51 MB, 302.35 MB, 302.33 MB, 302.33 MB, 302.47 MB, 302.37 MB, 302.41 MB, 302.31 MB, 302.54 MB, 302.35 MB, 302.58 MB, 302.41 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 362 (362) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.60 GB (1721325092) - RowsProduced: 225.69K (225687) - TotalNetworkReceiveTime: 26s550ms - TotalNetworkSendTime: 3.991ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s784ms - SysTime: 143.978ms - UserTime: 1s257ms - VoluntaryContextSwitches: 7.49K (7488) Fragment Instance Lifecycle Timings: - ExecTime: 23s046ms - ExecTreeExecTime: 22s922ms - OpenTime: 4s586ms - ExecTreeOpenTime: 4s195ms - PrepareTime: 59.059ms - ExecTreePrepareTime: 1.113ms DataStreamSender (dst_id=11):(Total: 66.794ms, non-child: 66.794ms, % non-child: 100.00%) - BytesSent: 6.18 MB (6479914) - NetworkThroughput(*): 410.26 MB/sec - OverallThroughput: 92.52 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 225.69K (225687) - SerializeBatchTime: 51.528ms - TransmitDataRPCTime: 15.063ms - UncompressedRowBatchSize: 13.56 MB (14221013) CodeGen:(Total: 431.257ms, non-child: 431.257ms, % non-child: 100.00%) - CodegenTime: 7.877ms - CompileTime: 109.486ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 280.760ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 40.449ms AGGREGATION_NODE (id=5):(Total: 27s118ms, non-child: 252.925ms, % non-child: 0.93%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 556.948us - GetResultsTime: 11.730ms - HTResizeTime: 27.963ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.48 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 225.69K (225687) - RowsReturnedRate: 8.32 K/sec - StreamingTime: 231.320ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s865ms, non-child: 247.348ms, % non-child: 0.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 598.38K (598376) - BuildTime: 131.960ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512081) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 232.244ms - RowsReturned: 596.11K (596109) - RowsReturnedRate: 22.19 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.261ms - BuildRowsPartitioned: 598.38K (598376) - GetNewBlockTime: 236.236us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.261ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.310ms, non-child: 13.310ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB, 7.44 MB - BytesReceived: 7.44 MB (7798291) - ConvertRowBatchTime: 10.426ms - DeserializeRowBatchTimer: 43.453ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 598.38K (598376) - RowsReturnedRate: 44.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s618ms, non-child: 115.811ms, % non-child: 0.44%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.33 MB, 2.90 MB, 4.46 MB, 6.06 MB, 7.64 MB, 9.26 MB, 10.85 MB, 12.48 MB, 14.15 MB, 15.76 MB, 17.39 MB, 19.02 MB, 20.62 MB, 22.23 MB, 23.89 MB, 25.49 MB, 27.13 MB, 28.74 MB, 30.40 MB, 32.03 MB, 33.64 MB, 35.26 MB, 36.88 MB, 38.45 MB, 40.09 MB, 41.74 MB, 43.32 MB, 44.95 MB, 46.58 MB, 48.23 MB, 49.85 MB, 51.52 MB, 53.17 MB, 54.83 MB, 56.48 MB, 58.12 MB, 59.72 MB, 61.30 MB, 62.76 MB, 63.87 MB, 64.79 MB, 65.47 MB, 65.89 MB, 66.02 MB, 66.13 MB, 66.27 MB - BytesReceived: 66.34 MB (69562061) - ConvertRowBatchTime: 55.523ms - DeserializeRowBatchTimer: 298.861ms - FirstBatchArrivalWaitTime: 4s169ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512081) - RowsReturnedRate: 56.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:45 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 3.85 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.89 MB, 159.37 MB, 159.49 MB, 167.41 MB, 167.47 MB, 167.48 MB, 168.56 MB, 168.54 MB, 168.37 MB, 168.58 MB, 168.29 MB, 168.53 MB, 168.31 MB, 168.33 MB, 169.66 MB, 170.33 MB, 170.33 MB, 170.43 MB, 170.47 MB, 170.41 MB, 170.33 MB, 170.35 MB, 170.39 MB, 170.45 MB, 170.39 MB, 170.31 MB, 170.29 MB, 170.37 MB, 234.41 MB, 298.33 MB, 298.37 MB, 298.41 MB, 301.60 MB, 302.47 MB, 302.35 MB, 302.29 MB, 302.35 MB, 302.43 MB, 302.31 MB, 302.56 MB, 302.45 MB, 302.37 MB, 302.41 MB, 302.49 MB, 302.43 MB, 103.97 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 342 (342) - PeakMemoryUsage: 302.88 MB (317587727) - PerHostPeakMemUsage: 1.60 GB (1713159721) - RowsProduced: 226.75K (226754) - TotalNetworkReceiveTime: 26s564ms - TotalNetworkSendTime: 3.711ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s745ms - SysTime: 110.982ms - UserTime: 1s245ms - VoluntaryContextSwitches: 7.49K (7487) Fragment Instance Lifecycle Timings: - ExecTime: 23s023ms - ExecTreeExecTime: 22s919ms - OpenTime: 4s585ms - ExecTreeOpenTime: 4s200ms - PrepareTime: 60.266ms - ExecTreePrepareTime: 1.090ms DataStreamSender (dst_id=11):(Total: 70.273ms, non-child: 70.273ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6510285) - NetworkThroughput(*): 257.72 MB/sec - OverallThroughput: 88.35 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.75K (226754) - SerializeBatchTime: 46.030ms - TransmitDataRPCTime: 24.090ms - UncompressedRowBatchSize: 13.63 MB (14288258) CodeGen:(Total: 421.901ms, non-child: 421.901ms, % non-child: 100.00%) - CodegenTime: 7.325ms - CompileTime: 109.482ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 274.595ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 37.268ms AGGREGATION_NODE (id=5):(Total: 27s120ms, non-child: 243.582ms, % non-child: 0.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 460.976us - GetResultsTime: 9.649ms - HTResizeTime: 25.682ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.44 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.75K (226754) - RowsReturnedRate: 8.36 K/sec - StreamingTime: 225.080ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s876ms, non-child: 244.824ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.12K (599125) - BuildTime: 117.492ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510659) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 230.563ms - RowsReturned: 598.24K (598243) - RowsReturnedRate: 22.26 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.268ms - BuildRowsPartitioned: 599.12K (599125) - GetNewBlockTime: 237.032us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.688ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.161ms, non-child: 13.161ms, % non-child: 100.00%) BytesReceived(500.000ms): 18.32 KB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7806702) - ConvertRowBatchTime: 10.128ms - DeserializeRowBatchTimer: 43.348ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.12K (599125) - RowsReturnedRate: 45.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s632ms, non-child: 115.355ms, % non-child: 0.43%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.53 MB, 3.09 MB, 4.72 MB, 6.35 MB, 7.95 MB, 9.51 MB, 11.09 MB, 12.74 MB, 14.37 MB, 16.04 MB, 17.66 MB, 19.29 MB, 20.90 MB, 22.52 MB, 24.13 MB, 25.76 MB, 27.37 MB, 28.98 MB, 30.61 MB, 32.26 MB, 33.84 MB, 35.46 MB, 37.05 MB, 38.70 MB, 40.29 MB, 41.91 MB, 43.53 MB, 45.13 MB, 46.77 MB, 48.39 MB, 50.04 MB, 51.67 MB, 53.31 MB, 54.97 MB, 56.59 MB, 58.22 MB, 59.86 MB, 61.42 MB, 62.90 MB, 63.95 MB, 64.84 MB, 65.49 MB, 65.86 MB, 65.99 MB, 66.10 MB - BytesReceived: 66.27 MB (69486158) - ConvertRowBatchTime: 55.359ms - DeserializeRowBatchTimer: 284.504ms - FirstBatchArrivalWaitTime: 4s177ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510659) - RowsReturnedRate: 56.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:43 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.91 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.95 MB, 158.85 MB, 159.41 MB, 165.41 MB, 167.53 MB, 167.43 MB, 168.34 MB, 168.51 MB, 168.33 MB, 168.29 MB, 168.49 MB, 168.56 MB, 168.43 MB, 168.47 MB, 168.49 MB, 170.22 MB, 170.61 MB, 170.45 MB, 170.54 MB, 170.45 MB, 170.47 MB, 170.56 MB, 170.31 MB, 170.37 MB, 170.54 MB, 170.54 MB, 170.49 MB, 170.51 MB, 170.33 MB, 250.53 MB, 298.41 MB, 298.49 MB, 298.53 MB, 302.43 MB, 302.43 MB, 302.55 MB, 302.43 MB, 302.45 MB, 302.49 MB, 302.47 MB, 302.31 MB, 302.39 MB, 302.53 MB, 302.31 MB, 302.33 MB, 302.58 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 206 (206) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.60 GB (1720128972) - RowsProduced: 226.41K (226407) - TotalNetworkReceiveTime: 26s702ms - TotalNetworkSendTime: 3.586ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s763ms - SysTime: 108.982ms - UserTime: 1s081ms - VoluntaryContextSwitches: 7.62K (7619) Fragment Instance Lifecycle Timings: - ExecTime: 23s022ms - ExecTreeExecTime: 22s919ms - OpenTime: 4s587ms - ExecTreeOpenTime: 4s210ms - PrepareTime: 57.871ms - ExecTreePrepareTime: 1.077ms DataStreamSender (dst_id=11):(Total: 57.884ms, non-child: 57.884ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6500078) - NetworkThroughput(*): 441.71 MB/sec - OverallThroughput: 107.09 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.41K (226407) - SerializeBatchTime: 43.711ms - TransmitDataRPCTime: 14.033ms - UncompressedRowBatchSize: 13.61 MB (14266377) CodeGen:(Total: 412.915ms, non-child: 412.915ms, % non-child: 100.00%) - CodegenTime: 7.999ms - CompileTime: 108.479ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 267.294ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 36.643ms AGGREGATION_NODE (id=5):(Total: 27s131ms, non-child: 187.695ms, % non-child: 0.69%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 593.632us - GetResultsTime: 9.861ms - HTResizeTime: 16.035ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.54 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.41K (226407) - RowsReturnedRate: 8.34 K/sec - StreamingTime: 168.639ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s943ms, non-child: 195.906ms, % non-child: 0.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.69K (600689) - BuildTime: 133.522ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1514342) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 183.812ms - RowsReturned: 599.40K (599405) - RowsReturnedRate: 22.25 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 88.064ms - BuildRowsPartitioned: 600.69K (600689) - GetNewBlockTime: 178.728us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.144ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.308ms, non-child: 13.308ms, % non-child: 100.00%) BytesReceived(500.000ms): 6.71 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB, 7.46 MB - BytesReceived: 7.46 MB (7822566) - ConvertRowBatchTime: 10.355ms - DeserializeRowBatchTimer: 43.462ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.69K (600689) - RowsReturnedRate: 45.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s748ms, non-child: 92.040ms, % non-child: 0.34%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 581.16 KB, 2.18 MB, 3.78 MB, 5.36 MB, 6.98 MB, 8.55 MB, 10.15 MB, 11.78 MB, 13.41 MB, 15.05 MB, 16.67 MB, 18.27 MB, 19.88 MB, 21.51 MB, 23.14 MB, 24.74 MB, 26.37 MB, 27.97 MB, 29.59 MB, 31.25 MB, 32.88 MB, 34.50 MB, 36.08 MB, 37.68 MB, 39.34 MB, 40.95 MB, 42.63 MB, 44.21 MB, 45.84 MB, 47.46 MB, 49.11 MB, 50.77 MB, 52.40 MB, 54.07 MB, 55.73 MB, 57.36 MB, 59.01 MB, 60.63 MB, 62.18 MB, 63.51 MB, 64.47 MB, 65.28 MB, 65.84 MB, 66.10 MB, 66.19 MB, 66.31 MB - BytesReceived: 66.44 MB (69664020) - ConvertRowBatchTime: 37.750ms - DeserializeRowBatchTimer: 468.496ms - FirstBatchArrivalWaitTime: 4s185ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1514342) - RowsReturnedRate: 56.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:48 (host=vb0226.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 13.33 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.64 MB, 159.03 MB, 159.37 MB, 159.49 MB, 167.35 MB, 167.61 MB, 167.79 MB, 168.39 MB, 168.37 MB, 168.45 MB, 168.56 MB, 168.47 MB, 168.54 MB, 168.35 MB, 168.55 MB, 169.74 MB, 170.31 MB, 170.43 MB, 170.35 MB, 170.37 MB, 170.39 MB, 170.47 MB, 170.54 MB, 170.35 MB, 170.49 MB, 170.31 MB, 170.35 MB, 170.56 MB, 170.41 MB, 226.45 MB, 298.33 MB, 298.37 MB, 298.54 MB, 302.08 MB, 302.49 MB, 302.45 MB, 302.47 MB, 302.29 MB, 302.33 MB, 302.39 MB, 302.53 MB, 302.54 MB, 302.31 MB, 302.35 MB, 302.59 MB, 302.33 MB, 22.50 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 291 (291) - PeakMemoryUsage: 302.76 MB (317465939) - PerHostPeakMemUsage: 1.60 GB (1719830126) - RowsProduced: 226.01K (226010) - TotalNetworkReceiveTime: 26s631ms - TotalNetworkSendTime: 3.134ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s786ms - SysTime: 115.982ms - UserTime: 1s162ms - VoluntaryContextSwitches: 7.57K (7565) Fragment Instance Lifecycle Timings: - ExecTime: 23s038ms - ExecTreeExecTime: 22s924ms - OpenTime: 4s603ms - ExecTreeOpenTime: 4s213ms - PrepareTime: 41.389ms - ExecTreePrepareTime: 1.200ms DataStreamSender (dst_id=11):(Total: 60.540ms, non-child: 60.540ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6489869) - NetworkThroughput(*): 414.90 MB/sec - OverallThroughput: 102.23 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.01K (226010) - SerializeBatchTime: 45.465ms - TransmitDataRPCTime: 14.917ms - UncompressedRowBatchSize: 13.58 MB (14241366) CodeGen:(Total: 420.860ms, non-child: 420.860ms, % non-child: 100.00%) - CodegenTime: 7.449ms - CompileTime: 109.122ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 280.679ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 30.505ms AGGREGATION_NODE (id=5):(Total: 27s138ms, non-child: 220.236ms, % non-child: 0.81%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 542.416us - GetResultsTime: 10.726ms - HTResizeTime: 19.456ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.50 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.01K (226010) - RowsReturnedRate: 8.33 K/sec - StreamingTime: 199.227ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s918ms, non-child: 230.869ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.76K (599760) - BuildTime: 125.139ms - PeakMemoryUsage: 153.17 MB (160607122) - ProbeRows: 1.51M (1512321) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 216.993ms - RowsReturned: 597.51K (597507) - RowsReturnedRate: 22.20 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 79.301ms - BuildRowsPartitioned: 599.76K (599760) - GetNewBlockTime: 228.348us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.221ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.072ms, non-child: 13.072ms, % non-child: 100.00%) BytesReceived(500.000ms): 3.05 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7813912) - ConvertRowBatchTime: 10.195ms - DeserializeRowBatchTimer: 43.137ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.76K (599760) - RowsReturnedRate: 45.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s687ms, non-child: 103.305ms, % non-child: 0.39%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 98.39 KB, 1.82 MB, 3.36 MB, 4.99 MB, 6.63 MB, 8.23 MB, 9.79 MB, 11.41 MB, 13.01 MB, 14.67 MB, 16.29 MB, 17.95 MB, 19.56 MB, 21.18 MB, 22.80 MB, 24.39 MB, 26.02 MB, 27.64 MB, 29.26 MB, 30.88 MB, 32.48 MB, 34.08 MB, 35.69 MB, 37.30 MB, 38.93 MB, 40.56 MB, 42.20 MB, 43.86 MB, 45.42 MB, 47.06 MB, 48.71 MB, 50.35 MB, 52.00 MB, 53.61 MB, 55.25 MB, 56.94 MB, 58.61 MB, 60.24 MB, 61.74 MB, 63.15 MB, 64.20 MB, 65.02 MB, 65.63 MB, 65.96 MB, 66.07 MB, 66.18 MB - BytesReceived: 66.33 MB (69556464) - ConvertRowBatchTime: 46.778ms - DeserializeRowBatchTimer: 466.689ms - FirstBatchArrivalWaitTime: 4s187ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512321) - RowsReturnedRate: 56.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:44 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 3.80 MB, 152.41 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.93 MB, 159.45 MB, 159.47 MB, 167.47 MB, 167.53 MB, 167.43 MB, 168.39 MB, 168.39 MB, 168.41 MB, 168.54 MB, 168.41 MB, 168.29 MB, 168.37 MB, 168.41 MB, 168.93 MB, 170.43 MB, 170.53 MB, 170.31 MB, 170.43 MB, 170.49 MB, 170.39 MB, 170.43 MB, 170.51 MB, 170.47 MB, 170.31 MB, 170.43 MB, 170.54 MB, 170.37 MB, 210.35 MB, 298.41 MB, 298.29 MB, 298.45 MB, 301.51 MB, 302.43 MB, 302.39 MB, 302.39 MB, 302.33 MB, 302.51 MB, 302.47 MB, 302.54 MB, 302.37 MB, 302.58 MB, 302.41 MB, 302.41 MB, 302.45 MB, 122.24 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 311 (311) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1721390396) - RowsProduced: 226.08K (226079) - TotalNetworkReceiveTime: 26s646ms - TotalNetworkSendTime: 3.825ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s755ms - SysTime: 103.984ms - UserTime: 1s139ms - VoluntaryContextSwitches: 7.62K (7619) Fragment Instance Lifecycle Timings: - ExecTime: 23s026ms - ExecTreeExecTime: 22s921ms - OpenTime: 4s587ms - ExecTreeOpenTime: 4s193ms - PrepareTime: 57.895ms - ExecTreePrepareTime: 1.142ms DataStreamSender (dst_id=11):(Total: 68.703ms, non-child: 68.703ms, % non-child: 100.00%) - BytesSent: 6.19 MB (6488971) - NetworkThroughput(*): 289.72 MB/sec - OverallThroughput: 90.07 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.08K (226079) - SerializeBatchTime: 47.199ms - TransmitDataRPCTime: 21.359ms - UncompressedRowBatchSize: 13.59 MB (14245725) CodeGen:(Total: 437.341ms, non-child: 437.341ms, % non-child: 100.00%) - CodegenTime: 10.978ms - CompileTime: 110.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 282.573ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 44.197ms AGGREGATION_NODE (id=5):(Total: 27s115ms, non-child: 203.089ms, % non-child: 0.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 410.848us - GetResultsTime: 10.585ms - HTResizeTime: 17.383ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.49 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.08K (226079) - RowsReturnedRate: 8.34 K/sec - StreamingTime: 183.820ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s912ms, non-child: 215.645ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.72K (599717) - BuildTime: 122.478ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.52M (1515800) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 203.277ms - RowsReturned: 597.23K (597227) - RowsReturnedRate: 22.19 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.583ms - BuildRowsPartitioned: 599.72K (599717) - GetNewBlockTime: 246.936us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.183ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.194ms, non-child: 13.194ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7813461) - ConvertRowBatchTime: 10.355ms - DeserializeRowBatchTimer: 42.606ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.72K (599717) - RowsReturnedRate: 45.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s697ms, non-child: 97.616ms, % non-child: 0.37%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.54 MB, 3.13 MB, 4.71 MB, 6.33 MB, 7.93 MB, 9.52 MB, 11.10 MB, 12.72 MB, 14.35 MB, 15.98 MB, 17.58 MB, 19.24 MB, 20.84 MB, 22.43 MB, 24.06 MB, 25.67 MB, 27.29 MB, 28.94 MB, 30.57 MB, 32.22 MB, 33.83 MB, 35.46 MB, 37.11 MB, 38.72 MB, 40.35 MB, 41.97 MB, 43.60 MB, 45.23 MB, 46.88 MB, 48.53 MB, 50.18 MB, 51.87 MB, 53.47 MB, 55.14 MB, 56.78 MB, 58.41 MB, 60.08 MB, 61.64 MB, 63.11 MB, 64.17 MB, 65.04 MB, 65.72 MB, 66.09 MB, 66.22 MB, 66.33 MB - BytesReceived: 66.50 MB (69725907) - ConvertRowBatchTime: 41.989ms - DeserializeRowBatchTimer: 469.276ms - FirstBatchArrivalWaitTime: 4s168ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1515800) - RowsReturnedRate: 56.78 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:47 (host=vb0214.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 24.83 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.91 MB, 159.33 MB, 159.29 MB, 167.54 MB, 167.47 MB, 167.43 MB, 168.47 MB, 168.39 MB, 168.51 MB, 168.49 MB, 168.29 MB, 168.49 MB, 168.31 MB, 168.35 MB, 168.57 MB, 170.31 MB, 170.31 MB, 170.56 MB, 170.29 MB, 170.47 MB, 170.47 MB, 170.49 MB, 170.49 MB, 170.51 MB, 170.41 MB, 170.31 MB, 170.56 MB, 170.39 MB, 178.47 MB, 298.35 MB, 298.41 MB, 298.47 MB, 300.60 MB, 302.29 MB, 302.47 MB, 302.29 MB, 302.35 MB, 302.31 MB, 302.37 MB, 302.41 MB, 302.53 MB, 302.54 MB, 302.56 MB, 302.49 MB, 302.47 MB, 302.39 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 258 (258) - PeakMemoryUsage: 302.74 MB (317442457) - PerHostPeakMemUsage: 1.59 GB (1707502940) - RowsProduced: 226.70K (226701) - TotalNetworkReceiveTime: 26s654ms - TotalNetworkSendTime: 2.959ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s760ms - SysTime: 101.984ms - UserTime: 1s124ms - VoluntaryContextSwitches: 7.59K (7595) Fragment Instance Lifecycle Timings: - ExecTime: 23s025ms - ExecTreeExecTime: 22s920ms - OpenTime: 4s589ms - ExecTreeOpenTime: 4s199ms - PrepareTime: 55.651ms - ExecTreePrepareTime: 1.040ms DataStreamSender (dst_id=11):(Total: 71.398ms, non-child: 71.398ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6510199) - NetworkThroughput(*): 256.62 MB/sec - OverallThroughput: 86.96 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.70K (226701) - SerializeBatchTime: 47.068ms - TransmitDataRPCTime: 24.193ms - UncompressedRowBatchSize: 13.62 MB (14284911) CodeGen:(Total: 432.482ms, non-child: 432.482ms, % non-child: 100.00%) - CodegenTime: 7.779ms - CompileTime: 107.895ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 281.223ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 42.816ms AGGREGATION_NODE (id=5):(Total: 27s120ms, non-child: 197.608ms, % non-child: 0.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 587.357us - GetResultsTime: 9.711ms - HTResizeTime: 15.875ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.51 MB (152581476) - PinTime: 0.000ns - ReductionFactorEstimate: 17.47 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.70K (226701) - RowsReturnedRate: 8.36 K/sec - StreamingTime: 179.242ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s922ms, non-child: 218.544ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.40K (599400) - BuildTime: 125.794ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1513156) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 206.607ms - RowsReturned: 598.55K (598547) - RowsReturnedRate: 22.23 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 81.696ms - BuildRowsPartitioned: 599.40K (599400) - GetNewBlockTime: 230.221us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.833ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.101ms, non-child: 13.101ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7810257) - ConvertRowBatchTime: 10.206ms - DeserializeRowBatchTimer: 45.256ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.40K (599400) - RowsReturnedRate: 45.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s704ms, non-child: 97.170ms, % non-child: 0.36%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.09 MB, 2.67 MB, 4.27 MB, 5.87 MB, 7.45 MB, 9.05 MB, 10.65 MB, 12.27 MB, 13.89 MB, 15.50 MB, 17.12 MB, 18.78 MB, 20.46 MB, 22.09 MB, 23.74 MB, 25.39 MB, 27.00 MB, 28.60 MB, 30.18 MB, 31.83 MB, 33.45 MB, 35.04 MB, 36.61 MB, 38.23 MB, 39.90 MB, 41.51 MB, 43.11 MB, 44.73 MB, 46.34 MB, 48.00 MB, 49.65 MB, 51.29 MB, 52.99 MB, 54.63 MB, 56.28 MB, 57.90 MB, 59.54 MB, 61.15 MB, 62.65 MB, 63.85 MB, 64.74 MB, 65.43 MB, 65.89 MB, 66.07 MB, 66.16 MB, 66.26 MB - BytesReceived: 66.38 MB (69601352) - ConvertRowBatchTime: 41.428ms - DeserializeRowBatchTimer: 478.621ms - FirstBatchArrivalWaitTime: 4s173ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1513156) - RowsReturnedRate: 56.66 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:4a (host=vb0228.halxg.cloudera.com:22000):(Total: 4s644ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 3.80 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.87 MB, 159.49 MB, 159.31 MB, 167.45 MB, 167.45 MB, 167.53 MB, 168.47 MB, 168.33 MB, 168.47 MB, 168.47 MB, 168.35 MB, 168.41 MB, 168.54 MB, 168.31 MB, 169.08 MB, 170.47 MB, 170.35 MB, 170.41 MB, 170.35 MB, 170.43 MB, 170.29 MB, 170.41 MB, 170.56 MB, 170.49 MB, 170.60 MB, 170.37 MB, 170.41 MB, 170.51 MB, 234.39 MB, 298.54 MB, 298.58 MB, 298.49 MB, 301.35 MB, 302.47 MB, 302.54 MB, 302.45 MB, 302.37 MB, 302.29 MB, 302.45 MB, 302.39 MB, 302.31 MB, 302.47 MB, 302.35 MB, 302.39 MB, 302.35 MB, 131.12 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 401 (401) - PeakMemoryUsage: 302.86 MB (317567429) - PerHostPeakMemUsage: 1.58 GB (1695392252) - RowsProduced: 226.65K (226646) - TotalNetworkReceiveTime: 26s544ms - TotalNetworkSendTime: 3.356ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s747ms - SysTime: 111.983ms - UserTime: 1s260ms - VoluntaryContextSwitches: 7.47K (7472) Fragment Instance Lifecycle Timings: - ExecTime: 23s034ms - ExecTreeExecTime: 22s924ms - OpenTime: 4s583ms - ExecTreeOpenTime: 4s209ms - PrepareTime: 61.089ms - ExecTreePrepareTime: 1.181ms DataStreamSender (dst_id=11):(Total: 60.076ms, non-child: 60.076ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6508355) - NetworkThroughput(*): 436.83 MB/sec - OverallThroughput: 103.32 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.65K (226646) - SerializeBatchTime: 45.688ms - TransmitDataRPCTime: 14.208ms - UncompressedRowBatchSize: 13.62 MB (14281446) CodeGen:(Total: 412.709ms, non-child: 412.709ms, % non-child: 100.00%) - CodegenTime: 6.730ms - CompileTime: 108.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 264.392ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 39.301ms AGGREGATION_NODE (id=5):(Total: 27s134ms, non-child: 256.530ms, % non-child: 0.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 732.716us - GetResultsTime: 10.615ms - HTResizeTime: 28.918ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.43 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.65K (226646) - RowsReturnedRate: 8.35 K/sec - StreamingTime: 235.912ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s878ms, non-child: 263.847ms, % non-child: 0.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 600.85K (600846) - BuildTime: 111.148ms - PeakMemoryUsage: 153.17 MB (160611760) - ProbeRows: 1.51M (1510992) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 249.798ms - RowsReturned: 598.18K (598176) - RowsReturnedRate: 22.25 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 66.723ms - BuildRowsPartitioned: 600.85K (600846) - GetNewBlockTime: 211.516us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.629ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.204ms, non-child: 13.204ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB, 7.47 MB - BytesReceived: 7.47 MB (7831133) - ConvertRowBatchTime: 10.559ms - DeserializeRowBatchTimer: 41.897ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 600.85K (600846) - RowsReturnedRate: 45.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s614ms, non-child: 118.132ms, % non-child: 0.44%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.52 MB, 3.10 MB, 4.69 MB, 6.32 MB, 7.85 MB, 9.43 MB, 11.00 MB, 12.64 MB, 14.23 MB, 15.86 MB, 17.47 MB, 19.11 MB, 20.74 MB, 22.34 MB, 23.92 MB, 25.56 MB, 27.21 MB, 28.81 MB, 30.44 MB, 32.04 MB, 33.69 MB, 35.32 MB, 36.96 MB, 38.54 MB, 40.16 MB, 41.81 MB, 43.44 MB, 45.06 MB, 46.72 MB, 48.36 MB, 50.00 MB, 51.67 MB, 53.31 MB, 54.93 MB, 56.54 MB, 58.20 MB, 59.87 MB, 61.41 MB, 62.87 MB, 63.93 MB, 64.83 MB, 65.49 MB, 65.88 MB, 65.99 MB, 66.11 MB - BytesReceived: 66.28 MB (69502363) - ConvertRowBatchTime: 56.978ms - DeserializeRowBatchTimer: 291.131ms - FirstBatchArrivalWaitTime: 4s183ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510992) - RowsReturnedRate: 56.77 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:49 (host=vb0232.halxg.cloudera.com:22000):(Total: 4s644ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 25.16 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.81 MB, 158.85 MB, 159.47 MB, 166.47 MB, 167.49 MB, 167.35 MB, 168.39 MB, 168.61 MB, 168.41 MB, 168.54 MB, 168.35 MB, 168.47 MB, 168.47 MB, 168.53 MB, 168.59 MB, 170.33 MB, 170.43 MB, 170.56 MB, 170.35 MB, 170.47 MB, 170.37 MB, 170.41 MB, 170.49 MB, 170.31 MB, 170.31 MB, 170.47 MB, 170.37 MB, 170.58 MB, 170.56 MB, 274.39 MB, 298.37 MB, 298.58 MB, 298.72 MB, 302.10 MB, 302.33 MB, 302.33 MB, 302.45 MB, 302.29 MB, 302.37 MB, 302.51 MB, 302.37 MB, 302.45 MB, 302.41 MB, 302.41 MB, 302.35 MB, 302.39 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 293 (293) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1720112795) - RowsProduced: 226.34K (226342) - TotalNetworkReceiveTime: 26s716ms - TotalNetworkSendTime: 2.370ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s776ms - SysTime: 79.988ms - UserTime: 1s098ms - VoluntaryContextSwitches: 7.54K (7541) Fragment Instance Lifecycle Timings: - ExecTime: 23s026ms - ExecTreeExecTime: 22s922ms - OpenTime: 4s606ms - ExecTreeOpenTime: 4s217ms - PrepareTime: 38.038ms - ExecTreePrepareTime: 512.788us DataStreamSender (dst_id=11):(Total: 58.562ms, non-child: 58.562ms, % non-child: 100.00%) - BytesSent: 6.20 MB (6499789) - NetworkThroughput(*): 452.02 MB/sec - OverallThroughput: 105.85 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.34K (226342) - SerializeBatchTime: 44.703ms - TransmitDataRPCTime: 13.713ms - UncompressedRowBatchSize: 13.60 MB (14262290) CodeGen:(Total: 417.171ms, non-child: 417.171ms, % non-child: 100.00%) - CodegenTime: 6.871ms - CompileTime: 113.990ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 273.295ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 29.355ms AGGREGATION_NODE (id=5):(Total: 27s140ms, non-child: 179.929ms, % non-child: 0.66%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 355.464us - GetResultsTime: 10.185ms - HTResizeTime: 17.254ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.45 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.34K (226342) - RowsReturnedRate: 8.34 K/sec - StreamingTime: 161.971ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s960ms, non-child: 200.426ms, % non-child: 0.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.57K (599574) - BuildTime: 123.960ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1510381) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 188.921ms - RowsReturned: 597.67K (597669) - RowsReturnedRate: 22.17 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.753ms - BuildRowsPartitioned: 599.57K (599574) - GetNewBlockTime: 215.192us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.278ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.652ms, non-child: 13.652ms, % non-child: 100.00%) BytesReceived(500.000ms): 6.79 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7810863) - ConvertRowBatchTime: 10.821ms - DeserializeRowBatchTimer: 44.924ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.57K (599574) - RowsReturnedRate: 43.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s760ms, non-child: 79.426ms, % non-child: 0.30%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 607.40 KB, 2.18 MB, 3.81 MB, 5.39 MB, 7.01 MB, 8.61 MB, 10.20 MB, 11.78 MB, 13.40 MB, 15.03 MB, 16.65 MB, 18.28 MB, 19.90 MB, 21.50 MB, 23.14 MB, 24.73 MB, 26.35 MB, 27.98 MB, 29.59 MB, 31.17 MB, 32.79 MB, 34.42 MB, 36.03 MB, 37.66 MB, 39.28 MB, 40.88 MB, 42.54 MB, 44.12 MB, 45.72 MB, 47.36 MB, 49.01 MB, 50.68 MB, 52.34 MB, 53.99 MB, 55.61 MB, 57.27 MB, 58.89 MB, 60.53 MB, 62.04 MB, 63.36 MB, 64.33 MB, 65.13 MB, 65.69 MB, 65.92 MB, 66.02 MB, 66.14 MB - BytesReceived: 66.27 MB (69487296) - ConvertRowBatchTime: 36.712ms - DeserializeRowBatchTimer: 259.121ms - FirstBatchArrivalWaitTime: 4s195ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1510381) - RowsReturnedRate: 56.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:3c (host=vb0230.halxg.cloudera.com:22000):(Total: 4s642ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 154.24 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.08 MB, 159.33 MB, 159.29 MB, 167.58 MB, 167.35 MB, 167.49 MB, 168.41 MB, 168.39 MB, 168.47 MB, 168.58 MB, 168.53 MB, 168.29 MB, 168.39 MB, 168.49 MB, 168.56 MB, 170.51 MB, 170.49 MB, 170.33 MB, 170.47 MB, 170.58 MB, 170.33 MB, 170.45 MB, 170.54 MB, 170.37 MB, 170.29 MB, 170.43 MB, 170.45 MB, 170.54 MB, 202.33 MB, 298.39 MB, 298.41 MB, 298.43 MB, 300.70 MB, 302.29 MB, 302.41 MB, 302.51 MB, 302.35 MB, 302.39 MB, 302.51 MB, 302.47 MB, 302.53 MB, 302.53 MB, 302.43 MB, 302.58 MB, 302.33 MB, 302.56 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 208 (208) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.59 GB (1709595022) - RowsProduced: 226.57K (226567) - TotalNetworkReceiveTime: 26s661ms - TotalNetworkSendTime: 3.482ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s757ms - SysTime: 102.984ms - UserTime: 1s123ms - VoluntaryContextSwitches: 7.63K (7635) Fragment Instance Lifecycle Timings: - ExecTime: 23s023ms - ExecTreeExecTime: 22s919ms - OpenTime: 4s587ms - ExecTreeOpenTime: 4s205ms - PrepareTime: 54.691ms - ExecTreePrepareTime: 1.181ms DataStreamSender (dst_id=11):(Total: 72.739ms, non-child: 72.739ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6506975) - NetworkThroughput(*): 246.53 MB/sec - OverallThroughput: 85.31 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.57K (226567) - SerializeBatchTime: 47.379ms - TransmitDataRPCTime: 25.171ms - UncompressedRowBatchSize: 13.62 MB (14276469) CodeGen:(Total: 422.693ms, non-child: 422.693ms, % non-child: 100.00%) - CodegenTime: 7.128ms - CompileTime: 111.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 269.954ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 40.371ms AGGREGATION_NODE (id=5):(Total: 27s125ms, non-child: 203.556ms, % non-child: 0.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 491.600us - GetResultsTime: 10.114ms - HTResizeTime: 16.023ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.63 MB (152703264) - PinTime: 0.000ns - ReductionFactorEstimate: 17.48 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.57K (226567) - RowsReturnedRate: 8.35 K/sec - StreamingTime: 184.853ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s921ms, non-child: 208.594ms, % non-child: 0.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.56K (599564) - BuildTime: 126.160ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1514078) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 196.412ms - RowsReturned: 599.07K (599068) - RowsReturnedRate: 22.25 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 81.529ms - BuildRowsPartitioned: 599.56K (599564) - GetNewBlockTime: 171.088us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.503ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 12.963ms, non-child: 12.963ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7807603) - ConvertRowBatchTime: 10.030ms - DeserializeRowBatchTimer: 43.113ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.56K (599564) - RowsReturnedRate: 46.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s713ms, non-child: 99.596ms, % non-child: 0.37%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.26 MB, 2.85 MB, 4.45 MB, 6.02 MB, 7.62 MB, 9.21 MB, 10.84 MB, 12.45 MB, 14.10 MB, 15.73 MB, 17.31 MB, 18.96 MB, 20.58 MB, 22.19 MB, 23.82 MB, 25.48 MB, 27.09 MB, 28.72 MB, 30.36 MB, 31.98 MB, 33.57 MB, 35.20 MB, 36.81 MB, 38.44 MB, 40.07 MB, 41.70 MB, 43.33 MB, 44.94 MB, 46.55 MB, 48.21 MB, 49.83 MB, 51.50 MB, 53.12 MB, 54.76 MB, 56.43 MB, 58.09 MB, 59.73 MB, 61.32 MB, 62.81 MB, 63.91 MB, 64.83 MB, 65.51 MB, 65.96 MB, 66.11 MB, 66.23 MB, 66.33 MB - BytesReceived: 66.41 MB (69640098) - ConvertRowBatchTime: 43.490ms - DeserializeRowBatchTimer: 466.114ms - FirstBatchArrivalWaitTime: 4s182ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1514078) - RowsReturnedRate: 56.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance c84bf4bc19372552:46 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s640ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 31.09 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 158.40 MB, 159.01 MB, 159.53 MB, 159.37 MB, 167.58 MB, 167.33 MB, 167.31 MB, 168.37 MB, 168.33 MB, 168.53 MB, 168.31 MB, 168.37 MB, 168.53 MB, 168.47 MB, 168.56 MB, 168.94 MB, 170.39 MB, 170.39 MB, 170.47 MB, 170.41 MB, 170.41 MB, 170.43 MB, 170.45 MB, 170.39 MB, 170.47 MB, 170.31 MB, 170.29 MB, 170.39 MB, 170.56 MB, 202.31 MB, 298.45 MB, 298.51 MB, 298.45 MB, 300.22 MB, 302.29 MB, 302.29 MB, 302.43 MB, 302.51 MB, 302.45 MB, 302.33 MB, 302.31 MB, 302.31 MB, 302.45 MB, 302.43 MB, 302.29 MB, 302.53 MB, 302.43 MB ThreadUsage(500.000ms): 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 318 (318) - PeakMemoryUsage: 302.85 MB (317564245) - PerHostPeakMemUsage: 1.60 GB (1721148052) - RowsProduced: 226.60K (226605) - TotalNetworkReceiveTime: 26s625ms - TotalNetworkSendTime: 3.236ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 27s737ms - SysTime: 97.985ms - UserTime: 1s133ms - VoluntaryContextSwitches: 7.53K (7534) Fragment Instance Lifecycle Timings: - ExecTime: 23s028ms - ExecTreeExecTime: 22s924ms - OpenTime: 4s579ms - ExecTreeOpenTime: 4s203ms - PrepareTime: 61.042ms - ExecTreePrepareTime: 1.116ms DataStreamSender (dst_id=11):(Total: 69.261ms, non-child: 69.261ms, % non-child: 100.00%) - BytesSent: 6.21 MB (6509346) - NetworkThroughput(*): 255.93 MB/sec - OverallThroughput: 89.63 MB/sec - PeakMemoryUsage: 459.14 KB (470160) - RowsReturned: 226.60K (226605) - SerializeBatchTime: 44.831ms - TransmitDataRPCTime: 24.255ms - UncompressedRowBatchSize: 13.62 MB (14278859) CodeGen:(Total: 413.751ms, non-child: 413.751ms, % non-child: 100.00%) - CodegenTime: 7.162ms - CompileTime: 108.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 128 (128) - NumInstructions: 4.95K (4945) - OptimizationTime: 265.979ms - PeakMemoryUsage: 2.41 MB (2531840) - PrepareTime: 38.714ms AGGREGATION_NODE (id=5):(Total: 27s129ms, non-child: 214.334ms, % non-child: 0.79%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 434.756us - GetResultsTime: 9.579ms - HTResizeTime: 22.401ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 145.61 MB (152682966) - PinTime: 0.000ns - ReductionFactorEstimate: 17.41 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 226.60K (226605) - RowsReturnedRate: 8.35 K/sec - StreamingTime: 196.002ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=4):(Total: 26s915ms, non-child: 232.856ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 599.91K (599908) - BuildTime: 111.008ms - PeakMemoryUsage: 153.17 MB (160605372) - ProbeRows: 1.51M (1512100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 218.905ms - RowsReturned: 597.80K (597802) - RowsReturnedRate: 22.21 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 67.342ms - BuildRowsPartitioned: 599.91K (599908) - GetNewBlockTime: 220.850us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 34.511ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=10):(Total: 13.066ms, non-child: 13.066ms, % non-child: 100.00%) BytesReceived(500.000ms): 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB - BytesReceived: 7.45 MB (7816277) - ConvertRowBatchTime: 10.411ms - DeserializeRowBatchTimer: 42.527ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 599.91K (599908) - RowsReturnedRate: 45.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=9):(Total: 26s682ms, non-child: 106.442ms, % non-child: 0.40%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.22 MB, 2.80 MB, 4.35 MB, 5.97 MB, 7.57 MB, 9.18 MB, 10.78 MB, 12.38 MB, 14.04 MB, 15.65 MB, 17.29 MB, 18.93 MB, 20.53 MB, 22.19 MB, 23.76 MB, 25.39 MB, 27.01 MB, 28.61 MB, 30.25 MB, 31.87 MB, 33.45 MB, 35.07 MB, 36.66 MB, 38.31 MB, 39.91 MB, 41.60 MB, 43.22 MB, 44.86 MB, 46.46 MB, 48.10 MB, 49.70 MB, 51.39 MB, 53.01 MB, 54.64 MB, 56.30 MB, 57.94 MB, 59.59 MB, 61.13 MB, 62.65 MB, 63.81 MB, 64.71 MB, 65.44 MB, 65.88 MB, 66.05 MB, 66.15 MB, 66.24 MB - BytesReceived: 66.34 MB (69564773) - ConvertRowBatchTime: 46.615ms - DeserializeRowBatchTimer: 287.813ms - FirstBatchArrivalWaitTime: 4s181ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1512100) - RowsReturnedRate: 56.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 4s660ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:27s531ms max:27s548ms mean: 27s545ms stddev:3.953ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 15 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.35K (3354) - PeakMemoryUsage: 689.84 MB (723348864) - PerHostPeakMemUsage: 1.60 GB (1714262543) - RowsProduced: 1.51M (1512369) - TotalNetworkReceiveTime: 16s987ms - TotalNetworkSendTime: 17.659ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s841ms - SysTime: 971.985ms - UserTime: 11s465ms - VoluntaryContextSwitches: 114.26K (114257) Fragment Instance Lifecycle Timings: - ExecTime: 22s883ms - ExecTreeExecTime: 21s111ms - OpenTime: 4s606ms - ExecTreeOpenTime: 4s351ms - PrepareTime: 53.213ms - ExecTreePrepareTime: 206.782us DataStreamSender (dst_id=9):(Total: 1s073ms, non-child: 1s073ms, % non-child: 100.00%) - BytesSent: 66.34 MB (69567279) - NetworkThroughput(*): 302.44 MB/sec - OverallThroughput: 63.44 MB/sec - PeakMemoryUsage: 465.57 KB (476747) - RowsReturned: 1.51M (1512369) - SerializeBatchTime: 836.922ms - TransmitDataRPCTime: 234.626ms - UncompressedRowBatchSize: 158.71 MB (166421449) CodeGen:(Total: 289.973ms, non-child: 289.973ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.525ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 175.163ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.703ms HASH_JOIN_NODE (id=3):(Total: 25s459ms, non-child: 6s855ms, % non-child: 26.93%) - BuildRows: 7.37M (7367283) - BuildTime: 2s778ms - PeakMemoryUsage: 649.11 MB (680636198) - ProbeRows: 64.69M (64687153) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s110ms - RowsReturned: 1.51M (1512369) - RowsReturnedRate: 59.41 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 2s138ms - BuildRowsPartitioned: 7.37M (7367283) - GetNewBlockTime: 557.699us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 604.786ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s543ms, non-child: 1s543ms, % non-child: 100.00%) - BytesReceived: 174.41 MB (182878855) - ConvertRowBatchTime: 191.370ms - DeserializeRowBatchTimer: 767.883ms - FirstBatchArrivalWaitTime: 362.494ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367283) - RowsReturnedRate: 4.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s528ms, non-child: 17s528ms, % non-child: 100.00%) - BytesReceived: 1.46 GB (1569898857) - ConvertRowBatchTime: 1s686ms - DeserializeRowBatchTimer: 7s387ms - FirstBatchArrivalWaitTime: 731.126ms - PeakMemoryUsage: 0 - RowsReturned: 64.69M (64687153) - RowsReturnedRate: 3.70 M/sec - SendersBlockedTimer: 3s424ms - SendersBlockedTotalTimer(*): 40s442ms Fragment F02: Instance c84bf4bc19372552:22 (host=vb0234.halxg.cloudera.com:22000):(Total: 4s695ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 156.34 MB, 178.30 MB, 305.53 MB, 305.71 MB, 437.41 MB, 433.51 MB, 433.49 MB, 577.48 MB, 666.10 MB, 666.16 MB, 667.75 MB, 666.84 MB, 667.39 MB, 665.99 MB, 666.22 MB, 667.71 MB, 667.56 MB, 667.04 MB, 666.20 MB, 666.88 MB, 665.93 MB, 666.90 MB, 667.45 MB, 666.70 MB, 665.77 MB, 665.92 MB, 667.65 MB, 667.33 MB, 666.00 MB, 665.84 MB, 667.12 MB, 665.91 MB, 667.89 MB, 666.91 MB, 665.81 MB, 666.24 MB, 667.36 MB, 667.85 MB, 667.54 MB, 666.62 MB, 666.78 MB, 665.98 MB, 667.46 MB, 666.95 MB, 666.29 MB, 666.62 MB, 667.11 MB, 666.03 MB, 667.47 MB, 665.84 MB, 665.88 MB, 666.28 MB, 667.29 MB, 665.80 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.37K (3373) - PeakMemoryUsage: 690.75 MB (724301038) - PerHostPeakMemUsage: 1.63 GB (1747877666) - RowsProduced: 1.51M (1513030) - TotalNetworkReceiveTime: 16s606ms - TotalNetworkSendTime: 14.988ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s839ms - SysTime: 939.857ms - UserTime: 11s831ms - VoluntaryContextSwitches: 116.10K (116103) Fragment Instance Lifecycle Timings: - ExecTime: 22s847ms - ExecTreeExecTime: 21s042ms - OpenTime: 4s638ms - ExecTreeOpenTime: 4s353ms - PrepareTime: 57.185ms - ExecTreePrepareTime: 232.924us DataStreamSender (dst_id=9):(Total: 1s052ms, non-child: 1s052ms, % non-child: 100.00%) - BytesSent: 66.38 MB (69607864) - NetworkThroughput(*): 389.98 MB/sec - OverallThroughput: 63.07 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1513030) - SerializeBatchTime: 880.593ms - TransmitDataRPCTime: 170.224ms - UncompressedRowBatchSize: 158.78 MB (166494196) CodeGen:(Total: 324.060ms, non-child: 324.060ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 82.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 200.925ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 40.289ms HASH_JOIN_NODE (id=3):(Total: 25s393ms, non-child: 6s987ms, % non-child: 27.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.36M (7364619) - BuildTime: 2s834ms - PeakMemoryUsage: 649.11 MB (680638244) - ProbeRows: 64.71M (64710355) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s194ms - RowsReturned: 1.51M (1513030) - RowsReturnedRate: 59.58 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s158ms - BuildRowsPartitioned: 7.36M (7364619) - GetNewBlockTime: 573.976us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 640.434ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s486ms, non-child: 484.961ms, % non-child: 32.61%) BytesReceived(500.000ms): 0, 12.24 MB, 39.99 MB, 70.75 MB, 101.96 MB, 134.04 MB, 161.41 MB, 173.02 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB, 174.34 MB - BytesReceived: 174.34 MB (182813227) - ConvertRowBatchTime: 215.690ms - DeserializeRowBatchTimer: 790.521ms - FirstBatchArrivalWaitTime: 329.351ms - PeakMemoryUsage: 0 - RowsReturned: 7.36M (7364619) - RowsReturnedRate: 4.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s340ms, non-child: 3s935ms, % non-child: 22.70%) BytesReceived(500.000ms): 0, 0, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 23.65 MB, 59.21 MB, 95.07 MB, 131.33 MB, 167.63 MB, 203.65 MB, 239.74 MB, 276.12 MB, 312.87 MB, 349.35 MB, 386.09 MB, 422.89 MB, 459.53 MB, 495.94 MB, 532.51 MB, 569.15 MB, 605.84 MB, 642.40 MB, 678.94 MB, 715.60 MB, 752.19 MB, 788.67 MB, 825.06 MB, 861.59 MB, 898.17 MB, 935.06 MB, 971.88 MB, 1008.41 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570456159) - ConvertRowBatchTime: 1s797ms - DeserializeRowBatchTimer: 5s634ms - FirstBatchArrivalWaitTime: 700.084ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64710355) - RowsReturnedRate: 3.73 M/sec - SendersBlockedTimer: 3s460ms - SendersBlockedTotalTimer(*): 31s211ms Instance c84bf4bc19372552:23 (host=vb0218.halxg.cloudera.com:22000):(Total: 4s689ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 88.89 KB, 111.86 KB, 160.78 MB, 178.00 MB, 308.25 MB, 305.63 MB, 433.57 MB, 433.49 MB, 433.49 MB, 625.45 MB, 667.62 MB, 666.35 MB, 667.28 MB, 667.53 MB, 666.64 MB, 667.88 MB, 666.13 MB, 667.26 MB, 667.02 MB, 666.22 MB, 666.42 MB, 667.87 MB, 665.86 MB, 667.50 MB, 665.82 MB, 667.35 MB, 667.59 MB, 667.53 MB, 665.92 MB, 667.48 MB, 665.83 MB, 667.33 MB, 666.27 MB, 666.87 MB, 665.80 MB, 666.44 MB, 666.06 MB, 666.74 MB, 667.69 MB, 666.32 MB, 666.02 MB, 665.77 MB, 666.27 MB, 665.90 MB, 666.24 MB, 665.63 MB, 665.72 MB, 665.97 MB, 667.30 MB, 666.72 MB, 666.94 MB, 667.43 MB, 667.39 MB, 665.67 MB, 666.43 MB, 522.88 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.01K (3006) - PeakMemoryUsage: 689.94 MB (723453562) - PerHostPeakMemUsage: 1.60 GB (1721325092) - RowsProduced: 1.51M (1514169) - TotalNetworkReceiveTime: 16s375ms - TotalNetworkSendTime: 8.453ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s885ms - SysTime: 920.860ms - UserTime: 12s244ms - VoluntaryContextSwitches: 115.86K (115857) Fragment Instance Lifecycle Timings: - ExecTime: 22s856ms - ExecTreeExecTime: 20s988ms - OpenTime: 4s635ms - ExecTreeOpenTime: 4s394ms - PrepareTime: 54.618ms - ExecTreePrepareTime: 257.232us DataStreamSender (dst_id=9):(Total: 1s121ms, non-child: 1s121ms, % non-child: 100.00%) - BytesSent: 66.42 MB (69649095) - NetworkThroughput(*): 349.67 MB/sec - OverallThroughput: 59.21 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1514169) - SerializeBatchTime: 928.517ms - TransmitDataRPCTime: 189.957ms - UncompressedRowBatchSize: 158.90 MB (166619526) CodeGen:(Total: 273.763ms, non-child: 273.763ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 76.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 163.433ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 33.556ms HASH_JOIN_NODE (id=3):(Total: 25s380ms, non-child: 7s150ms, % non-child: 28.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370459) - BuildTime: 2s874ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64695726) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s312ms - RowsReturned: 1.51M (1514169) - RowsReturnedRate: 59.66 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s200ms - BuildRowsPartitioned: 7.37M (7370459) - GetNewBlockTime: 712.548us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 634.896ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s492ms, non-child: 474.339ms, % non-child: 31.78%) BytesReceived(500.000ms): 0, 0, 20.05 MB, 47.33 MB, 78.26 MB, 109.61 MB, 141.47 MB, 165.43 MB, 174.41 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB - BytesReceived: 174.48 MB (182960542) - ConvertRowBatchTime: 172.992ms - DeserializeRowBatchTimer: 883.356ms - FirstBatchArrivalWaitTime: 376.114ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370459) - RowsReturnedRate: 4.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s194ms, non-child: 4s067ms, % non-child: 23.66%) BytesReceived(500.000ms): 0, 0, 0, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 32.09 MB, 67.99 MB, 103.81 MB, 140.07 MB, 176.25 MB, 212.39 MB, 248.55 MB, 285.01 MB, 321.84 MB, 358.37 MB, 395.08 MB, 431.99 MB, 468.38 MB, 504.91 MB, 541.43 MB, 577.89 MB, 614.39 MB, 650.91 MB, 687.46 MB, 724.06 MB, 760.59 MB, 796.97 MB, 833.22 MB, 869.93 MB, 906.75 MB, 943.56 MB, 980.25 MB, 1016.70 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.14 GB, 1.17 GB, 1.21 GB, 1.25 GB, 1.28 GB, 1.32 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570103737) - ConvertRowBatchTime: 1s923ms - DeserializeRowBatchTimer: 5s618ms - FirstBatchArrivalWaitTime: 744.521ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64695726) - RowsReturnedRate: 3.76 M/sec - SendersBlockedTimer: 3s453ms - SendersBlockedTotalTimer(*): 34s656ms Instance c84bf4bc19372552:2b (host=vb0226.halxg.cloudera.com:22000):(Total: 4s686ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 166.55 MB, 177.53 MB, 305.55 MB, 305.55 MB, 434.38 MB, 433.51 MB, 481.45 MB, 689.45 MB, 667.36 MB, 666.47 MB, 667.67 MB, 665.84 MB, 666.14 MB, 668.02 MB, 666.67 MB, 666.68 MB, 667.28 MB, 667.75 MB, 667.31 MB, 667.01 MB, 667.28 MB, 667.64 MB, 667.72 MB, 666.37 MB, 667.01 MB, 667.52 MB, 665.84 MB, 666.24 MB, 667.37 MB, 667.36 MB, 666.01 MB, 667.67 MB, 666.58 MB, 667.27 MB, 667.27 MB, 667.65 MB, 667.04 MB, 666.65 MB, 665.64 MB, 665.95 MB, 666.65 MB, 667.58 MB, 665.82 MB, 667.15 MB, 666.24 MB, 666.38 MB, 666.87 MB, 665.91 MB, 667.19 MB, 666.98 MB, 667.35 MB, 666.01 MB, 666.89 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.12K (3124) - PeakMemoryUsage: 689.89 MB (723406642) - PerHostPeakMemUsage: 1.60 GB (1719830126) - RowsProduced: 1.51M (1509614) - TotalNetworkReceiveTime: 17s616ms - TotalNetworkSendTime: 15.664ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s898ms - SysTime: 948.855ms - UserTime: 10s906ms - VoluntaryContextSwitches: 114.78K (114780) Fragment Instance Lifecycle Timings: - ExecTime: 22s858ms - ExecTreeExecTime: 21s217ms - OpenTime: 4s641ms - ExecTreeOpenTime: 4s399ms - PrepareTime: 44.850ms - ExecTreePrepareTime: 201.776us DataStreamSender (dst_id=9):(Total: 1s035ms, non-child: 1s035ms, % non-child: 100.00%) - BytesSent: 66.23 MB (69445515) - NetworkThroughput(*): 233.71 MB/sec - OverallThroughput: 63.98 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1509614) - SerializeBatchTime: 750.003ms - TransmitDataRPCTime: 283.373ms - UncompressedRowBatchSize: 158.42 MB (166118284) CodeGen:(Total: 278.945ms, non-child: 278.945ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 77.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 164.094ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 37.191ms HASH_JOIN_NODE (id=3):(Total: 25s613ms, non-child: 6s636ms, % non-child: 25.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.36M (7361508) - BuildTime: 2s909ms - PeakMemoryUsage: 649.11 MB (680636306) - ProbeRows: 64.64M (64639006) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s767ms - RowsReturned: 1.51M (1509614) - RowsReturnedRate: 58.94 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s241ms - BuildRowsPartitioned: 7.36M (7361508) - GetNewBlockTime: 552.944us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 626.570ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s465ms, non-child: 370.139ms, % non-child: 25.26%) BytesReceived(500.000ms): 0, 0, 26.04 MB, 56.32 MB, 87.35 MB, 119.03 MB, 150.24 MB, 168.87 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB, 174.27 MB - BytesReceived: 174.27 MB (182735368) - ConvertRowBatchTime: 180.087ms - DeserializeRowBatchTimer: 648.109ms - FirstBatchArrivalWaitTime: 385.246ms - PeakMemoryUsage: 0 - RowsReturned: 7.36M (7361508) - RowsReturnedRate: 5.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s022ms, non-child: 6s358ms, % non-child: 35.28%) BytesReceived(500.000ms): 0, 0, 5.47 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 10.11 MB, 42.69 MB, 78.36 MB, 114.49 MB, 150.75 MB, 186.84 MB, 223.08 MB, 259.25 MB, 295.89 MB, 332.46 MB, 369.16 MB, 405.77 MB, 442.60 MB, 478.85 MB, 515.28 MB, 551.76 MB, 588.34 MB, 624.61 MB, 661.14 MB, 697.69 MB, 734.28 MB, 770.64 MB, 807.35 MB, 843.62 MB, 880.31 MB, 916.96 MB, 953.69 MB, 990.47 MB, 1.00 GB, 1.04 GB, 1.07 GB, 1.11 GB, 1.15 GB, 1.18 GB, 1.22 GB, 1.26 GB, 1.29 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568758988) - ConvertRowBatchTime: 1s488ms - DeserializeRowBatchTimer: 8s953ms - FirstBatchArrivalWaitTime: 753.826ms - PeakMemoryUsage: 0 - RowsReturned: 64.64M (64639006) - RowsReturnedRate: 3.59 M/sec - SendersBlockedTimer: 3s451ms - SendersBlockedTotalTimer(*): 37s995ms Instance c84bf4bc19372552:29 (host=vb0206.halxg.cloudera.com:22000):(Total: 4s684ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.19 MB, 177.53 MB, 305.55 MB, 306.36 MB, 433.51 MB, 433.49 MB, 433.49 MB, 609.45 MB, 666.91 MB, 666.61 MB, 666.87 MB, 665.68 MB, 667.21 MB, 667.31 MB, 665.96 MB, 665.77 MB, 666.73 MB, 665.96 MB, 665.64 MB, 666.93 MB, 666.94 MB, 665.82 MB, 667.17 MB, 667.22 MB, 666.10 MB, 667.37 MB, 665.98 MB, 666.36 MB, 667.63 MB, 666.52 MB, 666.73 MB, 666.76 MB, 667.58 MB, 666.31 MB, 667.74 MB, 666.02 MB, 666.05 MB, 666.16 MB, 667.54 MB, 665.70 MB, 666.61 MB, 667.52 MB, 667.02 MB, 667.49 MB, 667.20 MB, 665.78 MB, 667.49 MB, 666.23 MB, 666.45 MB, 666.22 MB, 667.59 MB, 666.95 MB, 667.59 MB, 666.17 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.28K (3278) - PeakMemoryUsage: 689.87 MB (723383101) - PerHostPeakMemUsage: 1.60 GB (1721148052) - RowsProduced: 1.51M (1513861) - TotalNetworkReceiveTime: 17s979ms - TotalNetworkSendTime: 14.749ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s881ms - SysTime: 768.883ms - UserTime: 10s457ms - VoluntaryContextSwitches: 122.98K (122983) Fragment Instance Lifecycle Timings: - ExecTime: 22s860ms - ExecTreeExecTime: 21s383ms - OpenTime: 4s632ms - ExecTreeOpenTime: 4s388ms - PrepareTime: 51.571ms - ExecTreePrepareTime: 195.128us DataStreamSender (dst_id=9):(Total: 854.449ms, non-child: 854.449ms, % non-child: 100.00%) - BytesSent: 66.42 MB (69641424) - NetworkThroughput(*): 379.59 MB/sec - OverallThroughput: 77.73 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1513861) - SerializeBatchTime: 678.024ms - TransmitDataRPCTime: 174.966ms - UncompressedRowBatchSize: 158.87 MB (166585630) CodeGen:(Total: 279.348ms, non-child: 279.348ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.448ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 164.533ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 35.814ms HASH_JOIN_NODE (id=3):(Total: 25s768ms, non-child: 6s590ms, % non-child: 25.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367843) - BuildTime: 2s899ms - PeakMemoryUsage: 649.11 MB (680640233) - ProbeRows: 64.67M (64671478) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s742ms - RowsReturned: 1.51M (1513861) - RowsReturnedRate: 58.75 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s238ms - BuildRowsPartitioned: 7.37M (7367843) - GetNewBlockTime: 548.102us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 625.105ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s464ms, non-child: 353.483ms, % non-child: 24.14%) BytesReceived(500.000ms): 0, 17.09 MB, 44.53 MB, 75.39 MB, 106.67 MB, 138.65 MB, 164.01 MB, 174.07 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB, 174.42 MB - BytesReceived: 174.42 MB (182891891) - ConvertRowBatchTime: 183.297ms - DeserializeRowBatchTimer: 581.138ms - FirstBatchArrivalWaitTime: 375.439ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367843) - RowsReturnedRate: 5.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s213ms, non-child: 3s340ms, % non-child: 18.34%) BytesReceived(500.000ms): 0, 0, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 28.84 MB, 64.47 MB, 100.37 MB, 136.65 MB, 172.87 MB, 208.82 MB, 244.93 MB, 281.46 MB, 318.14 MB, 354.68 MB, 391.27 MB, 428.13 MB, 464.64 MB, 501.14 MB, 537.76 MB, 574.24 MB, 610.77 MB, 647.30 MB, 683.83 MB, 720.43 MB, 756.92 MB, 793.45 MB, 829.72 MB, 866.36 MB, 903.02 MB, 939.94 MB, 976.68 MB, 1013.18 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569532632) - ConvertRowBatchTime: 1s353ms - DeserializeRowBatchTimer: 5s663ms - FirstBatchArrivalWaitTime: 743.441ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64671478) - RowsReturnedRate: 3.55 M/sec - SendersBlockedTimer: 3s449ms - SendersBlockedTotalTimer(*): 44s861ms Instance c84bf4bc19372552:2a (host=vb0214.halxg.cloudera.com:22000):(Total: 4s680ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 160.26 MB, 178.78 MB, 305.49 MB, 305.57 MB, 433.57 MB, 433.49 MB, 433.49 MB, 593.45 MB, 665.94 MB, 666.43 MB, 665.96 MB, 666.72 MB, 666.30 MB, 667.23 MB, 667.55 MB, 667.23 MB, 667.10 MB, 666.46 MB, 667.47 MB, 668.12 MB, 666.53 MB, 666.20 MB, 667.12 MB, 666.77 MB, 666.57 MB, 667.60 MB, 666.30 MB, 666.32 MB, 665.93 MB, 666.22 MB, 666.23 MB, 667.14 MB, 665.89 MB, 667.39 MB, 667.22 MB, 666.06 MB, 666.78 MB, 665.76 MB, 666.62 MB, 666.52 MB, 666.90 MB, 666.67 MB, 666.35 MB, 667.13 MB, 666.15 MB, 666.61 MB, 667.67 MB, 666.29 MB, 667.23 MB, 666.19 MB, 666.36 MB, 666.06 MB, 667.14 MB, 665.53 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.34K (3343) - PeakMemoryUsage: 689.81 MB (723319897) - PerHostPeakMemUsage: 1.59 GB (1707502940) - RowsProduced: 1.51M (1512670) - TotalNetworkReceiveTime: 17s033ms - TotalNetworkSendTime: 20.255ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s865ms - SysTime: 1s048ms - UserTime: 11s381ms - VoluntaryContextSwitches: 110.58K (110585) Fragment Instance Lifecycle Timings: - ExecTime: 22s863ms - ExecTreeExecTime: 21s098ms - OpenTime: 4s628ms - ExecTreeOpenTime: 4s373ms - PrepareTime: 51.811ms - ExecTreePrepareTime: 183.412us DataStreamSender (dst_id=9):(Total: 1s088ms, non-child: 1s088ms, % non-child: 100.00%) - BytesSent: 66.37 MB (69590318) - NetworkThroughput(*): 237.98 MB/sec - OverallThroughput: 60.95 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1512670) - SerializeBatchTime: 808.077ms - TransmitDataRPCTime: 278.879ms - UncompressedRowBatchSize: 158.74 MB (166454580) CodeGen:(Total: 288.762ms, non-child: 288.762ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 172.984ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.490ms HASH_JOIN_NODE (id=3):(Total: 25s469ms, non-child: 6s876ms, % non-child: 27.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370098) - BuildTime: 2s872ms - PeakMemoryUsage: 649.11 MB (680636000) - ProbeRows: 64.67M (64670034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s070ms - RowsReturned: 1.51M (1512670) - RowsReturnedRate: 59.39 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s213ms - BuildRowsPartitioned: 7.37M (7370098) - GetNewBlockTime: 678.926us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 623.814ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s471ms, non-child: 480.869ms, % non-child: 32.68%) BytesReceived(500.000ms): 0, 14.91 MB, 42.49 MB, 73.38 MB, 104.59 MB, 136.69 MB, 162.93 MB, 173.70 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB, 174.47 MB - BytesReceived: 174.47 MB (182944326) - ConvertRowBatchTime: 173.555ms - DeserializeRowBatchTimer: 888.606ms - FirstBatchArrivalWaitTime: 365.634ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370098) - RowsReturnedRate: 5.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s573ms, non-child: 6s785ms, % non-child: 38.61%) BytesReceived(500.000ms): 0, 0, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 26.48 MB, 62.12 MB, 97.99 MB, 134.24 MB, 170.40 MB, 206.40 MB, 242.52 MB, 279.09 MB, 315.90 MB, 352.56 MB, 389.22 MB, 426.01 MB, 462.50 MB, 498.88 MB, 535.29 MB, 571.73 MB, 608.11 MB, 644.72 MB, 681.37 MB, 717.92 MB, 754.51 MB, 790.97 MB, 827.31 MB, 863.93 MB, 900.49 MB, 937.44 MB, 974.09 MB, 1010.60 MB, 1.02 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569464210) - ConvertRowBatchTime: 1s626ms - DeserializeRowBatchTimer: 9s253ms - FirstBatchArrivalWaitTime: 733.023ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64670034) - RowsReturnedRate: 3.68 M/sec - SendersBlockedTimer: 3s445ms - SendersBlockedTotalTimer(*): 44s840ms Instance c84bf4bc19372552:20 (host=vb0212.halxg.cloudera.com:22000):(Total: 4s678ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 161.77 MB, 177.60 MB, 305.57 MB, 305.53 MB, 433.57 MB, 433.53 MB, 465.45 MB, 673.45 MB, 665.92 MB, 667.45 MB, 667.42 MB, 666.41 MB, 666.75 MB, 666.14 MB, 665.86 MB, 667.20 MB, 667.34 MB, 667.89 MB, 667.53 MB, 666.66 MB, 666.06 MB, 667.23 MB, 666.05 MB, 665.67 MB, 665.98 MB, 666.41 MB, 666.43 MB, 667.26 MB, 667.30 MB, 667.38 MB, 665.77 MB, 666.92 MB, 665.63 MB, 666.81 MB, 666.67 MB, 666.34 MB, 666.79 MB, 666.96 MB, 667.84 MB, 665.71 MB, 666.67 MB, 665.70 MB, 665.85 MB, 667.07 MB, 666.22 MB, 666.50 MB, 666.57 MB, 666.75 MB, 665.67 MB, 667.40 MB, 667.28 MB, 666.07 MB, 666.74 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.10K (3101) - PeakMemoryUsage: 689.79 MB (723302309) - PerHostPeakMemUsage: 1.60 GB (1720996548) - RowsProduced: 1.51M (1511840) - TotalNetworkReceiveTime: 17s958ms - TotalNetworkSendTime: 31.230ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s882ms - SysTime: 948.855ms - UserTime: 10s599ms - VoluntaryContextSwitches: 117.22K (117218) Fragment Instance Lifecycle Timings: - ExecTime: 22s867ms - ExecTreeExecTime: 21s218ms - OpenTime: 4s626ms - ExecTreeOpenTime: 4s389ms - PrepareTime: 52.197ms - ExecTreePrepareTime: 228.636us DataStreamSender (dst_id=9):(Total: 1s038ms, non-child: 1s038ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69536932) - NetworkThroughput(*): 229.34 MB/sec - OverallThroughput: 63.88 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511840) - SerializeBatchTime: 747.293ms - TransmitDataRPCTime: 289.155ms - UncompressedRowBatchSize: 158.66 MB (166363232) CodeGen:(Total: 265.099ms, non-child: 265.099ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 75.873ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 160.457ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 28.268ms HASH_JOIN_NODE (id=3):(Total: 25s604ms, non-child: 6s296ms, % non-child: 24.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7369445) - BuildTime: 2s714ms - PeakMemoryUsage: 649.11 MB (680636255) - ProbeRows: 64.70M (64698162) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s653ms - RowsReturned: 1.51M (1511840) - RowsReturnedRate: 59.05 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s055ms - BuildRowsPartitioned: 7.37M (7369445) - GetNewBlockTime: 420.122us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 621.992ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s652ms, non-child: 450.864ms, % non-child: 27.28%) BytesReceived(500.000ms): 0, 0, 24.20 MB, 54.38 MB, 85.35 MB, 116.96 MB, 148.40 MB, 168.33 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB, 174.45 MB - BytesReceived: 174.45 MB (182928730) - ConvertRowBatchTime: 139.231ms - DeserializeRowBatchTimer: 899.729ms - FirstBatchArrivalWaitTime: 382.071ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7369445) - RowsReturnedRate: 4.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s140ms, non-child: 6s408ms, % non-child: 35.33%) BytesReceived(500.000ms): 0, 0, 3.45 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.14 MB, 40.25 MB, 75.91 MB, 112.13 MB, 148.36 MB, 184.39 MB, 220.53 MB, 256.75 MB, 293.22 MB, 329.95 MB, 366.57 MB, 403.23 MB, 440.14 MB, 476.51 MB, 512.93 MB, 549.56 MB, 586.24 MB, 622.64 MB, 659.33 MB, 695.81 MB, 732.49 MB, 768.91 MB, 805.40 MB, 841.76 MB, 878.35 MB, 915.13 MB, 952.14 MB, 988.84 MB, 1.00 GB, 1.04 GB, 1.07 GB, 1.11 GB, 1.15 GB, 1.18 GB, 1.22 GB, 1.25 GB, 1.29 GB, 1.33 GB, 1.36 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570159636) - ConvertRowBatchTime: 1s495ms - DeserializeRowBatchTimer: 8s835ms - FirstBatchArrivalWaitTime: 750.407ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64698162) - RowsReturnedRate: 3.57 M/sec - SendersBlockedTimer: 3s441ms - SendersBlockedTotalTimer(*): 48s251ms Instance c84bf4bc19372552:27 (host=vb0222.halxg.cloudera.com:22000):(Total: 4s677ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 155.53 MB, 177.55 MB, 305.55 MB, 305.64 MB, 433.68 MB, 433.53 MB, 449.48 MB, 657.48 MB, 667.13 MB, 667.53 MB, 665.75 MB, 667.71 MB, 666.52 MB, 666.38 MB, 665.93 MB, 666.59 MB, 666.40 MB, 667.15 MB, 667.92 MB, 667.13 MB, 667.58 MB, 667.59 MB, 666.64 MB, 667.51 MB, 667.67 MB, 667.21 MB, 666.64 MB, 667.38 MB, 667.56 MB, 666.09 MB, 666.94 MB, 667.73 MB, 667.45 MB, 666.80 MB, 667.64 MB, 665.77 MB, 667.43 MB, 667.77 MB, 666.24 MB, 666.34 MB, 666.09 MB, 667.34 MB, 667.44 MB, 666.48 MB, 667.12 MB, 665.91 MB, 666.11 MB, 665.78 MB, 667.22 MB, 666.84 MB, 665.90 MB, 667.21 MB, 665.91 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.69K (3689) - PeakMemoryUsage: 689.89 MB (723400862) - PerHostPeakMemUsage: 1.60 GB (1721390396) - RowsProduced: 1.52M (1516792) - TotalNetworkReceiveTime: 16s037ms - TotalNetworkSendTime: 12.684ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s859ms - SysTime: 1s091ms - UserTime: 12s322ms - VoluntaryContextSwitches: 105.67K (105673) Fragment Instance Lifecycle Timings: - ExecTime: 22s863ms - ExecTreeExecTime: 20s898ms - OpenTime: 4s621ms - ExecTreeOpenTime: 4s374ms - PrepareTime: 55.903ms - ExecTreePrepareTime: 197.360us DataStreamSender (dst_id=9):(Total: 1s243ms, non-child: 1s243ms, % non-child: 100.00%) - BytesSent: 66.53 MB (69761425) - NetworkThroughput(*): 232.95 MB/sec - OverallThroughput: 53.50 MB/sec - PeakMemoryUsage: 450.64 KB (461456) - RowsReturned: 1.52M (1516792) - SerializeBatchTime: 955.825ms - TransmitDataRPCTime: 285.601ms - UncompressedRowBatchSize: 159.18 MB (166908168) CodeGen:(Total: 275.828ms, non-child: 275.828ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 166.005ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 28.904ms HASH_JOIN_NODE (id=3):(Total: 25s269ms, non-child: 7s371ms, % non-child: 29.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367515) - BuildTime: 2s854ms - PeakMemoryUsage: 649.11 MB (680640233) - ProbeRows: 64.71M (64705040) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s537ms - RowsReturned: 1.52M (1516792) - RowsReturnedRate: 60.02 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s196ms - BuildRowsPartitioned: 7.37M (7367515) - GetNewBlockTime: 578.564us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 622.113ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s498ms, non-child: 370.209ms, % non-child: 24.71%) BytesReceived(500.000ms): 0, 0, 22.11 MB, 51.10 MB, 82.06 MB, 113.59 MB, 145.19 MB, 167.11 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB, 174.41 MB - BytesReceived: 174.41 MB (182883862) - ConvertRowBatchTime: 188.366ms - DeserializeRowBatchTimer: 605.159ms - FirstBatchArrivalWaitTime: 368.262ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367515) - RowsReturnedRate: 4.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s869ms, non-child: 6s780ms, % non-child: 40.19%) BytesReceived(500.000ms): 0, 0, 991.04 KB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 36.56 MB, 72.23 MB, 108.06 MB, 144.41 MB, 180.49 MB, 216.66 MB, 252.75 MB, 289.27 MB, 325.89 MB, 362.55 MB, 399.27 MB, 436.16 MB, 472.59 MB, 509.15 MB, 545.65 MB, 582.18 MB, 618.63 MB, 655.22 MB, 691.85 MB, 728.56 MB, 764.95 MB, 801.45 MB, 837.74 MB, 874.35 MB, 911.04 MB, 947.93 MB, 984.68 MB, 1021.17 MB, 1.03 GB, 1.07 GB, 1.11 GB, 1.14 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570307554) - ConvertRowBatchTime: 1s916ms - DeserializeRowBatchTimer: 8s965ms - FirstBatchArrivalWaitTime: 736.640ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64705040) - RowsReturnedRate: 3.84 M/sec - SendersBlockedTimer: 3s443ms - SendersBlockedTotalTimer(*): 48s196ms Instance c84bf4bc19372552:2d (host=vb0228.halxg.cloudera.com:22000):(Total: 4s668ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 156.49 MB, 177.55 MB, 305.51 MB, 305.71 MB, 433.60 MB, 433.55 MB, 449.48 MB, 657.48 MB, 665.90 MB, 666.68 MB, 667.57 MB, 667.56 MB, 666.88 MB, 666.23 MB, 667.38 MB, 667.19 MB, 666.98 MB, 667.43 MB, 667.70 MB, 665.86 MB, 667.08 MB, 666.96 MB, 666.48 MB, 666.39 MB, 666.12 MB, 667.24 MB, 666.57 MB, 667.23 MB, 666.14 MB, 666.03 MB, 666.01 MB, 666.95 MB, 667.51 MB, 665.93 MB, 667.25 MB, 667.65 MB, 665.99 MB, 667.51 MB, 667.43 MB, 666.34 MB, 666.21 MB, 666.95 MB, 666.44 MB, 666.67 MB, 667.13 MB, 666.33 MB, 665.94 MB, 666.44 MB, 666.80 MB, 666.10 MB, 667.42 MB, 666.67 MB, 665.56 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.95K (2950) - PeakMemoryUsage: 689.78 MB (723281960) - PerHostPeakMemUsage: 1.58 GB (1695392252) - RowsProduced: 1.52M (1515423) - TotalNetworkReceiveTime: 15s839ms - TotalNetworkSendTime: 9.168ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s857ms - SysTime: 963.853ms - UserTime: 12s727ms - VoluntaryContextSwitches: 112.03K (112035) Fragment Instance Lifecycle Timings: - ExecTime: 22s877ms - ExecTreeExecTime: 20s930ms - OpenTime: 4s619ms - ExecTreeOpenTime: 4s361ms - PrepareTime: 49.409ms - ExecTreePrepareTime: 202.440us DataStreamSender (dst_id=9):(Total: 1s139ms, non-child: 1s139ms, % non-child: 100.00%) - BytesSent: 66.47 MB (69699516) - NetworkThroughput(*): 388.59 MB/sec - OverallThroughput: 58.31 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1515423) - SerializeBatchTime: 967.018ms - TransmitDataRPCTime: 171.054ms - UncompressedRowBatchSize: 159.03 MB (166757514) CodeGen:(Total: 284.449ms, non-child: 284.449ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 82.873ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 173.554ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 27.409ms HASH_JOIN_NODE (id=3):(Total: 25s289ms, non-child: 7s475ms, % non-child: 29.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365220) - BuildTime: 2s873ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.70M (64697716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s632ms - RowsReturned: 1.52M (1515423) - RowsReturnedRate: 59.92 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s228ms - BuildRowsPartitioned: 7.37M (7365220) - GetNewBlockTime: 477.452us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 609.979ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s452ms, non-child: 432.610ms, % non-child: 29.78%) BytesReceived(500.000ms): 0, 0, 21.89 MB, 50.72 MB, 81.68 MB, 113.23 MB, 144.80 MB, 166.93 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB, 174.36 MB - BytesReceived: 174.36 MB (182832376) - ConvertRowBatchTime: 207.938ms - DeserializeRowBatchTimer: 730.073ms - FirstBatchArrivalWaitTime: 364.974ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365220) - RowsReturnedRate: 5.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s814ms, non-child: 4s127ms, % non-child: 24.55%) BytesReceived(500.000ms): 0, 0, 782.99 KB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 10.15 MB, 36.14 MB, 71.80 MB, 107.91 MB, 144.06 MB, 180.26 MB, 216.33 MB, 252.48 MB, 289.08 MB, 325.87 MB, 362.49 MB, 399.09 MB, 436.07 MB, 472.51 MB, 509.12 MB, 545.60 MB, 582.10 MB, 618.45 MB, 655.16 MB, 691.67 MB, 728.41 MB, 764.82 MB, 801.31 MB, 837.47 MB, 874.20 MB, 910.91 MB, 947.74 MB, 984.40 MB, 1020.91 MB, 1.03 GB, 1.07 GB, 1.11 GB, 1.14 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570159965) - ConvertRowBatchTime: 1s991ms - DeserializeRowBatchTimer: 5s587ms - FirstBatchArrivalWaitTime: 732.386ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64697716) - RowsReturnedRate: 3.85 M/sec - SendersBlockedTimer: 3s433ms - SendersBlockedTotalTimer(*): 51s483ms Instance c84bf4bc19372552:1f (host=vb0230.halxg.cloudera.com:22000):(Total: 4s662ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.35 MB, 186.62 MB, 305.69 MB, 305.98 MB, 433.57 MB, 433.53 MB, 433.51 MB, 625.45 MB, 667.98 MB, 666.67 MB, 667.02 MB, 667.65 MB, 667.10 MB, 665.96 MB, 667.39 MB, 666.87 MB, 667.06 MB, 667.66 MB, 666.54 MB, 667.32 MB, 665.98 MB, 666.46 MB, 667.55 MB, 668.01 MB, 666.45 MB, 665.95 MB, 665.90 MB, 666.13 MB, 666.96 MB, 667.10 MB, 666.00 MB, 665.91 MB, 666.21 MB, 666.36 MB, 666.82 MB, 666.18 MB, 666.10 MB, 667.57 MB, 666.49 MB, 666.81 MB, 667.59 MB, 665.96 MB, 667.57 MB, 666.94 MB, 667.27 MB, 667.48 MB, 666.08 MB, 665.68 MB, 666.53 MB, 666.08 MB, 665.58 MB, 666.39 MB, 667.05 MB, 601.77 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.82K (3824) - PeakMemoryUsage: 689.68 MB (723180215) - PerHostPeakMemUsage: 1.59 GB (1709595022) - RowsProduced: 1.51M (1511615) - TotalNetworkReceiveTime: 15s988ms - TotalNetworkSendTime: 9.790ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s821ms - SysTime: 1s159ms - UserTime: 12s311ms - VoluntaryContextSwitches: 105.70K (105697) Fragment Instance Lifecycle Timings: - ExecTime: 22s868ms - ExecTreeExecTime: 20s914ms - OpenTime: 4s605ms - ExecTreeOpenTime: 4s348ms - PrepareTime: 57.070ms - ExecTreePrepareTime: 192.976us DataStreamSender (dst_id=9):(Total: 1s236ms, non-child: 1s236ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69540732) - NetworkThroughput(*): 225.10 MB/sec - OverallThroughput: 53.64 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511615) - SerializeBatchTime: 939.439ms - TransmitDataRPCTime: 294.618ms - UncompressedRowBatchSize: 158.63 MB (166338482) CodeGen:(Total: 290.191ms, non-child: 290.191ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.678ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 176.149ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 33.824ms HASH_JOIN_NODE (id=3):(Total: 25s259ms, non-child: 7s400ms, % non-child: 29.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365737) - BuildTime: 2s883ms - PeakMemoryUsage: 649.10 MB (680634980) - ProbeRows: 64.72M (64719454) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s516ms - RowsReturned: 1.51M (1511615) - RowsReturnedRate: 59.84 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s233ms - BuildRowsPartitioned: 7.37M (7365737) - GetNewBlockTime: 452.984us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 610.338ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s431ms, non-child: 485.274ms, % non-child: 33.89%) BytesReceived(500.000ms): 0, 18.43 MB, 45.77 MB, 76.67 MB, 107.95 MB, 139.94 MB, 164.63 MB, 174.20 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB - BytesReceived: 174.37 MB (182840463) - ConvertRowBatchTime: 214.248ms - DeserializeRowBatchTimer: 812.058ms - FirstBatchArrivalWaitTime: 357.986ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365737) - RowsReturnedRate: 5.14 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s886ms, non-child: 6s758ms, % non-child: 40.03%) BytesReceived(500.000ms): 0, 0, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 30.22 MB, 65.91 MB, 101.89 MB, 138.17 MB, 174.42 MB, 210.54 MB, 246.73 MB, 283.21 MB, 319.90 MB, 356.70 MB, 393.30 MB, 430.18 MB, 466.76 MB, 503.35 MB, 539.87 MB, 576.40 MB, 612.88 MB, 649.47 MB, 686.07 MB, 722.74 MB, 759.24 MB, 795.77 MB, 832.15 MB, 868.73 MB, 905.35 MB, 942.33 MB, 979.00 MB, 1015.43 MB, 1.03 GB, 1.06 GB, 1.10 GB, 1.14 GB, 1.17 GB, 1.21 GB, 1.24 GB, 1.28 GB, 1.32 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570670526) - ConvertRowBatchTime: 1s875ms - DeserializeRowBatchTimer: 9s036ms - FirstBatchArrivalWaitTime: 725.810ms - PeakMemoryUsage: 0 - RowsReturned: 64.72M (64719454) - RowsReturnedRate: 3.83 M/sec - SendersBlockedTimer: 3s425ms - SendersBlockedTotalTimer(*): 34s322ms Instance c84bf4bc19372552:24 (host=vb0204.halxg.cloudera.com:22000):(Total: 4s660ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 153.19 MB, 177.53 MB, 305.54 MB, 305.59 MB, 433.57 MB, 433.51 MB, 433.51 MB, 593.45 MB, 666.46 MB, 666.72 MB, 667.12 MB, 666.42 MB, 667.84 MB, 665.72 MB, 666.63 MB, 667.28 MB, 667.67 MB, 666.10 MB, 666.13 MB, 667.75 MB, 665.82 MB, 666.53 MB, 666.35 MB, 666.86 MB, 666.80 MB, 665.87 MB, 665.72 MB, 666.55 MB, 666.89 MB, 666.85 MB, 665.78 MB, 666.92 MB, 667.15 MB, 665.80 MB, 666.78 MB, 666.37 MB, 666.98 MB, 665.72 MB, 667.35 MB, 666.78 MB, 665.75 MB, 667.14 MB, 667.53 MB, 666.32 MB, 666.54 MB, 667.05 MB, 666.10 MB, 666.83 MB, 667.18 MB, 665.95 MB, 667.38 MB, 667.62 MB, 666.38 MB, 667.15 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 2.81K (2811) - PeakMemoryUsage: 689.72 MB (723220913) - PerHostPeakMemUsage: 1.54 GB (1654437808) - RowsProduced: 1.52M (1515559) - TotalNetworkReceiveTime: 18s890ms - TotalNetworkSendTime: 20.919ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s819ms - SysTime: 706.892ms - UserTime: 9s747ms - VoluntaryContextSwitches: 128.42K (128421) Fragment Instance Lifecycle Timings: - ExecTime: 22s883ms - ExecTreeExecTime: 21s410ms - OpenTime: 4s611ms - ExecTreeOpenTime: 4s325ms - PrepareTime: 48.464ms - ExecTreePrepareTime: 143.249us DataStreamSender (dst_id=9):(Total: 779.515ms, non-child: 779.515ms, % non-child: 100.00%) - BytesSent: 66.48 MB (69704462) - NetworkThroughput(*): 417.98 MB/sec - OverallThroughput: 85.28 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.52M (1515559) - SerializeBatchTime: 619.045ms - TransmitDataRPCTime: 159.038ms - UncompressedRowBatchSize: 159.05 MB (166772474) CodeGen:(Total: 321.288ms, non-child: 321.288ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 78.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 206.414ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 35.657ms HASH_JOIN_NODE (id=3):(Total: 25s731ms, non-child: 5s806ms, % non-child: 22.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7368781) - BuildTime: 2s378ms - PeakMemoryUsage: 649.10 MB (680634521) - ProbeRows: 64.70M (64700804) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s484ms - RowsReturned: 1.52M (1515559) - RowsReturnedRate: 58.90 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s734ms - BuildRowsPartitioned: 7.37M (7368781) - GetNewBlockTime: 430.538us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 608.047ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s924ms, non-child: 462.951ms, % non-child: 24.05%) BytesReceived(500.000ms): 0, 14.57 MB, 42.21 MB, 73.04 MB, 104.24 MB, 136.35 MB, 162.75 MB, 173.60 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182916649) - ConvertRowBatchTime: 137.571ms - DeserializeRowBatchTimer: 891.776ms - FirstBatchArrivalWaitTime: 335.576ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7368781) - RowsReturnedRate: 3.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s476ms, non-child: 3s070ms, % non-child: 16.62%) BytesReceived(500.000ms): 0, 0, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 10.12 MB, 26.16 MB, 61.71 MB, 97.59 MB, 133.83 MB, 170.08 MB, 206.00 MB, 242.05 MB, 278.46 MB, 315.23 MB, 351.84 MB, 388.55 MB, 425.29 MB, 461.69 MB, 498.15 MB, 534.64 MB, 571.16 MB, 607.72 MB, 644.32 MB, 680.92 MB, 717.62 MB, 754.22 MB, 790.71 MB, 827.09 MB, 863.78 MB, 900.46 MB, 937.38 MB, 974.20 MB, 1010.83 MB, 1.02 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570226112) - ConvertRowBatchTime: 1s214ms - DeserializeRowBatchTimer: 5s061ms - FirstBatchArrivalWaitTime: 706.695ms - PeakMemoryUsage: 0 - RowsReturned: 64.70M (64700804) - RowsReturnedRate: 3.50 M/sec - SendersBlockedTimer: 3s423ms - SendersBlockedTotalTimer(*): 44s507ms Instance c84bf4bc19372552:28 (host=vb0208.halxg.cloudera.com:22000):(Total: 4s645ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 1.28 MB, 111.86 KB, 160.49 MB, 177.77 MB, 305.64 MB, 306.25 MB, 434.38 MB, 433.51 MB, 449.45 MB, 673.45 MB, 666.17 MB, 666.28 MB, 667.52 MB, 666.97 MB, 666.02 MB, 667.31 MB, 666.14 MB, 667.52 MB, 667.28 MB, 666.22 MB, 666.22 MB, 666.68 MB, 665.96 MB, 667.57 MB, 666.83 MB, 666.34 MB, 667.78 MB, 665.77 MB, 667.05 MB, 666.87 MB, 666.17 MB, 667.50 MB, 666.23 MB, 666.73 MB, 667.63 MB, 667.47 MB, 667.37 MB, 667.81 MB, 666.35 MB, 667.18 MB, 666.81 MB, 666.53 MB, 665.93 MB, 667.38 MB, 666.21 MB, 667.24 MB, 665.91 MB, 667.57 MB, 667.24 MB, 667.12 MB, 667.06 MB, 667.65 MB, 665.96 MB, 667.44 MB, 666.02 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.29K (3287) - PeakMemoryUsage: 689.83 MB (723343007) - PerHostPeakMemUsage: 1.60 GB (1713159721) - RowsProduced: 1.51M (1508417) - TotalNetworkReceiveTime: 16s756ms - TotalNetworkSendTime: 15.283ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s840ms - SysTime: 960.854ms - UserTime: 11s680ms - VoluntaryContextSwitches: 116.52K (116523) Fragment Instance Lifecycle Timings: - ExecTime: 22s899ms - ExecTreeExecTime: 21s126ms - OpenTime: 4s590ms - ExecTreeOpenTime: 4s350ms - PrepareTime: 54.874ms - ExecTreePrepareTime: 207.416us DataStreamSender (dst_id=9):(Total: 1s032ms, non-child: 1s032ms, % non-child: 100.00%) - BytesSent: 66.17 MB (69388523) - NetworkThroughput(*): 366.26 MB/sec - OverallThroughput: 64.12 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1508417) - SerializeBatchTime: 849.566ms - TransmitDataRPCTime: 180.675ms - UncompressedRowBatchSize: 158.30 MB (165986566) CodeGen:(Total: 273.944ms, non-child: 273.944ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 77.726ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 161.539ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.161ms HASH_JOIN_NODE (id=3):(Total: 25s474ms, non-child: 7s028ms, % non-child: 27.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7367997) - BuildTime: 2s820ms - PeakMemoryUsage: 649.10 MB (680635898) - ProbeRows: 64.65M (64645952) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s242ms - RowsReturned: 1.51M (1508417) - RowsReturnedRate: 59.21 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s199ms - BuildRowsPartitioned: 7.37M (7367997) - GetNewBlockTime: 581.388us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 587.933ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s497ms, non-child: 490.242ms, % non-child: 32.74%) BytesReceived(500.000ms): 0, 0, 22.37 MB, 51.57 MB, 82.52 MB, 114.05 MB, 145.67 MB, 167.33 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB - BytesReceived: 174.43 MB (182900094) - ConvertRowBatchTime: 229.625ms - DeserializeRowBatchTimer: 794.415ms - FirstBatchArrivalWaitTime: 376.715ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7367997) - RowsReturnedRate: 4.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s423ms, non-child: 3s810ms, % non-child: 21.87%) BytesReceived(500.000ms): 0, 0, 1.28 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 10.14 MB, 37.13 MB, 72.75 MB, 108.66 MB, 144.96 MB, 181.01 MB, 217.10 MB, 253.10 MB, 289.69 MB, 326.34 MB, 362.83 MB, 399.44 MB, 436.35 MB, 472.75 MB, 509.17 MB, 545.63 MB, 582.16 MB, 618.67 MB, 655.30 MB, 691.92 MB, 728.55 MB, 764.97 MB, 801.40 MB, 837.85 MB, 874.48 MB, 911.04 MB, 947.92 MB, 984.70 MB, 1021.14 MB, 1.03 GB, 1.07 GB, 1.11 GB, 1.14 GB, 1.18 GB, 1.21 GB, 1.25 GB, 1.29 GB, 1.32 GB, 1.36 GB, 1.39 GB, 1.41 GB, 1.43 GB, 1.45 GB, 1.45 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568931333) - ConvertRowBatchTime: 1s730ms - DeserializeRowBatchTimer: 5s588ms - FirstBatchArrivalWaitTime: 745.941ms - PeakMemoryUsage: 0 - RowsReturned: 64.65M (64645952) - RowsReturnedRate: 3.71 M/sec - SendersBlockedTimer: 3s410ms - SendersBlockedTotalTimer(*): 51s138ms Instance c84bf4bc19372552:21 (host=vb0224.halxg.cloudera.com:22000):(Total: 4s637ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 158.34 MB, 178.40 MB, 305.59 MB, 307.48 MB, 433.89 MB, 433.49 MB, 433.49 MB, 593.45 MB, 667.50 MB, 666.47 MB, 666.69 MB, 667.50 MB, 666.84 MB, 666.95 MB, 667.18 MB, 666.31 MB, 665.82 MB, 667.09 MB, 667.61 MB, 666.24 MB, 666.63 MB, 666.30 MB, 667.53 MB, 667.37 MB, 666.07 MB, 666.18 MB, 665.81 MB, 666.48 MB, 667.40 MB, 666.20 MB, 667.37 MB, 667.78 MB, 667.89 MB, 667.03 MB, 667.33 MB, 667.19 MB, 667.86 MB, 667.29 MB, 667.60 MB, 666.84 MB, 667.86 MB, 666.23 MB, 666.21 MB, 667.30 MB, 666.34 MB, 667.30 MB, 667.07 MB, 667.58 MB, 665.64 MB, 667.09 MB, 665.49 MB, 666.22 MB, 666.98 MB, 665.81 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 4.48K (4477) - PeakMemoryUsage: 689.60 MB (723098819) - PerHostPeakMemUsage: 1.60 GB (1720395712) - RowsProduced: 1.51M (1511988) - TotalNetworkReceiveTime: 15s842ms - TotalNetworkSendTime: 31.716ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s787ms - SysTime: 1s221ms - UserTime: 12s279ms - VoluntaryContextSwitches: 103.06K (103060) Fragment Instance Lifecycle Timings: - ExecTime: 22s906ms - ExecTreeExecTime: 20s887ms - OpenTime: 4s578ms - ExecTreeOpenTime: 4s303ms - PrepareTime: 59.579ms - ExecTreePrepareTime: 206.368us DataStreamSender (dst_id=9):(Total: 1s256ms, non-child: 1s256ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69544158) - NetworkThroughput(*): 222.29 MB/sec - OverallThroughput: 52.80 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511988) - SerializeBatchTime: 955.298ms - TransmitDataRPCTime: 298.364ms - UncompressedRowBatchSize: 158.67 MB (166379504) CodeGen:(Total: 316.599ms, non-child: 316.599ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 82.212ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 190.976ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 42.725ms HASH_JOIN_NODE (id=3):(Total: 25s187ms, non-child: 7s408ms, % non-child: 29.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7368943) - BuildTime: 2s838ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.71M (64709740) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s557ms - RowsReturned: 1.51M (1511988) - RowsReturnedRate: 60.03 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s223ms - BuildRowsPartitioned: 7.37M (7368943) - GetNewBlockTime: 531.356us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 585.044ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s427ms, non-child: 497.820ms, % non-child: 34.88%) BytesReceived(500.000ms): 0, 11.75 MB, 39.48 MB, 70.28 MB, 101.47 MB, 133.57 MB, 161.21 MB, 173.02 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB, 174.44 MB - BytesReceived: 174.44 MB (182918822) - ConvertRowBatchTime: 228.904ms - DeserializeRowBatchTimer: 808.364ms - FirstBatchArrivalWaitTime: 337.669ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7368943) - RowsReturnedRate: 5.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s788ms, non-child: 7s168ms, % non-child: 42.70%) BytesReceived(500.000ms): 0, 0, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 23.10 MB, 58.59 MB, 94.28 MB, 130.53 MB, 166.72 MB, 202.75 MB, 238.85 MB, 275.26 MB, 312.05 MB, 348.63 MB, 385.29 MB, 422.13 MB, 458.74 MB, 495.30 MB, 531.84 MB, 568.36 MB, 604.91 MB, 641.52 MB, 678.19 MB, 714.87 MB, 751.37 MB, 787.86 MB, 824.26 MB, 860.79 MB, 897.36 MB, 934.22 MB, 970.89 MB, 1007.48 MB, 1.02 GB, 1.06 GB, 1.09 GB, 1.13 GB, 1.16 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.31 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570422127) - ConvertRowBatchTime: 1s905ms - DeserializeRowBatchTimer: 9s304ms - FirstBatchArrivalWaitTime: 705.923ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64709740) - RowsReturnedRate: 3.85 M/sec - SendersBlockedTimer: 3s399ms - SendersBlockedTotalTimer(*): 27s195ms Instance c84bf4bc19372552:26 (host=vb0216.halxg.cloudera.com:22000):(Total: 4s625ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 104.89 KB, 153.19 MB, 177.55 MB, 177.51 MB, 305.53 MB, 305.59 MB, 433.55 MB, 433.47 MB, 545.45 MB, 667.07 MB, 667.45 MB, 667.47 MB, 666.96 MB, 666.14 MB, 667.54 MB, 666.06 MB, 667.95 MB, 666.37 MB, 666.09 MB, 666.27 MB, 667.26 MB, 666.44 MB, 666.50 MB, 665.95 MB, 667.23 MB, 667.90 MB, 666.39 MB, 667.67 MB, 666.16 MB, 665.83 MB, 666.56 MB, 666.59 MB, 666.84 MB, 665.82 MB, 666.62 MB, 667.08 MB, 667.87 MB, 666.06 MB, 667.78 MB, 667.00 MB, 667.70 MB, 667.66 MB, 666.74 MB, 666.12 MB, 666.45 MB, 667.31 MB, 667.72 MB, 666.25 MB, 665.59 MB, 666.20 MB, 665.77 MB, 666.92 MB, 666.30 MB, 666.93 MB, 665.77 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.09K (3093) - PeakMemoryUsage: 689.66 MB (723159866) - PerHostPeakMemUsage: 1.60 GB (1720128972) - RowsProduced: 1.51M (1510643) - TotalNetworkReceiveTime: 15s992ms - TotalNetworkSendTime: 19.159ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s805ms - SysTime: 992.849ms - UserTime: 12s591ms - VoluntaryContextSwitches: 106.19K (106191) Fragment Instance Lifecycle Timings: - ExecTime: 22s919ms - ExecTreeExecTime: 20s816ms - OpenTime: 4s571ms - ExecTreeOpenTime: 4s313ms - PrepareTime: 53.683ms - ExecTreePrepareTime: 203.156us DataStreamSender (dst_id=9):(Total: 1s360ms, non-child: 1s360ms, % non-child: 100.00%) - BytesSent: 66.25 MB (69470290) - NetworkThroughput(*): 219.65 MB/sec - OverallThroughput: 48.70 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1510643) - SerializeBatchTime: 1s056ms - TransmitDataRPCTime: 301.627ms - UncompressedRowBatchSize: 158.53 MB (166231514) CodeGen:(Total: 291.294ms, non-child: 291.294ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.836ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 176.056ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 33.861ms HASH_JOIN_NODE (id=3):(Total: 25s126ms, non-child: 7s120ms, % non-child: 28.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7370778) - BuildTime: 2s371ms - PeakMemoryUsage: 649.10 MB (680634231) - ProbeRows: 64.66M (64662002) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s700ms - RowsReturned: 1.51M (1510643) - RowsReturnedRate: 60.12 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1s767ms - BuildRowsPartitioned: 7.37M (7370778) - GetNewBlockTime: 602.044us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 574.339ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s919ms, non-child: 283.802ms, % non-child: 14.79%) BytesReceived(500.000ms): 0, 4.64 MB, 32.76 MB, 63.45 MB, 94.49 MB, 126.42 MB, 156.72 MB, 171.39 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB, 174.48 MB - BytesReceived: 174.48 MB (182957953) - ConvertRowBatchTime: 146.187ms - DeserializeRowBatchTimer: 554.175ms - FirstBatchArrivalWaitTime: 360.858ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7370778) - RowsReturnedRate: 3.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 16s592ms, non-child: 6s999ms, % non-child: 42.18%) BytesReceived(500.000ms): 0, 0, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 15.33 MB, 50.57 MB, 86.13 MB, 122.44 MB, 158.55 MB, 194.64 MB, 230.75 MB, 267.14 MB, 303.68 MB, 340.19 MB, 377.00 MB, 413.70 MB, 450.45 MB, 486.77 MB, 523.24 MB, 559.72 MB, 596.35 MB, 632.83 MB, 669.49 MB, 705.98 MB, 742.69 MB, 779.10 MB, 815.59 MB, 851.98 MB, 888.60 MB, 925.38 MB, 962.22 MB, 998.86 MB, 1.01 GB, 1.05 GB, 1.08 GB, 1.12 GB, 1.16 GB, 1.19 GB, 1.23 GB, 1.26 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.40 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569293299) - ConvertRowBatchTime: 2s140ms - DeserializeRowBatchTimer: 9s007ms - FirstBatchArrivalWaitTime: 728.007ms - PeakMemoryUsage: 0 - RowsReturned: 64.66M (64662002) - RowsReturnedRate: 3.90 M/sec - SendersBlockedTimer: 3s388ms - SendersBlockedTotalTimer(*): 33s901ms Instance c84bf4bc19372552:2c (host=vb0232.halxg.cloudera.com:22000):(Total: 4s610ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 104.89 KB, 26.93 MB, 178.77 MB, 178.23 MB, 305.56 MB, 306.63 MB, 433.53 MB, 433.53 MB, 545.45 MB, 666.81 MB, 665.74 MB, 666.46 MB, 667.55 MB, 666.97 MB, 666.77 MB, 667.10 MB, 667.46 MB, 667.38 MB, 666.53 MB, 666.56 MB, 666.78 MB, 666.40 MB, 667.47 MB, 665.76 MB, 665.97 MB, 666.88 MB, 667.61 MB, 665.84 MB, 666.15 MB, 666.75 MB, 666.08 MB, 666.11 MB, 666.68 MB, 666.73 MB, 665.94 MB, 666.79 MB, 667.31 MB, 667.00 MB, 667.80 MB, 667.40 MB, 665.86 MB, 667.48 MB, 667.11 MB, 667.57 MB, 666.62 MB, 667.05 MB, 666.93 MB, 667.22 MB, 667.00 MB, 665.76 MB, 667.51 MB, 667.04 MB, 665.66 MB, 666.51 MB, 667.44 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.46K (3456) - PeakMemoryUsage: 689.62 MB (723119168) - PerHostPeakMemUsage: 1.60 GB (1720112795) - RowsProduced: 1.51M (1508089) - TotalNetworkReceiveTime: 18s763ms - TotalNetworkSendTime: 18.148ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s806ms - SysTime: 882.865ms - UserTime: 9s621ms - VoluntaryContextSwitches: 127.30K (127302) Fragment Instance Lifecycle Timings: - ExecTime: 22s934ms - ExecTreeExecTime: 21s540ms - OpenTime: 4s568ms - ExecTreeOpenTime: 4s303ms - PrepareTime: 41.683ms - ExecTreePrepareTime: 202.908us DataStreamSender (dst_id=9):(Total: 771.347ms, non-child: 771.347ms, % non-child: 100.00%) - BytesSent: 66.17 MB (69384780) - NetworkThroughput(*): 405.60 MB/sec - OverallThroughput: 85.79 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1508089) - SerializeBatchTime: 606.754ms - TransmitDataRPCTime: 163.141ms - UncompressedRowBatchSize: 158.26 MB (165950478) CodeGen:(Total: 298.865ms, non-child: 298.865ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 82.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 181.465ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 34.496ms HASH_JOIN_NODE (id=3):(Total: 25s840ms, non-child: 5s957ms, % non-child: 23.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365037) - BuildTime: 2s761ms - PeakMemoryUsage: 649.11 MB (680636408) - ProbeRows: 64.71M (64713414) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s279ms - RowsReturned: 1.51M (1508089) - RowsReturnedRate: 58.36 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s177ms - BuildRowsPartitioned: 7.37M (7365037) - GetNewBlockTime: 671.956us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 555.602ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s509ms, non-child: 487.604ms, % non-child: 32.31%) BytesReceived(500.000ms): 0, 4.97 MB, 33.08 MB, 63.83 MB, 94.86 MB, 126.76 MB, 156.99 MB, 171.39 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB, 174.35 MB - BytesReceived: 174.35 MB (182823380) - ConvertRowBatchTime: 222.486ms - DeserializeRowBatchTimer: 795.588ms - FirstBatchArrivalWaitTime: 363.393ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365037) - RowsReturnedRate: 4.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 18s839ms, non-child: 2s981ms, % non-child: 15.82%) BytesReceived(500.000ms): 0, 0, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 15.71 MB, 51.09 MB, 86.70 MB, 122.97 MB, 159.24 MB, 195.28 MB, 231.43 MB, 267.79 MB, 304.38 MB, 341.01 MB, 377.59 MB, 414.28 MB, 451.09 MB, 487.47 MB, 524.02 MB, 560.53 MB, 597.11 MB, 633.73 MB, 670.46 MB, 707.11 MB, 743.68 MB, 780.13 MB, 816.59 MB, 853.04 MB, 889.72 MB, 926.54 MB, 963.22 MB, 999.82 MB, 1.01 GB, 1.05 GB, 1.08 GB, 1.12 GB, 1.16 GB, 1.19 GB, 1.23 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.40 GB, 1.42 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1570535719) - ConvertRowBatchTime: 1s200ms - DeserializeRowBatchTimer: 5s061ms - FirstBatchArrivalWaitTime: 733.100ms - PeakMemoryUsage: 0 - RowsReturned: 64.71M (64713414) - RowsReturnedRate: 3.43 M/sec - SendersBlockedTimer: 3s373ms - SendersBlockedTotalTimer(*): 30s355ms Instance c84bf4bc19372552:25 (host=vb0220.halxg.cloudera.com:22000):(Total: 4s600ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 111.86 KB, 159.21 MB, 186.35 MB, 307.12 MB, 307.08 MB, 434.43 MB, 433.57 MB, 433.53 MB, 625.48 MB, 667.95 MB, 666.53 MB, 666.40 MB, 665.77 MB, 666.98 MB, 665.98 MB, 667.18 MB, 667.31 MB, 665.85 MB, 667.45 MB, 667.66 MB, 667.56 MB, 667.18 MB, 667.17 MB, 665.77 MB, 666.77 MB, 666.00 MB, 667.98 MB, 666.66 MB, 666.24 MB, 666.00 MB, 667.74 MB, 666.77 MB, 667.46 MB, 667.21 MB, 667.32 MB, 665.83 MB, 666.13 MB, 666.19 MB, 666.99 MB, 665.96 MB, 665.82 MB, 667.01 MB, 666.66 MB, 667.92 MB, 667.02 MB, 666.60 MB, 667.35 MB, 666.56 MB, 666.29 MB, 667.34 MB, 667.01 MB, 667.63 MB, 667.16 MB, 667.53 MB, 666.04 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 3.50K (3505) - PeakMemoryUsage: 689.76 MB (723261611) - PerHostPeakMemUsage: 1.60 GB (1720645053) - RowsProduced: 1.51M (1511825) - TotalNetworkReceiveTime: 17s132ms - TotalNetworkSendTime: 22.677ms - TotalStorageWaitTime: 0.000ns - TotalWallClockTime: 31s764ms - SysTime: 1s022ms - UserTime: 11s287ms - VoluntaryContextSwitches: 111.43K (111430) Fragment Instance Lifecycle Timings: - ExecTime: 22s942ms - ExecTreeExecTime: 21s201ms - OpenTime: 4s534ms - ExecTreeOpenTime: 4s287ms - PrepareTime: 65.295ms - ExecTreePrepareTime: 246.752us DataStreamSender (dst_id=9):(Total: 1s092ms, non-child: 1s092ms, % non-child: 100.00%) - BytesSent: 66.32 MB (69544164) - NetworkThroughput(*): 237.95 MB/sec - OverallThroughput: 60.70 MB/sec - PeakMemoryUsage: 466.64 KB (477840) - RowsReturned: 1.51M (1511825) - SerializeBatchTime: 812.052ms - TransmitDataRPCTime: 278.723ms - UncompressedRowBatchSize: 158.65 MB (166361590) CodeGen:(Total: 287.165ms, non-child: 287.165ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 77.695ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 54 (54) - NumInstructions: 2.40K (2404) - OptimizationTime: 168.861ms - PeakMemoryUsage: 1.17 MB (1230848) - PrepareTime: 39.897ms HASH_JOIN_NODE (id=3):(Total: 25s485ms, non-child: 6s720ms, % non-child: 26.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 7.37M (7365265) - BuildTime: 2s788ms - PeakMemoryUsage: 649.11 MB (680636969) - ProbeRows: 64.67M (64668417) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s970ms - RowsReturned: 1.51M (1511825) - RowsReturnedRate: 59.32 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2s206ms - BuildRowsPartitioned: 7.37M (7365265) - GetNewBlockTime: 552.596us - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - HashTablesBuildTime: 545.586ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 649.02 MB (680547456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=8):(Total: 1s460ms, non-child: 515.752ms, % non-child: 35.30%) BytesReceived(500.000ms): 0, 15.51 MB, 43.00 MB, 73.90 MB, 105.12 MB, 137.19 MB, 163.18 MB, 173.72 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB, 174.37 MB - BytesReceived: 174.37 MB (182835154) - ConvertRowBatchTime: 230.374ms - DeserializeRowBatchTimer: 835.182ms - FirstBatchArrivalWaitTime: 358.127ms - PeakMemoryUsage: 0 - RowsReturned: 7.37M (7365265) - RowsReturnedRate: 5.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 17s757ms, non-child: 6s769ms, % non-child: 38.12%) BytesReceived(500.000ms): 0, 0, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 10.13 MB, 27.24 MB, 62.84 MB, 98.65 MB, 134.97 MB, 171.24 MB, 207.24 MB, 243.32 MB, 279.79 MB, 316.42 MB, 352.98 MB, 389.59 MB, 426.46 MB, 462.94 MB, 499.41 MB, 535.89 MB, 572.42 MB, 608.95 MB, 645.47 MB, 682.03 MB, 718.47 MB, 754.96 MB, 791.57 MB, 827.98 MB, 864.44 MB, 901.00 MB, 937.90 MB, 974.70 MB, 1011.29 MB, 1.02 GB, 1.06 GB, 1.10 GB, 1.13 GB, 1.17 GB, 1.20 GB, 1.24 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569460863) - ConvertRowBatchTime: 1s634ms - DeserializeRowBatchTimer: 9s247ms - FirstBatchArrivalWaitTime: 727.085ms - PeakMemoryUsage: 0 - RowsReturned: 64.67M (64668417) - RowsReturnedRate: 3.64 M/sec - SendersBlockedTimer: 3s364ms - SendersBlockedTotalTimer(*): 43s725ms Averaged Fragment F00:(Total: 112.080ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 147.82 MB completion times: min:23s196ms max:27s512ms mean: 25s026ms stddev:1s082ms execution rates: min:165.78 MB/sec max:181.80 MB/sec mean:175.67 MB/sec stddev:4.33 MB/sec num instances: 15 - AverageThreadTokens: 11.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 10.30K (10303) - PeakMemoryUsage: 786.49 MB (824694395) - PerHostPeakMemUsage: 1.60 GB (1714262543) - RowsProduced: 64.69M (64687153) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s505ms - TotalStorageWaitTime: 651.685ms - TotalWallClockTime: 4m39s - SysTime: 1s769ms - UserTime: 36s416ms - VoluntaryContextSwitches: 64.15K (64148) Fragment Instance Lifecycle Timings: - ExecTime: 24s913ms - ExecTreeExecTime: 1s263ms - OpenTime: 67.045ms - ExecTreeOpenTime: 52.394us - PrepareTime: 44.995ms - ExecTreePrepareTime: 290.156us DataStreamSender (dst_id=7):(Total: 16s236ms, non-child: 16s236ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1569898857) - NetworkThroughput(*): 355.11 MB/sec - OverallThroughput: 92.81 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 64.69M (64687153) - SerializeBatchTime: 11s655ms - TransmitDataRPCTime: 4s560ms - UncompressedRowBatchSize: 3.31 GB (3558441956) CodeGen:(Total: 94.679ms, non-child: 94.679ms, % non-child: 100.00%) - CodegenTime: 1.681ms - CompileTime: 16.726ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 49.268ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.151ms HDFS_SCAN_NODE (id=2):(Total: 1s224ms, non-child: 1s224ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 10.20 - BytesRead: 1013.25 MB (1062467810) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1013.25 MB (1062467810) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1013.25 MB (1062467810) - DecompressionTime: 3s606ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 770.01 MB (807411958) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.619ms - RowBatchQueuePutWaitTime: 3m48s - RowsRead: 120.00M (119999272) - RowsReturned: 64.69M (64687153) - RowsReturnedRate: 52.92 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 8.16K (8157) - ScannerThreadsTotalWallClockTime: 4m14s - MaterializeTupleTime(*): 12s713ms - ScannerThreadsSysTime: 814.470ms - ScannerThreadsUserTime: 16s794ms - ScannerThreadsVoluntaryContextSwitches: 63.88K (63875) - TotalRawHdfsReadTime(*): 764.501ms - TotalReadThroughput: 40.50 MB/sec Filter 1 (16.00 MB): - Rows processed: 370.26K (370262) - Rows rejected: 3.15K (3155) - Rows total: 120.00M (119999272) Fragment F00: Instance c84bf4bc19372552:4 (host=vb0234.halxg.cloudera.com:22000):(Total: 140.287ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.79 MB 6:1/253.39 MB 1:3/760.21 MB 7:1/253.40 MB 8:1/253.38 MB 10:3/760.19 MB 3:3/760.17 MB 4:4/1013.54 MB Filter 1 arrival: 4s422ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 774.40 MB, 791.77 MB, 792.20 MB, 792.33 MB, 791.97 MB, 791.95 MB, 792.09 MB, 696.48 MB, 696.95 MB, 696.80 MB, 696.94 MB, 696.61 MB, 696.60 MB, 672.37 MB, 601.43 MB, 601.52 MB, 601.61 MB, 601.68 MB, 601.50 MB, 593.90 MB, 529.64 MB, 481.83 MB, 410.08 MB, 338.50 MB, 314.72 MB, 314.50 MB, 282.95 MB, 218.92 MB, 354.78 MB, 412.38 MB, 412.15 MB, 412.22 MB, 364.60 MB, 364.36 MB, 364.19 MB, 316.58 MB, 316.51 MB, 316.66 MB, 284.94 MB, 228.91 MB, 173.25 MB, 149.39 MB, 81.11 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 4 - AverageThreadTokens: 11.06 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.73K (12727) - PeakMemoryUsage: 793.00 MB (831521983) - PerHostPeakMemUsage: 1.63 GB (1747877666) - RowsProduced: 67.17M (67173990) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s496ms - TotalStorageWaitTime: 677.655ms - TotalWallClockTime: 4m45s - SysTime: 2s450ms - UserTime: 42s115ms - VoluntaryContextSwitches: 66.48K (66485) Fragment Instance Lifecycle Timings: - ExecTime: 25s405ms - ExecTreeExecTime: 1s274ms - OpenTime: 89.533ms - ExecTreeOpenTime: 52.040us - PrepareTime: 50.708ms - ExecTreePrepareTime: 254.848us DataStreamSender (dst_id=7):(Total: 15s008ms, non-child: 15s008ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630476551) - NetworkThroughput(*): 478.99 MB/sec - OverallThroughput: 103.60 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67173990) - SerializeBatchTime: 11s741ms - TransmitDataRPCTime: 3s246ms - UncompressedRowBatchSize: 3.44 GB (3695242910) CodeGen:(Total: 124.278ms, non-child: 124.278ms, % non-child: 100.00%) - CodegenTime: 2.162ms - CompileTime: 19.034ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 69.310ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 35.294ms HDFS_SCAN_NODE (id=2):(Total: 1s232ms, non-child: 1s232ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.79 MB 6:1/253.39 MB 1:3/760.21 MB 7:1/253.40 MB 8:1/253.38 MB 10:3/760.19 MB 3:3/760.17 MB 4:4/1013.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 864ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 876.64 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.841ms ; Min: 2.236ms ; Max: 5.989ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.06 - BytesRead: 1.03 GB (1102941326) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102941326) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102941326) - DecompressionTime: 4s749ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.49 MB (814206288) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.774ms - RowBatchQueuePutWaitTime: 3m48s - RowsRead: 124.58M (124581346) - RowsReturned: 67.17M (67173990) - RowsReturnedRate: 54.49 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.57K (10566) - ScannerThreadsTotalWallClockTime: 4m19s - MaterializeTupleTime(*): 17s045ms - ScannerThreadsSysTime: 1s176ms - ScannerThreadsUserTime: 22s255ms - ScannerThreadsVoluntaryContextSwitches: 66.22K (66215) - TotalRawHdfsReadTime(*): 780.591ms - TotalReadThroughput: 41.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 354.77K (354774) - Rows rejected: 3.05K (3052) - Rows total: 124.58M (124581346) Instance c84bf4bc19372552:9 (host=vb0222.halxg.cloudera.com:22000):(Total: 118.771ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.41 MB 8:1/253.41 MB 7:1/253.40 MB 0:4/1013.57 MB 6:3/760.17 MB 1:2/506.82 MB 9:5/1.24 GB Filter 1 arrival: 4s423ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 437.10 MB, 774.46 MB, 774.46 MB, 774.46 MB, 774.46 MB, 774.46 MB, 774.46 MB, 790.46 MB, 792.29 MB, 792.36 MB, 792.27 MB, 792.09 MB, 792.51 MB, 760.71 MB, 696.35 MB, 696.89 MB, 696.45 MB, 696.49 MB, 696.80 MB, 696.62 MB, 601.60 MB, 601.44 MB, 601.41 MB, 601.24 MB, 601.43 MB, 601.43 MB, 577.80 MB, 505.51 MB, 457.51 MB, 385.58 MB, 314.53 MB, 314.40 MB, 314.36 MB, 218.55 MB, 218.69 MB, 348.02 MB, 348.55 MB, 348.60 MB, 308.94 MB, 308.84 MB, 269.51 MB, 269.43 MB, 269.46 MB, 229.30 MB, 150.02 MB, 149.68 MB, 65.94 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 11.00 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.49K (8492) - PeakMemoryUsage: 792.96 MB (831482255) - PerHostPeakMemUsage: 1.60 GB (1721390396) - RowsProduced: 63.43M (63429157) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s519ms - TotalStorageWaitTime: 732.236ms - TotalWallClockTime: 4m30s - SysTime: 1s410ms - UserTime: 31s990ms - VoluntaryContextSwitches: 62.99K (62995) Fragment Instance Lifecycle Timings: - ExecTime: 24s027ms - ExecTreeExecTime: 1s173ms - OpenTime: 70.001ms - ExecTreeOpenTime: 48.432us - PrepareTime: 48.730ms - ExecTreePrepareTime: 294.148us DataStreamSender (dst_id=7):(Total: 16s993ms, non-child: 16s993ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539674315) - NetworkThroughput(*): 264.06 MB/sec - OverallThroughput: 86.40 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.43M (63429157) - SerializeBatchTime: 11s415ms - TransmitDataRPCTime: 5s560ms - UncompressedRowBatchSize: 3.25 GB (3489239551) CodeGen:(Total: 95.401ms, non-child: 95.401ms, % non-child: 100.00%) - CodegenTime: 1.493ms - CompileTime: 15.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 51.612ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.723ms HDFS_SCAN_NODE (id=2):(Total: 1s141ms, non-child: 1s141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.41 MB 8:1/253.41 MB 7:1/253.40 MB 0:4/1013.57 MB 6:3/760.17 MB 1:2/506.82 MB 9:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 884ms Hdfs Read Thread Concurrency Bucket: 0:97.92% 1:0% 2:2.083% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 362.72 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 701.25 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB - FooterProcessingTime: (Avg: 3.186ms ; Min: 1.641ms ; Max: 4.856ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 10.21 - BytesRead: 993.42 MB (1041678633) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.42 MB (1041678633) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.42 MB (1041678633) - DecompressionTime: 2s880ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.55 MB (814266916) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.429ms - RowBatchQueuePutWaitTime: 3m43s - RowsRead: 117.66M (117660067) - RowsReturned: 63.43M (63429157) - RowsReturnedRate: 55.55 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.49K (6490) - ScannerThreadsTotalWallClockTime: 4m6s - MaterializeTupleTime(*): 9s739ms - ScannerThreadsSysTime: 614.901ms - ScannerThreadsUserTime: 13s076ms - ScannerThreadsVoluntaryContextSwitches: 62.70K (62705) - TotalRawHdfsReadTime(*): 748.663ms - TotalReadThroughput: 40.55 MB/sec Filter 1 (16.00 MB): - Rows processed: 373.46K (373465) - Rows rejected: 3.35K (3348) - Rows total: 117.66M (117660067) Instance c84bf4bc19372552:1 (host=vb0230.halxg.cloudera.com:22000):(Total: 115.553ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 9:1/253.39 MB 6:2/506.80 MB 3:1/7.47 MB 5:2/506.78 MB 0:2/506.78 MB 7:2/260.78 MB 2:2/506.80 MB 8:4/1013.57 MB 4:2/506.81 MB Filter 1 arrival: 4s386ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 715.33 MB, 715.33 MB, 715.33 MB, 715.33 MB, 715.33 MB, 715.33 MB, 731.33 MB, 791.93 MB, 791.95 MB, 792.18 MB, 792.20 MB, 791.97 MB, 792.80 MB, 697.09 MB, 696.58 MB, 696.75 MB, 696.90 MB, 696.87 MB, 696.89 MB, 617.29 MB, 601.41 MB, 601.60 MB, 601.65 MB, 601.52 MB, 601.25 MB, 593.27 MB, 505.78 MB, 457.90 MB, 385.90 MB, 314.90 MB, 315.13 MB, 314.89 MB, 218.67 MB, 218.87 MB, 349.27 MB, 348.60 MB, 348.90 MB, 308.81 MB, 309.08 MB, 269.62 MB, 268.97 MB, 268.88 MB, 229.40 MB, 149.31 MB, 149.69 MB, 51.15 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 2 - AverageThreadTokens: 11.17 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.28K (8280) - PeakMemoryUsage: 793.04 MB (831559539) - PerHostPeakMemUsage: 1.59 GB (1709595022) - RowsProduced: 63.62M (63621637) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s503ms - TotalStorageWaitTime: 664.014ms - TotalWallClockTime: 4m27s - SysTime: 1s389ms - UserTime: 31s956ms - VoluntaryContextSwitches: 63.19K (63193) Fragment Instance Lifecycle Timings: - ExecTime: 23s930ms - ExecTreeExecTime: 1s194ms - OpenTime: 65.043ms - ExecTreeOpenTime: 59.480us - PrepareTime: 50.471ms - ExecTreePrepareTime: 330.600us DataStreamSender (dst_id=7):(Total: 17s194ms, non-child: 17s194ms, % non-child: 100.00%) - BytesSent: 1.44 GB (1543493817) - NetworkThroughput(*): 253.45 MB/sec - OverallThroughput: 85.61 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.62M (63621637) - SerializeBatchTime: 11s366ms - TransmitDataRPCTime: 5s807ms - UncompressedRowBatchSize: 3.26 GB (3499827883) CodeGen:(Total: 95.350ms, non-child: 95.350ms, % non-child: 100.00%) - CodegenTime: 1.597ms - CompileTime: 16.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.528ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 30.540ms HDFS_SCAN_NODE (id=2):(Total: 1s162ms, non-child: 1s162ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 9:1/253.39 MB 6:2/506.80 MB 3:1/7.47 MB 5:2/506.78 MB 0:2/506.78 MB 7:2/260.78 MB 2:2/506.80 MB 8:4/1013.57 MB 4:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(500.000ms): 0, 0, 644.73 MB, 644.73 MB, 644.73 MB, 644.73 MB, 644.73 MB, 644.73 MB, 644.73 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 703.17 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB, 997.24 MB - FooterProcessingTime: (Avg: 4.369ms ; Min: 1.874ms ; Max: 20.158ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.17 - BytesRead: 997.24 MB (1045686580) - BytesReadDataNodeCache: 0 - BytesReadLocal: 997.24 MB (1045686580) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 997.24 MB (1045686580) - DecompressionTime: 2s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.51 MB (814230028) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.894ms - RowBatchQueuePutWaitTime: 3m42s - RowsRead: 118.04M (118040430) - RowsReturned: 63.62M (63621637) - RowsReturnedRate: 54.75 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.26K (6261) - ScannerThreadsTotalWallClockTime: 4m3s - MaterializeTupleTime(*): 9s779ms - ScannerThreadsSysTime: 599.905ms - ScannerThreadsUserTime: 13s136ms - ScannerThreadsVoluntaryContextSwitches: 62.86K (62864) - TotalRawHdfsReadTime(*): 763.324ms - TotalReadThroughput: 41.55 MB/sec Filter 1 (16.00 MB): - Rows processed: 402.84K (402836) - Rows rejected: 3.50K (3500) - Rows total: 118.04M (118040430) Instance c84bf4bc19372552:5 (host=vb0218.halxg.cloudera.com:22000):(Total: 115.472ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.38 MB 2:1/253.39 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 7:2/506.76 MB 0:5/1.24 GB 1:1/253.39 MB Filter 1 arrival: 4s426ms MemoryUsage(500.000ms): 0, 59.86 KB, 59.86 KB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 774.23 MB, 790.23 MB, 791.97 MB, 792.07 MB, 792.10 MB, 791.85 MB, 792.26 MB, 791.85 MB, 696.39 MB, 696.82 MB, 697.07 MB, 697.14 MB, 696.84 MB, 696.68 MB, 649.23 MB, 601.22 MB, 601.35 MB, 601.48 MB, 601.74 MB, 601.68 MB, 601.58 MB, 529.75 MB, 505.94 MB, 426.16 MB, 338.73 MB, 314.76 MB, 314.91 MB, 282.84 MB, 218.79 MB, 361.52 MB, 348.91 MB, 348.75 MB, 332.82 MB, 308.96 MB, 309.01 MB, 276.92 MB, 269.09 MB, 269.13 MB, 221.35 MB, 165.40 MB, 133.57 MB, 63.86 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 11.02 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 11.79K (11791) - PeakMemoryUsage: 793.08 MB (831609751) - PerHostPeakMemUsage: 1.60 GB (1721325092) - RowsProduced: 63.42M (63420063) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s491ms - TotalStorageWaitTime: 614.738ms - TotalWallClockTime: 4m36s - SysTime: 2s221ms - UserTime: 39s156ms - VoluntaryContextSwitches: 62.89K (62894) Fragment Instance Lifecycle Timings: - ExecTime: 24s525ms - ExecTreeExecTime: 1s304ms - OpenTime: 64.761ms - ExecTreeOpenTime: 48.396us - PrepareTime: 50.662ms - ExecTreePrepareTime: 266.408us DataStreamSender (dst_id=7):(Total: 14s562ms, non-child: 14s562ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538401506) - NetworkThroughput(*): 442.34 MB/sec - OverallThroughput: 100.75 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.42M (63420063) - SerializeBatchTime: 11s222ms - TransmitDataRPCTime: 3s316ms - UncompressedRowBatchSize: 3.25 GB (3488739281) CodeGen:(Total: 91.798ms, non-child: 91.798ms, % non-child: 100.00%) - CodegenTime: 1.654ms - CompileTime: 15.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.013ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.317ms HDFS_SCAN_NODE (id=2):(Total: 1s265ms, non-child: 1s265ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.38 MB 2:1/253.39 MB 8:2/506.80 MB 9:1/253.38 MB 4:1/253.40 MB 6:3/760.20 MB 7:2/506.76 MB 0:5/1.24 GB 1:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 0, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 876.54 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB, 993.42 MB - FooterProcessingTime: (Avg: 3.672ms ; Min: 2.083ms ; Max: 6.497ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.22 - BytesRead: 993.42 MB (1041676926) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.42 MB (1041676926) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.42 MB (1041676926) - DecompressionTime: 4s327ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.57 MB (814295068) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.792ms - RowBatchQueuePutWaitTime: 3m40s - RowsRead: 117.66M (117660047) - RowsReturned: 63.42M (63420063) - RowsReturnedRate: 50.12 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 9.69K (9687) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 15s361ms - ScannerThreadsSysTime: 1s084ms - ScannerThreadsUserTime: 20s109ms - ScannerThreadsVoluntaryContextSwitches: 62.66K (62658) - TotalRawHdfsReadTime(*): 752.056ms - TotalReadThroughput: 39.74 MB/sec Filter 1 (16.00 MB): - Rows processed: 334.32K (334320) - Rows rejected: 2.87K (2873) - Rows total: 117.66M (117660047) Instance c84bf4bc19372552:8 (host=vb0216.halxg.cloudera.com:22000):(Total: 113.843ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 3:3/760.19 MB 0:1/253.41 MB 2:2/506.79 MB 4:2/506.80 MB 7:1/253.39 MB 6:3/760.20 MB 10:4/1013.58 MB Filter 1 arrival: 4s412ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.03 MB, 774.03 MB, 774.03 MB, 774.03 MB, 774.03 MB, 774.03 MB, 774.03 MB, 790.93 MB, 792.05 MB, 792.44 MB, 792.30 MB, 792.18 MB, 792.13 MB, 705.19 MB, 696.76 MB, 697.03 MB, 696.68 MB, 696.89 MB, 696.95 MB, 688.91 MB, 601.57 MB, 601.46 MB, 601.36 MB, 601.31 MB, 601.54 MB, 601.52 MB, 506.06 MB, 506.18 MB, 409.96 MB, 314.85 MB, 314.56 MB, 314.85 MB, 227.13 MB, 218.33 MB, 364.40 MB, 348.94 MB, 348.74 MB, 308.88 MB, 308.93 MB, 309.08 MB, 269.50 MB, 269.45 MB, 229.84 MB, 149.88 MB, 149.56 MB, 110.19 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.27 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.08K (8080) - PeakMemoryUsage: 793.00 MB (831522291) - PerHostPeakMemUsage: 1.60 GB (1720128972) - RowsProduced: 63.41M (63414368) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s506ms - TotalStorageWaitTime: 655.201ms - TotalWallClockTime: 4m28s - SysTime: 1s311ms - UserTime: 31s696ms - VoluntaryContextSwitches: 63.10K (63101) Fragment Instance Lifecycle Timings: - ExecTime: 23s815ms - ExecTreeExecTime: 1s196ms - OpenTime: 67.155ms - ExecTreeOpenTime: 52.912us - PrepareTime: 46.649ms - ExecTreePrepareTime: 302.192us DataStreamSender (dst_id=7):(Total: 17s179ms, non-child: 17s179ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538824454) - NetworkThroughput(*): 251.46 MB/sec - OverallThroughput: 85.42 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.41M (63414368) - SerializeBatchTime: 11s325ms - TransmitDataRPCTime: 5s836ms - UncompressedRowBatchSize: 3.25 GB (3488426008) CodeGen:(Total: 96.318ms, non-child: 96.318ms, % non-child: 100.00%) - CodegenTime: 1.768ms - CompileTime: 18.895ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.478ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.397ms HDFS_SCAN_NODE (id=2):(Total: 1s163ms, non-child: 1s163ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.41 MB 3:3/760.19 MB 0:1/253.41 MB 2:2/506.79 MB 4:2/506.80 MB 7:1/253.39 MB 6:3/760.20 MB 10:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB, 993.45 MB - FooterProcessingTime: (Avg: 4.792ms ; Min: 2.175ms ; Max: 17.780ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 993.45 MB (1041708915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.45 MB (1041708915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.45 MB (1041708915) - DecompressionTime: 2s865ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.47 MB (814183040) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.432ms - RowBatchQueuePutWaitTime: 3m40s - RowsRead: 117.66M (117659798) - RowsReturned: 63.41M (63414368) - RowsReturnedRate: 54.52 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.12K (6120) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 9s661ms - ScannerThreadsSysTime: 600.901ms - ScannerThreadsUserTime: 12s927ms - ScannerThreadsVoluntaryContextSwitches: 62.77K (62766) - TotalRawHdfsReadTime(*): 746.692ms - TotalReadThroughput: 41.39 MB/sec Filter 1 (16.00 MB): - Rows processed: 410.68K (410678) - Rows rejected: 3.42K (3423) - Rows total: 117.66M (117659798) Instance c84bf4bc19372552:b (host=vb0206.halxg.cloudera.com:22000):(Total: 113.696ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:1/253.40 MB 8:1/253.41 MB 3:1/253.40 MB 7:2/506.80 MB 9:3/760.16 MB 10:1/253.41 MB 6:1/253.40 MB 2:3/760.21 MB Filter 1 arrival: 4s507ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 792.12 MB, 791.91 MB, 791.73 MB, 792.66 MB, 792.08 MB, 792.22 MB, 728.69 MB, 696.48 MB, 696.89 MB, 696.85 MB, 697.07 MB, 697.04 MB, 696.89 MB, 625.66 MB, 601.65 MB, 601.53 MB, 601.58 MB, 601.78 MB, 601.76 MB, 601.32 MB, 529.62 MB, 505.81 MB, 433.86 MB, 346.38 MB, 314.72 MB, 314.63 MB, 314.49 MB, 242.71 MB, 218.72 MB, 411.46 MB, 348.57 MB, 349.04 MB, 309.23 MB, 309.02 MB, 308.89 MB, 269.23 MB, 269.39 MB, 269.24 MB, 229.37 MB, 149.86 MB, 149.55 MB, 109.76 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.29 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 13.32K (13324) - PeakMemoryUsage: 793.17 MB (831699655) - PerHostPeakMemUsage: 1.60 GB (1721148052) - RowsProduced: 63.41M (63407411) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s504ms - TotalStorageWaitTime: 546.030ms - TotalWallClockTime: 4m47s - SysTime: 1s869ms - UserTime: 43s296ms - VoluntaryContextSwitches: 62.92K (62918) Fragment Instance Lifecycle Timings: - ExecTime: 25s554ms - ExecTreeExecTime: 1s371ms - OpenTime: 66.021ms - ExecTreeOpenTime: 40.056us - PrepareTime: 47.634ms - ExecTreePrepareTime: 287.092us DataStreamSender (dst_id=7):(Total: 14s834ms, non-child: 14s834ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539383376) - NetworkThroughput(*): 434.89 MB/sec - OverallThroughput: 98.96 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.41M (63407411) - SerializeBatchTime: 11s434ms - TransmitDataRPCTime: 3s375ms - UncompressedRowBatchSize: 3.25 GB (3488043297) CodeGen:(Total: 94.150ms, non-child: 94.150ms, % non-child: 100.00%) - CodegenTime: 1.550ms - CompileTime: 17.094ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.019ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.514ms HDFS_SCAN_NODE (id=2):(Total: 1s326ms, non-child: 1s326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.77 MB 5:2/506.79 MB 4:1/253.40 MB 8:1/253.41 MB 3:1/253.40 MB 7:2/506.80 MB 9:3/760.16 MB 10:1/253.41 MB 6:1/253.40 MB 2:3/760.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB, 993.41 MB - FooterProcessingTime: (Avg: 3.373ms ; Min: 2.083ms ; Max: 5.883ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 993.41 MB (1041661462) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.41 MB (1041661462) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.41 MB (1041661462) - DecompressionTime: 4s818ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.72 MB (814449496) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.411ms - RowBatchQueuePutWaitTime: 3m48s - RowsRead: 117.66M (117659817) - RowsReturned: 63.41M (63407411) - RowsReturnedRate: 47.81 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 11.05K (11048) - ScannerThreadsTotalWallClockTime: 4m21s - MaterializeTupleTime(*): 17s320ms - ScannerThreadsSysTime: 1s020ms - ScannerThreadsUserTime: 22s932ms - ScannerThreadsVoluntaryContextSwitches: 62.68K (62678) - TotalRawHdfsReadTime(*): 747.914ms - TotalReadThroughput: 38.96 MB/sec Filter 1 (16.00 MB): - Rows processed: 366.69K (366691) - Rows rejected: 3.17K (3169) - Rows total: 117.66M (117659817) Instance c84bf4bc19372552:a (host=vb0208.halxg.cloudera.com:22000):(Total: 111.566ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 2:2/506.77 MB 5:2/506.81 MB 6:4/1013.59 MB 7:2/479.24 MB 9:1/253.40 MB 10:2/440.61 MB 0:4/1013.59 MB Filter 1 arrival: 4s462ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 515.51 MB, 767.21 MB, 767.21 MB, 767.21 MB, 767.21 MB, 767.21 MB, 767.21 MB, 783.21 MB, 785.22 MB, 784.69 MB, 785.73 MB, 785.34 MB, 785.23 MB, 785.14 MB, 689.63 MB, 689.54 MB, 689.81 MB, 689.68 MB, 689.68 MB, 689.78 MB, 689.64 MB, 618.36 MB, 594.52 MB, 594.31 MB, 594.59 MB, 594.10 MB, 594.77 MB, 594.31 MB, 538.90 MB, 499.07 MB, 442.94 MB, 394.72 MB, 316.05 MB, 307.67 MB, 346.48 MB, 298.70 MB, 251.94 MB, 423.11 MB, 395.95 MB, 387.97 MB, 380.08 MB, 348.59 MB, 340.46 MB, 340.41 MB, 301.03 MB, 300.76 MB, 292.63 MB, 213.45 MB, 165.54 MB, 126.78 MB, 64.12 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 5, 4 - AverageThreadTokens: 11.15 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 13.07K (13067) - PeakMemoryUsage: 786.13 MB (824320743) - PerHostPeakMemUsage: 1.60 GB (1713159721) - RowsProduced: 65.76M (65760509) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s507ms - TotalStorageWaitTime: 629.192ms - TotalWallClockTime: 4m55s - SysTime: 2s242ms - UserTime: 43s361ms - VoluntaryContextSwitches: 65.17K (65165) Fragment Instance Lifecycle Timings: - ExecTime: 26s043ms - ExecTreeExecTime: 1s362ms - OpenTime: 63.857ms - ExecTreeOpenTime: 48.924us - PrepareTime: 47.652ms - ExecTreePrepareTime: 272.756us DataStreamSender (dst_id=7):(Total: 15s494ms, non-child: 15s494ms, % non-child: 100.00%) - BytesSent: 1.49 GB (1596047070) - NetworkThroughput(*): 437.05 MB/sec - OverallThroughput: 98.23 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 65.76M (65760509) - SerializeBatchTime: 11s988ms - TransmitDataRPCTime: 3s482ms - UncompressedRowBatchSize: 3.37 GB (3617487279) CodeGen:(Total: 94.903ms, non-child: 94.903ms, % non-child: 100.00%) - CodegenTime: 1.676ms - CompileTime: 15.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.090ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 31.327ms HDFS_SCAN_NODE (id=2):(Total: 1s315ms, non-child: 1s315ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 2:2/506.77 MB 5:2/506.81 MB 6:4/1013.59 MB 7:2/479.24 MB 9:1/253.40 MB 10:2/440.61 MB 0:4/1013.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:96.15% 1:0% 2:1.923% 3:0% 4:0% 5:0% 6:1.923% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 429.74 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 694.89 MB, 753.33 MB, 753.33 MB, 753.33 MB, 980.69 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB - FooterProcessingTime: (Avg: 3.457ms ; Min: 1.931ms ; Max: 6.133ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 10.35 - BytesRead: 1.01 GB (1080355072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 GB (1080355072) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 GB (1080355072) - DecompressionTime: 4s849ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 769.67 MB (807062392) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.088ms - RowBatchQueuePutWaitTime: 3m56s - RowsRead: 122.02M (122016885) - RowsReturned: 65.76M (65760509) - RowsReturnedRate: 49.98 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.71K (10705) - ScannerThreadsTotalWallClockTime: 4m29s - MaterializeTupleTime(*): 17s412ms - ScannerThreadsSysTime: 1s057ms - ScannerThreadsUserTime: 22s852ms - ScannerThreadsVoluntaryContextSwitches: 64.94K (64939) - TotalRawHdfsReadTime(*): 752.388ms - TotalReadThroughput: 38.88 MB/sec Filter 1 (16.00 MB): - Rows processed: 382.16K (382156) - Rows rejected: 3.25K (3245) - Rows total: 122.02M (122016885) Instance c84bf4bc19372552:7 (host=vb0220.halxg.cloudera.com:22000):(Total: 110.596ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 7:1/253.39 MB 9:1/253.41 MB 10:1/253.40 MB 6:1/253.39 MB 4:2/506.78 MB 5:1/253.38 MB 0:4/1013.57 MB 2:4/1013.58 MB Filter 1 arrival: 4s393ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.47 MB, 774.47 MB, 774.47 MB, 774.47 MB, 774.47 MB, 774.47 MB, 790.47 MB, 792.09 MB, 792.42 MB, 792.24 MB, 792.39 MB, 792.40 MB, 791.89 MB, 696.96 MB, 696.55 MB, 696.66 MB, 696.94 MB, 696.84 MB, 696.77 MB, 688.86 MB, 601.47 MB, 601.96 MB, 601.61 MB, 601.31 MB, 600.95 MB, 600.98 MB, 505.37 MB, 505.79 MB, 409.65 MB, 314.36 MB, 315.07 MB, 314.74 MB, 306.21 MB, 218.23 MB, 218.28 MB, 348.68 MB, 348.54 MB, 317.05 MB, 309.02 MB, 308.74 MB, 269.35 MB, 269.26 MB, 268.90 MB, 213.34 MB, 149.69 MB, 109.94 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.40 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.62K (8625) - PeakMemoryUsage: 793.02 MB (831540231) - PerHostPeakMemUsage: 1.60 GB (1720645053) - RowsProduced: 63.44M (63438140) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s509ms - TotalStorageWaitTime: 698.929ms - TotalWallClockTime: 4m32s - SysTime: 1s444ms - UserTime: 32s563ms - VoluntaryContextSwitches: 62.95K (62945) Fragment Instance Lifecycle Timings: - ExecTime: 24s280ms - ExecTreeExecTime: 1s221ms - OpenTime: 66.416ms - ExecTreeOpenTime: 54.096us - PrepareTime: 44.145ms - ExecTreePrepareTime: 283.968us DataStreamSender (dst_id=7):(Total: 16s966ms, non-child: 16s966ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539886808) - NetworkThroughput(*): 271.46 MB/sec - OverallThroughput: 86.56 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 63.44M (63438140) - SerializeBatchTime: 11s535ms - TransmitDataRPCTime: 5s409ms - UncompressedRowBatchSize: 3.25 GB (3489733696) CodeGen:(Total: 88.747ms, non-child: 88.747ms, % non-child: 100.00%) - CodegenTime: 1.565ms - CompileTime: 17.211ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.369ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 22.651ms HDFS_SCAN_NODE (id=2):(Total: 1s181ms, non-child: 1s181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 7:1/253.39 MB 9:1/253.41 MB 10:1/253.40 MB 6:1/253.39 MB 4:2/506.78 MB 5:1/253.38 MB 0:4/1013.57 MB 2:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:68 BytesRead(500.000ms): 0, 0, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 701.26 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB, 993.44 MB - FooterProcessingTime: (Avg: 6.140ms ; Min: 2.393ms ; Max: 22.847ms ; Number of samples: 17) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 993.44 MB (1041695130) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.44 MB (1041695130) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.44 MB (1041695130) - DecompressionTime: 2s945ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.57 MB (814290568) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.642ms - RowBatchQueuePutWaitTime: 3m45s - RowsRead: 117.66M (117660134) - RowsReturned: 63.44M (63438140) - RowsReturnedRate: 53.67 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 6.61K (6608) - ScannerThreadsTotalWallClockTime: 4m8s - MaterializeTupleTime(*): 10s089ms - ScannerThreadsSysTime: 631.898ms - ScannerThreadsUserTime: 13s433ms - ScannerThreadsVoluntaryContextSwitches: 62.65K (62654) - TotalRawHdfsReadTime(*): 726.542ms - TotalReadThroughput: 41.39 MB/sec Filter 1 (16.00 MB): - Rows processed: 314.44K (314436) - Rows rejected: 2.84K (2843) - Rows total: 117.66M (117660134) Instance c84bf4bc19372552:2 (host=vb0212.halxg.cloudera.com:22000):(Total: 109.938ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:1/253.42 MB 4:1/253.39 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 8:3/760.17 MB 5:3/760.16 MB 9:1/253.39 MB 3:1/253.40 MB 2:1/253.40 MB Filter 1 arrival: 4s440ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 741.01 MB, 774.11 MB, 774.11 MB, 774.11 MB, 774.11 MB, 774.11 MB, 774.11 MB, 790.05 MB, 792.28 MB, 792.36 MB, 792.40 MB, 792.45 MB, 791.92 MB, 792.06 MB, 696.76 MB, 696.83 MB, 697.17 MB, 696.82 MB, 696.89 MB, 696.50 MB, 617.71 MB, 601.81 MB, 601.48 MB, 601.95 MB, 601.86 MB, 601.91 MB, 601.65 MB, 506.36 MB, 505.97 MB, 409.88 MB, 314.74 MB, 314.56 MB, 314.48 MB, 226.65 MB, 218.75 MB, 252.82 MB, 285.26 MB, 269.75 MB, 253.52 MB, 253.44 MB, 221.80 MB, 221.79 MB, 158.15 MB, 126.23 MB, 79.62 MB ThreadUsage(500.000ms): 1, 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 10.77 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 7.45K (7449) - PeakMemoryUsage: 793.13 MB (831652491) - PerHostPeakMemUsage: 1.60 GB (1720996548) - RowsProduced: 59.70M (59702163) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s499ms - TotalStorageWaitTime: 616.901ms - TotalWallClockTime: 4m12s - SysTime: 1s258ms - UserTime: 30s674ms - VoluntaryContextSwitches: 58.77K (58775) Fragment Instance Lifecycle Timings: - ExecTime: 23s085ms - ExecTreeExecTime: 1s204ms - OpenTime: 64.933ms - ExecTreeOpenTime: 48.583us - PrepareTime: 44.981ms - ExecTreePrepareTime: 143.491us DataStreamSender (dst_id=7):(Total: 16s105ms, non-child: 16s105ms, % non-child: 100.00%) - BytesSent: 1.35 GB (1449066539) - NetworkThroughput(*): 263.07 MB/sec - OverallThroughput: 85.80 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 59.70M (59702163) - SerializeBatchTime: 10s833ms - TransmitDataRPCTime: 5s253ms - UncompressedRowBatchSize: 3.06 GB (3284217513) CodeGen:(Total: 91.566ms, non-child: 91.566ms, % non-child: 100.00%) - CodegenTime: 1.601ms - CompileTime: 16.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.708ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.673ms HDFS_SCAN_NODE (id=2):(Total: 1s173ms, non-child: 1s173ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.40 MB 7:1/253.42 MB 4:1/253.39 MB 0:1/253.40 MB 6:2/506.80 MB 10:1/253.41 MB 8:3/760.17 MB 5:3/760.16 MB 9:1/253.39 MB 3:1/253.40 MB 2:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:95.74% 1:4.255% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 0, 664.06 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 701.24 MB, 895.88 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB, 934.98 MB - FooterProcessingTime: (Avg: 4.867ms ; Min: 1.973ms ; Max: 32.937ms ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 9.77 - BytesRead: 934.98 MB (980401417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.98 MB (980401417) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.98 MB (980401417) - DecompressionTime: 2s769ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.63 MB (814360348) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.686ms - RowBatchQueuePutWaitTime: 3m35s - RowsRead: 110.74M (110738621) - RowsReturned: 59.70M (59702163) - RowsReturnedRate: 50.88 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 5.51K (5515) - ScannerThreadsTotalWallClockTime: 3m49s - MaterializeTupleTime(*): 9s516ms - ScannerThreadsSysTime: 541.912ms - ScannerThreadsUserTime: 12s645ms - ScannerThreadsVoluntaryContextSwitches: 58.54K (58543) - TotalRawHdfsReadTime(*): 796.418ms - TotalReadThroughput: 39.79 MB/sec Filter 1 (16.00 MB): - Rows processed: 295.84K (295837) - Rows rejected: 2.51K (2512) - Rows total: 110.74M (110738621) Instance c84bf4bc19372552:d (host=vb0226.halxg.cloudera.com:22000):(Total: 108.964ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 3:1/253.39 MB 0:2/506.78 MB 5:2/506.80 MB 7:1/253.40 MB 2:1/253.38 MB 1:2/506.79 MB 9:2/506.78 MB 8:3/760.18 MB 6:3/760.20 MB Filter 1 arrival: 4s501ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 772.51 MB, 773.16 MB, 773.16 MB, 773.16 MB, 773.16 MB, 773.16 MB, 773.16 MB, 789.16 MB, 790.86 MB, 790.90 MB, 791.18 MB, 790.68 MB, 791.04 MB, 727.92 MB, 696.14 MB, 695.79 MB, 695.95 MB, 695.88 MB, 695.83 MB, 687.81 MB, 600.45 MB, 600.54 MB, 600.25 MB, 600.40 MB, 600.63 MB, 600.85 MB, 504.40 MB, 496.20 MB, 408.62 MB, 313.53 MB, 313.21 MB, 313.50 MB, 265.66 MB, 217.47 MB, 243.68 MB, 411.10 MB, 411.13 MB, 410.99 MB, 363.38 MB, 363.27 MB, 363.53 MB, 315.60 MB, 315.84 MB, 315.65 MB, 267.48 MB, 211.80 MB, 172.23 MB, 124.55 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.20 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.23K (8234) - PeakMemoryUsage: 791.92 MB (830391971) - PerHostPeakMemUsage: 1.60 GB (1719830126) - RowsProduced: 67.16M (67162503) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s511ms - TotalStorageWaitTime: 676.716ms - TotalWallClockTime: 4m42s - SysTime: 1s483ms - UserTime: 33s514ms - VoluntaryContextSwitches: 66.68K (66676) Fragment Instance Lifecycle Timings: - ExecTime: 24s978ms - ExecTreeExecTime: 1s215ms - OpenTime: 67.370ms - ExecTreeOpenTime: 54.232us - PrepareTime: 41.542ms - ExecTreePrepareTime: 379.344us DataStreamSender (dst_id=7):(Total: 17s804ms, non-child: 17s804ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629685180) - NetworkThroughput(*): 267.07 MB/sec - OverallThroughput: 87.29 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.16M (67162503) - SerializeBatchTime: 11s966ms - TransmitDataRPCTime: 5s819ms - UncompressedRowBatchSize: 3.44 GB (3694610997) CodeGen:(Total: 96.148ms, non-child: 96.148ms, % non-child: 100.00%) - CodegenTime: 1.586ms - CompileTime: 15.435ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 51.141ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.048ms HDFS_SCAN_NODE (id=2):(Total: 1s182ms, non-child: 1s182ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 3:1/253.39 MB 0:2/506.78 MB 5:2/506.80 MB 7:1/253.40 MB 2:1/253.38 MB 1:2/506.79 MB 9:2/506.78 MB 8:3/760.18 MB 6:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:2% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 701.22 MB, 759.75 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 3.719ms ; Min: 2.475ms ; Max: 6.034ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.20 - BytesRead: 1.03 GB (1102912239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102912239) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102912239) - DecompressionTime: 3s021ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 775.43 MB (813092744) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.692ms - RowBatchQueuePutWaitTime: 3m53s - RowsRead: 124.58M (124580858) - RowsReturned: 67.16M (67162503) - RowsReturnedRate: 56.78 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.14K (6142) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 10s234ms - ScannerThreadsSysTime: 624.900ms - ScannerThreadsUserTime: 13s724ms - ScannerThreadsVoluntaryContextSwitches: 66.38K (66378) - TotalRawHdfsReadTime(*): 857.855ms - TotalReadThroughput: 42.07 MB/sec Filter 1 (16.00 MB): - Rows processed: 376.78K (376779) - Rows rejected: 3.21K (3215) - Rows total: 124.58M (124580858) Instance c84bf4bc19372552:c (host=vb0214.halxg.cloudera.com:22000):(Total: 108.809ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/234.34 MB 10:1/253.38 MB 0:1/253.42 MB 8:1/253.39 MB 3:2/506.77 MB 1:2/506.76 MB 6:2/481.03 MB 7:5/1.18 GB 4:3/760.14 MB Filter 1 arrival: 4s498ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 761.30 MB, 761.30 MB, 761.30 MB, 761.30 MB, 761.30 MB, 761.30 MB, 761.30 MB, 778.60 MB, 779.04 MB, 779.62 MB, 779.25 MB, 779.42 MB, 779.09 MB, 683.71 MB, 683.69 MB, 683.57 MB, 683.67 MB, 684.14 MB, 683.88 MB, 684.26 MB, 588.58 MB, 588.72 MB, 588.56 MB, 588.65 MB, 588.79 MB, 588.43 MB, 492.68 MB, 492.67 MB, 396.95 MB, 301.67 MB, 301.93 MB, 302.03 MB, 348.09 MB, 314.18 MB, 314.42 MB, 398.51 MB, 398.82 MB, 382.38 MB, 350.87 MB, 350.79 MB, 334.89 MB, 302.96 MB, 303.16 MB, 287.40 MB, 239.43 MB, 191.36 MB, 133.81 MB, 78.94 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 4 - AverageThreadTokens: 11.36 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 8.47K (8467) - PeakMemoryUsage: 780.01 MB (817896379) - PerHostPeakMemUsage: 1.59 GB (1707502940) - RowsProduced: 65.71M (65710440) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s507ms - TotalStorageWaitTime: 714.186ms - TotalWallClockTime: 4m42s - SysTime: 1s437ms - UserTime: 33s484ms - VoluntaryContextSwitches: 65.38K (65377) Fragment Instance Lifecycle Timings: - ExecTime: 25s028ms - ExecTreeExecTime: 1s229ms - OpenTime: 63.634ms - ExecTreeOpenTime: 52.497us - PrepareTime: 45.145ms - ExecTreePrepareTime: 511.432us DataStreamSender (dst_id=7):(Total: 17s581ms, non-child: 17s581ms, % non-child: 100.00%) - BytesSent: 1.49 GB (1594745910) - NetworkThroughput(*): 267.24 MB/sec - OverallThroughput: 86.50 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 65.71M (65710440) - SerializeBatchTime: 11s872ms - TransmitDataRPCTime: 5s691ms - UncompressedRowBatchSize: 3.37 GB (3614732984) CodeGen:(Total: 92.789ms, non-child: 92.789ms, % non-child: 100.00%) - CodegenTime: 1.584ms - CompileTime: 15.878ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.849ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.561ms HDFS_SCAN_NODE (id=2):(Total: 1s186ms, non-child: 1s186ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/234.34 MB 10:1/253.38 MB 0:1/253.42 MB 8:1/253.39 MB 3:2/506.77 MB 1:2/506.76 MB 6:2/481.03 MB 7:5/1.18 GB 4:3/760.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 690.92 MB, 749.35 MB, 807.79 MB, 807.79 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB - FooterProcessingTime: (Avg: 5.382ms ; Min: 2.431ms ; Max: 18.910ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 1.01 GB (1079189381) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 GB (1079189381) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 GB (1079189381) - DecompressionTime: 2s982ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 763.53 MB (800621644) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.170ms - RowBatchQueuePutWaitTime: 3m54s - RowsRead: 121.89M (121886452) - RowsReturned: 65.71M (65710440) - RowsReturnedRate: 55.40 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.37K (6369) - ScannerThreadsTotalWallClockTime: 4m17s - MaterializeTupleTime(*): 10s177ms - ScannerThreadsSysTime: 659.893ms - ScannerThreadsUserTime: 13s581ms - ScannerThreadsVoluntaryContextSwitches: 64.99K (64990) - TotalRawHdfsReadTime(*): 757.164ms - TotalReadThroughput: 41.17 MB/sec Filter 1 (16.00 MB): - Rows processed: 349.98K (349981) - Rows rejected: 2.77K (2768) - Rows total: 121.89M (121886452) Instance c84bf4bc19372552:3 (host=vb0224.halxg.cloudera.com:22000):(Total: 108.442ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.77 MB 1:2/506.81 MB 4:1/253.38 MB 6:1/253.38 MB 2:2/506.78 MB 0:2/506.80 MB 10:2/506.83 MB 8:1/253.39 MB 3:4/1013.55 MB 7:1/253.40 MB Filter 1 arrival: 4s371ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 774.30 MB, 790.30 MB, 791.58 MB, 792.13 MB, 792.50 MB, 792.09 MB, 792.50 MB, 792.31 MB, 768.21 MB, 696.68 MB, 696.61 MB, 696.41 MB, 696.83 MB, 696.78 MB, 696.68 MB, 696.60 MB, 601.40 MB, 601.41 MB, 601.27 MB, 601.42 MB, 601.54 MB, 601.59 MB, 601.07 MB, 505.65 MB, 505.51 MB, 409.58 MB, 338.08 MB, 314.61 MB, 314.65 MB, 314.59 MB, 218.59 MB, 218.34 MB, 422.34 MB, 412.08 MB, 412.22 MB, 411.86 MB, 364.44 MB, 364.23 MB, 364.41 MB, 340.89 MB, 316.87 MB, 316.79 MB, 316.77 MB, 269.11 MB, 220.86 MB, 173.47 MB, 141.33 MB, 95.88 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 5 - AverageThreadTokens: 11.29 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.17K (12172) - PeakMemoryUsage: 792.95 MB (831465659) - PerHostPeakMemUsage: 1.60 GB (1720395712) - RowsProduced: 67.17M (67166510) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s521ms - TotalStorageWaitTime: 683.543ms - TotalWallClockTime: 5m7s - SysTime: 1s962ms - UserTime: 40s304ms - VoluntaryContextSwitches: 66.57K (66571) Fragment Instance Lifecycle Timings: - ExecTime: 27s393ms - ExecTreeExecTime: 1s290ms - OpenTime: 63.900ms - ExecTreeOpenTime: 45.044us - PrepareTime: 44.503ms - ExecTreePrepareTime: 298.972us DataStreamSender (dst_id=7):(Total: 19s025ms, non-child: 19s025ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1629235191) - NetworkThroughput(*): 253.93 MB/sec - OverallThroughput: 81.67 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67166510) - SerializeBatchTime: 12s879ms - TransmitDataRPCTime: 6s118ms - UncompressedRowBatchSize: 3.44 GB (3694831426) CodeGen:(Total: 91.196ms, non-child: 91.196ms, % non-child: 100.00%) - CodegenTime: 1.695ms - CompileTime: 16.297ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.728ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.603ms HDFS_SCAN_NODE (id=2):(Total: 1s246ms, non-child: 1s246ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/506.77 MB 1:2/506.81 MB 4:1/253.38 MB 6:1/253.38 MB 2:2/506.78 MB 0:2/506.80 MB 10:2/506.83 MB 8:1/253.39 MB 3:4/1013.55 MB 7:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 701.21 MB, 998.90 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.101ms ; Min: 2.306ms ; Max: 10.791ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.29 - BytesRead: 1.03 GB (1102921011) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102921011) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102921011) - DecompressionTime: 3s871ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.47 MB (814182820) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.442ms - RowBatchQueuePutWaitTime: 4m12s - RowsRead: 124.58M (124581238) - RowsReturned: 67.17M (67166510) - RowsReturnedRate: 53.89 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.81K (9809) - ScannerThreadsTotalWallClockTime: 4m40s - MaterializeTupleTime(*): 13s884ms - ScannerThreadsSysTime: 1s010ms - ScannerThreadsUserTime: 18s216ms - ScannerThreadsVoluntaryContextSwitches: 66.25K (66254) - TotalRawHdfsReadTime(*): 868.607ms - TotalReadThroughput: 38.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 361.47K (361466) - Rows rejected: 2.98K (2983) - Rows total: 124.58M (124581238) Instance c84bf4bc19372552:f (host=vb0228.halxg.cloudera.com:22000):(Total: 108.134ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 5:4/765.48 MB 9:2/506.78 MB 0:4/951.82 MB 7:1/253.39 MB 10:3/760.17 MB 2:2/506.82 MB Filter 1 arrival: 4s522ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 427.13 MB, 700.18 MB, 700.18 MB, 700.18 MB, 700.18 MB, 700.18 MB, 700.18 MB, 716.18 MB, 778.10 MB, 777.81 MB, 777.83 MB, 778.01 MB, 778.00 MB, 778.11 MB, 682.63 MB, 682.55 MB, 682.86 MB, 682.84 MB, 682.96 MB, 682.92 MB, 619.28 MB, 587.34 MB, 587.60 MB, 587.38 MB, 587.22 MB, 587.18 MB, 547.47 MB, 499.68 MB, 481.60 MB, 410.15 MB, 362.52 MB, 354.95 MB, 354.85 MB, 282.82 MB, 266.53 MB, 356.40 MB, 340.76 MB, 340.94 MB, 301.10 MB, 301.21 MB, 300.93 MB, 253.54 MB, 245.65 MB, 213.41 MB, 149.92 MB, 118.18 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 11.12 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 11.52K (11519) - PeakMemoryUsage: 779.12 MB (816964819) - PerHostPeakMemUsage: 1.58 GB (1695392252) - RowsProduced: 62.58M (62581058) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s492ms - TotalStorageWaitTime: 601.917ms - TotalWallClockTime: 4m28s - SysTime: 2s287ms - UserTime: 39s804ms - VoluntaryContextSwitches: 62.15K (62150) Fragment Instance Lifecycle Timings: - ExecTime: 23s965ms - ExecTreeExecTime: 1s305ms - OpenTime: 64.141ms - ExecTreeOpenTime: 61.392us - PrepareTime: 43.950ms - ExecTreePrepareTime: 273.576us DataStreamSender (dst_id=7):(Total: 14s108ms, non-child: 14s108ms, % non-child: 100.00%) - BytesSent: 1.41 GB (1518710760) - NetworkThroughput(*): 480.18 MB/sec - OverallThroughput: 102.66 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 62.58M (62581058) - SerializeBatchTime: 11s071ms - TransmitDataRPCTime: 3s016ms - UncompressedRowBatchSize: 3.21 GB (3442585602) CodeGen:(Total: 88.833ms, non-child: 88.833ms, % non-child: 100.00%) - CodegenTime: 1.633ms - CompileTime: 16.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.506ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.055ms HDFS_SCAN_NODE (id=2):(Total: 1s269ms, non-child: 1s269ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.39 MB 1:1/253.41 MB 5:4/765.48 MB 9:2/506.78 MB 0:4/951.82 MB 7:1/253.39 MB 10:3/760.17 MB 2:2/506.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 903ms Hdfs Read Thread Concurrency Bucket: 0:97.87% 1:0% 2:0% 3:0% 4:0% 5:2.128% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 357.12 MB, 630.04 MB, 630.04 MB, 630.04 MB, 630.04 MB, 630.04 MB, 630.04 MB, 630.04 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 688.48 MB, 746.92 MB, 746.92 MB, 746.92 MB, 746.92 MB, 746.92 MB, 746.92 MB, 746.92 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB, 980.66 MB - FooterProcessingTime: (Avg: 3.634ms ; Min: 1.905ms ; Max: 5.332ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 980.66 MB (1028294922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 980.66 MB (1028294922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 980.66 MB (1028294922) - DecompressionTime: 4s558ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 762.65 MB (799699296) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.158ms - RowBatchQueuePutWaitTime: 3m33s - RowsRead: 116.10M (116100817) - RowsReturned: 62.58M (62581058) - RowsReturnedRate: 49.29 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.44K (9436) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 16s321ms - ScannerThreadsSysTime: 1s064ms - ScannerThreadsUserTime: 21s406ms - ScannerThreadsVoluntaryContextSwitches: 61.88K (61880) - TotalRawHdfsReadTime(*): 758.333ms - TotalReadThroughput: 40.86 MB/sec Filter 1 (16.00 MB): - Rows processed: 429.34K (429337) - Rows rejected: 3.63K (3633) - Rows total: 116.10M (116100817) Instance c84bf4bc19372552:e (host=vb0232.halxg.cloudera.com:22000):(Total: 100.066ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.38 MB 8:1/253.40 MB 6:2/506.79 MB 0:4/1013.60 MB 4:2/506.80 MB 3:2/506.79 MB 9:4/1013.57 MB 5:1/253.39 MB 1:1/253.41 MB Filter 1 arrival: 4s507ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 774.10 MB, 774.10 MB, 774.10 MB, 774.10 MB, 774.10 MB, 774.10 MB, 774.10 MB, 790.62 MB, 792.56 MB, 792.22 MB, 792.24 MB, 791.85 MB, 792.45 MB, 736.32 MB, 696.91 MB, 696.75 MB, 696.76 MB, 696.70 MB, 696.70 MB, 696.79 MB, 601.34 MB, 601.48 MB, 601.55 MB, 601.65 MB, 601.55 MB, 601.45 MB, 593.14 MB, 505.61 MB, 481.55 MB, 409.56 MB, 314.82 MB, 314.52 MB, 314.29 MB, 242.40 MB, 219.12 MB, 284.13 MB, 411.84 MB, 412.03 MB, 412.23 MB, 364.64 MB, 364.59 MB, 364.32 MB, 316.75 MB, 316.97 MB, 316.94 MB, 317.02 MB, 260.68 MB, 173.32 MB, 173.45 MB, 125.47 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.38 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 10.14K (10140) - PeakMemoryUsage: 793.05 MB (831570879) - PerHostPeakMemUsage: 1.60 GB (1720112795) - RowsProduced: 67.17M (67171406) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s502ms - TotalStorageWaitTime: 654.112ms - TotalWallClockTime: 4m52s - SysTime: 2s021ms - UserTime: 36s085ms - VoluntaryContextSwitches: 66.58K (66575) Fragment Instance Lifecycle Timings: - ExecTime: 25s981ms - ExecTreeExecTime: 1s300ms - OpenTime: 64.411ms - ExecTreeOpenTime: 57.616us - PrepareTime: 35.611ms - ExecTreePrepareTime: 266.152us DataStreamSender (dst_id=7):(Total: 15s493ms, non-child: 15s493ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630659617) - NetworkThroughput(*): 477.47 MB/sec - OverallThroughput: 100.37 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.17M (67171406) - SerializeBatchTime: 12s211ms - TransmitDataRPCTime: 3s256ms - UncompressedRowBatchSize: 3.44 GB (3695100758) CodeGen:(Total: 91.713ms, non-child: 91.713ms, % non-child: 100.00%) - CodegenTime: 1.699ms - CompileTime: 16.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.269ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.721ms HDFS_SCAN_NODE (id=2):(Total: 1s259ms, non-child: 1s259ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.38 MB 8:1/253.40 MB 6:2/506.79 MB 0:4/1013.60 MB 4:2/506.80 MB 3:2/506.79 MB 9:4/1013.57 MB 5:1/253.39 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 904ms Hdfs Read Thread Concurrency Bucket: 0:98.08% 1:1.923% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 701.23 MB, 808.99 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 4.069ms ; Min: 2.025ms ; Max: 14.336ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.38 - BytesRead: 1.03 GB (1102943871) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102943871) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102943871) - DecompressionTime: 3s280ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 776.61 MB (814337148) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.488ms - RowBatchQueuePutWaitTime: 4m - RowsRead: 124.58M (124581331) - RowsReturned: 67.17M (67171406) - RowsReturnedRate: 53.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7.87K (7866) - ScannerThreadsTotalWallClockTime: 4m26s - MaterializeTupleTime(*): 11s992ms - ScannerThreadsSysTime: 777.875ms - ScannerThreadsUserTime: 15s692ms - ScannerThreadsVoluntaryContextSwitches: 66.39K (66388) - TotalRawHdfsReadTime(*): 745.289ms - TotalReadThroughput: 40.46 MB/sec Filter 1 (16.00 MB): - Rows processed: 428.09K (428089) - Rows rejected: 3.51K (3513) - Rows total: 124.58M (124581331) Instance c84bf4bc19372552:6 (host=vb0204.halxg.cloudera.com:22000):(Total: 97.059ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/760.15 MB 2:2/506.79 MB 5:1/253.39 MB 7:2/506.77 MB 8:4/1013.58 MB 4:4/1013.59 MB 0:2/506.81 MB Filter 1 arrival: 4s336ms MemoryUsage(500.000ms): 59.86 KB, 59.86 KB, 711.20 MB, 711.20 MB, 711.20 MB, 711.20 MB, 711.20 MB, 711.20 MB, 727.20 MB, 727.81 MB, 729.22 MB, 728.62 MB, 728.94 MB, 728.28 MB, 728.67 MB, 649.40 MB, 641.32 MB, 641.28 MB, 641.86 MB, 641.50 MB, 641.11 MB, 553.77 MB, 553.77 MB, 554.07 MB, 553.82 MB, 554.09 MB, 553.96 MB, 466.03 MB, 466.12 MB, 377.90 MB, 290.88 MB, 291.20 MB, 290.87 MB, 203.17 MB, 202.87 MB, 474.88 MB, 475.24 MB, 475.35 MB, 475.16 MB, 419.74 MB, 419.94 MB, 419.74 MB, 363.71 MB, 363.77 MB, 363.72 MB, 363.98 MB, 307.82 MB, 252.27 MB, 196.50 MB, 196.40 MB, 140.53 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 10.75 - BloomFilterBytes: 16.00 MB (16777216) - InvoluntaryContextSwitches: 12.18K (12178) - PeakMemoryUsage: 729.77 MB (765217279) - PerHostPeakMemUsage: 1.54 GB (1654437808) - RowsProduced: 67.15M (67147945) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s501ms - TotalStorageWaitTime: 609.900ms - TotalWallClockTime: 4m34s - SysTime: 1s749ms - UserTime: 36s238ms - VoluntaryContextSwitches: 66.40K (66402) Fragment Instance Lifecycle Timings: - ExecTime: 25s677ms - ExecTreeExecTime: 1s301ms - OpenTime: 64.501ms - ExecTreeOpenTime: 62.222us - PrepareTime: 32.536ms - ExecTreePrepareTime: 187.366us DataStreamSender (dst_id=7):(Total: 15s200ms, non-child: 15s200ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630191766) - NetworkThroughput(*): 484.00 MB/sec - OverallThroughput: 102.28 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 67.15M (67147945) - SerializeBatchTime: 11s966ms - TransmitDataRPCTime: 3s212ms - UncompressedRowBatchSize: 3.44 GB (3693810163) CodeGen:(Total: 86.989ms, non-child: 86.989ms, % non-child: 100.00%) - CodegenTime: 1.950ms - CompileTime: 17.245ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.408ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 22.838ms HDFS_SCAN_NODE (id=2):(Total: 1s259ms, non-child: 1s259ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/760.15 MB 2:2/506.79 MB 5:1/253.39 MB 7:2/506.77 MB 8:4/1013.58 MB 4:4/1013.59 MB 0:2/506.81 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 0, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 642.80 MB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB, 1.03 GB - FooterProcessingTime: (Avg: 5.008ms ; Min: 2.114ms ; Max: 17.030ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.75 - BytesRead: 1.03 GB (1102950275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.03 GB (1102950275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.03 GB (1102950275) - DecompressionTime: 3s286ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 7 (7) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 713.25 MB (747901576) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.183ms - RowBatchQueuePutWaitTime: 3m42s - RowsRead: 124.58M (124581250) - RowsReturned: 67.15M (67147945) - RowsReturnedRate: 53.30 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 9.74K (9744) - ScannerThreadsTotalWallClockTime: 4m8s - MaterializeTupleTime(*): 12s167ms - ScannerThreadsSysTime: 748.880ms - ScannerThreadsUserTime: 15s929ms - ScannerThreadsVoluntaryContextSwitches: 66.22K (66222) - TotalRawHdfsReadTime(*): 665.685ms - TotalReadThroughput: 41.25 MB/sec Filter 1 (16.00 MB): - Rows processed: 373.09K (373094) - Rows rejected: 3.25K (3255) - Rows total: 124.58M (124581250) Averaged Fragment F01:(Total: 112.502ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 1012.34 MB, max: 1.48 GB, avg: 1.25 GB, stddev: 138.37 MB completion times: min:2s921ms max:4s038ms mean: 3s523ms stddev:322.219ms execution rates: min:337.56 MB/sec max:390.64 MB/sec mean:364.36 MB/sec stddev:15.67 MB/sec num instances: 15 - AverageThreadTokens: 5.67 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.85K (1855) - PeakMemoryUsage: 377.82 MB (396175706) - PerHostPeakMemUsage: 1.51 GB (1622940804) - RowsProduced: 7.37M (7367283) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.120ms - TotalStorageWaitTime: 167.293ms - TotalWallClockTime: 19s817ms - SysTime: 284.887ms - UserTime: 8s462ms - VoluntaryContextSwitches: 7.13K (7135) Fragment Instance Lifecycle Timings: - ExecTime: 3s409ms - ExecTreeExecTime: 613.289ms - OpenTime: 68.105ms - ExecTreeOpenTime: 72.034us - PrepareTime: 44.355ms - ExecTreePrepareTime: 164.179us DataStreamSender (dst_id=8):(Total: 1s935ms, non-child: 1s935ms, % non-child: 100.00%) - BytesSent: 174.41 MB (182878855) - NetworkThroughput(*): 313.21 MB/sec - OverallThroughput: 90.87 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.37M (7367283) - SerializeBatchTime: 1s347ms - TransmitDataRPCTime: 585.512ms - UncompressedRowBatchSize: 386.50 MB (405274453) CodeGen:(Total: 96.840ms, non-child: 96.840ms, % non-child: 100.00%) - CodegenTime: 1.700ms - CompileTime: 16.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 50.618ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 29.342ms HDFS_SCAN_NODE (id=1):(Total: 608.470ms, non-child: 608.470ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 322.02 MB (337667513) - BytesReadDataNodeCache: 0 - BytesReadLocal: 322.02 MB (337667513) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 322.02 MB (337667513) - DecompressionTime: 1s034ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 373.27 MB (391397918) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.425ms - RowBatchQueuePutWaitTime: 8s389ms - RowsRead: 30.00M (30000000) - RowsReturned: 7.37M (7367283) - RowsReturnedRate: 12.12 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1542) - ScannerThreadsTotalWallClockTime: 16s340ms - MaterializeTupleTime(*): 4s667ms - ScannerThreadsSysTime: 160.572ms - ScannerThreadsUserTime: 5s692ms - ScannerThreadsVoluntaryContextSwitches: 7.06K (7060) - TotalRawHdfsReadTime(*): 220.195ms - TotalReadThroughput: 92.15 MB/sec Filter 0 (4.00 MB): - Rows processed: 30.00M (30000000) - Rows rejected: 14.84M (14836390) - Rows total: 30.00M (30000000) Fragment F01: Instance c84bf4bc19372552:18 (host=vb0208.halxg.cloudera.com:22000):(Total: 147.802ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 8:1/253.09 MB 3:2/506.18 MB 6:1/253.08 MB Filter 0 arrival: 647ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 369.31 MB, 321.45 MB, 250.07 MB, 209.99 MB, 162.47 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.51K (1511) - PeakMemoryUsage: 370.15 MB (388132123) - PerHostPeakMemUsage: 1.50 GB (1608523649) - RowsProduced: 7.25M (7253437) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.876ms - TotalStorageWaitTime: 170.208ms - TotalWallClockTime: 18s412ms - SysTime: 251.959ms - UserTime: 7s585ms - VoluntaryContextSwitches: 7.09K (7086) Fragment Instance Lifecycle Timings: - ExecTime: 3s185ms - ExecTreeExecTime: 574.177ms - OpenTime: 89.755ms - ExecTreeOpenTime: 65.552us - PrepareTime: 57.998ms - ExecTreePrepareTime: 186.196us DataStreamSender (dst_id=8):(Total: 1s923ms, non-child: 1s923ms, % non-child: 100.00%) - BytesSent: 171.68 MB (180018684) - NetworkThroughput(*): 270.27 MB/sec - OverallThroughput: 89.27 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7253437) - SerializeBatchTime: 1s285ms - TransmitDataRPCTime: 635.225ms - UncompressedRowBatchSize: 380.53 MB (399011783) CodeGen:(Total: 129.426ms, non-child: 129.426ms, % non-child: 100.00%) - CodegenTime: 2.253ms - CompileTime: 20.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 67.725ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 40.237ms HDFS_SCAN_NODE (id=1):(Total: 570.524ms, non-child: 570.524ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 8:1/253.09 MB 3:2/506.18 MB 6:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 502ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB - FooterProcessingTime: (Avg: 3.787ms ; Min: 3.215ms ; Max: 5.578ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.11 MB (332513220) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.11 MB (332513220) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.11 MB (332513220) - DecompressionTime: 924.963ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.54 MB (383297956) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.064ms - RowBatchQueuePutWaitTime: 7s746ms - RowsRead: 29.55M (29549430) - RowsReturned: 7.25M (7253437) - RowsReturnedRate: 12.71 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.23K (1226) - ScannerThreadsTotalWallClockTime: 15s136ms - MaterializeTupleTime(*): 4s050ms - ScannerThreadsSysTime: 132.977ms - ScannerThreadsUserTime: 4s976ms - ScannerThreadsVoluntaryContextSwitches: 7.01K (7012) - TotalRawHdfsReadTime(*): 209.832ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29549430) - Rows rejected: 14.62M (14617454) - Rows total: 29.55M (29549430) Instance c84bf4bc19372552:1c (host=vb0234.halxg.cloudera.com:22000):(Total: 136.479ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.08 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB Filter 0 arrival: 659ms MemoryUsage(500.000ms): 59.86 KB, 435.29 MB, 435.29 MB, 372.07 MB, 316.34 MB, 292.45 MB, 196.91 MB, 95.65 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 4 - AverageThreadTokens: 5.88 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.19K (2193) - PeakMemoryUsage: 436.31 MB (457503103) - PerHostPeakMemUsage: 1.63 GB (1747877666) - RowsProduced: 8.71M (8710542) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.295ms - TotalStorageWaitTime: 174.300ms - TotalWallClockTime: 24s957ms - SysTime: 274.957ms - UserTime: 9s392ms - VoluntaryContextSwitches: 8.55K (8554) Fragment Instance Lifecycle Timings: - ExecTime: 3s841ms - ExecTreeExecTime: 621.421ms - OpenTime: 87.589ms - ExecTreeOpenTime: 43.364us - PrepareTime: 48.838ms - ExecTreePrepareTime: 182.272us DataStreamSender (dst_id=8):(Total: 2s289ms, non-child: 2s289ms, % non-child: 100.00%) - BytesSent: 206.23 MB (216249599) - NetworkThroughput(*): 295.14 MB/sec - OverallThroughput: 90.09 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.71M (8710542) - SerializeBatchTime: 1s587ms - TransmitDataRPCTime: 698.751ms - UncompressedRowBatchSize: 456.97 MB (479167158) CodeGen:(Total: 121.768ms, non-child: 121.768ms, % non-child: 100.00%) - CodegenTime: 2.311ms - CompileTime: 16.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 69.702ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 34.679ms HDFS_SCAN_NODE (id=1):(Total: 616.182ms, non-child: 616.182ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.08 MB 7:1/253.08 MB 1:1/253.07 MB 4:1/253.09 MB 3:1/253.08 MB 5:1/253.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB, 380.51 MB - FooterProcessingTime: (Avg: 3.006ms ; Min: 2.607ms ; Max: 3.329ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 380.51 MB (398991806) - BytesReadDataNodeCache: 0 - BytesReadLocal: 380.51 MB (398991806) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 380.51 MB (398991806) - DecompressionTime: 1s118ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 431.76 MB (452729336) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.618ms - RowBatchQueuePutWaitTime: 12s852ms - RowsRead: 35.46M (35457891) - RowsReturned: 8.71M (8710542) - RowsReturnedRate: 14.14 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.84K (1841) - ScannerThreadsTotalWallClockTime: 21s028ms - MaterializeTupleTime(*): 5s028ms - ScannerThreadsSysTime: 159.974ms - ScannerThreadsUserTime: 6s166ms - ScannerThreadsVoluntaryContextSwitches: 8.48K (8479) - TotalRawHdfsReadTime(*): 294.296ms - TotalReadThroughput: 95.13 MB/sec Filter 0 (4.00 MB): - Rows processed: 35.46M (35457891) - Rows rejected: 17.53M (17531363) - Rows total: 35.46M (35457891) Instance c84bf4bc19372552:16 (host=vb0222.halxg.cloudera.com:22000):(Total: 115.989ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 10:1/253.10 MB Filter 0 arrival: 634ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 340.65 MB, 300.64 MB, 208.47 MB, 159.89 MB, 93.32 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 5, 5, 4 - AverageThreadTokens: 4.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.67K (1667) - PeakMemoryUsage: 341.22 MB (357796123) - PerHostPeakMemUsage: 1.48 GB (1586293492) - RowsProduced: 6.52M (6516139) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.256ms - TotalStorageWaitTime: 175.236ms - TotalWallClockTime: 15s989ms - SysTime: 274.956ms - UserTime: 8s222ms - VoluntaryContextSwitches: 6.17K (6165) Fragment Instance Lifecycle Timings: - ExecTime: 3s074ms - ExecTreeExecTime: 598.484ms - OpenTime: 68.823ms - ExecTreeOpenTime: 51.264us - PrepareTime: 47.119ms - ExecTreePrepareTime: 184.256us DataStreamSender (dst_id=8):(Total: 1s481ms, non-child: 1s481ms, % non-child: 100.00%) - BytesSent: 154.19 MB (161677689) - NetworkThroughput(*): 443.60 MB/sec - OverallThroughput: 104.09 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.52M (6516139) - SerializeBatchTime: 1s131ms - TransmitDataRPCTime: 347.584ms - UncompressedRowBatchSize: 341.85 MB (358453005) CodeGen:(Total: 94.076ms, non-child: 94.076ms, % non-child: 100.00%) - CodegenTime: 1.615ms - CompileTime: 16.945ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 49.183ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.451ms HDFS_SCAN_NODE (id=1):(Total: 593.708ms, non-child: 593.708ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/506.17 MB 3:1/253.08 MB 9:1/123.69 MB 10:1/253.10 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 284.77 MB, 284.77 MB, 284.77 MB, 284.77 MB, 284.77 MB - FooterProcessingTime: (Avg: 3.732ms ; Min: 3.137ms ; Max: 5.639ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.33 - BytesRead: 284.77 MB (298605909) - BytesReadDataNodeCache: 0 - BytesReadLocal: 284.77 MB (298605909) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 284.77 MB (298605909) - DecompressionTime: 1s042ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 336.70 MB (353055140) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.639ms - RowBatchQueuePutWaitTime: 5s076ms - RowsRead: 26.52M (26524501) - RowsReturned: 6.52M (6516139) - RowsReturnedRate: 10.98 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.38K (1383) - ScannerThreadsTotalWallClockTime: 12s846ms - MaterializeTupleTime(*): 4s743ms - ScannerThreadsSysTime: 174.971ms - ScannerThreadsUserTime: 5s749ms - ScannerThreadsVoluntaryContextSwitches: 6.09K (6089) - TotalRawHdfsReadTime(*): 199.660ms - TotalReadThroughput: 81.36 MB/sec Filter 0 (4.00 MB): - Rows processed: 26.52M (26524501) - Rows rejected: 13.12M (13115129) - Rows total: 26.52M (26524501) Instance c84bf4bc19372552:11 (host=vb0216.halxg.cloudera.com:22000):(Total: 114.412ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.13 MB 7:1/253.09 MB 3:1/114.22 MB 5:1/253.08 MB Filter 0 arrival: 624ms MemoryUsage(500.000ms): 59.86 KB, 336.35 MB, 336.52 MB, 256.83 MB, 207.28 MB, 143.35 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.67 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.56K (1563) - PeakMemoryUsage: 337.24 MB (353623323) - PerHostPeakMemUsage: 1.48 GB (1585864596) - RowsProduced: 6.46M (6462494) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.710ms - TotalStorageWaitTime: 171.494ms - TotalWallClockTime: 16s559ms - SysTime: 354.945ms - UserTime: 9s093ms - VoluntaryContextSwitches: 6.08K (6076) Fragment Instance Lifecycle Timings: - ExecTime: 3s146ms - ExecTreeExecTime: 609.984ms - OpenTime: 68.240ms - ExecTreeOpenTime: 46.184us - PrepareTime: 46.133ms - ExecTreePrepareTime: 147.912us DataStreamSender (dst_id=8):(Total: 1s562ms, non-child: 1s562ms, % non-child: 100.00%) - BytesSent: 152.98 MB (160406959) - NetworkThroughput(*): 396.17 MB/sec - OverallThroughput: 97.93 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.46M (6462494) - SerializeBatchTime: 1s173ms - TransmitDataRPCTime: 386.139ms - UncompressedRowBatchSize: 339.03 MB (355501994) CodeGen:(Total: 95.557ms, non-child: 95.557ms, % non-child: 100.00%) - CodegenTime: 1.545ms - CompileTime: 14.948ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 52.478ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.633ms HDFS_SCAN_NODE (id=1):(Total: 604.571ms, non-child: 604.571ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 2:1/253.13 MB 7:1/253.09 MB 3:1/114.22 MB 5:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB, 282.41 MB - FooterProcessingTime: (Avg: 3.684ms ; Min: 3.102ms ; Max: 4.133ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.67 - BytesRead: 282.41 MB (296127991) - BytesReadDataNodeCache: 0 - BytesReadLocal: 282.41 MB (296127991) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 282.41 MB (296127991) - DecompressionTime: 1s226ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 332.61 MB (348765596) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.427ms - RowBatchQueuePutWaitTime: 4s339ms - RowsRead: 26.30M (26303132) - RowsReturned: 6.46M (6462494) - RowsReturnedRate: 10.69 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.26K (1263) - ScannerThreadsTotalWallClockTime: 13s345ms - MaterializeTupleTime(*): 5s428ms - ScannerThreadsSysTime: 177.971ms - ScannerThreadsUserTime: 6s629ms - ScannerThreadsVoluntaryContextSwitches: 6.00K (6003) - TotalRawHdfsReadTime(*): 229.135ms - TotalReadThroughput: 94.14 MB/sec Filter 0 (4.00 MB): - Rows processed: 26.30M (26303132) - Rows rejected: 13.01M (13005478) - Rows total: 26.30M (26303132) Instance c84bf4bc19372552:19 (host=vb0206.halxg.cloudera.com:22000):(Total: 112.038ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 6:1/253.08 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB Filter 0 arrival: 654ms MemoryUsage(500.000ms): 59.86 KB, 369.31 MB, 329.56 MB, 289.58 MB, 249.54 MB, 170.22 MB, 93.78 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 5.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.02K (2015) - PeakMemoryUsage: 369.97 MB (387942691) - PerHostPeakMemUsage: 1.52 GB (1630604916) - RowsProduced: 7.25M (7254751) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.448ms - TotalStorageWaitTime: 123.818ms - TotalWallClockTime: 19s737ms - SysTime: 316.949ms - UserTime: 8s940ms - VoluntaryContextSwitches: 7.00K (7004) Fragment Instance Lifecycle Timings: - ExecTime: 3s479ms - ExecTreeExecTime: 657.099ms - OpenTime: 66.005ms - ExecTreeOpenTime: 64.700us - PrepareTime: 45.993ms - ExecTreePrepareTime: 166.208us DataStreamSender (dst_id=8):(Total: 1s719ms, non-child: 1s719ms, % non-child: 100.00%) - BytesSent: 171.72 MB (180056959) - NetworkThroughput(*): 424.49 MB/sec - OverallThroughput: 99.84 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7254751) - SerializeBatchTime: 1s312ms - TransmitDataRPCTime: 404.522ms - UncompressedRowBatchSize: 380.60 MB (399084065) CodeGen:(Total: 93.937ms, non-child: 93.937ms, % non-child: 100.00%) - CodegenTime: 1.657ms - CompileTime: 17.010ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.952ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.485ms HDFS_SCAN_NODE (id=1):(Total: 651.526ms, non-child: 651.526ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.08 MB 6:1/253.08 MB 8:1/253.09 MB 4:1/253.08 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB - FooterProcessingTime: (Avg: 3.257ms ; Min: 3.024ms ; Max: 3.463ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.71 - BytesRead: 317.10 MB (332501203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.10 MB (332501203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.10 MB (332501203) - DecompressionTime: 1s124ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.37 MB (383120836) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.937ms - RowBatchQueuePutWaitTime: 7s552ms - RowsRead: 29.55M (29548399) - RowsReturned: 7.25M (7254751) - RowsReturnedRate: 11.14 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1653) - ScannerThreadsTotalWallClockTime: 16s192ms - MaterializeTupleTime(*): 5s052ms - ScannerThreadsSysTime: 157.973ms - ScannerThreadsUserTime: 6s175ms - ScannerThreadsVoluntaryContextSwitches: 6.93K (6933) - TotalRawHdfsReadTime(*): 208.954ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29548399) - Rows rejected: 14.61M (14614391) - Rows total: 29.55M (29548399) Instance c84bf4bc19372552:1e (host=vb0230.halxg.cloudera.com:22000):(Total: 111.156ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 0:2/348.96 MB 9:1/253.09 MB 2:1/253.08 MB Filter 0 arrival: 656ms MemoryUsage(500.000ms): 59.86 KB, 333.66 MB, 293.79 MB, 239.38 MB, 207.57 MB, 143.61 MB ThreadUsage(500.000ms): 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.50 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.60K (1602) - PeakMemoryUsage: 334.22 MB (350451051) - PerHostPeakMemUsage: 1.42 GB (1527261181) - RowsProduced: 6.35M (6354730) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.030ms - TotalStorageWaitTime: 155.387ms - TotalWallClockTime: 16s023ms - SysTime: 246.961ms - UserTime: 7s180ms - VoluntaryContextSwitches: 6.16K (6155) Fragment Instance Lifecycle Timings: - ExecTime: 3s169ms - ExecTreeExecTime: 630.367ms - OpenTime: 65.992ms - ExecTreeOpenTime: 56.212us - PrepareTime: 45.121ms - ExecTreePrepareTime: 177.096us DataStreamSender (dst_id=8):(Total: 1s757ms, non-child: 1s757ms, % non-child: 100.00%) - BytesSent: 150.44 MB (157752315) - NetworkThroughput(*): 280.28 MB/sec - OverallThroughput: 85.62 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 6.35M (6354730) - SerializeBatchTime: 1s217ms - TransmitDataRPCTime: 536.766ms - UncompressedRowBatchSize: 333.38 MB (349573890) CodeGen:(Total: 92.394ms, non-child: 92.394ms, % non-child: 100.00%) - CodegenTime: 1.564ms - CompileTime: 17.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.588ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.895ms HDFS_SCAN_NODE (id=1):(Total: 625.778ms, non-child: 625.778ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.07 MB 0:2/348.96 MB 9:1/253.09 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 277.80 MB, 277.80 MB, 277.80 MB, 277.80 MB, 277.80 MB - FooterProcessingTime: (Avg: 3.618ms ; Min: 3.038ms ; Max: 5.080ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.50 - BytesRead: 277.80 MB (291292814) - BytesReadDataNodeCache: 0 - BytesReadLocal: 277.80 MB (291292814) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 277.80 MB (291292814) - DecompressionTime: 850.553ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 329.61 MB (345626052) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.649ms - RowBatchQueuePutWaitTime: 6s327ms - RowsRead: 25.87M (25871292) - RowsReturned: 6.35M (6354730) - RowsReturnedRate: 10.15 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1321) - ScannerThreadsTotalWallClockTime: 12s787ms - MaterializeTupleTime(*): 3s817ms - ScannerThreadsSysTime: 140.977ms - ScannerThreadsUserTime: 4s652ms - ScannerThreadsVoluntaryContextSwitches: 6.08K (6075) - TotalRawHdfsReadTime(*): 194.685ms - TotalReadThroughput: 92.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 25.87M (25871292) - Rows rejected: 12.79M (12794754) - Rows total: 25.87M (25871292) Instance c84bf4bc19372552:1a (host=vb0204.halxg.cloudera.com:22000):(Total: 110.984ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/253.07 MB 1:1/253.10 MB 8:1/253.08 MB 7:2/506.14 MB Filter 0 arrival: 632ms MemoryUsage(500.000ms): 59.86 KB, 369.60 MB, 329.38 MB, 281.68 MB, 250.00 MB, 170.21 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.56K (1557) - PeakMemoryUsage: 369.97 MB (387939611) - PerHostPeakMemUsage: 1.44 GB (1547796734) - RowsProduced: 7.25M (7254572) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.645ms - TotalStorageWaitTime: 153.539ms - TotalWallClockTime: 18s108ms - SysTime: 194.968ms - UserTime: 8s119ms - VoluntaryContextSwitches: 7.00K (7001) Fragment Instance Lifecycle Timings: - ExecTime: 3s175ms - ExecTreeExecTime: 588.120ms - OpenTime: 66.302ms - ExecTreeOpenTime: 322.032us - PrepareTime: 44.642ms - ExecTreePrepareTime: 132.112us DataStreamSender (dst_id=8):(Total: 1s978ms, non-child: 1s978ms, % non-child: 100.00%) - BytesSent: 171.70 MB (180043059) - NetworkThroughput(*): 255.54 MB/sec - OverallThroughput: 86.80 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.25M (7254572) - SerializeBatchTime: 1s303ms - TransmitDataRPCTime: 671.927ms - UncompressedRowBatchSize: 380.59 MB (399074216) CodeGen:(Total: 103.029ms, non-child: 103.029ms, % non-child: 100.00%) - CodegenTime: 1.634ms - CompileTime: 16.166ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 48.988ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 37.341ms HDFS_SCAN_NODE (id=1):(Total: 584.498ms, non-child: 584.498ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.07 MB 1:1/253.10 MB 8:1/253.08 MB 7:2/506.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB, 317.09 MB - FooterProcessingTime: (Avg: 3.336ms ; Min: 2.445ms ; Max: 5.152ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.09 MB (332490978) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.09 MB (332490978) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.09 MB (332490978) - DecompressionTime: 951.303ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.43 MB (383186332) - PerReadThreadRawHdfsThroughput: 1.70 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.403ms - RowBatchQueuePutWaitTime: 7s069ms - RowsRead: 29.55M (29547112) - RowsReturned: 7.25M (7254572) - RowsReturnedRate: 12.41 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.28K (1279) - ScannerThreadsTotalWallClockTime: 14s866ms - MaterializeTupleTime(*): 4s542ms - ScannerThreadsSysTime: 93.983ms - ScannerThreadsUserTime: 5s539ms - ScannerThreadsVoluntaryContextSwitches: 6.93K (6934) - TotalRawHdfsReadTime(*): 182.289ms - TotalReadThroughput: 105.70 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29547112) - Rows rejected: 14.61M (14612646) - Rows total: 29.55M (29547112) Instance c84bf4bc19372552:14 (host=vb0214.halxg.cloudera.com:22000):(Total: 108.670ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 10:1/253.10 MB 8:1/253.08 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB Filter 0 arrival: 621ms MemoryUsage(500.000ms): 59.86 KB, 407.50 MB, 399.82 MB, 311.96 MB, 250.02 MB, 186.21 MB, 104.44 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 6, 6, 5 - AverageThreadTokens: 6.43 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.02K (2017) - PeakMemoryUsage: 408.02 MB (427843999) - PerHostPeakMemUsage: 1.52 GB (1633789765) - RowsProduced: 7.99M (7994104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.224ms - TotalStorageWaitTime: 180.093ms - TotalWallClockTime: 21s629ms - SysTime: 346.942ms - UserTime: 8s608ms - VoluntaryContextSwitches: 7.82K (7823) Fragment Instance Lifecycle Timings: - ExecTime: 3s459ms - ExecTreeExecTime: 599.397ms - OpenTime: 62.632ms - ExecTreeOpenTime: 52.817us - PrepareTime: 46.010ms - ExecTreePrepareTime: 102.019us DataStreamSender (dst_id=8):(Total: 2s128ms, non-child: 2s128ms, % non-child: 100.00%) - BytesSent: 189.25 MB (198437860) - NetworkThroughput(*): 269.33 MB/sec - OverallThroughput: 88.89 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.99M (7994104) - SerializeBatchTime: 1s423ms - TransmitDataRPCTime: 702.648ms - UncompressedRowBatchSize: 419.38 MB (439755892) CodeGen:(Total: 91.188ms, non-child: 91.188ms, % non-child: 100.00%) - CodegenTime: 1.577ms - CompileTime: 15.070ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.653ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.989ms HDFS_SCAN_NODE (id=1):(Total: 593.497ms, non-child: 593.497ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.07 MB 10:1/253.10 MB 8:1/253.08 MB 2:1/253.09 MB 5:1/253.10 MB 9:1/129.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB, 349.51 MB - FooterProcessingTime: (Avg: 3.572ms ; Min: 2.751ms ; Max: 3.845ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.43 - BytesRead: 349.51 MB (366484495) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.51 MB (366484495) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.51 MB (366484495) - DecompressionTime: 1s080ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 403.49 MB (423085608) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.978ms - RowBatchQueuePutWaitTime: 9s625ms - RowsRead: 32.56M (32556938) - RowsReturned: 7.99M (7994104) - RowsReturnedRate: 13.47 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1712) - ScannerThreadsTotalWallClockTime: 18s106ms - MaterializeTupleTime(*): 4s751ms - ScannerThreadsSysTime: 217.962ms - ScannerThreadsUserTime: 5s781ms - ScannerThreadsVoluntaryContextSwitches: 7.73K (7733) - TotalRawHdfsReadTime(*): 266.754ms - TotalReadThroughput: 99.86 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.56M (32556938) - Rows rejected: 16.10M (16099787) - Rows total: 32.56M (32556938) Instance c84bf4bc19372552:1d (host=vb0228.halxg.cloudera.com:22000):(Total: 108.473ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/144.90 MB 8:2/506.14 MB 4:1/253.09 MB 1:2/506.18 MB Filter 0 arrival: 650ms MemoryUsage(500.000ms): 385.26 KB, 59.86 KB, 414.66 MB, 367.17 MB, 319.20 MB, 271.85 MB, 210.26 MB, 162.19 MB ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.09K (2092) - PeakMemoryUsage: 415.48 MB (435667311) - PerHostPeakMemUsage: 1.51 GB (1620412633) - RowsProduced: 8.09M (8085997) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.151ms - TotalStorageWaitTime: 180.368ms - TotalWallClockTime: 23s355ms - SysTime: 292.953ms - UserTime: 8s953ms - VoluntaryContextSwitches: 7.84K (7839) Fragment Instance Lifecycle Timings: - ExecTime: 3s704ms - ExecTreeExecTime: 630.473ms - OpenTime: 63.118ms - ExecTreeOpenTime: 49.876us - PrepareTime: 45.289ms - ExecTreePrepareTime: 188.500us DataStreamSender (dst_id=8):(Total: 2s154ms, non-child: 2s154ms, % non-child: 100.00%) - BytesSent: 191.45 MB (200754786) - NetworkThroughput(*): 294.84 MB/sec - OverallThroughput: 88.85 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.09M (8085997) - SerializeBatchTime: 1s502ms - TransmitDataRPCTime: 649.343ms - UncompressedRowBatchSize: 424.20 MB (444810931) CodeGen:(Total: 91.606ms, non-child: 91.606ms, % non-child: 100.00%) - CodegenTime: 1.525ms - CompileTime: 14.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.242ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 28.820ms HDFS_SCAN_NODE (id=1):(Total: 625.574ms, non-child: 625.574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/144.90 MB 8:2/506.14 MB 4:1/253.09 MB 1:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 0, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB, 353.47 MB - FooterProcessingTime: (Avg: 2.792ms ; Min: 1.857ms ; Max: 4.295ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.71 - BytesRead: 353.47 MB (370644173) - BytesReadDataNodeCache: 0 - BytesReadLocal: 353.47 MB (370644173) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 353.47 MB (370644173) - DecompressionTime: 1s084ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 410.96 MB (430923264) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.352ms - RowBatchQueuePutWaitTime: 11s000ms - RowsRead: 32.93M (32927525) - RowsReturned: 8.09M (8085997) - RowsReturnedRate: 12.93 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1762) - ScannerThreadsTotalWallClockTime: 19s587ms - MaterializeTupleTime(*): 4s818ms - ScannerThreadsSysTime: 140.976ms - ScannerThreadsUserTime: 5s938ms - ScannerThreadsVoluntaryContextSwitches: 7.76K (7765) - TotalRawHdfsReadTime(*): 217.485ms - TotalReadThroughput: 88.37 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.93M (32927525) - Rows rejected: 16.28M (16283549) - Rows total: 32.93M (32927525) Instance c84bf4bc19372552:12 (host=vb0220.halxg.cloudera.com:22000):(Total: 108.051ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 9:1/253.07 MB 4:2/506.17 MB 0:1/253.08 MB 2:1/141.46 MB Filter 0 arrival: 630ms MemoryUsage(500.000ms): 59.86 KB, 414.65 MB, 414.88 MB, 319.37 MB, 271.77 MB, 250.20 MB, 170.30 MB, 31.87 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6, 1 - AverageThreadTokens: 6.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.28K (2280) - PeakMemoryUsage: 415.55 MB (435736999) - PerHostPeakMemUsage: 1.58 GB (1699399775) - RowsProduced: 8.07M (8065631) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.792ms - TotalStorageWaitTime: 206.617ms - TotalWallClockTime: 24s447ms - SysTime: 311.950ms - UserTime: 9s153ms - VoluntaryContextSwitches: 7.91K (7910) Fragment Instance Lifecycle Timings: - ExecTime: 3s879ms - ExecTreeExecTime: 621.076ms - OpenTime: 63.946ms - ExecTreeOpenTime: 51.452us - PrepareTime: 44.079ms - ExecTreePrepareTime: 115.048us DataStreamSender (dst_id=8):(Total: 2s272ms, non-child: 2s272ms, % non-child: 100.00%) - BytesSent: 190.97 MB (200241462) - NetworkThroughput(*): 271.69 MB/sec - OverallThroughput: 84.04 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.07M (8065631) - SerializeBatchTime: 1s566ms - TransmitDataRPCTime: 702.872ms - UncompressedRowBatchSize: 423.14 MB (443690601) CodeGen:(Total: 89.187ms, non-child: 89.187ms, % non-child: 100.00%) - CodegenTime: 1.673ms - CompileTime: 15.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.348ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 25.672ms HDFS_SCAN_NODE (id=1):(Total: 615.046ms, non-child: 615.046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.08 MB 9:1/253.07 MB 4:2/506.17 MB 0:1/253.08 MB 2:1/141.46 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB, 352.61 MB - FooterProcessingTime: (Avg: 3.684ms ; Min: 2.885ms ; Max: 5.843ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 352.61 MB (369737350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 352.61 MB (369737350) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 352.61 MB (369737350) - DecompressionTime: 1s087ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 411.01 MB (430976568) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.905ms - RowBatchQueuePutWaitTime: 12s071ms - RowsRead: 32.85M (32847511) - RowsReturned: 8.07M (8065631) - RowsReturnedRate: 13.11 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.92K (1924) - ScannerThreadsTotalWallClockTime: 20s504ms - MaterializeTupleTime(*): 4s838ms - ScannerThreadsSysTime: 175.971ms - ScannerThreadsUserTime: 5s936ms - ScannerThreadsVoluntaryContextSwitches: 7.84K (7840) - TotalRawHdfsReadTime(*): 264.112ms - TotalReadThroughput: 88.15 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.85M (32847511) - Rows rejected: 16.25M (16247271) - Rows total: 32.85M (32847511) Instance c84bf4bc19372552:1b (host=vb0218.halxg.cloudera.com:22000):(Total: 107.418ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB Filter 0 arrival: 641ms MemoryUsage(500.000ms): 0, 59.86 KB, 369.03 MB, 329.60 MB, 289.96 MB, 250.08 MB, 170.18 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.29 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.79K (1794) - PeakMemoryUsage: 369.99 MB (387960147) - PerHostPeakMemUsage: 1.51 GB (1622490328) - RowsProduced: 7.26M (7259174) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.908ms - TotalStorageWaitTime: 140.860ms - TotalWallClockTime: 19s205ms - SysTime: 285.953ms - UserTime: 7s980ms - VoluntaryContextSwitches: 6.98K (6979) Fragment Instance Lifecycle Timings: - ExecTime: 3s352ms - ExecTreeExecTime: 611.034ms - OpenTime: 63.758ms - ExecTreeOpenTime: 62.780us - PrepareTime: 43.613ms - ExecTreePrepareTime: 232.436us DataStreamSender (dst_id=8):(Total: 1s994ms, non-child: 1s994ms, % non-child: 100.00%) - BytesSent: 171.83 MB (180171734) - NetworkThroughput(*): 260.51 MB/sec - OverallThroughput: 86.16 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.26M (7259174) - SerializeBatchTime: 1s332ms - TransmitDataRPCTime: 659.577ms - UncompressedRowBatchSize: 380.83 MB (399327370) CodeGen:(Total: 90.597ms, non-child: 90.597ms, % non-child: 100.00%) - CodegenTime: 1.667ms - CompileTime: 15.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.155ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.266ms HDFS_SCAN_NODE (id=1):(Total: 606.852ms, non-child: 606.852ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.11 MB 6:1/253.07 MB 7:1/253.09 MB 4:1/253.07 MB 10:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB, 317.11 MB - FooterProcessingTime: (Avg: 3.063ms ; Min: 2.349ms ; Max: 3.561ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 317.11 MB (332515761) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.11 MB (332515761) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.11 MB (332515761) - DecompressionTime: 1s006ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.49 MB (383248868) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.378ms - RowBatchQueuePutWaitTime: 7s917ms - RowsRead: 29.55M (29549877) - RowsReturned: 7.26M (7259174) - RowsReturnedRate: 11.96 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1489) - ScannerThreadsTotalWallClockTime: 15s789ms - MaterializeTupleTime(*): 4s297ms - ScannerThreadsSysTime: 157.973ms - ScannerThreadsUserTime: 5s277ms - ScannerThreadsVoluntaryContextSwitches: 6.90K (6901) - TotalRawHdfsReadTime(*): 220.617ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29549877) - Rows rejected: 14.61M (14608642) - Rows total: 29.55M (29549877) Instance c84bf4bc19372552:10 (host=vb0212.halxg.cloudera.com:22000):(Total: 105.103ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:2/506.17 MB Filter 0 arrival: 627ms MemoryUsage(500.000ms): 59.86 KB, 4.06 MB, 369.51 MB, 305.68 MB, 258.09 MB, 194.24 MB, 138.63 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6 - AverageThreadTokens: 4.57 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.71K (1714) - PeakMemoryUsage: 369.98 MB (387948867) - PerHostPeakMemUsage: 1.50 GB (1613942195) - RowsProduced: 7.26M (7255948) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.677ms - TotalStorageWaitTime: 170.056ms - TotalWallClockTime: 16s404ms - SysTime: 286.953ms - UserTime: 8s145ms - VoluntaryContextSwitches: 6.91K (6908) Fragment Instance Lifecycle Timings: - ExecTime: 3s254ms - ExecTreeExecTime: 611.543ms - OpenTime: 63.854ms - ExecTreeOpenTime: 59.880us - PrepareTime: 41.205ms - ExecTreePrepareTime: 156.592us DataStreamSender (dst_id=8):(Total: 1s940ms, non-child: 1s940ms, % non-child: 100.00%) - BytesSent: 171.74 MB (180077388) - NetworkThroughput(*): 257.22 MB/sec - OverallThroughput: 88.50 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 7.26M (7255948) - SerializeBatchTime: 1s270ms - TransmitDataRPCTime: 667.652ms - UncompressedRowBatchSize: 380.66 MB (399149916) CodeGen:(Total: 89.292ms, non-child: 89.292ms, % non-child: 100.00%) - CodegenTime: 1.576ms - CompileTime: 15.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.603ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 26.541ms HDFS_SCAN_NODE (id=1):(Total: 607.630ms, non-child: 607.630ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.17 MB 9:1/253.08 MB 5:2/506.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB, 317.10 MB - FooterProcessingTime: (Avg: 3.422ms ; Min: 1.981ms ; Max: 5.069ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.57 - BytesRead: 317.10 MB (332499940) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.10 MB (332499940) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.10 MB (332499940) - DecompressionTime: 985.258ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 365.35 MB (383098220) - PerReadThreadRawHdfsThroughput: 1.59 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.709ms - RowBatchQueuePutWaitTime: 7s224ms - RowsRead: 29.55M (29548710) - RowsReturned: 7.26M (7255948) - RowsReturnedRate: 11.94 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 1.41K (1408) - ScannerThreadsTotalWallClockTime: 13s085ms - MaterializeTupleTime(*): 4s583ms - ScannerThreadsSysTime: 192.968ms - ScannerThreadsUserTime: 5s510ms - ScannerThreadsVoluntaryContextSwitches: 6.83K (6826) - TotalRawHdfsReadTime(*): 194.940ms - TotalReadThroughput: 90.60 MB/sec Filter 0 (4.00 MB): - Rows processed: 29.55M (29548710) - Rows rejected: 14.62M (14615105) - Rows total: 29.55M (29548710) Instance c84bf4bc19372552:15 (host=vb0224.halxg.cloudera.com:22000):(Total: 103.115ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/78.16 MB 2:1/253.11 MB 0:1/93.74 MB 8:1/253.09 MB 1:2/506.15 MB Filter 0 arrival: 627ms MemoryUsage(500.000ms): 59.86 KB, 418.88 MB, 418.87 MB, 362.97 MB, 289.67 MB, 250.13 MB, 170.46 MB, 130.34 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 6, 6, 6, 6 - AverageThreadTokens: 7.00 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.38K (2380) - PeakMemoryUsage: 419.57 MB (439956059) - PerHostPeakMemUsage: 1.58 GB (1698631330) - RowsProduced: 8.24M (8243657) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.487ms - TotalStorageWaitTime: 187.926ms - TotalWallClockTime: 25s847ms - SysTime: 293.953ms - UserTime: 9s197ms - VoluntaryContextSwitches: 8.21K (8207) Fragment Instance Lifecycle Timings: - ExecTime: 3s932ms - ExecTreeExecTime: 618.555ms - OpenTime: 63.432ms - ExecTreeOpenTime: 57.888us - PrepareTime: 39.643ms - ExecTreePrepareTime: 220.760us DataStreamSender (dst_id=8):(Total: 2s292ms, non-child: 2s292ms, % non-child: 100.00%) - BytesSent: 195.36 MB (204848977) - NetworkThroughput(*): 281.25 MB/sec - OverallThroughput: 85.21 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.24M (8243657) - SerializeBatchTime: 1s594ms - TransmitDataRPCTime: 694.608ms - UncompressedRowBatchSize: 432.48 MB (453483811) CodeGen:(Total: 90.702ms, non-child: 90.702ms, % non-child: 100.00%) - CodegenTime: 1.701ms - CompileTime: 15.899ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.670ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.632ms HDFS_SCAN_NODE (id=1):(Total: 613.425ms, non-child: 613.425ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/78.16 MB 2:1/253.11 MB 0:1/93.74 MB 8:1/253.09 MB 1:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:28 BytesRead(500.000ms): 0, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB, 360.40 MB - FooterProcessingTime: (Avg: 2.478ms ; Min: 1.807ms ; Max: 3.449ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 360.40 MB (377905027) - BytesReadDataNodeCache: 0 - BytesReadLocal: 360.40 MB (377905027) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 360.40 MB (377905027) - DecompressionTime: 1s072ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 415.05 MB (435210956) - PerReadThreadRawHdfsThroughput: 1.49 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.135ms - RowBatchQueuePutWaitTime: 13s136ms - RowsRead: 33.55M (33551637) - RowsReturned: 8.24M (8243657) - RowsReturnedRate: 13.44 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 2.01K (2014) - ScannerThreadsTotalWallClockTime: 21s851ms - MaterializeTupleTime(*): 4s817ms - ScannerThreadsSysTime: 161.973ms - ScannerThreadsUserTime: 5s919ms - ScannerThreadsVoluntaryContextSwitches: 8.13K (8133) - TotalRawHdfsReadTime(*): 235.464ms - TotalReadThroughput: 90.10 MB/sec Filter 0 (4.00 MB): - Rows processed: 33.55M (33551637) - Rows rejected: 16.59M (16588559) - Rows total: 33.55M (33551637) Instance c84bf4bc19372552:17 (host=vb0232.halxg.cloudera.com:22000):(Total: 100.805ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 2:1/129.89 MB 3:2/506.17 MB 6:1/253.09 MB Filter 0 arrival: 629ms MemoryUsage(500.000ms): 59.86 KB, 408.02 MB, 408.01 MB, 360.49 MB, 312.32 MB, 249.63 MB, 170.10 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 6.71 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 2.10K (2103) - PeakMemoryUsage: 408.53 MB (428378575) - PerHostPeakMemUsage: 1.58 GB (1699166180) - RowsProduced: 8.00M (7996520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.011ms - TotalStorageWaitTime: 170.949ms - TotalWallClockTime: 23s058ms - SysTime: 300.951ms - UserTime: 9s417ms - VoluntaryContextSwitches: 7.79K (7789) Fragment Instance Lifecycle Timings: - ExecTime: 3s657ms - ExecTreeExecTime: 610.005ms - OpenTime: 64.231ms - ExecTreeOpenTime: 49.360us - PrepareTime: 36.525ms - ExecTreePrepareTime: 160.176us DataStreamSender (dst_id=8):(Total: 2s187ms, non-child: 2s187ms, % non-child: 100.00%) - BytesSent: 189.29 MB (198489755) - NetworkThroughput(*): 268.37 MB/sec - OverallThroughput: 86.53 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 8.00M (7996520) - SerializeBatchTime: 1s478ms - TransmitDataRPCTime: 705.346ms - UncompressedRowBatchSize: 419.51 MB (439888796) CodeGen:(Total: 91.714ms, non-child: 91.714ms, % non-child: 100.00%) - CodegenTime: 1.657ms - CompileTime: 15.985ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 47.367ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 27.847ms HDFS_SCAN_NODE (id=1):(Total: 604.947ms, non-child: 604.947ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/506.15 MB 2:1/129.89 MB 3:2/506.17 MB 6:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB, 349.72 MB - FooterProcessingTime: (Avg: 2.519ms ; Min: 1.881ms ; Max: 3.714ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.71 - BytesRead: 349.72 MB (366706943) - BytesReadDataNodeCache: 0 - BytesReadLocal: 349.72 MB (366706943) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 349.72 MB (366706943) - DecompressionTime: 1s102ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 404.02 MB (423643784) - PerReadThreadRawHdfsThroughput: 1.55 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.391ms - RowBatchQueuePutWaitTime: 10s155ms - RowsRead: 32.58M (32577610) - RowsReturned: 8.00M (7996520) - RowsReturnedRate: 13.22 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.77K (1770) - ScannerThreadsTotalWallClockTime: 19s337ms - MaterializeTupleTime(*): 5s320ms - ScannerThreadsSysTime: 175.970ms - ScannerThreadsUserTime: 6s400ms - ScannerThreadsVoluntaryContextSwitches: 7.71K (7711) - TotalRawHdfsReadTime(*): 219.910ms - TotalReadThroughput: 99.92 MB/sec Filter 0 (4.00 MB): - Rows processed: 32.58M (32577610) - Rows rejected: 16.12M (16119523) - Rows total: 32.58M (32577610) Instance c84bf4bc19372552:13 (host=vb0226.halxg.cloudera.com:22000):(Total: 97.042ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.09 MB 6:1/253.08 MB 3:2/506.18 MB Filter 0 arrival: 626ms MemoryUsage(500.000ms): 59.86 KB, 52.78 MB, 300.58 MB, 237.08 MB, 197.28 MB, 133.25 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.33 - BloomFilterBytes: 4.00 MB (4194304) - InvoluntaryContextSwitches: 1.35K (1346) - PeakMemoryUsage: 301.13 MB (315755615) - PerHostPeakMemUsage: 1.42 GB (1522057621) - RowsProduced: 5.80M (5801549) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.297ms - TotalStorageWaitTime: 148.541ms - TotalWallClockTime: 13s523ms - SysTime: 237.961ms - UserTime: 6s938ms - VoluntaryContextSwitches: 5.54K (5537) Fragment Instance Lifecycle Timings: - ExecTime: 2s823ms - ExecTreeExecTime: 617.594ms - OpenTime: 63.896ms - ExecTreeOpenTime: 47.160us - PrepareTime: 33.121ms - ExecTreePrepareTime: 111.116us DataStreamSender (dst_id=8):(Total: 1s355ms, non-child: 1s355ms, % non-child: 100.00%) - BytesSent: 137.29 MB (143955611) - NetworkThroughput(*): 429.41 MB/sec - OverallThroughput: 101.25 MB/sec - PeakMemoryUsage: 466.76 KB (477960) - RowsReturned: 5.80M (5801549) - SerializeBatchTime: 1s033ms - TransmitDataRPCTime: 319.713ms - UncompressedRowBatchSize: 304.36 MB (319143379) CodeGen:(Total: 88.122ms, non-child: 88.122ms, % non-child: 100.00%) - CodegenTime: 1.539ms - CompileTime: 16.354ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 43 (43) - NumInstructions: 661 (661) - OptimizationTime: 46.615ms - PeakMemoryUsage: 330.50 KB (338432) - PrepareTime: 24.650ms HDFS_SCAN_NODE (id=1):(Total: 613.285ms, non-child: 613.285ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.09 MB 6:1/253.08 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:0% 2:0% 3:16.67% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 24.39 MB, 253.67 MB, 253.67 MB, 253.67 MB, 253.67 MB - FooterProcessingTime: (Avg: 4.105ms ; Min: 3.428ms ; Max: 5.753ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 3.33 - BytesRead: 253.67 MB (265995099) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.67 MB (265995099) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.67 MB (265995099) - DecompressionTime: 859.022ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 296.59 MB (311000256) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.795ms - RowBatchQueuePutWaitTime: 3s753ms - RowsRead: 23.64M (23638435) - RowsReturned: 5.80M (5801549) - RowsReturnedRate: 9.46 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1088) - ScannerThreadsTotalWallClockTime: 10s635ms - MaterializeTupleTime(*): 3s917ms - ScannerThreadsSysTime: 145.975ms - ScannerThreadsUserTime: 4s731ms - ScannerThreadsVoluntaryContextSwitches: 5.47K (5469) - TotalRawHdfsReadTime(*): 164.793ms - TotalReadThroughput: 84.56 MB/sec Filter 0 (4.00 MB): - Rows processed: 23.64M (23638435) - Rows rejected: 11.69M (11692207) - Rows total: 23.64M (23638435) Averaged Fragment F03:(Total: 76.957ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 143.95 MB, max: 396.14 MB, avg: 257.24 MB, stddev: 74.80 MB completion times: min:168.923ms max:388.362ms mean: 256.668ms stddev:59.833ms execution rates: min:662.39 MB/sec max:1.12 GB/sec mean:993.76 MB/sec stddev:137.81 MB/sec num instances: 14 - AverageThreadTokens: 0.43 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 55 (55) - PeakMemoryUsage: 27.85 MB (29206875) - PerHostPeakMemUsage: 50.89 MB (53357244) - RowsProduced: 642.56K (642562) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.775ms - TotalStorageWaitTime: 11.528ms - TotalWallClockTime: 420.534ms - SysTime: 18.496ms - UserTime: 342.661ms - VoluntaryContextSwitches: 173 (173) Fragment Instance Lifecycle Timings: - ExecTime: 178.522ms - ExecTreeExecTime: 14.356ms - OpenTime: 36.074ms - ExecTreeOpenTime: 52.468us - PrepareTime: 40.832ms - ExecTreePrepareTime: 503.007us DataStreamSender (dst_id=10):(Total: 89.160ms, non-child: 89.160ms, % non-child: 100.00%) - BytesSent: 7.98 MB (8370885) - NetworkThroughput(*): 340.20 MB/sec - OverallThroughput: 89.07 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 642.56K (642562) - SerializeBatchTime: 65.616ms - TransmitDataRPCTime: 23.340ms - UncompressedRowBatchSize: 22.68 MB (23778751) CodeGen:(Total: 64.233ms, non-child: 64.233ms, % non-child: 100.00%) - CodegenTime: 1.111ms - CompileTime: 7.904ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 27.177ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 28.606ms HDFS_SCAN_NODE (id=0):(Total: 15.119ms, non-child: 15.119ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.68 MB (14346276) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.68 MB (14346276) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.68 MB (14346276) - DecompressionTime: 47.230ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 27.33 MB (28653424) - PerReadThreadRawHdfsThroughput: 2.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.682ms - RowBatchQueuePutWaitTime: 30.675ms - RowsRead: 3.21M (3214285) - RowsReturned: 642.56K (642562) - RowsReturnedRate: 42.42 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 26 (26) - ScannerThreadsTotalWallClockTime: 205.970ms - MaterializeTupleTime(*): 110.544ms - ScannerThreadsSysTime: 9.283ms - ScannerThreadsUserTime: 152.976ms - ScannerThreadsVoluntaryContextSwitches: 125 (125) - TotalRawHdfsReadTime(*): 6.727ms - TotalReadThroughput: 1.10 MB/sec Fragment F03: Instance c84bf4bc19372552:31 (host=vb0208.halxg.cloudera.com:22000):(Total: 102.537ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/143.96 MB MemoryUsage(500.000ms): 229.26 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 32 (32) - PeakMemoryUsage: 15.83 MB (16598825) - PerHostPeakMemUsage: 38.76 MB (40643629) - RowsProduced: 359.83K (359831) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.688ms - TotalStorageWaitTime: 7.624ms - TotalWallClockTime: 266.236ms - SysTime: 13.997ms - UserTime: 230.964ms - VoluntaryContextSwitches: 45 (45) Fragment Instance Lifecycle Timings: - ExecTime: 113.379ms - ExecTreeExecTime: 11.277ms - OpenTime: 49.695ms - ExecTreeOpenTime: 74.096us - PrepareTime: 52.796ms - ExecTreePrepareTime: 957.752us DataStreamSender (dst_id=10):(Total: 51.972ms, non-child: 51.972ms, % non-child: 100.00%) - BytesSent: 4.44 MB (4650922) - NetworkThroughput(*): 332.45 MB/sec - OverallThroughput: 85.34 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 359.83K (359831) - SerializeBatchTime: 38.461ms - TransmitDataRPCTime: 13.341ms - UncompressedRowBatchSize: 12.70 MB (13315971) CodeGen:(Total: 88.129ms, non-child: 88.129ms, % non-child: 100.00%) - CodegenTime: 1.436ms - CompileTime: 10.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 37.788ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 38.940ms HDFS_SCAN_NODE (id=0):(Total: 13.032ms, non-child: 13.032ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/143.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 1.910ms ; Min: 1.910ms ; Max: 1.910ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 7.70 MB (8072992) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.70 MB (8072992) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.70 MB (8072992) - DecompressionTime: 26.183ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.43 MB (16182804) - PerReadThreadRawHdfsThroughput: 2.22 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.556ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1797174) - RowsReturned: 359.83K (359831) - RowsReturnedRate: 27.61 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 103.201ms - MaterializeTupleTime(*): 65.575ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 86.986ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 3.380ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:30 (host=vb0224.halxg.cloudera.com:22000):(Total: 95.496ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/252.20 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 54 (54) - PeakMemoryUsage: 27.33 MB (28662716) - PerHostPeakMemUsage: 52.22 MB (54757263) - RowsProduced: 630.60K (630601) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.834ms - TotalStorageWaitTime: 9.300ms - TotalWallClockTime: 397.997ms - SysTime: 17.998ms - UserTime: 352.945ms - VoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 188.884ms - ExecTreeExecTime: 15.098ms - OpenTime: 47.888ms - ExecTreeOpenTime: 52.056us - PrepareTime: 47.553ms - ExecTreePrepareTime: 118.304us DataStreamSender (dst_id=10):(Total: 86.534ms, non-child: 86.534ms, % non-child: 100.00%) - BytesSent: 7.76 MB (8134899) - NetworkThroughput(*): 354.52 MB/sec - OverallThroughput: 89.65 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.60K (630601) - SerializeBatchTime: 64.427ms - TransmitDataRPCTime: 21.883ms - UncompressedRowBatchSize: 22.26 MB (23336117) CodeGen:(Total: 84.513ms, non-child: 84.513ms, % non-child: 100.00%) - CodegenTime: 1.318ms - CompileTime: 8.821ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 37.938ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 37.053ms HDFS_SCAN_NODE (id=0):(Total: 14.958ms, non-child: 14.958ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/252.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.042ms ; Min: 2.042ms ; Max: 2.042ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14025713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14025713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14025713) - DecompressionTime: 43.724ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 26.78 MB (28076628) - PerReadThreadRawHdfsThroughput: 1.97 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.861ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3153218) - RowsReturned: 630.60K (630601) - RowsReturnedRate: 42.16 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 161.266ms - MaterializeTupleTime(*): 103.407ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 144.977ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 6.635ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:37 (host=vb0234.halxg.cloudera.com:22000):(Total: 95.433ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.19 MB 2:1/143.95 MB MemoryUsage(500.000ms): 93.26 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 86 (86) - PeakMemoryUsage: 53.05 MB (55629237) - PerHostPeakMemUsage: 81.46 MB (85422205) - RowsProduced: 989.16K (989165) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.941ms - TotalStorageWaitTime: 18.167ms - TotalWallClockTime: 759.783ms - SysTime: 39.993ms - UserTime: 551.916ms - VoluntaryContextSwitches: 554 (554) Fragment Instance Lifecycle Timings: - ExecTime: 292.137ms - ExecTreeExecTime: 16.536ms - OpenTime: 49.837ms - ExecTreeOpenTime: 59.336us - PrepareTime: 45.552ms - ExecTreePrepareTime: 965.920us DataStreamSender (dst_id=10):(Total: 129.822ms, non-child: 129.822ms, % non-child: 100.00%) - BytesSent: 12.19 MB (12785574) - NetworkThroughput(*): 355.39 MB/sec - OverallThroughput: 93.92 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 989.16K (989165) - SerializeBatchTime: 95.266ms - TransmitDataRPCTime: 34.310ms - UncompressedRowBatchSize: 34.91 MB (36605177) CodeGen:(Total: 82.758ms, non-child: 82.758ms, % non-child: 100.00%) - CodegenTime: 1.293ms - CompileTime: 10.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 37.820ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 33.503ms HDFS_SCAN_NODE (id=0):(Total: 17.977ms, non-child: 17.977ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.19 MB 2:1/143.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 2.156ms ; Min: 2.040ms ; Max: 2.272ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 21.07 MB (22098342) - BytesReadDataNodeCache: 0 - BytesReadLocal: 21.07 MB (22098342) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21.07 MB (22098342) - DecompressionTime: 74.952ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 52.42 MB (54969504) - PerReadThreadRawHdfsThroughput: 1.86 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.434ms - RowBatchQueuePutWaitTime: 132.911ms - RowsRead: 4.95M (4950000) - RowsReturned: 989.16K (989165) - RowsReturnedRate: 55.02 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 44 (44) - ScannerThreadsTotalWallClockTime: 417.846ms - MaterializeTupleTime(*): 180.803ms - ScannerThreadsSysTime: 24.995ms - ScannerThreadsUserTime: 241.963ms - ScannerThreadsVoluntaryContextSwitches: 512 (512) - TotalRawHdfsReadTime(*): 11.073ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:2e (host=vb0222.halxg.cloudera.com:22000):(Total: 81.512ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/156.02 MB 8:1/143.97 MB MemoryUsage(500.000ms): 229.26 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 69 (69) - PeakMemoryUsage: 44.06 MB (46202205) - PerHostPeakMemUsage: 70.75 MB (74187983) - RowsProduced: 748.10K (748102) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.696ms - TotalStorageWaitTime: 17.191ms - TotalWallClockTime: 582.020ms - SysTime: 27.995ms - UserTime: 407.937ms - VoluntaryContextSwitches: 480 (480) Fragment Instance Lifecycle Timings: - ExecTime: 214.831ms - ExecTreeExecTime: 14.836ms - OpenTime: 34.510ms - ExecTreeOpenTime: 53.744us - PrepareTime: 46.953ms - ExecTreePrepareTime: 296.960us DataStreamSender (dst_id=10):(Total: 97.102ms, non-child: 97.102ms, % non-child: 100.00%) - BytesSent: 9.22 MB (9668689) - NetworkThroughput(*): 349.22 MB/sec - OverallThroughput: 94.96 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 748.10K (748102) - SerializeBatchTime: 70.492ms - TransmitDataRPCTime: 26.403ms - UncompressedRowBatchSize: 26.40 MB (27684370) CodeGen:(Total: 60.598ms, non-child: 60.598ms, % non-child: 100.00%) - CodegenTime: 997.880us - CompileTime: 7.533ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 25.671ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 26.884ms HDFS_SCAN_NODE (id=0):(Total: 15.151ms, non-child: 15.151ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/156.02 MB 8:1/143.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.021ms ; Min: 1.896ms ; Max: 2.146ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 16.03 MB (16807204) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.03 MB (16807204) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.03 MB (16807204) - DecompressionTime: 55.098ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 43.43 MB (45540514) - PerReadThreadRawHdfsThroughput: 2.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.037ms - RowBatchQueuePutWaitTime: 111.475ms - RowsRead: 3.75M (3745028) - RowsReturned: 748.10K (748102) - RowsReturnedRate: 49.38 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 43 (43) - ScannerThreadsTotalWallClockTime: 332.710ms - MaterializeTupleTime(*): 139.503ms - ScannerThreadsSysTime: 21.996ms - ScannerThreadsUserTime: 179.971ms - ScannerThreadsVoluntaryContextSwitches: 437 (437) - TotalRawHdfsReadTime(*): 7.806ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:32 (host=vb0206.halxg.cloudera.com:22000):(Total: 76.473ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/252.17 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 34 (34) - PeakMemoryUsage: 20.99 MB (22010627) - PerHostPeakMemUsage: 41.66 MB (43686809) - RowsProduced: 630.05K (630049) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.442ms - TotalStorageWaitTime: 8.640ms - TotalWallClockTime: 321.786ms - SysTime: 5.999ms - UserTime: 291.956ms - VoluntaryContextSwitches: 50 (50) Fragment Instance Lifecycle Timings: - ExecTime: 148.320ms - ExecTreeExecTime: 12.664ms - OpenTime: 32.314ms - ExecTreeOpenTime: 51.914us - PrepareTime: 44.113ms - ExecTreePrepareTime: 705.060us DataStreamSender (dst_id=10):(Total: 81.974ms, non-child: 81.974ms, % non-child: 100.00%) - BytesSent: 7.76 MB (8139067) - NetworkThroughput(*): 371.66 MB/sec - OverallThroughput: 94.69 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.05K (630049) - SerializeBatchTime: 60.887ms - TransmitDataRPCTime: 20.884ms - UncompressedRowBatchSize: 22.24 MB (23315693) CodeGen:(Total: 62.542ms, non-child: 62.542ms, % non-child: 100.00%) - CodegenTime: 1.099ms - CompileTime: 7.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.884ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 30.565ms HDFS_SCAN_NODE (id=0):(Total: 13.838ms, non-child: 13.838ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/252.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.009ms ; Min: 2.009ms ; Max: 2.009ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14019753) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14019753) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14019753) - DecompressionTime: 41.719ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.51 MB (21504502) - PerReadThreadRawHdfsThroughput: 2.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.861ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152011) - RowsReturned: 630.05K (630049) - RowsReturnedRate: 45.53 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 141.181ms - MaterializeTupleTime(*): 86.905ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 130.979ms - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 6.336ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:36 (host=vb0218.halxg.cloudera.com:22000):(Total: 76.372ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/155.97 MB MemoryUsage(500.000ms): 0 ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 33 (33) - PeakMemoryUsage: 14.80 MB (15517720) - PerHostPeakMemUsage: 35.73 MB (37461632) - RowsProduced: 388.47K (388469) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.486ms - TotalStorageWaitTime: 8.184ms - TotalWallClockTime: 241.526ms - SysTime: 9.998ms - UserTime: 206.968ms - VoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 110.872ms - ExecTreeExecTime: 12.994ms - OpenTime: 32.254ms - ExecTreeOpenTime: 47.208us - PrepareTime: 44.072ms - ExecTreePrepareTime: 105.960us DataStreamSender (dst_id=10):(Total: 56.565ms, non-child: 56.565ms, % non-child: 100.00%) - BytesSent: 4.77 MB (5006775) - NetworkThroughput(*): 331.33 MB/sec - OverallThroughput: 84.41 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 388.47K (388469) - SerializeBatchTime: 41.980ms - TransmitDataRPCTime: 14.411ms - UncompressedRowBatchSize: 13.71 MB (14375753) CodeGen:(Total: 59.169ms, non-child: 59.169ms, % non-child: 100.00%) - CodegenTime: 1.075ms - CompileTime: 7.102ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.217ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 27.331ms HDFS_SCAN_NODE (id=0):(Total: 13.002ms, non-child: 13.002ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/155.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.240ms ; Min: 2.240ms ; Max: 2.240ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 8.33 MB (8731657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 8.33 MB (8731657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 8.33 MB (8731657) - DecompressionTime: 27.124ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 14.31 MB (15001044) - PerReadThreadRawHdfsThroughput: 2.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.411ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.95M (1947366) - RowsReturned: 388.47K (388469) - RowsReturnedRate: 29.88 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 98.437ms - MaterializeTupleTime(*): 59.315ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 83.987ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 3.554ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:3b (host=vb0230.halxg.cloudera.com:22000):(Total: 74.574ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/252.21 MB 2:1/143.90 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 74 (74) - PeakMemoryUsage: 52.99 MB (55562678) - PerHostPeakMemUsage: 79.91 MB (83786499) - RowsProduced: 989.50K (989505) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.867ms - TotalStorageWaitTime: 17.805ms - TotalWallClockTime: 718.943ms - SysTime: 33.994ms - UserTime: 565.912ms - VoluntaryContextSwitches: 391 (391) Fragment Instance Lifecycle Timings: - ExecTime: 284.344ms - ExecTreeExecTime: 15.367ms - OpenTime: 31.687ms - ExecTreeOpenTime: 45.000us - PrepareTime: 42.837ms - ExecTreePrepareTime: 153.644us DataStreamSender (dst_id=10):(Total: 127.830ms, non-child: 127.830ms, % non-child: 100.00%) - BytesSent: 12.14 MB (12729084) - NetworkThroughput(*): 390.59 MB/sec - OverallThroughput: 94.97 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 989.50K (989505) - SerializeBatchTime: 96.489ms - TransmitDataRPCTime: 31.079ms - UncompressedRowBatchSize: 34.92 MB (36617757) CodeGen:(Total: 60.781ms, non-child: 60.781ms, % non-child: 100.00%) - CodegenTime: 1.032ms - CompileTime: 7.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.759ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 29.460ms HDFS_SCAN_NODE (id=0):(Total: 15.117ms, non-child: 15.117ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/252.21 MB 2:1/143.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 2.033ms ; Min: 2.003ms ; Max: 2.063ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 21.07 MB (22094188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 21.07 MB (22094188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 21.07 MB (22094188) - DecompressionTime: 80.800ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 52.35 MB (54892705) - PerReadThreadRawHdfsThroughput: 1.96 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.633ms - RowBatchQueuePutWaitTime: 84.204ms - RowsRead: 4.95M (4949385) - RowsReturned: 989.50K (989505) - RowsReturnedRate: 65.45 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 42 (42) - ScannerThreadsTotalWallClockTime: 402.947ms - MaterializeTupleTime(*): 209.488ms - ScannerThreadsSysTime: 13.997ms - ScannerThreadsUserTime: 285.955ms - ScannerThreadsVoluntaryContextSwitches: 339 (339) - TotalRawHdfsReadTime(*): 10.493ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:33 (host=vb0214.halxg.cloudera.com:22000):(Total: 73.542ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 49 (49) - PeakMemoryUsage: 20.43 MB (21417633) - PerHostPeakMemUsage: 41.87 MB (43902275) - RowsProduced: 629.43K (629430) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.199ms - TotalStorageWaitTime: 8.501ms - TotalWallClockTime: 349.444ms - SysTime: 13.998ms - UserTime: 310.952ms - VoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 161.751ms - ExecTreeExecTime: 12.752ms - OpenTime: 31.949ms - ExecTreeOpenTime: 49.953us - PrepareTime: 41.513ms - ExecTreePrepareTime: 935.566us DataStreamSender (dst_id=10):(Total: 91.563ms, non-child: 91.563ms, % non-child: 100.00%) - BytesSent: 7.94 MB (8327978) - NetworkThroughput(*): 333.13 MB/sec - OverallThroughput: 86.74 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 629.43K (629430) - SerializeBatchTime: 67.483ms - TransmitDataRPCTime: 23.841ms - UncompressedRowBatchSize: 22.21 MB (23292786) CodeGen:(Total: 59.938ms, non-child: 59.938ms, % non-child: 100.00%) - CodegenTime: 1.114ms - CompileTime: 7.031ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.902ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 28.494ms HDFS_SCAN_NODE (id=0):(Total: 14.201ms, non-child: 14.201ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.956ms ; Min: 1.956ms ; Max: 1.956ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14022303) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14022303) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14022303) - DecompressionTime: 44.760ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.92 MB (20888038) - PerReadThreadRawHdfsThroughput: 2.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.484ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152634) - RowsReturned: 629.43K (629430) - RowsReturnedRate: 44.32 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 21 (21) - ScannerThreadsTotalWallClockTime: 155.780ms - MaterializeTupleTime(*): 97.585ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 139.978ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 5.935ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:2f (host=vb0228.halxg.cloudera.com:22000):(Total: 73.169ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/252.21 MB MemoryUsage(500.000ms): 229.26 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 94 (94) - PeakMemoryUsage: 19.93 MB (20897433) - PerHostPeakMemUsage: 43.87 MB (46001745) - RowsProduced: 631.37K (631372) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.691ms - TotalStorageWaitTime: 9.070ms - TotalWallClockTime: 424.473ms - SysTime: 9.998ms - UserTime: 380.941ms - VoluntaryContextSwitches: 132 (132) Fragment Instance Lifecycle Timings: - ExecTime: 198.428ms - ExecTreeExecTime: 18.792ms - OpenTime: 32.421ms - ExecTreeOpenTime: 52.104us - PrepareTime: 40.696ms - ExecTreePrepareTime: 1.172ms DataStreamSender (dst_id=10):(Total: 105.686ms, non-child: 105.686ms, % non-child: 100.00%) - BytesSent: 7.93 MB (8319341) - NetworkThroughput(*): 357.46 MB/sec - OverallThroughput: 75.07 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 631.37K (631372) - SerializeBatchTime: 83.238ms - TransmitDataRPCTime: 22.195ms - UncompressedRowBatchSize: 22.28 MB (23364656) CodeGen:(Total: 56.503ms, non-child: 56.503ms, % non-child: 100.00%) - CodegenTime: 1.009ms - CompileTime: 7.626ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.847ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 24.531ms HDFS_SCAN_NODE (id=0):(Total: 21.812ms, non-child: 21.812ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/252.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.057ms ; Min: 2.057ms ; Max: 2.057ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14026723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14026723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14026723) - DecompressionTime: 50.953ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.52 MB (20465028) - PerReadThreadRawHdfsThroughput: 2.03 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.465ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3153576) - RowsReturned: 631.37K (631372) - RowsReturnedRate: 28.95 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 25 (25) - ScannerThreadsTotalWallClockTime: 193.646ms - MaterializeTupleTime(*): 127.884ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 180.972ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 6.434ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:38 (host=vb0216.halxg.cloudera.com:22000):(Total: 69.285ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 32 (32) - PeakMemoryUsage: 20.43 MB (21418657) - PerHostPeakMemUsage: 40.94 MB (42930537) - RowsProduced: 630.97K (630965) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.337ms - TotalStorageWaitTime: 10.150ms - TotalWallClockTime: 322.487ms - SysTime: 7.998ms - UserTime: 287.955ms - VoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 147.774ms - ExecTreeExecTime: 14.031ms - OpenTime: 32.565ms - ExecTreeOpenTime: 44.192us - PrepareTime: 36.640ms - ExecTreePrepareTime: 142.436us DataStreamSender (dst_id=10):(Total: 84.171ms, non-child: 84.171ms, % non-child: 100.00%) - BytesSent: 7.97 MB (8359833) - NetworkThroughput(*): 348.69 MB/sec - OverallThroughput: 94.72 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.97K (630965) - SerializeBatchTime: 61.134ms - TransmitDataRPCTime: 22.864ms - UncompressedRowBatchSize: 22.27 MB (23349589) CodeGen:(Total: 58.487ms, non-child: 58.487ms, % non-child: 100.00%) - CodegenTime: 1.044ms - CompileTime: 7.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.508ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 26.406ms HDFS_SCAN_NODE (id=0):(Total: 14.120ms, non-child: 14.120ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.345ms ; Min: 2.345ms ; Max: 2.345ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.38 MB (14024819) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.38 MB (14024819) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.38 MB (14024819) - DecompressionTime: 41.408ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.90 MB (20862438) - PerReadThreadRawHdfsThroughput: 1.70 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.449ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152961) - RowsReturned: 630.97K (630965) - RowsReturnedRate: 44.69 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 142.178ms - MaterializeTupleTime(*): 86.530ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 128.979ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 7.683ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:39 (host=vb0220.halxg.cloudera.com:22000):(Total: 67.934ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/155.93 MB 8:1/143.90 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 114 (114) - PeakMemoryUsage: 43.99 MB (46127450) - PerHostPeakMemUsage: 71.05 MB (74497911) - RowsProduced: 749.46K (749458) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.752ms - TotalStorageWaitTime: 16.737ms - TotalWallClockTime: 585.238ms - SysTime: 38.993ms - UserTime: 410.936ms - VoluntaryContextSwitches: 438 (438) Fragment Instance Lifecycle Timings: - ExecTime: 214.668ms - ExecTreeExecTime: 14.526ms - OpenTime: 31.993ms - ExecTreeOpenTime: 48.124us - PrepareTime: 35.894ms - ExecTreePrepareTime: 964.948us DataStreamSender (dst_id=10):(Total: 106.887ms, non-child: 106.887ms, % non-child: 100.00%) - BytesSent: 9.24 MB (9686594) - NetworkThroughput(*): 310.77 MB/sec - OverallThroughput: 86.43 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 749.46K (749458) - SerializeBatchTime: 76.910ms - TransmitDataRPCTime: 29.726ms - UncompressedRowBatchSize: 26.45 MB (27734546) CodeGen:(Total: 53.950ms, non-child: 53.950ms, % non-child: 100.00%) - CodegenTime: 965.476us - CompileTime: 7.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 23.954ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 22.276ms HDFS_SCAN_NODE (id=0):(Total: 15.921ms, non-child: 15.921ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/155.93 MB 8:1/143.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 - FooterProcessingTime: (Avg: 1.945ms ; Min: 1.870ms ; Max: 2.021ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 16.02 MB (16801537) - BytesReadDataNodeCache: 0 - BytesReadLocal: 16.02 MB (16801537) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 16.02 MB (16801537) - DecompressionTime: 62.081ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 43.40 MB (45506809) - PerReadThreadRawHdfsThroughput: 2.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.554ms - RowBatchQueuePutWaitTime: 100.872ms - RowsRead: 3.74M (3743821) - RowsReturned: 749.46K (749458) - RowsReturnedRate: 47.07 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 79 (79) - ScannerThreadsTotalWallClockTime: 338.606ms - MaterializeTupleTime(*): 149.414ms - ScannerThreadsSysTime: 25.995ms - ScannerThreadsUserTime: 190.970ms - ScannerThreadsVoluntaryContextSwitches: 404 (404) - TotalRawHdfsReadTime(*): 7.642ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:35 (host=vb0204.halxg.cloudera.com:22000):(Total: 67.475ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/252.22 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 33 (33) - PeakMemoryUsage: 20.65 MB (21656315) - PerHostPeakMemUsage: 40.51 MB (42473517) - RowsProduced: 629.82K (629818) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.545ms - TotalStorageWaitTime: 11.399ms - TotalWallClockTime: 329.882ms - SysTime: 11.998ms - UserTime: 287.956ms - VoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 152.382ms - ExecTreeExecTime: 15.645ms - OpenTime: 32.824ms - ExecTreeOpenTime: 57.185us - PrepareTime: 34.603ms - ExecTreePrepareTime: 362.040us DataStreamSender (dst_id=10):(Total: 87.469ms, non-child: 87.469ms, % non-child: 100.00%) - BytesSent: 7.87 MB (8254531) - NetworkThroughput(*): 305.18 MB/sec - OverallThroughput: 90.00 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 629.82K (629818) - SerializeBatchTime: 61.508ms - TransmitDataRPCTime: 25.794ms - UncompressedRowBatchSize: 22.23 MB (23307150) CodeGen:(Total: 62.059ms, non-child: 62.059ms, % non-child: 100.00%) - CodegenTime: 1.079ms - CompileTime: 7.671ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.354ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 29.504ms HDFS_SCAN_NODE (id=0):(Total: 16.147ms, non-child: 16.147ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/252.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 3.638ms ; Min: 3.638ms ; Max: 3.638ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14024538) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14024538) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14024538) - DecompressionTime: 42.805ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.19 MB (21166574) - PerReadThreadRawHdfsThroughput: 1.83 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.832ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152826) - RowsReturned: 629.82K (629818) - RowsReturnedRate: 39.00 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 144.712ms - MaterializeTupleTime(*): 86.344ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 127.980ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 7.145ms - TotalReadThroughput: 0.00 /sec Instance c84bf4bc19372552:34 (host=vb0226.halxg.cloudera.com:22000):(Total: 63.052ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/143.95 MB MemoryUsage(500.000ms): 4.92 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 32 (32) - PeakMemoryUsage: 14.87 MB (15591776) - PerHostPeakMemUsage: 32.88 MB (34480450) - RowsProduced: 358.59K (358588) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.513ms - TotalStorageWaitTime: 9.437ms - TotalWallClockTime: 229.188ms - SysTime: 12.997ms - UserTime: 190.971ms - VoluntaryContextSwitches: 54 (54) Fragment Instance Lifecycle Timings: - ExecTime: 104.896ms - ExecTreeExecTime: 13.095ms - OpenTime: 31.982ms - ExecTreeOpenTime: 48.968us - PrepareTime: 31.045ms - ExecTreePrepareTime: 73.012us DataStreamSender (dst_id=10):(Total: 53.940ms, non-child: 53.940ms, % non-child: 100.00%) - BytesSent: 4.52 MB (4743838) - NetworkThroughput(*): 305.09 MB/sec - OverallThroughput: 83.87 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 358.59K (358588) - SerializeBatchTime: 38.993ms - TransmitDataRPCTime: 14.828ms - UncompressedRowBatchSize: 12.66 MB (13269976) CodeGen:(Total: 54.473ms, non-child: 54.473ms, % non-child: 100.00%) - CodegenTime: 990.424us - CompileTime: 7.118ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.019ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 22.847ms HDFS_SCAN_NODE (id=0):(Total: 13.062ms, non-child: 13.062ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/143.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 7.70 MB - FooterProcessingTime: (Avg: 2.625ms ; Min: 2.625ms ; Max: 2.625ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 7.70 MB (8073491) - BytesReadDataNodeCache: 0 - BytesReadLocal: 7.70 MB (8073491) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 7.70 MB (8073491) - DecompressionTime: 25.892ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 14.36 MB (15061067) - PerReadThreadRawHdfsThroughput: 1.84 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.724ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1797139) - RowsReturned: 358.59K (358588) - RowsReturnedRate: 27.45 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 92.340ms - MaterializeTupleTime(*): 53.843ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 76.988ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 4.079ms - TotalReadThroughput: 15.40 MB/sec Instance c84bf4bc19372552:3a (host=vb0232.halxg.cloudera.com:22000):(Total: 60.539ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.18 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 36 (36) - PeakMemoryUsage: 20.60 MB (21602985) - PerHostPeakMemUsage: 40.79 MB (42768974) - RowsProduced: 630.52K (630516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.866ms - TotalStorageWaitTime: 9.193ms - TotalWallClockTime: 358.465ms - SysTime: 12.997ms - UserTime: 318.951ms - VoluntaryContextSwitches: 44 (44) Fragment Instance Lifecycle Timings: - ExecTime: 166.644ms - ExecTreeExecTime: 13.371ms - OpenTime: 33.119ms - ExecTreeOpenTime: 50.676us - PrepareTime: 27.388ms - ExecTreePrepareTime: 88.132us DataStreamSender (dst_id=10):(Total: 86.718ms, non-child: 86.718ms, % non-child: 100.00%) - BytesSent: 8.00 MB (8385266) - NetworkThroughput(*): 317.35 MB/sec - OverallThroughput: 92.22 MB/sec - PeakMemoryUsage: 496.76 KB (508680) - RowsReturned: 630.52K (630516) - SerializeBatchTime: 61.351ms - TransmitDataRPCTime: 25.198ms - UncompressedRowBatchSize: 22.25 MB (23332976) CodeGen:(Total: 55.358ms, non-child: 55.358ms, % non-child: 100.00%) - CodegenTime: 1.099ms - CompileTime: 7.316ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 18 (18) - NumInstructions: 289 (289) - OptimizationTime: 24.815ms - PeakMemoryUsage: 144.50 KB (147968) - PrepareTime: 22.692ms HDFS_SCAN_NODE (id=0):(Total: 13.322ms, non-child: 13.322ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/252.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.240ms ; Min: 2.240ms ; Max: 2.240ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 13.37 MB (14024611) - BytesReadDataNodeCache: 0 - BytesReadLocal: 13.37 MB (14024611) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 13.37 MB (14024611) - DecompressionTime: 43.716ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.06 MB (21030292) - PerReadThreadRawHdfsThroughput: 2.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.247ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.15M (3152861) - RowsReturned: 630.52K (630516) - RowsReturnedRate: 47.33 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 158.735ms - MaterializeTupleTime(*): 101.018ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 140.978ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 5.978ms - TotalReadThroughput: 0.00 /sec ================================================================================