Query (id=5e42471e272c7b4a:f7fdeddcf24303b2): Summary: Session ID: f84d514893c536b5:782cd6893241d4ac Session Type: BEESWAX Start Time: 2016-02-21 14:43:31.169518000 End Time: 2016-02-21 14:44:52.235367000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE (build 213efa3492b9618c69565b885117badfb90468ef) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.20.122.102:49934 Default Db: tpcds_15000_decimal_parquet Sql Statement: select count(*) as c from store_sales ,household_demographics ,time_dim, store where store_sales.ss_sold_time_sk = time_dim.t_time_sk and store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk and store_sales.ss_store_sk = store.s_store_sk and time_dim.t_hour = 8 and time_dim.t_minute >= 30 and household_demographics.hd_dep_count = 5 and store.s_store_name = 'ese' order by c limit 100 Coordinator: d2402.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=24 Plan: ---------------- Estimated Per-Host Requirements: Memory=274.03MB VCores=4 08:TOP-N [LIMIT=100] | order by: count(*) ASC | hosts=20 per-host-mem=unavailable | tuple-ids=5 row-size=8B cardinality=1 | 13:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=20 per-host-mem=unavailable | tuple-ids=4 row-size=8B cardinality=1 | 12:EXCHANGE [UNPARTITIONED] | hosts=20 per-host-mem=unavailable | tuple-ids=4 row-size=8B cardinality=1 | 07:AGGREGATE | output: count(*) | hosts=20 per-host-mem=10.00MB | tuple-ids=4 row-size=8B cardinality=1 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_store_sk = store.s_store_sk | runtime filters: RF000 <- store.s_store_sk | hosts=20 per-host-mem=186B | tuple-ids=0,2,1,3 row-size=80B cardinality=18530203 | |--11:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=28B cardinality=6 | | | 03:SCAN HDFS [tpcds_15000_decimal_parquet.store, RANDOM] | partitions=1/1 files=1 size=11.92KB | predicates: store.s_store_name = 'ese' | table stats: 62 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=3 row-size=28B cardinality=6 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | runtime filters: RF001 <- household_demographics.hd_demo_sk | hosts=20 per-host-mem=9.28KB | tuple-ids=0,2,1 row-size=52B cardinality=100447876 | |--10:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=1 row-size=12B cardinality=720 | | | 01:SCAN HDFS [tpcds_15000_decimal_parquet.household_demographics, RANDOM] | partitions=1/1 files=1 size=41.12KB | predicates: household_demographics.hd_dep_count = 5 | table stats: 7200 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=1 row-size=12B cardinality=720 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_sold_time_sk = time_dim.t_time_sk | runtime filters: RF002 <- time_dim.t_time_sk | hosts=20 per-host-mem=19.56KB | tuple-ids=0,2 row-size=40B cardinality=1004478759 | |--09:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=16B cardinality=1138 | | | 02:SCAN HDFS [tpcds_15000_decimal_parquet.time_dim, RANDOM] | partitions=1/1 files=1 size=1.30MB | predicates: time_dim.t_hour = 8, time_dim.t_minute >= 30 | table stats: 86400 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=2 row-size=16B cardinality=1138 | 00:SCAN HDFS [tpcds_15000_decimal_parquet.store_sales, RANDOM] partitions=1824/1824 files=6922 size=1.52TB runtime filters: RF000 -> store_sales.ss_store_sk, RF001 -> store_sales.ss_hdemo_sk, RF002 -> store_sales.ss_sold_time_sk table stats: 43202446268 rows total column stats: all hosts=20 per-host-mem=264.00MB tuple-ids=0 row-size=24B cardinality=43202446268 ---------------- Estimated Per-Host Mem: 287339543 Estimated Per-Host VCores: 4 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------ 08:TOP-N 1 208.622us 208.622us 1 1 12.00 KB -1.00 B 13:AGGREGATE 1 194.306ms 194.306ms 1 1 92.00 KB -1.00 B FINALIZE 12:EXCHANGE 1 303.107us 303.107us 20 1 0 -1.00 B UNPARTITIONED 07:AGGREGATE 20 1s528ms 1s915ms 20 1 18.59 MB 10.00 MB 06:HASH JOIN 20 195.809ms 257.033ms 9.43M 18.53M 12.66 MB 186.00 B INNER JOIN, BROADCAST |--11:EXCHANGE 20 10.005us 19.213us 8 6 0 0 BROADCAST | 03:SCAN HDFS 1 7.345ms 7.345ms 8 6 70.00 KB 32.00 MB tpcds_15000_decimal_parquet... 05:HASH JOIN 20 1s367ms 1s657ms 80.90M 100.45M 6.16 MB 9.28 KB INNER JOIN, BROADCAST |--10:EXCHANGE 20 23.366us 40.828us 720 720 0 0 BROADCAST | 01:SCAN HDFS 1 17.284ms 17.284ms 720 720 273.20 KB 32.00 MB tpcds_15000_decimal_parquet... 04:HASH JOIN 20 55s059ms 1m4s 818.31M 1.00B 2.21 MB 19.56 KB INNER JOIN, BROADCAST |--09:EXCHANGE 20 41.442us 79.434us 1.80K 1.14K 0 0 BROADCAST | 02:SCAN HDFS 1 21.815ms 21.815ms 1.80K 1.14K 1.89 MB 48.00 MB tpcds_15000_decimal_parquet... 00:SCAN HDFS 20 9s064ms 11s342ms 43.20B 43.20B 418.11 MB 264.00 MB tpcds_15000_decimal_parquet... Planner Timeline: 32.606ms - Analysis finished: 4.212ms (4.212ms) - Equivalence classes computed: 4.571ms (359.113us) - Single node plan created: 21.573ms (17.001ms) - Runtime filters computed: 21.767ms (193.743us) - Distributed plan created: 26.602ms (4.835ms) - Lineage info computed: 27.359ms (756.329us) - Planning finished: 32.606ms (5.247ms) Query Timeline: 1m21s - Start execution: 57.735us (57.735us) - Planning finished: 89.569ms (89.511ms) - Ready to start 23 remote fragments: 312.972ms (223.403ms) - All 23 remote fragments started: 505.922ms (192.950ms) - Rows available: 1m20s (1m20s) - First row fetched: 1m21s (324.096ms) - Unregister query: 1m21s (6.484ms) ImpalaServer: - ClientFetchWaitTimer: 325.556ms - RowMaterializationTimer: 7.852us Execution Profile 5e42471e272c7b4a:f7fdeddcf24303b2:(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) Fragment start latencies: Count: 23, 25th %-ile: 20ms, 50th %-ile: 21ms, 75th %-ile: 21ms, 90th %-ile: 22ms, 95th %-ile: 32ms, 99.9th %-ile: 32ms Per Node Peak Memory Usage: d2415.halxg.cloudera.com:22000(404.03 MB) d2408.halxg.cloudera.com:22000(396.50 MB) d2421.halxg.cloudera.com:22000(422.01 MB) d2403.halxg.cloudera.com:22000(402.73 MB) d2420.halxg.cloudera.com:22000(424.51 MB) d2410.halxg.cloudera.com:22000(429.80 MB) d2404.halxg.cloudera.com:22000(410.76 MB) d2416.halxg.cloudera.com:22000(406.32 MB) d2405.halxg.cloudera.com:22000(408.35 MB) d2414.halxg.cloudera.com:22000(400.04 MB) d2409.halxg.cloudera.com:22000(420.02 MB) d2419.halxg.cloudera.com:22000(405.69 MB) d2411.halxg.cloudera.com:22000(428.28 MB) d2407.halxg.cloudera.com:22000(406.90 MB) d2412.halxg.cloudera.com:22000(394.47 MB) d2418.halxg.cloudera.com:22000(412.12 MB) d2413.halxg.cloudera.com:22000(416.52 MB) d2406.halxg.cloudera.com:22000(402.56 MB) d2402.halxg.cloudera.com:22000(404.84 MB) d2417.halxg.cloudera.com:22000(409.74 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F04:(Total: 1m20s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(2s000ms): 11.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 23.00 KB, 58.01 KB, 85.01 KB, 99.01 KB, 100.01 KB, 100.01 KB, 100.01 KB, 100.01 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 104.02 KB (106512) - PerHostPeakMemUsage: 0 - PrepareTime: 193.771ms - RowsProduced: 1 (1) - TotalCpuTime: 943.084ms - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 72 (72) - BlocksRecycled: 24 (24) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 416.721ms, non-child: 416.721ms, % non-child: 100.00%) - CodegenTime: 836.559us - CompileTime: 3.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 220.608ms - PrepareTime: 190.544ms SORT_NODE (id=8):(Total: 1m20s, non-child: 208.622us, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 12.00 KB (12288) - RowsReturned: 1 (1) - RowsReturnedRate: 0 AGGREGATION_NODE (id=13):(Total: 1m20s, non-child: 194.306ms, % non-child: 0.24%) ExecOption: Codegen Enabled - BuildTime: 155.687us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 92.00 KB (94208) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=12):(Total: 1m19s, non-child: 303.107us, % non-child: 0.00%) BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 36.00 B, 164.00 B, 264.00 B, 304.00 B, 304.00 B, 304.00 B, 304.00 B, 304.00 B - BytesReceived: 320.00 B (320) - ConvertRowBatchTime: 52.272us - DeserializeRowBatchTimer: 181.642us - FirstBatchArrivalWaitTime: 1m4s - PeakMemoryUsage: 0 - RowsReturned: 20 (20) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1m7s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 77.49 GB, max: 78.17 GB, avg: 77.94 GB, stddev: 155.98 MB completion times: min:1m4s max:1m20s mean: 1m7s stddev:3s258ms execution rates: min:996.16 MB/sec max:1.21 GB/sec mean:1.16 GB/sec stddev:50.82 MB/sec num instances: 20 - AverageThreadTokens: 23.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 410.31 MB (430240805) - PerHostPeakMemUsage: 410.31 MB (430241624) - PrepareTime: 175.981ms - RowsProduced: 1 (1) - TotalCpuTime: 26m14s - TotalNetworkReceiveTime: 13.199us - TotalNetworkSendTime: 346.084us - TotalStorageWaitTime: 4s665ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 71 (71) - BlocksRecycled: 24 (24) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 498.795ms, non-child: 498.795ms, % non-child: 100.00%) - CodegenTime: 159.818us - CompileTime: 67.736ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 263.058ms - PrepareTime: 166.534ms DataStreamSender (dst_id=12):(Total: 35.389us, non-child: 35.389us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 62.57 KB/sec - OverallThroughput: 449.87 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 11.051us - ThriftTransmitTime(*): 271.389us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m7s, non-child: 1s528ms, % non-child: 2.27%) - BuildTime: 1s331ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.43 MB (18275956) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m5s, non-child: 195.809ms, % non-child: 0.30%) - BuildPartitionTime: 4.770us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 4.628us - GetNewBlockTime: 266.958us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.88 MB (12459269) - PinTime: 0.000ns - ProbeRows: 4.05M (4045013) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 155.286ms - RowsReturned: 471.57K (471573) - RowsReturnedRate: 7.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.184us EXCHANGE_NODE (id=11):(Total: 10.005us, non-child: 10.005us, % non-child: 100.00%) - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.201us - DeserializeRowBatchTimer: 7.669us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 840.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m5s, non-child: 1s367ms, % non-child: 2.09%) - BuildPartitionTime: 38.748us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 29.507us - GetNewBlockTime: 413.472us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.31 MB (5563257) - PinTime: 0.000ns - ProbeRows: 40.92M (40915380) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s286ms - RowsReturned: 4.05M (4045013) - RowsReturnedRate: 61.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.386us EXCHANGE_NODE (id=10):(Total: 23.366us, non-child: 23.366us, % non-child: 100.00%) - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 13.269us - DeserializeRowBatchTimer: 19.073us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 31.90 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m4s, non-child: 55s059ms, % non-child: 85.86%) - BuildPartitionTime: 77.495us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 64.897us - GetNewBlockTime: 328.868us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.18 MB (2284428) - PinTime: 0.000ns - ProbeRows: 2.16B (2160122313) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52s957ms - RowsReturned: 40.92M (40915380) - RowsReturnedRate: 639.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.072us EXCHANGE_NODE (id=9):(Total: 41.442us, non-child: 41.442us, % non-child: 100.00%) - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 31.758us - DeserializeRowBatchTimer: 61.469us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 44.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s064ms, non-child: 9s064ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 22.54 - BytesRead: 3.39 GB (3634649490) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3634649490) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3634649490) - DecompressionTime: 12s801ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 346 (346) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 397.79 MB (417110172) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2160122313) - RowsReturned: 2.16B (2160122313) - RowsReturnedRate: 239.21 M/sec - ScanRangesComplete: 346 (346) - ScannerThreadsInvoluntaryContextSwitches: 86.36K (86362) - ScannerThreadsTotalWallClockTime: 25m11s - MaterializeTupleTime(*): 24m51s - ScannerThreadsSysTime: 2s444ms - ScannerThreadsUserTime: 4m37s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2140323) - TotalRawHdfsReadTime(*): 2s533ms - TotalReadThroughput: 51.56 MB/sec Filter 0: - Rows processed: 5.67M (5670156) - Rows rejected: 0 (0) - Rows total: 5.67M (5670502) Filter 1: - Rows processed: 5.67M (5670156) - Rows rejected: 0 (0) - Rows total: 5.67M (5670502) Filter 2: - Rows processed: 5.67M (5670156) - Rows rejected: 0 (0) - Rows total: 5.67M (5670502) Averaged Fragment F03:(Total: 10.931ms, non-child: 3.447ms, % non-child: 31.54%) split sizes: min: 11.92 KB, max: 11.92 KB, avg: 11.92 KB, stddev: 0 completion times: min:305.339ms max:305.339ms mean: 305.339ms stddev:0.000ns execution rates: min:39.04 KB/sec max:39.04 KB/sec mean:39.04 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 158.00 KB (161792) - PerHostPeakMemUsage: 204.94 KB (209856) - PrepareTime: 95.408us - RowsProduced: 8 (8) - TotalCpuTime: 20.329ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 284.474ms - TotalStorageWaitTime: 6.693ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=11):(Total: 137.380us, non-child: 137.380us, % non-child: 100.00%) - BytesSent: 4.39 KB (4500) - NetworkThroughput(*): 1.12 KB/sec - OverallThroughput: 31.24 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 15.988us - ThriftTransmitTime(*): 3s920ms - UncompressedRowBatchSize: 6.17 KB (6320) HDFS_SCAN_NODE (id=3):(Total: 7.345ms, non-child: 7.345ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 12.41 KB (12711) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.41 KB (12711) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.41 KB (12711) - DecompressionTime: 2.528us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 70.00 KB (71680) - PerReadThreadRawHdfsThroughput: 652.50 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62 (62) - RowsReturned: 8 (8) - RowsReturnedRate: 1.09 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 7.051ms - MaterializeTupleTime(*): 20.340us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 18.578us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 20.189ms, non-child: 2.692ms, % non-child: 13.34%) split sizes: min: 41.12 KB, max: 41.12 KB, avg: 41.12 KB, stddev: 0 completion times: min:305.911ms max:305.911ms mean: 305.911ms stddev:0.000ns execution rates: min:134.42 KB/sec max:134.42 KB/sec mean:134.42 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 441.20 KB (451792) - PerHostPeakMemUsage: 441.20 KB (451792) - PrepareTime: 99.500us - RowsProduced: 720 (720) - TotalCpuTime: 27.463ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 279.068ms - TotalStorageWaitTime: 15.843ms DataStreamSender (dst_id=10):(Total: 212.316us, non-child: 212.316us, % non-child: 100.00%) - BytesSent: 143.54 KB (146980) - NetworkThroughput(*): 38.77 KB/sec - OverallThroughput: 660.20 MB/sec - PeakMemoryUsage: 160.00 KB (163840) - SerializeBatchTime: 113.308us - ThriftTransmitTime(*): 3s702ms - UncompressedRowBatchSize: 281.33 KB (288080) HDFS_SCAN_NODE (id=1):(Total: 17.284ms, non-child: 17.284ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 80.89 KB (82833) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.89 KB (82833) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.89 KB (82833) - DecompressionTime: 5.984us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 273.20 KB (279760) - PerReadThreadRawHdfsThroughput: 2.70 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.20K (7200) - RowsReturned: 720 (720) - RowsReturnedRate: 41.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.960ms - MaterializeTupleTime(*): 714.336us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 28.622us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 296.086ms, non-child: 2.968ms, % non-child: 1.00%) split sizes: min: 1.30 MB, max: 1.30 MB, avg: 1.30 MB, stddev: 0 completion times: min:303.433ms max:303.433ms mean: 303.433ms stddev:0.000ns execution rates: min:4.30 MB/sec max:4.30 MB/sec mean:4.30 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.00 MB (2095960) - PerHostPeakMemUsage: 2.00 MB (2095960) - PrepareTime: 107.374us - RowsProduced: 1.80K (1800) - TotalCpuTime: 43.180ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 271.004ms - TotalStorageWaitTime: 10.200ms DataStreamSender (dst_id=9):(Total: 271.302ms, non-child: 271.302ms, % non-child: 100.00%) - BytesSent: 467.42 KB (478640) - NetworkThroughput(*): 127.27 KB/sec - OverallThroughput: 1.68 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 150.894us - ThriftTransmitTime(*): 3s672ms - UncompressedRowBatchSize: 984.53 KB (1008160) HDFS_SCAN_NODE (id=2):(Total: 21.815ms, non-child: 21.815ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 517.10 KB (529509) - BytesReadDataNodeCache: 0 - BytesReadLocal: 517.10 KB (529509) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 517.10 KB (529509) - DecompressionTime: 645.722us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.89 MB (1978648) - PerReadThreadRawHdfsThroughput: 3.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 86.40K (86400) - RowsReturned: 1.80K (1800) - RowsReturnedRate: 82.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 21.589ms - MaterializeTupleTime(*): 9.619ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 156.248us - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 5e42471e272c7b4a:f7fdeddcf24303c1 (host=d2420.halxg.cloudera.com:22000):(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:33/7.72 GB 3:22/5.27 GB 9:35/7.99 GB 6:28/5.84 GB 10:29/6.94 GB 7:29/7.08 GB 2:31/7.01 GB 4:31/7.00 GB 8:27/6.12 GB 0:40/8.99 GB 1:36/8.10 GB MemoryUsage(2s000ms): 171.21 MB, 347.64 MB, 357.46 MB, 366.11 MB, 376.62 MB, 389.05 MB, 392.95 MB, 393.86 MB, 377.28 MB, 367.06 MB, 371.53 MB, 368.54 MB, 355.77 MB, 355.85 MB, 349.73 MB, 352.50 MB, 362.69 MB, 371.65 MB, 367.37 MB, 363.25 MB, 363.15 MB, 390.59 MB, 409.80 MB, 383.52 MB, 366.34 MB, 344.94 MB, 351.09 MB, 347.11 MB, 356.79 MB, 350.60 MB, 369.02 MB, 368.02 MB, 358.08 MB, 359.41 MB, 368.14 MB, 364.65 MB, 363.78 MB, 357.12 MB, 358.49 MB, 241.91 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 15 - AverageThreadTokens: 23.49 - BloomFilterBytes: 0 - PeakMemoryUsage: 424.51 MB (445130232) - PerHostPeakMemUsage: 424.51 MB (445130232) - PrepareTime: 219.727ms - RowsProduced: 1 (1) - TotalCpuTime: 31m17s - TotalNetworkReceiveTime: 24.008us - TotalNetworkSendTime: 379.970us - TotalStorageWaitTime: 5s450ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 590.289ms, non-child: 590.289ms, % non-child: 100.00%) - CodegenTime: 206.952us - CompileTime: 68.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 311.784ms - PrepareTime: 208.364ms DataStreamSender (dst_id=12):(Total: 41.238us, non-child: 41.238us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 46.52 KB/sec - OverallThroughput: 378.90 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 13.792us - ThriftTransmitTime(*): 335.870us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m19s, non-child: 1s915ms, % non-child: 2.40%) ExecOption: Codegen Enabled - BuildTime: 1s673ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 18.20 MB (19089128) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m17s, non-child: 257.033ms, % non-child: 0.33%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 6.846us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 6.808us - GetNewBlockTime: 56.648us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.69 MB (12263016) - PinTime: 0.000ns - ProbeRows: 4.25M (4251548) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 203.392ms - RowsReturned: 550.73K (550732) - RowsReturnedRate: 7.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.004us EXCHANGE_NODE (id=11):(Total: 16.710us, non-child: 16.710us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 2.020us - DeserializeRowBatchTimer: 15.142us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 478.75 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m17s, non-child: 1s657ms, % non-child: 2.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 73.106us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 56.934us - GetNewBlockTime: 559.776us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.53 MB (5801296) - PinTime: 0.000ns - ProbeRows: 41.12M (41117683) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s554ms - RowsReturned: 4.25M (4251548) - RowsReturnedRate: 54.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.784us EXCHANGE_NODE (id=10):(Total: 40.828us, non-child: 40.828us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 24.554us - DeserializeRowBatchTimer: 35.020us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 17.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m16s, non-child: 1m4s, % non-child: 85.08%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 145.114us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 127.282us - GetNewBlockTime: 440.614us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.17 MB (2280104) - PinTime: 0.000ns - ProbeRows: 2.17B (2165066661) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1m2s - RowsReturned: 41.12M (41117683) - RowsReturnedRate: 540.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.236us EXCHANGE_NODE (id=9):(Total: 79.434us, non-child: 79.434us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 60.458us - DeserializeRowBatchTimer: 80.480us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 22.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 11s342ms, non-child: 11s342ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 341 Hdfs split stats (:<# splits>/): 5:33/7.72 GB 3:22/5.27 GB 9:35/7.99 GB 6:28/5.84 GB 10:29/6.94 GB 7:29/7.08 GB 2:31/7.01 GB 4:31/7.00 GB 8:27/6.12 GB 0:40/8.99 GB 1:36/8.10 GB Runtime filters: Only following filters arrived: , waited 402ms Hdfs Read Thread Concurrency Bucket: 0:98.74% 1:1.258% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1023 BytesRead(2s000ms): 109.46 MB, 221.61 MB, 237.25 MB, 326.93 MB, 468.54 MB, 503.45 MB, 583.94 MB, 736.36 MB, 762.62 MB, 846.41 MB, 982.10 MB, 1012.46 MB, 1.11 GB, 1.19 GB, 1.24 GB, 1.37 GB, 1.44 GB, 1.54 GB, 1.65 GB, 1.71 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.10 GB, 2.18 GB, 2.24 GB, 2.34 GB, 2.41 GB, 2.49 GB, 2.59 GB, 2.67 GB, 2.74 GB, 2.83 GB, 2.93 GB, 3.01 GB, 3.11 GB, 3.17 GB, 3.26 GB, 3.36 GB, 3.39 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 22.64 - BytesRead: 3.39 GB (3636974297) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3636974297) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3636974297) - DecompressionTime: 18s641ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 341 (341) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 412.28 MB (432308632) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2165066661) - RowsReturned: 2.17B (2165066661) - RowsReturnedRate: 190.89 M/sec - ScanRangesComplete: 341 (341) - ScannerThreadsInvoluntaryContextSwitches: 114.76K (114757) - ScannerThreadsTotalWallClockTime: 30m2s - MaterializeTupleTime(*): 29m34s - ScannerThreadsSysTime: 5s080ms - ScannerThreadsUserTime: 6m46s - ScannerThreadsVoluntaryContextSwitches: 2.16M (2160476) - TotalRawHdfsReadTime(*): 2s935ms - TotalReadThroughput: 43.36 MB/sec Filter 0: - Rows processed: 5.59M (5586603) - Rows rejected: 0 (0) - Rows total: 5.59M (5586944) Filter 1: - Rows processed: 5.59M (5586603) - Rows rejected: 0 (0) - Rows total: 5.59M (5586944) Filter 2: - Rows processed: 5.59M (5586603) - Rows rejected: 0 (0) - Rows total: 5.59M (5586944) Instance 5e42471e272c7b4a:f7fdeddcf24303c4 (host=d2403.halxg.cloudera.com:22000):(Total: 1m9s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:23/5.09 GB 6:32/7.70 GB 5:29/6.65 GB 2:35/8.13 GB 8:33/7.65 GB 10:30/6.14 GB 9:38/8.00 GB 1:32/6.93 GB 0:38/8.60 GB 4:26/5.89 GB 7:32/7.02 GB MemoryUsage(2s000ms): 196.99 MB, 393.85 MB, 377.56 MB, 324.07 MB, 351.56 MB, 361.64 MB, 330.40 MB, 352.31 MB, 360.91 MB, 359.78 MB, 345.41 MB, 350.98 MB, 371.76 MB, 360.05 MB, 373.14 MB, 379.11 MB, 374.71 MB, 366.34 MB, 356.23 MB, 376.38 MB, 359.29 MB, 362.78 MB, 386.17 MB, 374.05 MB, 352.72 MB, 345.82 MB, 352.41 MB, 369.50 MB, 359.74 MB, 348.92 MB, 371.10 MB, 382.72 MB, 368.47 MB, 347.10 MB, 212.19 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 13 - AverageThreadTokens: 23.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 402.73 MB (422297720) - PerHostPeakMemUsage: 402.73 MB (422297720) - PrepareTime: 178.323ms - RowsProduced: 1 (1) - TotalCpuTime: 27m7s - TotalNetworkReceiveTime: 10.938us - TotalNetworkSendTime: 236.986us - TotalStorageWaitTime: 4s938ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 500.818ms, non-child: 500.818ms, % non-child: 100.00%) - CodegenTime: 158.078us - CompileTime: 67.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 262.466ms - PrepareTime: 168.957ms DataStreamSender (dst_id=12):(Total: 33.564us, non-child: 33.564us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 75.36 KB/sec - OverallThroughput: 465.53 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.178us - ThriftTransmitTime(*): 207.324us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m9s, non-child: 1s475ms, % non-child: 2.12%) ExecOption: Codegen Enabled - BuildTime: 1s282ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.40 MB (18245008) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m8s, non-child: 178.422ms, % non-child: 0.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.418us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 3.122us - GetNewBlockTime: 77.202us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.89 MB (12468664) - PinTime: 0.000ns - ProbeRows: 3.76M (3755334) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 142.884ms - RowsReturned: 399.81K (399807) - RowsReturnedRate: 5.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.092us EXCHANGE_NODE (id=11):(Total: 8.644us, non-child: 8.644us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 892.000ns - DeserializeRowBatchTimer: 5.720us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 925.50 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m8s, non-child: 1s360ms, % non-child: 2.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 42.922us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 32.906us - GetNewBlockTime: 59.062us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.16 MB (6454312) - PinTime: 0.000ns - ProbeRows: 39.89M (39889717) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s285ms - RowsReturned: 3.76M (3755334) - RowsReturnedRate: 55.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.136us EXCHANGE_NODE (id=10):(Total: 20.450us, non-child: 20.450us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 11.952us - DeserializeRowBatchTimer: 16.367us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 35.21 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m6s, non-child: 57s480ms, % non-child: 86.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 74.058us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.596us - GetNewBlockTime: 123.022us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.16 MB (2267936) - PinTime: 0.000ns - ProbeRows: 2.15B (2150420661) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 55s473ms - RowsReturned: 39.89M (39889717) - RowsReturnedRate: 598.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.132us EXCHANGE_NODE (id=9):(Total: 38.010us, non-child: 38.010us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 29.670us - DeserializeRowBatchTimer: 44.566us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 47.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s193ms, non-child: 9s193ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 348 Hdfs split stats (:<# splits>/): 3:23/5.09 GB 6:32/7.70 GB 5:29/6.65 GB 2:35/8.13 GB 8:33/7.65 GB 10:30/6.14 GB 9:38/8.00 GB 1:32/6.93 GB 0:38/8.60 GB 4:26/5.89 GB 7:32/7.02 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:94.96% 1:5.036% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1044 BytesRead(2s000ms): 132.94 MB, 271.60 MB, 284.16 MB, 439.30 MB, 511.27 MB, 562.29 MB, 679.11 MB, 759.22 MB, 854.66 MB, 967.73 MB, 1017.06 MB, 1.14 GB, 1.22 GB, 1.33 GB, 1.45 GB, 1.55 GB, 1.65 GB, 1.75 GB, 1.86 GB, 1.97 GB, 2.05 GB, 2.16 GB, 2.26 GB, 2.34 GB, 2.45 GB, 2.54 GB, 2.64 GB, 2.76 GB, 2.83 GB, 2.95 GB, 3.06 GB, 3.17 GB, 3.25 GB, 3.32 GB, 3.37 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 22.50 - BytesRead: 3.37 GB (3614320828) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.37 GB (3614320828) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.37 GB (3614320828) - DecompressionTime: 12s320ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 348 (348) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 390.35 MB (409308464) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.15B (2150420661) - RowsReturned: 2.15B (2150420661) - RowsReturnedRate: 233.90 M/sec - ScanRangesComplete: 348 (348) - ScannerThreadsInvoluntaryContextSwitches: 81.75K (81755) - ScannerThreadsTotalWallClockTime: 26m2s - MaterializeTupleTime(*): 25m42s - ScannerThreadsSysTime: 2s374ms - ScannerThreadsUserTime: 4m28s - ScannerThreadsVoluntaryContextSwitches: 2.13M (2126997) - TotalRawHdfsReadTime(*): 2s840ms - TotalReadThroughput: 49.24 MB/sec Filter 0: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Filter 1: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Filter 2: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Instance 5e42471e272c7b4a:f7fdeddcf24303b9 (host=d2417.halxg.cloudera.com:22000):(Total: 1m9s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:26/6.00 GB 5:34/8.03 GB 8:34/8.04 GB 1:27/6.08 GB 3:28/6.56 GB 9:29/6.59 GB 7:24/5.54 GB 2:33/7.68 GB 4:38/8.75 GB 6:31/7.06 GB 0:33/7.15 GB MemoryUsage(2s000ms): 178.97 MB, 363.37 MB, 373.11 MB, 370.83 MB, 366.62 MB, 357.37 MB, 352.65 MB, 357.79 MB, 352.50 MB, 390.05 MB, 384.38 MB, 368.78 MB, 368.57 MB, 365.13 MB, 379.28 MB, 391.78 MB, 389.90 MB, 376.23 MB, 363.38 MB, 355.19 MB, 352.97 MB, 358.25 MB, 358.28 MB, 349.20 MB, 368.58 MB, 369.40 MB, 361.09 MB, 368.02 MB, 370.86 MB, 372.60 MB, 370.10 MB, 368.78 MB, 361.54 MB, 340.34 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22 - AverageThreadTokens: 23.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 409.74 MB (429639224) - PerHostPeakMemUsage: 409.74 MB (429639224) - PrepareTime: 173.447ms - RowsProduced: 1 (1) - TotalCpuTime: 26m55s - TotalNetworkReceiveTime: 11.478us - TotalNetworkSendTime: 392.944us - TotalStorageWaitTime: 3s671ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 75 (75) - BlocksRecycled: 21 (21) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 492.949ms, non-child: 492.949ms, % non-child: 100.00%) - CodegenTime: 157.706us - CompileTime: 67.198ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 260.117ms - PrepareTime: 164.238ms DataStreamSender (dst_id=12):(Total: 39.332us, non-child: 39.332us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 46.94 KB/sec - OverallThroughput: 397.26 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.030us - ThriftTransmitTime(*): 332.884us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m9s, non-child: 1s423ms, % non-child: 2.06%) ExecOption: Codegen Enabled - BuildTime: 1s239ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.39 MB (18235288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m7s, non-child: 176.621ms, % non-child: 0.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.302us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 6.582us - GetNewBlockTime: 307.542us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.95 MB (12532312) - PinTime: 0.000ns - ProbeRows: 4.12M (4116185) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 139.330ms - RowsReturned: 454.37K (454368) - RowsReturnedRate: 6.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.590us EXCHANGE_NODE (id=11):(Total: 9.498us, non-child: 9.498us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.136us - DeserializeRowBatchTimer: 9.420us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 842.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m7s, non-child: 1s337ms, % non-child: 1.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 39.232us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 28.414us - GetNewBlockTime: 493.730us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.23 MB (5481544) - PinTime: 0.000ns - ProbeRows: 40.00M (40000143) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s263ms - RowsReturned: 4.12M (4116185) - RowsReturnedRate: 61.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.400us EXCHANGE_NODE (id=10):(Total: 20.912us, non-child: 20.912us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.054us - DeserializeRowBatchTimer: 14.664us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 34.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m6s, non-child: 56s969ms, % non-child: 86.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 113.928us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 60.144us - GetNewBlockTime: 310.496us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.21 MB (2320352) - PinTime: 0.000ns - ProbeRows: 2.14B (2140590908) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 54s977ms - RowsReturned: 40.00M (40000143) - RowsReturnedRate: 605.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.420us EXCHANGE_NODE (id=9):(Total: 45.598us, non-child: 45.598us, % non-child: 100.00%) BytesReceived(2s000ms): 19.89 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 36.994us - DeserializeRowBatchTimer: 44.160us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 39.48 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s094ms, non-child: 9s094ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 337 Hdfs split stats (:<# splits>/): 10:26/6.00 GB 5:34/8.03 GB 8:34/8.04 GB 1:27/6.08 GB 3:28/6.56 GB 9:29/6.59 GB 7:24/5.54 GB 2:33/7.68 GB 4:38/8.75 GB 6:31/7.06 GB 0:33/7.15 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:97.83% 1:2.174% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1011 BytesRead(2s000ms): 116.57 MB, 238.31 MB, 269.11 MB, 455.63 MB, 494.35 MB, 612.73 MB, 712.49 MB, 768.08 MB, 920.65 MB, 1014.26 MB, 1.09 GB, 1.18 GB, 1.28 GB, 1.39 GB, 1.50 GB, 1.60 GB, 1.71 GB, 1.80 GB, 1.89 GB, 1.98 GB, 2.07 GB, 2.16 GB, 2.26 GB, 2.34 GB, 2.48 GB, 2.56 GB, 2.67 GB, 2.76 GB, 2.85 GB, 2.97 GB, 3.06 GB, 3.17 GB, 3.27 GB, 3.36 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.44 - BytesRead: 3.37 GB (3623280534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.37 GB (3623280534) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.37 GB (3623280534) - DecompressionTime: 12s438ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 337 (337) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 398.26 MB (417608928) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.14B (2140590908) - RowsReturned: 2.14B (2140590908) - RowsReturnedRate: 235.37 M/sec - ScanRangesComplete: 337 (337) - ScannerThreadsInvoluntaryContextSwitches: 81.17K (81170) - ScannerThreadsTotalWallClockTime: 25m50s - MaterializeTupleTime(*): 25m31s - ScannerThreadsSysTime: 2s256ms - ScannerThreadsUserTime: 4m26s - ScannerThreadsVoluntaryContextSwitches: 2.11M (2113221) - TotalRawHdfsReadTime(*): 1s796ms - TotalReadThroughput: 49.72 MB/sec Filter 0: - Rows processed: 5.52M (5521071) - Rows rejected: 0 (0) - Rows total: 5.52M (5521408) Filter 1: - Rows processed: 5.52M (5521071) - Rows rejected: 0 (0) - Rows total: 5.52M (5521408) Filter 2: - Rows processed: 5.52M (5521071) - Rows rejected: 0 (0) - Rows total: 5.52M (5521408) Instance 5e42471e272c7b4a:f7fdeddcf24303bd (host=d2419.halxg.cloudera.com:22000):(Total: 1m8s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:28/6.46 GB 10:29/6.68 GB 8:30/6.60 GB 2:25/5.56 GB 4:33/7.65 GB 9:28/6.59 GB 0:39/8.59 GB 1:36/7.95 GB 3:35/7.92 GB 7:31/7.11 GB 5:29/6.71 GB MemoryUsage(2s000ms): 175.14 MB, 360.73 MB, 366.97 MB, 346.18 MB, 365.62 MB, 352.31 MB, 352.16 MB, 350.66 MB, 355.46 MB, 354.21 MB, 344.48 MB, 361.78 MB, 368.77 MB, 394.48 MB, 378.82 MB, 359.69 MB, 367.55 MB, 369.58 MB, 366.85 MB, 365.45 MB, 393.18 MB, 386.53 MB, 380.53 MB, 369.30 MB, 366.23 MB, 366.25 MB, 361.37 MB, 368.98 MB, 383.92 MB, 364.12 MB, 368.08 MB, 366.69 MB, 362.86 MB, 322.91 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 21 - AverageThreadTokens: 23.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 405.69 MB (425401424) - PerHostPeakMemUsage: 405.69 MB (425401424) - PrepareTime: 171.985ms - RowsProduced: 1 (1) - TotalCpuTime: 26m51s - TotalNetworkReceiveTime: 12.070us - TotalNetworkSendTime: 457.874us - TotalStorageWaitTime: 6s288ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 83 (83) - BlocksRecycled: 13 (13) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 491.754ms, non-child: 491.754ms, % non-child: 100.00%) - CodegenTime: 161.546us - CompileTime: 68.155ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 259.419ms - PrepareTime: 162.773ms DataStreamSender (dst_id=12):(Total: 30.032us, non-child: 30.032us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 44.07 KB/sec - OverallThroughput: 520.28 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.108us - ThriftTransmitTime(*): 354.544us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m8s, non-child: 1s473ms, % non-child: 2.14%) ExecOption: Codegen Enabled - BuildTime: 1s288ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.83 MB (18692840) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m7s, non-child: 183.065ms, % non-child: 0.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.842us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 5.806us - GetNewBlockTime: 424.402us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.58 MB (12137472) - PinTime: 0.000ns - ProbeRows: 4.11M (4107506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 146.612ms - RowsReturned: 406.77K (406770) - RowsReturnedRate: 6.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.500us EXCHANGE_NODE (id=11):(Total: 8.980us, non-child: 8.980us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.040us - DeserializeRowBatchTimer: 10.502us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 890.87 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m7s, non-child: 1s355ms, % non-child: 2.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 36.360us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.122us - GetNewBlockTime: 437.634us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.01 MB (5254088) - PinTime: 0.000ns - ProbeRows: 40.77M (40772507) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s277ms - RowsReturned: 4.11M (4107506) - RowsReturnedRate: 61.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.642us EXCHANGE_NODE (id=10):(Total: 20.692us, non-child: 20.692us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.022us - DeserializeRowBatchTimer: 14.468us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 34.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m5s, non-child: 56s589ms, % non-child: 85.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 62.252us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.836us - GetNewBlockTime: 401.358us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.16 MB (2260528) - PinTime: 0.000ns - ProbeRows: 2.15B (2150698993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 54s424ms - RowsReturned: 40.77M (40772507) - RowsReturnedRate: 619.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.266us EXCHANGE_NODE (id=9):(Total: 38.826us, non-child: 38.826us, % non-child: 100.00%) BytesReceived(2s000ms): 19.89 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.832us - DeserializeRowBatchTimer: 45.956us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 46.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s252ms, non-child: 9s252ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 343 Hdfs split stats (:<# splits>/): 6:28/6.46 GB 10:29/6.68 GB 8:30/6.60 GB 2:25/5.56 GB 4:33/7.65 GB 9:28/6.59 GB 0:39/8.59 GB 1:36/7.95 GB 3:35/7.92 GB 7:31/7.11 GB 5:29/6.71 GB Runtime filters: Only following filters arrived: , waited 503ms Hdfs Read Thread Concurrency Bucket: 0:96.35% 1:3.65% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1029 BytesRead(2s000ms): 114.85 MB, 240.97 MB, 277.35 MB, 434.62 MB, 498.06 MB, 550.60 MB, 694.81 MB, 749.17 MB, 884.90 MB, 957.61 MB, 1.04 GB, 1.15 GB, 1.22 GB, 1.40 GB, 1.45 GB, 1.56 GB, 1.68 GB, 1.74 GB, 1.88 GB, 1.96 GB, 2.10 GB, 2.19 GB, 2.27 GB, 2.38 GB, 2.48 GB, 2.58 GB, 2.68 GB, 2.78 GB, 2.90 GB, 2.99 GB, 3.09 GB, 3.19 GB, 3.28 GB, 3.36 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 22.61 - BytesRead: 3.37 GB (3616853718) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.37 GB (3616853718) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.37 GB (3616853718) - DecompressionTime: 12s199ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 343 (343) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 390.48 MB (409450088) - PerReadThreadRawHdfsThroughput: 974.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.15B (2150698993) - RowsReturned: 2.15B (2150698993) - RowsReturnedRate: 232.46 M/sec - ScanRangesComplete: 343 (343) - ScannerThreadsInvoluntaryContextSwitches: 82.58K (82581) - ScannerThreadsTotalWallClockTime: 25m48s - MaterializeTupleTime(*): 25m27s - ScannerThreadsSysTime: 2s115ms - ScannerThreadsUserTime: 4m23s - ScannerThreadsVoluntaryContextSwitches: 2.13M (2125737) - TotalRawHdfsReadTime(*): 3s539ms - TotalReadThroughput: 49.99 MB/sec Filter 0: - Rows processed: 5.62M (5619369) - Rows rejected: 0 (0) - Rows total: 5.62M (5619712) Filter 1: - Rows processed: 5.62M (5619369) - Rows rejected: 0 (0) - Rows total: 5.62M (5619712) Filter 2: - Rows processed: 5.62M (5619369) - Rows rejected: 0 (0) - Rows total: 5.62M (5619712) Instance 5e42471e272c7b4a:f7fdeddcf24303c0 (host=d2416.halxg.cloudera.com:22000):(Total: 1m7s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:32/7.02 GB 9:29/6.69 GB 3:35/7.40 GB 5:33/7.23 GB 10:28/6.44 GB 6:29/6.60 GB 0:29/6.58 GB 2:33/6.68 GB 1:35/7.87 GB 8:35/8.15 GB 7:33/7.39 GB MemoryUsage(2s000ms): 161.23 MB, 341.24 MB, 370.43 MB, 355.56 MB, 355.24 MB, 336.25 MB, 342.79 MB, 360.85 MB, 352.15 MB, 379.62 MB, 365.41 MB, 353.99 MB, 355.41 MB, 339.86 MB, 352.78 MB, 366.16 MB, 366.82 MB, 382.96 MB, 362.93 MB, 373.35 MB, 363.11 MB, 358.57 MB, 389.35 MB, 389.11 MB, 385.64 MB, 365.50 MB, 358.23 MB, 361.28 MB, 355.83 MB, 349.17 MB, 358.83 MB, 380.82 MB, 359.27 MB, 288.08 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 19 - AverageThreadTokens: 23.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 406.32 MB (426053304) - PerHostPeakMemUsage: 406.32 MB (426053304) - PrepareTime: 171.982ms - RowsProduced: 1 (1) - TotalCpuTime: 26m33s - TotalNetworkReceiveTime: 10.762us - TotalNetworkSendTime: 384.718us - TotalStorageWaitTime: 4s873ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 489.878ms, non-child: 489.878ms, % non-child: 100.00%) - CodegenTime: 151.106us - CompileTime: 66.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 258.774ms - PrepareTime: 162.934ms DataStreamSender (dst_id=12):(Total: 38.998us, non-child: 38.998us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 56.73 KB/sec - OverallThroughput: 400.66 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 7.862us - ThriftTransmitTime(*): 275.446us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m7s, non-child: 1s499ms, % non-child: 2.21%) ExecOption: Codegen Enabled - BuildTime: 1s284ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.25 MB (18092088) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m6s, non-child: 174.108ms, % non-child: 0.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.652us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 4.124us - GetNewBlockTime: 68.826us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.70 MB (12269568) - PinTime: 0.000ns - ProbeRows: 4.03M (4026009) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 137.622ms - RowsReturned: 398.47K (398473) - RowsReturnedRate: 6.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.074us EXCHANGE_NODE (id=11):(Total: 10.142us, non-child: 10.142us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.092us - DeserializeRowBatchTimer: 6.386us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 788.80 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m6s, non-child: 1s346ms, % non-child: 2.03%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 37.748us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 26.442us - GetNewBlockTime: 285.458us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.94 MB (5183704) - PinTime: 0.000ns - ProbeRows: 41.42M (41418911) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s263ms - RowsReturned: 4.03M (4026009) - RowsReturnedRate: 60.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.228us EXCHANGE_NODE (id=10):(Total: 20.962us, non-child: 20.962us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 11.834us - DeserializeRowBatchTimer: 15.830us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 34.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m4s, non-child: 55s909ms, % non-child: 86.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 74.086us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 60.680us - GetNewBlockTime: 180.198us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.20 MB (2301824) - PinTime: 0.000ns - ProbeRows: 2.16B (2163417423) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53s516ms - RowsReturned: 41.42M (41418911) - RowsReturnedRate: 637.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 952.000ns EXCHANGE_NODE (id=9):(Total: 35.734us, non-child: 35.734us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.446us - DeserializeRowBatchTimer: 42.110us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 50.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s024ms, non-child: 9s024ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 351 Hdfs split stats (:<# splits>/): 4:32/7.02 GB 9:29/6.69 GB 3:35/7.40 GB 5:33/7.23 GB 10:28/6.44 GB 6:29/6.60 GB 0:29/6.58 GB 2:33/6.68 GB 1:35/7.87 GB 8:35/8.15 GB 7:33/7.39 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:96.32% 1:3.676% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1053 BytesRead(2s000ms): 151.69 MB, 227.67 MB, 302.79 MB, 444.70 MB, 508.19 MB, 612.65 MB, 723.69 MB, 806.74 MB, 910.72 MB, 1.01 GB, 1.10 GB, 1.20 GB, 1.28 GB, 1.36 GB, 1.49 GB, 1.58 GB, 1.70 GB, 1.78 GB, 1.88 GB, 2.01 GB, 2.09 GB, 2.23 GB, 2.32 GB, 2.45 GB, 2.53 GB, 2.62 GB, 2.75 GB, 2.81 GB, 2.92 GB, 3.01 GB, 3.14 GB, 3.23 GB, 3.34 GB, 3.37 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 22.57 - BytesRead: 3.37 GB (3617285898) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.37 GB (3617285898) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.37 GB (3617285898) - DecompressionTime: 12s357ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 351 (351) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 392.12 MB (411170512) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2163417423) - RowsReturned: 2.16B (2163417423) - RowsReturnedRate: 239.74 M/sec - ScanRangesComplete: 351 (351) - ScannerThreadsInvoluntaryContextSwitches: 85.59K (85593) - ScannerThreadsTotalWallClockTime: 25m30s - MaterializeTupleTime(*): 25m10s - ScannerThreadsSysTime: 2s232ms - ScannerThreadsUserTime: 4m27s - ScannerThreadsVoluntaryContextSwitches: 2.13M (2134903) - TotalRawHdfsReadTime(*): 2s771ms - TotalReadThroughput: 50.73 MB/sec Filter 0: - Rows processed: 5.75M (5750433) - Rows rejected: 0 (0) - Rows total: 5.75M (5750784) Filter 1: - Rows processed: 5.75M (5750433) - Rows rejected: 0 (0) - Rows total: 5.75M (5750784) Filter 2: - Rows processed: 5.75M (5750433) - Rows rejected: 0 (0) - Rows total: 5.75M (5750784) Instance 5e42471e272c7b4a:f7fdeddcf24303be (host=d2405.halxg.cloudera.com:22000):(Total: 1m7s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:26/5.91 GB 4:33/7.59 GB 8:28/6.35 GB 1:29/6.79 GB 9:28/6.29 GB 5:34/7.65 GB 6:27/6.32 GB 2:40/8.73 GB 3:34/7.64 GB 7:33/7.05 GB 10:33/7.62 GB MemoryUsage(2s000ms): 180.34 MB, 376.72 MB, 383.95 MB, 378.74 MB, 375.62 MB, 362.61 MB, 365.54 MB, 366.89 MB, 378.47 MB, 378.76 MB, 374.61 MB, 375.84 MB, 375.56 MB, 373.90 MB, 366.17 MB, 352.33 MB, 346.88 MB, 387.07 MB, 382.36 MB, 364.51 MB, 371.98 MB, 367.53 MB, 363.15 MB, 353.42 MB, 343.93 MB, 331.85 MB, 357.77 MB, 364.93 MB, 362.20 MB, 373.35 MB, 380.61 MB, 349.41 MB, 338.93 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 23.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 408.35 MB (428189232) - PerHostPeakMemUsage: 408.35 MB (428189232) - PrepareTime: 172.530ms - RowsProduced: 1 (1) - TotalCpuTime: 26m22s - TotalNetworkReceiveTime: 12.680us - TotalNetworkSendTime: 410.992us - TotalStorageWaitTime: 5s514ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 82 (82) - BlocksRecycled: 14 (14) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 492.502ms, non-child: 492.502ms, % non-child: 100.00%) - CodegenTime: 146.968us - CompileTime: 67.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 260.434ms - PrepareTime: 163.283ms DataStreamSender (dst_id=12):(Total: 28.164us, non-child: 28.164us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 44.49 KB/sec - OverallThroughput: 554.79 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.800us - ThriftTransmitTime(*): 351.196us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m7s, non-child: 1s384ms, % non-child: 2.05%) ExecOption: Codegen Enabled - BuildTime: 1s199ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.77 MB (18636520) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m6s, non-child: 184.440ms, % non-child: 0.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.364us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 5.106us - GetNewBlockTime: 416.832us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.01 MB (12588936) - PinTime: 0.000ns - ProbeRows: 4.10M (4102344) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 146.873ms - RowsReturned: 540.50K (540501) - RowsReturnedRate: 8.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.320us EXCHANGE_NODE (id=11):(Total: 9.138us, non-child: 9.138us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.144us - DeserializeRowBatchTimer: 5.554us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 875.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m5s, non-child: 1s278ms, % non-child: 1.94%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 38.634us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.846us - GetNewBlockTime: 578.972us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.30 MB (5562224) - PinTime: 0.000ns - ProbeRows: 40.04M (40038907) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s200ms - RowsReturned: 4.10M (4102344) - RowsReturnedRate: 62.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.362us EXCHANGE_NODE (id=10):(Total: 21.294us, non-child: 21.294us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.288us - DeserializeRowBatchTimer: 22.550us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 33.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m4s, non-child: 55s636ms, % non-child: 86.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 75.272us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 60.318us - GetNewBlockTime: 387.328us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.19 MB (2300120) - PinTime: 0.000ns - ProbeRows: 2.15B (2153334698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53s582ms - RowsReturned: 40.04M (40038907) - RowsReturnedRate: 619.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.032us EXCHANGE_NODE (id=9):(Total: 50.196us, non-child: 50.196us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 41.188us - DeserializeRowBatchTimer: 42.564us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 35.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s021ms, non-child: 9s021ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 345 Hdfs split stats (:<# splits>/): 0:26/5.91 GB 4:33/7.59 GB 8:28/6.35 GB 1:29/6.79 GB 9:28/6.29 GB 5:34/7.65 GB 6:27/6.32 GB 2:40/8.73 GB 3:34/7.64 GB 7:33/7.05 GB 10:33/7.62 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:91.04% 1:8.955% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1035 BytesRead(2s000ms): 115.87 MB, 247.93 MB, 302.63 MB, 494.84 MB, 535.35 MB, 676.56 MB, 759.80 MB, 842.88 MB, 991.61 MB, 1.03 GB, 1.16 GB, 1.24 GB, 1.35 GB, 1.45 GB, 1.52 GB, 1.63 GB, 1.71 GB, 1.86 GB, 1.95 GB, 2.04 GB, 2.16 GB, 2.24 GB, 2.34 GB, 2.45 GB, 2.52 GB, 2.64 GB, 2.75 GB, 2.83 GB, 2.94 GB, 3.04 GB, 3.17 GB, 3.25 GB, 3.37 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 22.63 - BytesRead: 3.39 GB (3637655035) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3637655035) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3637655035) - DecompressionTime: 12s388ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 345 (345) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 395.56 MB (414778488) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.15B (2153334698) - RowsReturned: 2.15B (2153334698) - RowsReturnedRate: 238.70 M/sec - ScanRangesComplete: 345 (345) - ScannerThreadsInvoluntaryContextSwitches: 76.29K (76289) - ScannerThreadsTotalWallClockTime: 25m20s - MaterializeTupleTime(*): 24m59s - ScannerThreadsSysTime: 2s261ms - ScannerThreadsUserTime: 4m26s - ScannerThreadsVoluntaryContextSwitches: 2.13M (2130519) - TotalRawHdfsReadTime(*): 3s282ms - TotalReadThroughput: 51.39 MB/sec Filter 0: - Rows processed: 5.65M (5652135) - Rows rejected: 0 (0) - Rows total: 5.65M (5652480) Filter 1: - Rows processed: 5.65M (5652135) - Rows rejected: 0 (0) - Rows total: 5.65M (5652480) Filter 2: - Rows processed: 5.65M (5652135) - Rows rejected: 0 (0) - Rows total: 5.65M (5652480) Instance 5e42471e272c7b4a:f7fdeddcf24303c6 (host=d2408.halxg.cloudera.com:22000):(Total: 1m7s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:27/6.22 GB 9:25/5.86 GB 7:31/7.18 GB 8:29/6.26 GB 1:46/9.75 GB 4:30/6.75 GB 2:30/6.55 GB 10:38/8.35 GB 3:38/8.50 GB 6:35/7.92 GB 5:20/4.79 GB MemoryUsage(2s000ms): 103.48 MB, 373.01 MB, 362.71 MB, 337.34 MB, 366.50 MB, 377.38 MB, 372.85 MB, 373.15 MB, 370.68 MB, 385.89 MB, 364.92 MB, 358.69 MB, 355.78 MB, 361.00 MB, 372.87 MB, 369.42 MB, 376.24 MB, 362.80 MB, 362.09 MB, 364.69 MB, 379.35 MB, 359.24 MB, 361.39 MB, 376.86 MB, 364.59 MB, 348.05 MB, 357.30 MB, 360.80 MB, 363.02 MB, 361.51 MB, 358.84 MB, 364.90 MB, 358.90 MB, 231.53 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23, 15 - AverageThreadTokens: 23.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 396.50 MB (415763872) - PerHostPeakMemUsage: 396.50 MB (415763872) - PrepareTime: 171.456ms - RowsProduced: 1 (1) - TotalCpuTime: 26m19s - TotalNetworkReceiveTime: 11.558us - TotalNetworkSendTime: 223.760us - TotalStorageWaitTime: 5s214ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 489.449ms, non-child: 489.449ms, % non-child: 100.00%) - CodegenTime: 157.530us - CompileTime: 67.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 258.446ms - PrepareTime: 161.949ms DataStreamSender (dst_id=12):(Total: 39.208us, non-child: 39.208us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 78.39 KB/sec - OverallThroughput: 398.51 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 19.202us - ThriftTransmitTime(*): 199.328us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m7s, non-child: 1s452ms, % non-child: 2.15%) ExecOption: Codegen Enabled - BuildTime: 1s268ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.70 MB (17513552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m5s, non-child: 183.408ms, % non-child: 0.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.628us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 2.776us - GetNewBlockTime: 61.606us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.86 MB (12436648) - PinTime: 0.000ns - ProbeRows: 3.99M (3986111) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.297ms - RowsReturned: 477.96K (477956) - RowsReturnedRate: 7.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 970.000ns EXCHANGE_NODE (id=11):(Total: 8.090us, non-child: 8.090us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.112us - DeserializeRowBatchTimer: 8.564us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 988.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m5s, non-child: 1s413ms, % non-child: 2.15%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 36.948us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 28.296us - GetNewBlockTime: 231.844us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.87 MB (6155144) - PinTime: 0.000ns - ProbeRows: 41.23M (41226381) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s333ms - RowsReturned: 3.99M (3986111) - RowsReturnedRate: 60.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.256us EXCHANGE_NODE (id=10):(Total: 22.052us, non-child: 22.052us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.284us - DeserializeRowBatchTimer: 16.496us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 32.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m4s, non-child: 55s331ms, % non-child: 85.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 101.154us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.402us - GetNewBlockTime: 154.372us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.17 MB (2273032) - PinTime: 0.000ns - ProbeRows: 2.17B (2169707188) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53s175ms - RowsReturned: 41.23M (41226381) - RowsReturnedRate: 640.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 948.000ns EXCHANGE_NODE (id=9):(Total: 39.094us, non-child: 39.094us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 29.186us - DeserializeRowBatchTimer: 69.002us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 46.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s045ms, non-child: 9s045ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 349 Hdfs split stats (:<# splits>/): 0:27/6.22 GB 9:25/5.86 GB 7:31/7.18 GB 8:29/6.26 GB 1:46/9.75 GB 4:30/6.75 GB 2:30/6.55 GB 10:38/8.35 GB 3:38/8.50 GB 6:35/7.92 GB 5:20/4.79 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:97.04% 1:2.222% 2:0% 3:0.7407% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1047 BytesRead(2s000ms): 123.09 MB, 254.84 MB, 319.92 MB, 478.15 MB, 538.45 MB, 695.07 MB, 767.45 MB, 881.81 MB, 994.08 MB, 1.05 GB, 1.15 GB, 1.24 GB, 1.33 GB, 1.45 GB, 1.55 GB, 1.64 GB, 1.74 GB, 1.82 GB, 1.92 GB, 2.03 GB, 2.11 GB, 2.20 GB, 2.32 GB, 2.43 GB, 2.51 GB, 2.64 GB, 2.72 GB, 2.84 GB, 2.95 GB, 3.04 GB, 3.18 GB, 3.25 GB, 3.37 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 22.55 - BytesRead: 3.39 GB (3641223511) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3641223511) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3641223511) - DecompressionTime: 12s665ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 349 (349) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 384.14 MB (402796840) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2169707188) - RowsReturned: 2.17B (2169707188) - RowsReturnedRate: 239.86 M/sec - ScanRangesComplete: 349 (349) - ScannerThreadsInvoluntaryContextSwitches: 87.44K (87435) - ScannerThreadsTotalWallClockTime: 25m17s - MaterializeTupleTime(*): 24m56s - ScannerThreadsSysTime: 2s274ms - ScannerThreadsUserTime: 4m36s - ScannerThreadsVoluntaryContextSwitches: 2.15M (2153095) - TotalRawHdfsReadTime(*): 2s990ms - TotalReadThroughput: 51.45 MB/sec Filter 0: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Filter 1: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Filter 2: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Instance 5e42471e272c7b4a:f7fdeddcf24303bf (host=d2414.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:20/4.77 GB 9:30/6.29 GB 4:30/6.63 GB 1:31/6.87 GB 3:32/7.23 GB 6:25/5.53 GB 5:43/9.43 GB 8:31/7.10 GB 7:36/7.87 GB 0:39/8.66 GB 10:33/7.58 GB MemoryUsage(2s000ms): 175.51 MB, 359.02 MB, 380.37 MB, 376.40 MB, 368.78 MB, 371.52 MB, 370.41 MB, 381.20 MB, 369.99 MB, 358.86 MB, 362.25 MB, 374.69 MB, 384.63 MB, 366.53 MB, 362.09 MB, 348.21 MB, 363.99 MB, 363.12 MB, 373.15 MB, 377.19 MB, 368.68 MB, 360.65 MB, 369.07 MB, 375.07 MB, 360.72 MB, 347.13 MB, 371.42 MB, 370.14 MB, 357.33 MB, 363.58 MB, 356.30 MB, 338.38 MB, 311.90 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 20 - AverageThreadTokens: 23.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 400.04 MB (419471280) - PerHostPeakMemUsage: 400.04 MB (419471280) - PrepareTime: 170.815ms - RowsProduced: 1 (1) - TotalCpuTime: 26m1s - TotalNetworkReceiveTime: 11.426us - TotalNetworkSendTime: 381.744us - TotalStorageWaitTime: 3s969ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 488.447ms, non-child: 488.447ms, % non-child: 100.00%) - CodegenTime: 160.856us - CompileTime: 67.819ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 257.678ms - PrepareTime: 161.558ms DataStreamSender (dst_id=12):(Total: 41.462us, non-child: 41.462us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 54.78 KB/sec - OverallThroughput: 376.85 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 17.702us - ThriftTransmitTime(*): 285.208us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s481ms, % non-child: 2.22%) ExecOption: Codegen Enabled - BuildTime: 1s294ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.65 MB (17454832) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m5s, non-child: 196.259ms, % non-child: 0.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.478us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 4.086us - GetNewBlockTime: 65.830us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.91 MB (12493304) - PinTime: 0.000ns - ProbeRows: 3.97M (3968367) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 157.759ms - RowsReturned: 494.16K (494162) - RowsReturnedRate: 7.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 992.000ns EXCHANGE_NODE (id=11):(Total: 10.002us, non-child: 10.002us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.134us - DeserializeRowBatchTimer: 6.068us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 799.84 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s352ms, % non-child: 2.08%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 39.368us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.104us - GetNewBlockTime: 300.740us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.74 MB (6022080) - PinTime: 0.000ns - ProbeRows: 40.91M (40914694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s270ms - RowsReturned: 3.97M (3968367) - RowsReturnedRate: 61.08 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.246us EXCHANGE_NODE (id=10):(Total: 20.510us, non-child: 20.510us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 11.952us - DeserializeRowBatchTimer: 17.104us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 35.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m3s, non-child: 54s728ms, % non-child: 86.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 72.124us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 61.902us - GetNewBlockTime: 209.530us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.17 MB (2280632) - PinTime: 0.000ns - ProbeRows: 2.17B (2166238732) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52s578ms - RowsReturned: 40.91M (40914694) - RowsReturnedRate: 643.10 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 970.000ns EXCHANGE_NODE (id=9):(Total: 39.658us, non-child: 39.658us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 30.464us - DeserializeRowBatchTimer: 65.536us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 45.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s892ms, non-child: 8s892ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 350 Hdfs split stats (:<# splits>/): 2:20/4.77 GB 9:30/6.29 GB 4:30/6.63 GB 1:31/6.87 GB 3:32/7.23 GB 6:25/5.53 GB 5:43/9.43 GB 8:31/7.10 GB 7:36/7.87 GB 0:39/8.66 GB 10:33/7.58 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:98.5% 1:1.504% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1050 BytesRead(2s000ms): 114.41 MB, 241.67 MB, 319.46 MB, 482.86 MB, 527.01 MB, 696.61 MB, 768.98 MB, 892.66 MB, 1000.38 MB, 1.05 GB, 1.19 GB, 1.28 GB, 1.41 GB, 1.48 GB, 1.58 GB, 1.70 GB, 1.78 GB, 1.91 GB, 2.01 GB, 2.14 GB, 2.23 GB, 2.34 GB, 2.44 GB, 2.55 GB, 2.63 GB, 2.71 GB, 2.84 GB, 2.91 GB, 3.03 GB, 3.12 GB, 3.21 GB, 3.30 GB, 3.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.46 - BytesRead: 3.39 GB (3641748817) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3641748817) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3641748817) - DecompressionTime: 12s355ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 350 (350) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 387.82 MB (406659584) - PerReadThreadRawHdfsThroughput: 1.72 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2166238732) - RowsReturned: 2.17B (2166238732) - RowsReturnedRate: 243.61 M/sec - ScanRangesComplete: 350 (350) - ScannerThreadsInvoluntaryContextSwitches: 84.38K (84377) - ScannerThreadsTotalWallClockTime: 24m58s - MaterializeTupleTime(*): 24m39s - ScannerThreadsSysTime: 2s130ms - ScannerThreadsUserTime: 4m27s - ScannerThreadsVoluntaryContextSwitches: 2.15M (2150510) - TotalRawHdfsReadTime(*): 1s975ms - TotalReadThroughput: 51.84 MB/sec Filter 0: - Rows processed: 5.73M (5734050) - Rows rejected: 0 (0) - Rows total: 5.73M (5734400) Filter 1: - Rows processed: 5.73M (5734050) - Rows rejected: 0 (0) - Rows total: 5.73M (5734400) Filter 2: - Rows processed: 5.73M (5734050) - Rows rejected: 0 (0) - Rows total: 5.73M (5734400) Instance 5e42471e272c7b4a:f7fdeddcf24303b4 (host=d2406.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:35/7.94 GB 6:36/8.17 GB 4:33/7.49 GB 8:29/6.53 GB 2:28/6.51 GB 1:32/7.26 GB 3:30/7.06 GB 7:34/7.87 GB 0:28/6.62 GB 5:22/4.80 GB 9:33/7.62 GB MemoryUsage(2s000ms): 187.55 MB, 375.59 MB, 369.44 MB, 360.59 MB, 362.85 MB, 352.58 MB, 366.62 MB, 358.44 MB, 353.86 MB, 377.65 MB, 388.33 MB, 369.16 MB, 343.05 MB, 340.46 MB, 351.37 MB, 360.70 MB, 374.76 MB, 383.89 MB, 362.14 MB, 361.23 MB, 350.19 MB, 370.66 MB, 388.58 MB, 384.31 MB, 361.52 MB, 360.06 MB, 376.12 MB, 387.75 MB, 386.56 MB, 365.10 MB, 353.06 MB, 357.07 MB, 312.61 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 20 - AverageThreadTokens: 23.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 402.56 MB (422119448) - PerHostPeakMemUsage: 402.56 MB (422119448) - PrepareTime: 175.980ms - RowsProduced: 1 (1) - TotalCpuTime: 25m56s - TotalNetworkReceiveTime: 11.326us - TotalNetworkSendTime: 287.072us - TotalStorageWaitTime: 4s186ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 494.961ms, non-child: 494.961ms, % non-child: 100.00%) - CodegenTime: 156.150us - CompileTime: 67.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 259.035ms - PrepareTime: 166.779ms DataStreamSender (dst_id=12):(Total: 35.340us, non-child: 35.340us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 66.32 KB/sec - OverallThroughput: 442.13 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 7.578us - ThriftTransmitTime(*): 235.614us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s589ms, % non-child: 2.39%) ExecOption: Codegen Enabled - BuildTime: 1s350ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.73 MB (18588320) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m4s, non-child: 190.150ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.766us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 7.494us - GetNewBlockTime: 555.602us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.02 MB (12602120) - PinTime: 0.000ns - ProbeRows: 4.08M (4078323) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 152.387ms - RowsReturned: 550.81K (550806) - RowsReturnedRate: 8.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.262us EXCHANGE_NODE (id=11):(Total: 9.270us, non-child: 9.270us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.116us - DeserializeRowBatchTimer: 5.116us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 863.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s340ms, % non-child: 2.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 29.140us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 28.634us - GetNewBlockTime: 710.926us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.85 MB (5084920) - PinTime: 0.000ns - ProbeRows: 40.55M (40545345) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s261ms - RowsReturned: 4.08M (4078323) - RowsReturnedRate: 62.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.224us EXCHANGE_NODE (id=10):(Total: 30.824us, non-child: 30.824us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.478us - DeserializeRowBatchTimer: 20.892us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 23.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m3s, non-child: 54s368ms, % non-child: 85.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 69.052us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 60.750us - GetNewBlockTime: 846.866us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.18 MB (2282008) - PinTime: 0.000ns - ProbeRows: 2.16B (2161184859) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52s339ms - RowsReturned: 40.55M (40545345) - RowsReturnedRate: 639.21 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.342us EXCHANGE_NODE (id=9):(Total: 36.734us, non-child: 36.734us, % non-child: 100.00%) BytesReceived(2s000ms): 19.89 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 29.154us - DeserializeRowBatchTimer: 49.416us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 49.00 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s061ms, non-child: 9s061ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 340 Hdfs split stats (:<# splits>/): 10:35/7.94 GB 6:36/8.17 GB 4:33/7.49 GB 8:29/6.53 GB 2:28/6.51 GB 1:32/7.26 GB 3:30/7.06 GB 7:34/7.87 GB 0:28/6.62 GB 5:22/4.80 GB 9:33/7.62 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:97.74% 1:2.256% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1020 BytesRead(2s000ms): 122.88 MB, 245.77 MB, 280.25 MB, 471.03 MB, 491.11 MB, 648.79 MB, 734.67 MB, 807.41 MB, 945.15 MB, 1.01 GB, 1.15 GB, 1.21 GB, 1.32 GB, 1.40 GB, 1.53 GB, 1.62 GB, 1.74 GB, 1.86 GB, 1.94 GB, 2.06 GB, 2.13 GB, 2.29 GB, 2.38 GB, 2.48 GB, 2.59 GB, 2.67 GB, 2.80 GB, 2.90 GB, 3.03 GB, 3.09 GB, 3.21 GB, 3.31 GB, 3.37 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.46 - BytesRead: 3.38 GB (3628658630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.38 GB (3628658630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.38 GB (3628658630) - DecompressionTime: 12s610ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 340 (340) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 390.54 MB (409515960) - PerReadThreadRawHdfsThroughput: 1.67 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2161184859) - RowsReturned: 2.16B (2161184859) - RowsReturnedRate: 238.51 M/sec - ScanRangesComplete: 340 (340) - ScannerThreadsInvoluntaryContextSwitches: 87.04K (87042) - ScannerThreadsTotalWallClockTime: 24m53s - MaterializeTupleTime(*): 24m34s - ScannerThreadsSysTime: 2s460ms - ScannerThreadsUserTime: 4m34s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2142932) - TotalRawHdfsReadTime(*): 2s021ms - TotalReadThroughput: 51.65 MB/sec Filter 0: - Rows processed: 5.57M (5570220) - Rows rejected: 0 (0) - Rows total: 5.57M (5570560) Filter 1: - Rows processed: 5.57M (5570220) - Rows rejected: 0 (0) - Rows total: 5.57M (5570560) Filter 2: - Rows processed: 5.57M (5570220) - Rows rejected: 0 (0) - Rows total: 5.57M (5570560) Instance 5e42471e272c7b4a:f7fdeddcf24303bc (host=d2409.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:28/6.36 GB 1:21/4.78 GB 5:26/5.79 GB 6:34/7.26 GB 2:31/6.77 GB 7:37/8.44 GB 10:34/7.64 GB 0:40/8.82 GB 4:28/6.06 GB 8:37/8.29 GB 9:37/7.81 GB MemoryUsage(2s000ms): 151.95 MB, 358.40 MB, 363.43 MB, 371.18 MB, 363.22 MB, 377.28 MB, 380.59 MB, 358.89 MB, 351.21 MB, 365.02 MB, 339.11 MB, 363.47 MB, 365.56 MB, 361.20 MB, 353.21 MB, 347.10 MB, 366.65 MB, 358.14 MB, 374.99 MB, 366.83 MB, 361.82 MB, 349.77 MB, 362.17 MB, 383.40 MB, 379.60 MB, 392.32 MB, 403.64 MB, 369.29 MB, 336.68 MB, 372.43 MB, 368.78 MB, 356.43 MB, 336.97 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 22 - AverageThreadTokens: 23.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 420.02 MB (440423736) - PerHostPeakMemUsage: 420.02 MB (440423736) - PrepareTime: 173.049ms - RowsProduced: 1 (1) - TotalCpuTime: 25m59s - TotalNetworkReceiveTime: 11.442us - TotalNetworkSendTime: 249.072us - TotalStorageWaitTime: 4s846ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 66 (66) - BlocksRecycled: 30 (30) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 492.721ms, non-child: 492.721ms, % non-child: 100.00%) - CodegenTime: 159.094us - CompileTime: 67.408ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 260.151ms - PrepareTime: 163.759ms DataStreamSender (dst_id=12):(Total: 27.326us, non-child: 27.326us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 70.14 KB/sec - OverallThroughput: 571.80 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 8.796us - ThriftTransmitTime(*): 222.758us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s479ms, % non-child: 2.22%) ExecOption: Codegen Enabled - BuildTime: 1s291ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.84 MB (17654688) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m5s, non-child: 191.846ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.708us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 2.950us - GetNewBlockTime: 61.244us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.70 MB (12270848) - PinTime: 0.000ns - ProbeRows: 4.06M (4060711) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 151.830ms - RowsReturned: 465.78K (465781) - RowsReturnedRate: 7.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 950.000ns EXCHANGE_NODE (id=11):(Total: 9.194us, non-child: 9.194us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.288us - DeserializeRowBatchTimer: 5.496us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 870.13 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s341ms, % non-child: 2.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 36.472us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 28.902us - GetNewBlockTime: 53.154us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.25 MB (5502072) - PinTime: 0.000ns - ProbeRows: 41.28M (41276955) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s262ms - RowsReturned: 4.06M (4060711) - RowsReturnedRate: 62.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.024us EXCHANGE_NODE (id=10):(Total: 21.122us, non-child: 21.122us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.130us - DeserializeRowBatchTimer: 15.972us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 34.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m3s, non-child: 54s299ms, % non-child: 85.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 55.462us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.422us - GetNewBlockTime: 153.920us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.18 MB (2285088) - PinTime: 0.000ns - ProbeRows: 2.17B (2166326061) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52s125ms - RowsReturned: 41.28M (41276955) - RowsReturnedRate: 649.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 854.000ns EXCHANGE_NODE (id=9):(Total: 36.468us, non-child: 36.468us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 29.226us - DeserializeRowBatchTimer: 51.890us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 49.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s207ms, non-child: 9s207ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 353 Hdfs split stats (:<# splits>/): 3:28/6.36 GB 1:21/4.78 GB 5:26/5.79 GB 6:34/7.26 GB 2:31/6.77 GB 7:37/8.44 GB 10:34/7.64 GB 0:40/8.82 GB 4:28/6.06 GB 8:37/8.29 GB 9:37/7.81 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:91.73% 1:7.519% 2:0.7519% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1059 BytesRead(2s000ms): 148.54 MB, 244.21 MB, 309.66 MB, 478.43 MB, 517.93 MB, 703.95 MB, 753.02 MB, 888.21 MB, 983.62 MB, 1.04 GB, 1.17 GB, 1.25 GB, 1.37 GB, 1.46 GB, 1.57 GB, 1.66 GB, 1.78 GB, 1.87 GB, 1.98 GB, 2.07 GB, 2.17 GB, 2.27 GB, 2.37 GB, 2.50 GB, 2.59 GB, 2.74 GB, 2.83 GB, 2.91 GB, 3.04 GB, 3.15 GB, 3.23 GB, 3.35 GB, 3.40 GB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 22.59 - BytesRead: 3.40 GB (3648249300) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.40 GB (3648249300) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.40 GB (3648249300) - DecompressionTime: 12s407ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 353 (353) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 408.18 MB (428007064) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2166326061) - RowsReturned: 2.17B (2166326061) - RowsReturnedRate: 235.28 M/sec - ScanRangesComplete: 353 (353) - ScannerThreadsInvoluntaryContextSwitches: 85.35K (85352) - ScannerThreadsTotalWallClockTime: 24m57s - MaterializeTupleTime(*): 24m37s - ScannerThreadsSysTime: 2s243ms - ScannerThreadsUserTime: 4m29s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2144635) - TotalRawHdfsReadTime(*): 2s638ms - TotalReadThroughput: 52.32 MB/sec Filter 0: - Rows processed: 5.78M (5783199) - Rows rejected: 0 (0) - Rows total: 5.78M (5783552) Filter 1: - Rows processed: 5.78M (5783199) - Rows rejected: 0 (0) - Rows total: 5.78M (5783552) Filter 2: - Rows processed: 5.78M (5783199) - Rows rejected: 0 (0) - Rows total: 5.78M (5783552) Instance 5e42471e272c7b4a:f7fdeddcf24303b7 (host=d2412.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:36/8.51 GB 3:29/6.26 GB 9:27/6.44 GB 6:25/5.79 GB 0:32/7.09 GB 1:34/7.44 GB 2:39/8.35 GB 8:28/6.33 GB 4:32/6.76 GB 5:37/7.73 GB 7:30/7.07 GB MemoryUsage(2s000ms): 176.59 MB, 353.82 MB, 364.72 MB, 379.41 MB, 370.72 MB, 338.20 MB, 349.42 MB, 345.74 MB, 344.47 MB, 360.69 MB, 361.61 MB, 362.69 MB, 360.01 MB, 370.11 MB, 360.50 MB, 350.97 MB, 353.86 MB, 357.07 MB, 359.10 MB, 368.89 MB, 381.38 MB, 375.33 MB, 371.38 MB, 373.01 MB, 355.02 MB, 346.19 MB, 346.21 MB, 359.48 MB, 364.96 MB, 372.37 MB, 353.42 MB, 346.87 MB, 274.67 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 18 - AverageThreadTokens: 23.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 394.47 MB (413631000) - PerHostPeakMemUsage: 394.47 MB (413631000) - PrepareTime: 175.559ms - RowsProduced: 1 (1) - TotalCpuTime: 25m55s - TotalNetworkReceiveTime: 11.148us - TotalNetworkSendTime: 411.403us - TotalStorageWaitTime: 3s573ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 494.658ms, non-child: 494.658ms, % non-child: 100.00%) - CodegenTime: 152.326us - CompileTime: 67.084ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 260.078ms - PrepareTime: 166.090ms DataStreamSender (dst_id=12):(Total: 35.381us, non-child: 35.381us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 43.14 KB/sec - OverallThroughput: 441.62 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 8.845us - ThriftTransmitTime(*): 362.194us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s506ms, % non-child: 2.27%) ExecOption: Codegen Enabled - BuildTime: 1s316ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.33 MB (18176928) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m4s, non-child: 202.093ms, % non-child: 0.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.111us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 3.086us - GetNewBlockTime: 64.387us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.94 MB (12515352) - PinTime: 0.000ns - ProbeRows: 4.04M (4042266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 158.769ms - RowsReturned: 493.49K (493493) - RowsReturnedRate: 7.60 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 966.000ns EXCHANGE_NODE (id=11):(Total: 8.360us, non-child: 8.360us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 934.000ns - DeserializeRowBatchTimer: 5.229us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 956.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s371ms, % non-child: 2.12%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 40.843us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.746us - GetNewBlockTime: 199.012us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.90 MB (5135008) - PinTime: 0.000ns - ProbeRows: 42.17M (42171619) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s288ms - RowsReturned: 4.04M (4042266) - RowsReturnedRate: 62.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.116us EXCHANGE_NODE (id=10):(Total: 21.633us, non-child: 21.633us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 11.953us - DeserializeRowBatchTimer: 16.184us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 33.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m3s, non-child: 54s064ms, % non-child: 85.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 65.179us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.250us - GetNewBlockTime: 184.099us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.18 MB (2284824) - PinTime: 0.000ns - ProbeRows: 2.15B (2150591293) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52s085ms - RowsReturned: 42.17M (42171619) - RowsReturnedRate: 665.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 932.000ns EXCHANGE_NODE (id=9):(Total: 37.039us, non-child: 37.039us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.789us - DeserializeRowBatchTimer: 41.053us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 48.60 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s315ms, non-child: 9s315ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 349 Hdfs split stats (:<# splits>/): 10:36/8.51 GB 3:29/6.26 GB 9:27/6.44 GB 6:25/5.79 GB 0:32/7.09 GB 1:34/7.44 GB 2:39/8.35 GB 8:28/6.33 GB 4:32/6.76 GB 5:37/7.73 GB 7:30/7.07 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:99.24% 1:0.7576% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1047 BytesRead(2s000ms): 112.49 MB, 224.98 MB, 305.28 MB, 472.83 MB, 500.57 MB, 653.05 MB, 710.44 MB, 809.86 MB, 932.65 MB, 998.37 MB, 1.11 GB, 1.18 GB, 1.30 GB, 1.41 GB, 1.50 GB, 1.60 GB, 1.70 GB, 1.81 GB, 1.91 GB, 2.03 GB, 2.13 GB, 2.24 GB, 2.33 GB, 2.45 GB, 2.53 GB, 2.63 GB, 2.73 GB, 2.82 GB, 2.95 GB, 3.03 GB, 3.14 GB, 3.23 GB, 3.29 GB - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 22.53 - BytesRead: 3.29 GB (3535046399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.29 GB (3535046399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.29 GB (3535046399) - DecompressionTime: 12s226ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 349 (349) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 382.24 MB (400807648) - PerReadThreadRawHdfsThroughput: 1.91 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.15B (2150591293) - RowsReturned: 2.15B (2150591293) - RowsReturnedRate: 230.86 M/sec - ScanRangesComplete: 349 (349) - ScannerThreadsInvoluntaryContextSwitches: 90.00K (89998) - ScannerThreadsTotalWallClockTime: 24m52s - MaterializeTupleTime(*): 24m33s - ScannerThreadsSysTime: 2s389ms - ScannerThreadsUserTime: 4m25s - ScannerThreadsVoluntaryContextSwitches: 2.13M (2129115) - TotalRawHdfsReadTime(*): 1s725ms - TotalReadThroughput: 50.70 MB/sec Filter 0: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Filter 1: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Filter 2: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Instance 5e42471e272c7b4a:f7fdeddcf24303b5 (host=d2413.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:32/7.20 GB 8:26/6.11 GB 10:35/7.93 GB 1:31/7.13 GB 9:31/6.76 GB 4:30/6.89 GB 5:36/8.17 GB 2:29/6.47 GB 0:31/7.09 GB 3:30/6.42 GB 6:35/7.94 GB MemoryUsage(2s000ms): 171.34 MB, 349.84 MB, 362.41 MB, 361.51 MB, 357.96 MB, 390.79 MB, 388.58 MB, 367.08 MB, 365.65 MB, 373.48 MB, 364.29 MB, 364.28 MB, 353.74 MB, 350.59 MB, 344.28 MB, 360.94 MB, 357.07 MB, 355.53 MB, 342.16 MB, 342.14 MB, 355.16 MB, 360.26 MB, 383.64 MB, 370.84 MB, 359.34 MB, 363.04 MB, 358.52 MB, 376.32 MB, 400.54 MB, 389.54 MB, 368.41 MB, 376.48 MB, 317.23 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 19 - AverageThreadTokens: 23.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 416.52 MB (436747640) - PerHostPeakMemUsage: 416.52 MB (436747640) - PrepareTime: 172.256ms - RowsProduced: 1 (1) - TotalCpuTime: 25m54s - TotalNetworkReceiveTime: 10.966us - TotalNetworkSendTime: 354.392us - TotalStorageWaitTime: 4s595ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 490.819ms, non-child: 490.819ms, % non-child: 100.00%) - CodegenTime: 157.130us - CompileTime: 67.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 259.301ms - PrepareTime: 163.030ms DataStreamSender (dst_id=12):(Total: 30.642us, non-child: 30.642us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 64.65 KB/sec - OverallThroughput: 509.92 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.904us - ThriftTransmitTime(*): 241.682us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s576ms, % non-child: 2.38%) ExecOption: Codegen Enabled - BuildTime: 1s386ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.28 MB (18123032) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m4s, non-child: 209.197ms, % non-child: 0.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.698us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 3.294us - GetNewBlockTime: 70.320us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.00 MB (12584576) - PinTime: 0.000ns - ProbeRows: 3.98M (3975697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 163.201ms - RowsReturned: 519.98K (519978) - RowsReturnedRate: 8.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.094us EXCHANGE_NODE (id=11):(Total: 8.850us, non-child: 8.850us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 996.000ns - DeserializeRowBatchTimer: 5.664us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 903.95 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s398ms, % non-child: 2.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 35.986us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.748us - GetNewBlockTime: 345.804us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.39 MB (5648136) - PinTime: 0.000ns - ProbeRows: 40.92M (40920669) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s320ms - RowsReturned: 3.98M (3975697) - RowsReturnedRate: 61.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.234us EXCHANGE_NODE (id=10):(Total: 21.554us, non-child: 21.554us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.476us - DeserializeRowBatchTimer: 14.748us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 33.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m3s, non-child: 54s371ms, % non-child: 86.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 75.516us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 89.590us - GetNewBlockTime: 229.008us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.17 MB (2274864) - PinTime: 0.000ns - ProbeRows: 2.17B (2172920189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52s324ms - RowsReturned: 40.92M (40920669) - RowsReturnedRate: 648.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.030us EXCHANGE_NODE (id=9):(Total: 35.664us, non-child: 35.664us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.568us - DeserializeRowBatchTimer: 48.370us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 50.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s730ms, non-child: 8s730ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 346 Hdfs split stats (:<# splits>/): 7:32/7.20 GB 8:26/6.11 GB 10:35/7.93 GB 1:31/7.13 GB 9:31/6.76 GB 4:30/6.89 GB 5:36/8.17 GB 2:29/6.47 GB 0:31/7.09 GB 3:30/6.42 GB 6:35/7.94 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:96.21% 1:3.788% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1038 BytesRead(2s000ms): 108.44 MB, 227.11 MB, 324.71 MB, 454.56 MB, 512.71 MB, 703.71 MB, 767.71 MB, 884.50 MB, 970.81 MB, 1.06 GB, 1.15 GB, 1.27 GB, 1.38 GB, 1.45 GB, 1.57 GB, 1.66 GB, 1.78 GB, 1.86 GB, 1.97 GB, 2.07 GB, 2.17 GB, 2.27 GB, 2.40 GB, 2.49 GB, 2.60 GB, 2.69 GB, 2.80 GB, 2.92 GB, 3.03 GB, 3.13 GB, 3.22 GB, 3.34 GB, 3.41 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 22.56 - BytesRead: 3.41 GB (3663348375) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.41 GB (3663348375) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.41 GB (3663348375) - DecompressionTime: 12s664ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 346 (346) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 404.33 MB (423965976) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2172920189) - RowsReturned: 2.17B (2172920189) - RowsReturnedRate: 248.88 M/sec - ScanRangesComplete: 346 (346) - ScannerThreadsInvoluntaryContextSwitches: 85.97K (85971) - ScannerThreadsTotalWallClockTime: 24m52s - MaterializeTupleTime(*): 24m32s - ScannerThreadsSysTime: 2s218ms - ScannerThreadsUserTime: 4m31s - ScannerThreadsVoluntaryContextSwitches: 2.15M (2153768) - TotalRawHdfsReadTime(*): 2s507ms - TotalReadThroughput: 52.54 MB/sec Filter 0: - Rows processed: 5.67M (5668518) - Rows rejected: 0 (0) - Rows total: 5.67M (5668864) Filter 1: - Rows processed: 5.67M (5668518) - Rows rejected: 0 (0) - Rows total: 5.67M (5668864) Filter 2: - Rows processed: 5.67M (5668518) - Rows rejected: 0 (0) - Rows total: 5.67M (5668864) Instance 5e42471e272c7b4a:f7fdeddcf24303b8 (host=d2402.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:29/6.52 GB 4:31/6.81 GB 10:29/6.19 GB 8:28/6.05 GB 0:30/7.16 GB 1:30/6.72 GB 2:31/6.76 GB 6:29/6.23 GB 5:27/6.30 GB 9:35/7.73 GB 7:50/11.51 GB MemoryUsage(2s000ms): 175.93 MB, 351.77 MB, 351.28 MB, 357.08 MB, 380.55 MB, 388.11 MB, 387.97 MB, 375.38 MB, 367.20 MB, 371.66 MB, 359.71 MB, 383.13 MB, 384.07 MB, 370.93 MB, 340.41 MB, 363.93 MB, 357.94 MB, 360.78 MB, 379.89 MB, 380.58 MB, 375.14 MB, 358.20 MB, 357.85 MB, 343.31 MB, 356.94 MB, 361.15 MB, 339.56 MB, 351.82 MB, 364.59 MB, 365.04 MB, 354.07 MB, 348.13 MB, 296.06 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 19 - AverageThreadTokens: 23.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 404.82 MB (424489480) - PerHostPeakMemUsage: 404.84 MB (424505864) - PrepareTime: 189.409ms - RowsProduced: 1 (1) - TotalCpuTime: 25m50s - TotalNetworkReceiveTime: 22.331us - TotalNetworkSendTime: 137.777us - TotalStorageWaitTime: 4s855ms CodeGen:(Total: 527.610ms, non-child: 527.610ms, % non-child: 100.00%) - CodegenTime: 156.026us - CompileTime: 70.630ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 275.951ms - PrepareTime: 178.746ms DataStreamSender (dst_id=12):(Total: 39.025us, non-child: 39.025us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 143.87 KB/sec - OverallThroughput: 400.38 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 7.681us - ThriftTransmitTime(*): 108.605us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s588ms, % non-child: 2.40%) ExecOption: Codegen Enabled - BuildTime: 1s384ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.10 MB (17927896) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m4s, non-child: 195.163ms, % non-child: 0.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.352us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 5.841us - GetNewBlockTime: 1.620ms - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.79 MB (12359792) - PinTime: 0.000ns - ProbeRows: 3.87M (3869744) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 149.923ms - RowsReturned: 507.26K (507262) - RowsReturnedRate: 7.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.555us EXCHANGE_NODE (id=11):(Total: 19.213us, non-child: 19.213us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.781us - DeserializeRowBatchTimer: 16.768us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 416.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s401ms, % non-child: 2.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 26.651us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.917us - GetNewBlockTime: 1.602ms - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.19 MB (5439000) - PinTime: 0.000ns - ProbeRows: 40.74M (40739790) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s318ms - RowsReturned: 3.87M (3869744) - RowsReturnedRate: 60.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.100us EXCHANGE_NODE (id=10):(Total: 34.094us, non-child: 34.094us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 22.490us - DeserializeRowBatchTimer: 36.336us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 21.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m2s, non-child: 53s804ms, % non-child: 85.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 59.693us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 63.202us - GetNewBlockTime: 1.079ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.19 MB (2296912) - PinTime: 0.000ns - ProbeRows: 2.16B (2161224410) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51s817ms - RowsReturned: 40.74M (40739790) - RowsReturnedRate: 646.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.335us EXCHANGE_NODE (id=9):(Total: 40.810us, non-child: 40.810us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 30.630us - DeserializeRowBatchTimer: 283.358us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 44.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s192ms, non-child: 9s192ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 349 Hdfs split stats (:<# splits>/): 3:29/6.52 GB 4:31/6.81 GB 10:29/6.19 GB 8:28/6.05 GB 0:30/7.16 GB 1:30/6.72 GB 2:31/6.76 GB 6:29/6.23 GB 5:27/6.30 GB 9:35/7.73 GB 7:50/11.51 GB Runtime filters: Only following filters arrived: , waited 461ms Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1047 BytesRead(2s000ms): 173.71 MB, 231.61 MB, 346.20 MB, 475.71 MB, 565.62 MB, 717.82 MB, 785.90 MB, 927.18 MB, 1005.43 MB, 1.11 GB, 1.20 GB, 1.32 GB, 1.44 GB, 1.51 GB, 1.64 GB, 1.72 GB, 1.82 GB, 1.92 GB, 2.03 GB, 2.16 GB, 2.23 GB, 2.34 GB, 2.44 GB, 2.52 GB, 2.67 GB, 2.71 GB, 2.85 GB, 2.94 GB, 3.03 GB, 3.15 GB, 3.23 GB, 3.36 GB, 3.38 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.58 - BytesRead: 3.38 GB (3634587582) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.38 GB (3634587582) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.38 GB (3634587582) - DecompressionTime: 12s685ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 349 (349) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 392.78 MB (411864072) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2161224410) - RowsReturned: 2.16B (2161224410) - RowsReturnedRate: 235.11 M/sec - ScanRangesComplete: 349 (349) - ScannerThreadsInvoluntaryContextSwitches: 86.14K (86144) - ScannerThreadsTotalWallClockTime: 24m49s - MaterializeTupleTime(*): 24m28s - ScannerThreadsSysTime: 3s089ms - ScannerThreadsUserTime: 4m37s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2141547) - TotalRawHdfsReadTime(*): 2s637ms - TotalReadThroughput: 52.52 MB/sec Filter 0: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Filter 1: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Filter 2: - Rows processed: 5.72M (5717667) - Rows rejected: 0 (0) - Rows total: 5.72M (5718016) Instance 5e42471e272c7b4a:f7fdeddcf24303c3 (host=d2404.halxg.cloudera.com:22000):(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:35/8.08 GB 10:30/6.52 GB 4:31/7.01 GB 8:23/5.01 GB 1:31/7.04 GB 6:34/7.59 GB 0:33/7.62 GB 5:39/8.61 GB 3:28/6.35 GB 7:25/5.76 GB 2:37/8.35 GB MemoryUsage(2s000ms): 194.79 MB, 389.77 MB, 373.17 MB, 384.39 MB, 395.37 MB, 358.77 MB, 355.67 MB, 348.06 MB, 362.07 MB, 354.41 MB, 363.66 MB, 372.90 MB, 354.78 MB, 360.21 MB, 365.82 MB, 360.89 MB, 379.09 MB, 366.12 MB, 357.81 MB, 364.81 MB, 358.97 MB, 349.95 MB, 345.85 MB, 343.06 MB, 359.70 MB, 386.14 MB, 392.01 MB, 363.52 MB, 353.68 MB, 362.81 MB, 368.49 MB, 379.17 MB, 278.32 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 17 - AverageThreadTokens: 23.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 410.76 MB (430717464) - PerHostPeakMemUsage: 410.76 MB (430717464) - PrepareTime: 170.164ms - RowsProduced: 1 (1) - TotalCpuTime: 25m46s - TotalNetworkReceiveTime: 12.122us - TotalNetworkSendTime: 428.022us - TotalStorageWaitTime: 3s826ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 491.460ms, non-child: 491.460ms, % non-child: 100.00%) - CodegenTime: 157.194us - CompileTime: 67.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 261.254ms - PrepareTime: 161.015ms DataStreamSender (dst_id=12):(Total: 31.100us, non-child: 31.100us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 40.15 KB/sec - OverallThroughput: 502.41 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 8.646us - ThriftTransmitTime(*): 389.168us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m6s, non-child: 1s559ms, % non-child: 2.36%) ExecOption: Codegen Enabled - BuildTime: 1s333ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.50 MB (18352280) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m4s, non-child: 187.777ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.412us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 3.672us - GetNewBlockTime: 64.501us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.66 MB (13271192) - PinTime: 0.000ns - ProbeRows: 4.13M (4134479) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 150.544ms - RowsReturned: 451.53K (451532) - RowsReturnedRate: 6.99 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.068us EXCHANGE_NODE (id=11):(Total: 10.518us, non-child: 10.518us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.360us - DeserializeRowBatchTimer: 5.808us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 760.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m4s, non-child: 1s342ms, % non-child: 2.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 35.204us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 28.508us - GetNewBlockTime: 90.066us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.86 MB (6145968) - PinTime: 0.000ns - ProbeRows: 40.58M (40577434) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s264ms - RowsReturned: 4.13M (4134479) - RowsReturnedRate: 64.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 994.000ns EXCHANGE_NODE (id=10):(Total: 21.634us, non-child: 21.634us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.278us - DeserializeRowBatchTimer: 15.856us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 33.28 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m3s, non-child: 53s689ms, % non-child: 85.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 59.818us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 62.368us - GetNewBlockTime: 100.692us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.19 MB (2300480) - PinTime: 0.000ns - ProbeRows: 2.16B (2156464177) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51s615ms - RowsReturned: 40.58M (40577434) - RowsReturnedRate: 643.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 892.000ns EXCHANGE_NODE (id=9):(Total: 37.788us, non-child: 37.788us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.580us - DeserializeRowBatchTimer: 43.904us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 47.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 9s337ms, non-child: 9s337ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 346 Hdfs split stats (:<# splits>/): 9:35/8.08 GB 10:30/6.52 GB 4:31/7.01 GB 8:23/5.01 GB 1:31/7.04 GB 6:34/7.59 GB 0:33/7.62 GB 5:39/8.61 GB 3:28/6.35 GB 7:25/5.76 GB 2:37/8.35 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1038 BytesRead(2s000ms): 130.43 MB, 260.86 MB, 301.66 MB, 513.64 MB, 541.10 MB, 683.36 MB, 769.42 MB, 867.56 MB, 986.22 MB, 1.04 GB, 1.18 GB, 1.24 GB, 1.37 GB, 1.46 GB, 1.59 GB, 1.68 GB, 1.79 GB, 1.89 GB, 1.98 GB, 2.09 GB, 2.18 GB, 2.28 GB, 2.38 GB, 2.46 GB, 2.59 GB, 2.70 GB, 2.81 GB, 2.91 GB, 3.01 GB, 3.12 GB, 3.23 GB, 3.32 GB, 3.39 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.45 - BytesRead: 3.39 GB (3636759922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3636759922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3636759922) - DecompressionTime: 12s451ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 346 (346) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 398.43 MB (417783704) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2156464177) - RowsReturned: 2.16B (2156464177) - RowsReturnedRate: 230.94 M/sec - ScanRangesComplete: 346 (346) - ScannerThreadsInvoluntaryContextSwitches: 85.45K (85446) - ScannerThreadsTotalWallClockTime: 24m43s - MaterializeTupleTime(*): 24m24s - ScannerThreadsSysTime: 2s476ms - ScannerThreadsUserTime: 4m30s - ScannerThreadsVoluntaryContextSwitches: 2.15M (2145391) - TotalRawHdfsReadTime(*): 1s896ms - TotalReadThroughput: 52.15 MB/sec Filter 0: - Rows processed: 5.67M (5668518) - Rows rejected: 0 (0) - Rows total: 5.67M (5668864) Filter 1: - Rows processed: 5.67M (5668518) - Rows rejected: 0 (0) - Rows total: 5.67M (5668864) Filter 2: - Rows processed: 5.67M (5668518) - Rows rejected: 0 (0) - Rows total: 5.67M (5668864) Instance 5e42471e272c7b4a:f7fdeddcf24303ba (host=d2407.halxg.cloudera.com:22000):(Total: 1m5s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:21/4.70 GB 8:34/8.01 GB 2:36/7.76 GB 9:29/6.52 GB 5:35/8.06 GB 1:30/6.81 GB 6:32/7.37 GB 3:37/8.02 GB 4:26/6.01 GB 0:37/8.20 GB 10:30/6.70 GB MemoryUsage(2s000ms): 162.64 MB, 360.35 MB, 364.31 MB, 366.43 MB, 370.91 MB, 374.29 MB, 366.41 MB, 367.18 MB, 369.65 MB, 388.04 MB, 378.81 MB, 358.34 MB, 353.52 MB, 369.62 MB, 375.86 MB, 371.38 MB, 360.34 MB, 353.14 MB, 356.59 MB, 390.36 MB, 370.21 MB, 357.40 MB, 367.06 MB, 361.48 MB, 374.30 MB, 378.97 MB, 356.52 MB, 354.97 MB, 363.45 MB, 359.33 MB, 374.99 MB, 369.43 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 23.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 406.90 MB (426666680) - PerHostPeakMemUsage: 406.90 MB (426666680) - PrepareTime: 173.807ms - RowsProduced: 1 (1) - TotalCpuTime: 25m31s - TotalNetworkReceiveTime: 12.442us - TotalNetworkSendTime: 264.714us - TotalStorageWaitTime: 3s810ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 75 (75) - BlocksRecycled: 21 (21) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 494.130ms, non-child: 494.130ms, % non-child: 100.00%) - CodegenTime: 159.988us - CompileTime: 67.685ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 260.703ms - PrepareTime: 164.291ms DataStreamSender (dst_id=12):(Total: 29.576us, non-child: 29.576us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 68.45 KB/sec - OverallThroughput: 528.30 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 7.140us - ThriftTransmitTime(*): 228.284us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m5s, non-child: 1s518ms, % non-child: 2.33%) ExecOption: Codegen Enabled - BuildTime: 1s329ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.97 MB (17794864) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m3s, non-child: 201.869ms, % non-child: 0.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 15.946us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 5.588us - GetNewBlockTime: 288.578us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.95 MB (12528800) - PinTime: 0.000ns - ProbeRows: 4.04M (4035437) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 158.487ms - RowsReturned: 482.58K (482576) - RowsReturnedRate: 7.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.210us EXCHANGE_NODE (id=11):(Total: 7.712us, non-child: 7.712us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.004us - DeserializeRowBatchTimer: 10.196us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 1.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m3s, non-child: 1s358ms, % non-child: 2.14%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 38.488us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.514us - GetNewBlockTime: 494.666us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.61 MB (5880720) - PinTime: 0.000ns - ProbeRows: 41.47M (41469323) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s279ms - RowsReturned: 4.04M (4035437) - RowsReturnedRate: 63.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.154us EXCHANGE_NODE (id=10):(Total: 21.722us, non-child: 21.722us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.152us - DeserializeRowBatchTimer: 17.986us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 33.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m2s, non-child: 53s821ms, % non-child: 86.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 69.728us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 61.436us - GetNewBlockTime: 330.692us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.18 MB (2281264) - PinTime: 0.000ns - ProbeRows: 2.17B (2167452392) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51s775ms - RowsReturned: 41.47M (41469323) - RowsReturnedRate: 666.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 966.000ns EXCHANGE_NODE (id=9):(Total: 38.766us, non-child: 38.766us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 29.342us - DeserializeRowBatchTimer: 46.774us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 46.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s381ms, non-child: 8s381ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 347 Hdfs split stats (:<# splits>/): 7:21/4.70 GB 8:34/8.01 GB 2:36/7.76 GB 9:29/6.52 GB 5:35/8.06 GB 1:30/6.81 GB 6:32/7.37 GB 3:37/8.02 GB 4:26/6.01 GB 0:37/8.20 GB 10:30/6.70 GB Runtime filters: Only following filters arrived: , waited 503ms Hdfs Read Thread Concurrency Bucket: 0:98.46% 1:1.538% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1041 BytesRead(2s000ms): 102.78 MB, 240.75 MB, 337.25 MB, 471.25 MB, 554.68 MB, 691.65 MB, 759.76 MB, 917.94 MB, 989.94 MB, 1.12 GB, 1.18 GB, 1.29 GB, 1.39 GB, 1.49 GB, 1.62 GB, 1.72 GB, 1.81 GB, 1.91 GB, 2.01 GB, 2.15 GB, 2.23 GB, 2.35 GB, 2.47 GB, 2.55 GB, 2.68 GB, 2.77 GB, 2.88 GB, 2.98 GB, 3.09 GB, 3.18 GB, 3.30 GB, 3.40 GB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 22.56 - BytesRead: 3.42 GB (3671308708) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.42 GB (3671308708) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.42 GB (3671308708) - DecompressionTime: 12s634ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 347 (347) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 394.29 MB (413442448) - PerReadThreadRawHdfsThroughput: 1.77 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2167452392) - RowsReturned: 2.17B (2167452392) - RowsReturnedRate: 258.59 M/sec - ScanRangesComplete: 347 (347) - ScannerThreadsInvoluntaryContextSwitches: 87.10K (87102) - ScannerThreadsTotalWallClockTime: 24m29s - MaterializeTupleTime(*): 24m10s - ScannerThreadsSysTime: 2s225ms - ScannerThreadsUserTime: 4m32s - ScannerThreadsVoluntaryContextSwitches: 2.15M (2149551) - TotalRawHdfsReadTime(*): 1s934ms - TotalReadThroughput: 53.45 MB/sec Filter 0: - Rows processed: 5.68M (5684901) - Rows rejected: 0 (0) - Rows total: 5.69M (5685248) Filter 1: - Rows processed: 5.68M (5684901) - Rows rejected: 0 (0) - Rows total: 5.69M (5685248) Filter 2: - Rows processed: 5.68M (5684901) - Rows rejected: 0 (0) - Rows total: 5.69M (5685248) Instance 5e42471e272c7b4a:f7fdeddcf24303b6 (host=d2418.halxg.cloudera.com:22000):(Total: 1m5s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:33/7.46 GB 0:33/7.58 GB 7:26/5.82 GB 1:31/7.17 GB 3:25/5.94 GB 4:26/5.83 GB 6:33/7.09 GB 5:35/8.26 GB 8:38/8.98 GB 10:29/6.78 GB 9:31/7.08 GB MemoryUsage(2s000ms): 145.36 MB, 372.18 MB, 363.43 MB, 356.90 MB, 357.91 MB, 369.99 MB, 368.25 MB, 366.64 MB, 367.71 MB, 354.23 MB, 345.50 MB, 353.68 MB, 354.19 MB, 360.33 MB, 365.50 MB, 375.08 MB, 371.90 MB, 365.82 MB, 372.80 MB, 375.99 MB, 382.43 MB, 370.80 MB, 379.47 MB, 390.27 MB, 387.39 MB, 384.13 MB, 368.56 MB, 359.50 MB, 356.11 MB, 370.17 MB, 372.96 MB, 365.13 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 23.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 412.12 MB (432142704) - PerHostPeakMemUsage: 412.12 MB (432142704) - PrepareTime: 171.335ms - RowsProduced: 1 (1) - TotalCpuTime: 25m21s - TotalNetworkReceiveTime: 9.822us - TotalNetworkSendTime: 261.531us - TotalStorageWaitTime: 4s524ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 55 (55) - BlocksRecycled: 41 (41) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 489.812ms, non-child: 489.812ms, % non-child: 100.00%) - CodegenTime: 156.684us - CompileTime: 67.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 259.023ms - PrepareTime: 162.129ms DataStreamSender (dst_id=12):(Total: 43.592us, non-child: 43.592us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 74.99 KB/sec - OverallThroughput: 358.44 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 19.640us - ThriftTransmitTime(*): 208.372us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m5s, non-child: 1s546ms, % non-child: 2.38%) ExecOption: Codegen Enabled - BuildTime: 1s358ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 18.59 MB (19492664) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m3s, non-child: 213.649ms, % non-child: 0.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.134us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 3.134us - GetNewBlockTime: 63.282us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.68 MB (12246160) - PinTime: 0.000ns - ProbeRows: 3.97M (3970783) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 172.542ms - RowsReturned: 482.78K (482783) - RowsReturnedRate: 7.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 988.000ns EXCHANGE_NODE (id=11):(Total: 8.374us, non-child: 8.374us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.302us - DeserializeRowBatchTimer: 5.608us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 955.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m3s, non-child: 1s345ms, % non-child: 2.12%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 36.260us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 29.086us - GetNewBlockTime: 68.376us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 4.76 MB (4993704) - PinTime: 0.000ns - ProbeRows: 41.03M (41029856) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s267ms - RowsReturned: 3.97M (3970783) - RowsReturnedRate: 62.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 918.000ns EXCHANGE_NODE (id=10):(Total: 21.400us, non-child: 21.400us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.318us - DeserializeRowBatchTimer: 16.216us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 33.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m2s, non-child: 53s339ms, % non-child: 86.01%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 62.202us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.504us - GetNewBlockTime: 121.158us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.16 MB (2265240) - PinTime: 0.000ns - ProbeRows: 2.16B (2156460237) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51s321ms - RowsReturned: 41.03M (41029856) - RowsReturnedRate: 661.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 896.000ns EXCHANGE_NODE (id=9):(Total: 35.506us, non-child: 35.506us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.496us - DeserializeRowBatchTimer: 42.702us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 50.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s678ms, non-child: 8s678ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 340 Hdfs split stats (:<# splits>/): 2:33/7.46 GB 0:33/7.58 GB 7:26/5.82 GB 1:31/7.17 GB 3:25/5.94 GB 4:26/5.83 GB 6:33/7.09 GB 5:35/8.26 GB 8:38/8.98 GB 10:29/6.78 GB 9:31/7.08 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:93.08% 1:6.154% 2:0% 3:0% 4:0% 5:0.7692% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1020 BytesRead(2s000ms): 138.55 MB, 246.17 MB, 340.34 MB, 471.87 MB, 538.38 MB, 706.51 MB, 759.30 MB, 930.55 MB, 987.79 MB, 1.10 GB, 1.18 GB, 1.29 GB, 1.40 GB, 1.47 GB, 1.61 GB, 1.70 GB, 1.82 GB, 1.91 GB, 2.02 GB, 2.13 GB, 2.24 GB, 2.35 GB, 2.47 GB, 2.59 GB, 2.70 GB, 2.81 GB, 2.88 GB, 3.01 GB, 3.10 GB, 3.21 GB, 3.32 GB, 3.41 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 22.54 - BytesRead: 3.42 GB (3672066116) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.42 GB (3672066116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.42 GB (3672066116) - DecompressionTime: 12s555ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 340 (340) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 399.74 MB (419158168) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2156460237) - RowsReturned: 2.16B (2156460237) - RowsReturnedRate: 248.49 M/sec - ScanRangesComplete: 340 (340) - ScannerThreadsInvoluntaryContextSwitches: 86.62K (86623) - ScannerThreadsTotalWallClockTime: 24m20s - MaterializeTupleTime(*): 24m1s - ScannerThreadsSysTime: 2s240ms - ScannerThreadsUserTime: 4m31s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2138215) - TotalRawHdfsReadTime(*): 2s418ms - TotalReadThroughput: 53.88 MB/sec Filter 0: - Rows processed: 5.57M (5570220) - Rows rejected: 0 (0) - Rows total: 5.57M (5570560) Filter 1: - Rows processed: 5.57M (5570220) - Rows rejected: 0 (0) - Rows total: 5.57M (5570560) Filter 2: - Rows processed: 5.57M (5570220) - Rows rejected: 0 (0) - Rows total: 5.57M (5570560) Instance 5e42471e272c7b4a:f7fdeddcf24303bb (host=d2411.halxg.cloudera.com:22000):(Total: 1m5s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:33/7.49 GB 3:40/8.95 GB 5:32/7.44 GB 7:26/5.59 GB 2:27/6.17 GB 8:27/6.11 GB 6:35/7.82 GB 10:24/5.15 GB 4:33/7.23 GB 0:35/7.65 GB 9:36/8.19 GB MemoryUsage(2s000ms): 143.73 MB, 353.69 MB, 361.22 MB, 347.40 MB, 354.84 MB, 358.31 MB, 352.95 MB, 355.60 MB, 411.61 MB, 402.58 MB, 355.76 MB, 357.94 MB, 363.01 MB, 364.54 MB, 353.48 MB, 357.61 MB, 358.17 MB, 355.67 MB, 359.77 MB, 375.67 MB, 354.76 MB, 354.56 MB, 378.65 MB, 381.95 MB, 375.47 MB, 375.31 MB, 393.53 MB, 383.43 MB, 388.27 MB, 377.11 MB, 364.25 MB, 346.25 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 23.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 428.28 MB (449084352) - PerHostPeakMemUsage: 428.28 MB (449084352) - PrepareTime: 171.056ms - RowsProduced: 1 (1) - TotalCpuTime: 25m23s - TotalNetworkReceiveTime: 22.928us - TotalNetworkSendTime: 312.874us - TotalStorageWaitTime: 4s675ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 88 (88) - BlocksRecycled: 8 (8) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 488.140ms, non-child: 488.140ms, % non-child: 100.00%) - CodegenTime: 153.144us - CompileTime: 67.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 257.494ms - PrepareTime: 161.812ms DataStreamSender (dst_id=12):(Total: 35.190us, non-child: 35.190us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 67.62 KB/sec - OverallThroughput: 444.02 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 9.662us - ThriftTransmitTime(*): 231.060us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m5s, non-child: 1s452ms, % non-child: 2.23%) ExecOption: Codegen Enabled - BuildTime: 1s268ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.58 MB (18435768) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m3s, non-child: 184.128ms, % non-child: 0.29%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.000us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 4.112us - GetNewBlockTime: 336.592us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.77 MB (12343448) - PinTime: 0.000ns - ProbeRows: 4.13M (4131235) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.816ms - RowsReturned: 390.35K (390349) - RowsReturnedRate: 6.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.260us EXCHANGE_NODE (id=11):(Total: 9.196us, non-child: 9.196us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.098us - DeserializeRowBatchTimer: 5.376us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 869.94 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m3s, non-child: 1s333ms, % non-child: 2.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 37.244us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.492us - GetNewBlockTime: 401.450us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.03 MB (5275936) - PinTime: 0.000ns - ProbeRows: 40.85M (40846526) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s252ms - RowsReturned: 4.13M (4131235) - RowsReturnedRate: 65.10 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.378us EXCHANGE_NODE (id=10):(Total: 20.908us, non-child: 20.908us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.096us - DeserializeRowBatchTimer: 18.400us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 34.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m2s, non-child: 53s220ms, % non-child: 85.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 81.016us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 60.456us - GetNewBlockTime: 244.298us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.19 MB (2301160) - PinTime: 0.000ns - ProbeRows: 2.17B (2168640020) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51s150ms - RowsReturned: 40.85M (40846526) - RowsReturnedRate: 657.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.154us EXCHANGE_NODE (id=9):(Total: 49.464us, non-child: 49.464us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.920us - DeserializeRowBatchTimer: 44.066us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 36.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s908ms, non-child: 8s908ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 348 Hdfs split stats (:<# splits>/): 1:33/7.49 GB 3:40/8.95 GB 5:32/7.44 GB 7:26/5.59 GB 2:27/6.17 GB 8:27/6.11 GB 6:35/7.82 GB 10:24/5.15 GB 4:33/7.23 GB 0:35/7.65 GB 9:36/8.19 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:97.69% 1:1.538% 2:0% 3:0% 4:0.7692% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1044 BytesRead(2s000ms): 139.46 MB, 242.37 MB, 317.03 MB, 453.93 MB, 511.64 MB, 664.83 MB, 717.67 MB, 874.50 MB, 1003.19 MB, 1.05 GB, 1.17 GB, 1.26 GB, 1.37 GB, 1.45 GB, 1.54 GB, 1.68 GB, 1.74 GB, 1.87 GB, 1.97 GB, 2.08 GB, 2.20 GB, 2.31 GB, 2.44 GB, 2.54 GB, 2.64 GB, 2.78 GB, 2.87 GB, 3.00 GB, 3.09 GB, 3.21 GB, 3.30 GB, 3.38 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 22.58 - BytesRead: 3.39 GB (3644243696) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.39 GB (3644243696) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.39 GB (3644243696) - DecompressionTime: 12s529ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 348 (348) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 415.91 MB (436116032) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.17B (2168640020) - RowsReturned: 2.17B (2168640020) - RowsReturnedRate: 243.43 M/sec - ScanRangesComplete: 348 (348) - ScannerThreadsInvoluntaryContextSwitches: 85.43K (85431) - ScannerThreadsTotalWallClockTime: 24m22s - MaterializeTupleTime(*): 24m2s - ScannerThreadsSysTime: 2s329ms - ScannerThreadsUserTime: 4m31s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2140759) - TotalRawHdfsReadTime(*): 2s419ms - TotalReadThroughput: 53.47 MB/sec Filter 0: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Filter 1: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Filter 2: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Instance 5e42471e272c7b4a:f7fdeddcf24303c5 (host=d2421.halxg.cloudera.com:22000):(Total: 1m5s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:27/5.86 GB 5:29/6.43 GB 2:33/7.66 GB 3:30/6.41 GB 1:29/6.81 GB 8:43/9.55 GB 4:22/4.60 GB 10:40/9.24 GB 6:32/7.32 GB 9:29/6.56 GB 7:33/7.54 GB MemoryUsage(2s000ms): 172.40 MB, 352.30 MB, 345.31 MB, 347.13 MB, 378.05 MB, 386.00 MB, 388.79 MB, 396.53 MB, 396.87 MB, 377.66 MB, 355.96 MB, 355.40 MB, 370.64 MB, 370.62 MB, 377.43 MB, 384.76 MB, 367.67 MB, 343.01 MB, 349.79 MB, 354.10 MB, 350.21 MB, 356.29 MB, 359.44 MB, 354.15 MB, 342.12 MB, 358.17 MB, 372.53 MB, 371.74 MB, 355.24 MB, 378.52 MB, 368.72 MB, 351.59 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 23.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 422.01 MB (442514696) - PerHostPeakMemUsage: 422.01 MB (442514696) - PrepareTime: 172.108ms - RowsProduced: 1 (1) - TotalCpuTime: 25m25s - TotalNetworkReceiveTime: 11.480us - TotalNetworkSendTime: 340.400us - TotalStorageWaitTime: 4s040ms CodeGen:(Total: 489.944ms, non-child: 489.944ms, % non-child: 100.00%) - CodegenTime: 168.214us - CompileTime: 67.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 258.395ms - PrepareTime: 162.897ms DataStreamSender (dst_id=12):(Total: 38.860us, non-child: 38.860us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 50.13 KB/sec - OverallThroughput: 402.08 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 21.260us - ThriftTransmitTime(*): 311.656us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m5s, non-child: 1s554ms, % non-child: 2.39%) ExecOption: Codegen Enabled - BuildTime: 1s368ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.06 MB (17891424) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m3s, non-child: 204.850ms, % non-child: 0.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.952us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 5.770us - GetNewBlockTime: 287.378us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 12.10 MB (12686360) - PinTime: 0.000ns - ProbeRows: 3.95M (3953104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 161.766ms - RowsReturned: 421.49K (421485) - RowsReturnedRate: 6.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.278us EXCHANGE_NODE (id=11):(Total: 10.762us, non-child: 10.762us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.400us - DeserializeRowBatchTimer: 8.798us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 743.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m3s, non-child: 1s386ms, % non-child: 2.19%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 38.036us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.506us - GetNewBlockTime: 500.694us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.34 MB (5601560) - PinTime: 0.000ns - ProbeRows: 41.42M (41422149) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s306ms - RowsReturned: 3.95M (3953104) - RowsReturnedRate: 62.41 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.546us EXCHANGE_NODE (id=10):(Total: 20.624us, non-child: 20.624us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 12.196us - DeserializeRowBatchTimer: 15.792us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 34.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m1s, non-child: 53s553ms, % non-child: 86.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 89.390us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 59.958us - GetNewBlockTime: 338.854us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.18 MB (2285712) - PinTime: 0.000ns - ProbeRows: 2.16B (2159787567) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51s592ms - RowsReturned: 41.42M (41422149) - RowsReturnedRate: 668.61 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.100us EXCHANGE_NODE (id=9):(Total: 38.234us, non-child: 38.234us, % non-child: 100.00%) BytesReceived(2s000ms): 19.89 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 30.056us - DeserializeRowBatchTimer: 44.294us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 47.08 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s399ms, non-child: 8s399ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 347 Hdfs split stats (:<# splits>/): 0:27/5.86 GB 5:29/6.43 GB 2:33/7.66 GB 3:30/6.41 GB 1:29/6.81 GB 8:43/9.55 GB 4:22/4.60 GB 10:40/9.24 GB 6:32/7.32 GB 9:29/6.56 GB 7:33/7.54 GB Runtime filters: Only following filters arrived: , waited 503ms Hdfs Read Thread Concurrency Bucket: 0:96.92% 1:3.077% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1041 BytesRead(2s000ms): 110.41 MB, 229.23 MB, 286.20 MB, 467.36 MB, 528.54 MB, 703.16 MB, 767.74 MB, 919.16 MB, 1.00 GB, 1.07 GB, 1.19 GB, 1.26 GB, 1.39 GB, 1.48 GB, 1.58 GB, 1.71 GB, 1.78 GB, 1.91 GB, 1.99 GB, 2.12 GB, 2.19 GB, 2.33 GB, 2.42 GB, 2.52 GB, 2.62 GB, 2.73 GB, 2.85 GB, 2.92 GB, 3.05 GB, 3.16 GB, 3.25 GB, 3.35 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 22.55 - BytesRead: 3.38 GB (3628229130) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.38 GB (3628229130) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.38 GB (3628229130) - DecompressionTime: 12s644ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 347 (347) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 410.21 MB (430132432) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2159787567) - RowsReturned: 2.16B (2159787567) - RowsReturnedRate: 257.14 M/sec - ScanRangesComplete: 347 (347) - ScannerThreadsInvoluntaryContextSwitches: 86.17K (86165) - ScannerThreadsTotalWallClockTime: 24m23s - MaterializeTupleTime(*): 24m4s - ScannerThreadsSysTime: 2s109ms - ScannerThreadsUserTime: 4m32s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2140385) - TotalRawHdfsReadTime(*): 2s134ms - TotalReadThroughput: 52.83 MB/sec Filter 0: - Rows processed: 5.68M (5684901) - Rows rejected: 0 (0) - Rows total: 5.69M (5685248) Filter 1: - Rows processed: 5.68M (5684901) - Rows rejected: 0 (0) - Rows total: 5.69M (5685248) Filter 2: - Rows processed: 5.68M (5684901) - Rows rejected: 0 (0) - Rows total: 5.69M (5685248) Instance 5e42471e272c7b4a:f7fdeddcf24303c2 (host=d2410.halxg.cloudera.com:22000):(Total: 1m4s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:35/8.09 GB 9:31/6.84 GB 7:38/8.42 GB 1:36/7.38 GB 0:35/8.04 GB 4:28/6.45 GB 8:35/7.89 GB 3:40/9.08 GB 6:33/7.29 GB 5:37/8.54 GB MemoryUsage(2s000ms): 178.33 MB, 366.35 MB, 368.94 MB, 362.40 MB, 386.10 MB, 417.88 MB, 390.89 MB, 350.33 MB, 340.18 MB, 361.57 MB, 364.30 MB, 356.00 MB, 344.90 MB, 367.36 MB, 383.38 MB, 373.09 MB, 338.55 MB, 343.64 MB, 366.36 MB, 366.30 MB, 365.02 MB, 359.04 MB, 357.64 MB, 367.35 MB, 361.98 MB, 362.08 MB, 380.54 MB, 387.62 MB, 369.93 MB, 354.05 MB, 353.14 MB, 310.69 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 20 - AverageThreadTokens: 23.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 429.80 MB (450680920) - PerHostPeakMemUsage: 429.80 MB (450680920) - PrepareTime: 171.611ms - RowsProduced: 1 (1) - TotalCpuTime: 25m11s - TotalNetworkReceiveTime: 12.134us - TotalNetworkSendTime: 618.226us - TotalStorageWaitTime: 6s261ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 71 (71) - BlocksRecycled: 25 (25) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 493.397ms, non-child: 493.397ms, % non-child: 100.00%) - CodegenTime: 166.392us - CompileTime: 68.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 261.510ms - PrepareTime: 162.412ms DataStreamSender (dst_id=12):(Total: 38.064us, non-child: 38.064us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 60.10 KB/sec - OverallThroughput: 410.49 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 7.894us - ThriftTransmitTime(*): 259.976us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m4s, non-child: 1s535ms, % non-child: 2.38%) ExecOption: Codegen Enabled - BuildTime: 1s346ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.98 MB (18855832) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m3s, non-child: 203.321ms, % non-child: 0.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 4.048us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 5.894us - GetNewBlockTime: 379.572us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.91 MB (12490528) - PinTime: 0.000ns - ProbeRows: 4.19M (4193198) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 161.037ms - RowsReturned: 435.39K (435390) - RowsReturnedRate: 6.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.558us EXCHANGE_NODE (id=11):(Total: 9.188us, non-child: 9.188us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.160us - DeserializeRowBatchTimer: 5.684us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 870.70 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m2s, non-child: 1s329ms, % non-child: 2.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 38.428us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 27.432us - GetNewBlockTime: 587.442us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.08 MB (5321976) - PinTime: 0.000ns - ProbeRows: 41.18M (41184420) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s252ms - RowsReturned: 4.19M (4193198) - RowsReturnedRate: 66.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.548us EXCHANGE_NODE (id=10):(Total: 22.066us, non-child: 22.066us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 11.896us - DeserializeRowBatchTimer: 19.720us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 32.63 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m1s, non-child: 52s916ms, % non-child: 85.92%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 70.904us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 58.788us - GetNewBlockTime: 554.436us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.16 MB (2269096) - PinTime: 0.000ns - ProbeRows: 2.16B (2157190811) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50s849ms - RowsReturned: 41.18M (41184420) - RowsReturnedRate: 668.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.092us EXCHANGE_NODE (id=9):(Total: 39.168us, non-child: 39.168us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 29.440us - DeserializeRowBatchTimer: 45.324us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 45.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s670ms, non-child: 8s670ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 348 Hdfs split stats (:<# splits>/): 2:35/8.09 GB 9:31/6.84 GB 7:38/8.42 GB 1:36/7.38 GB 0:35/8.04 GB 4:28/6.45 GB 8:35/7.89 GB 3:40/9.08 GB 6:33/7.29 GB 5:37/8.54 GB Runtime filters: Only following filters arrived: , waited 503ms Hdfs Read Thread Concurrency Bucket: 0:96.9% 1:2.326% 2:0.7752% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1044 BytesRead(2s000ms): 117.34 MB, 252.68 MB, 320.67 MB, 487.49 MB, 554.35 MB, 735.71 MB, 808.85 MB, 903.13 MB, 1018.94 MB, 1.10 GB, 1.21 GB, 1.30 GB, 1.42 GB, 1.53 GB, 1.66 GB, 1.73 GB, 1.86 GB, 1.94 GB, 2.09 GB, 2.17 GB, 2.28 GB, 2.38 GB, 2.48 GB, 2.60 GB, 2.69 GB, 2.82 GB, 2.90 GB, 3.04 GB, 3.12 GB, 3.23 GB, 3.33 GB, 3.40 GB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 22.49 - BytesRead: 3.40 GB (3651795339) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.40 GB (3651795339) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.40 GB (3651795339) - DecompressionTime: 12s498ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 10 (10) - NumRowGroups: 348 (348) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 418.11 MB (438419184) - PerReadThreadRawHdfsThroughput: 885.48 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2157190811) - RowsReturned: 2.16B (2157190811) - RowsReturnedRate: 248.80 M/sec - ScanRangesComplete: 348 (348) - ScannerThreadsInvoluntaryContextSwitches: 83.55K (83553) - ScannerThreadsTotalWallClockTime: 24m12s - MaterializeTupleTime(*): 23m51s - ScannerThreadsSysTime: 2s124ms - ScannerThreadsUserTime: 4m30s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2140999) - TotalRawHdfsReadTime(*): 3s933ms - TotalReadThroughput: 53.58 MB/sec Filter 0: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Filter 1: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Filter 2: - Rows processed: 5.70M (5701284) - Rows rejected: 0 (0) - Rows total: 5.70M (5701632) Instance 5e42471e272c7b4a:f7fdeddcf24303c7 (host=d2415.halxg.cloudera.com:22000):(Total: 1m4s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:33/7.59 GB 8:28/6.17 GB 7:28/6.17 GB 10:33/7.63 GB 0:28/6.19 GB 3:34/7.36 GB 2:29/6.78 GB 6:28/6.42 GB 5:35/7.58 GB 4:39/8.83 GB 9:30/7.20 GB MemoryUsage(2s000ms): 131.43 MB, 393.57 MB, 375.11 MB, 377.37 MB, 383.85 MB, 366.14 MB, 390.42 MB, 387.70 MB, 358.41 MB, 360.21 MB, 361.55 MB, 348.02 MB, 356.74 MB, 364.45 MB, 361.48 MB, 362.46 MB, 352.74 MB, 331.60 MB, 355.03 MB, 359.72 MB, 374.59 MB, 371.57 MB, 367.97 MB, 369.98 MB, 361.49 MB, 371.19 MB, 363.12 MB, 368.85 MB, 362.53 MB, 360.47 MB, 352.55 MB, 285.09 MB ThreadUsage(2s000ms): 12, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 18 - AverageThreadTokens: 23.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 404.03 MB (423651704) - PerHostPeakMemUsage: 404.03 MB (423651704) - PrepareTime: 173.013ms - RowsProduced: 1 (1) - TotalCpuTime: 24m57s - TotalNetworkReceiveTime: 10.928us - TotalNetworkSendTime: 387.220us - TotalStorageWaitTime: 4s190ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 70 (70) - BlocksRecycled: 26 (26) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 92.19 KB (94400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 492.159ms, non-child: 492.159ms, % non-child: 100.00%) - CodegenTime: 153.286us - CompileTime: 67.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.85 MB (1939816) - OptimizationTime: 259.155ms - PrepareTime: 163.672ms DataStreamSender (dst_id=12):(Total: 31.694us, non-child: 31.694us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 54.52 KB/sec - OverallThroughput: 493.00 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 8.300us - ThriftTransmitTime(*): 286.612us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 1m4s, non-child: 1s550ms, % non-child: 2.42%) ExecOption: Codegen Enabled - BuildTime: 1s360ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 17.42 MB (18266176) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=6):(Total: 1m2s, non-child: 198.778ms, % non-child: 0.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3.752us - BuildRows: 8 (8) - BuildRowsPartitioned: 8 (8) - BuildTime: 3.318us - GetNewBlockTime: 68.506us - HashBuckets: 12 (12) - HashCollisions: 0 (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.54 MB (12096288) - PinTime: 0.000ns - ProbeRows: 4.14M (4141897) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 160.644ms - RowsReturned: 507.26K (507257) - RowsReturnedRate: 8.12 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 966.000ns EXCHANGE_NODE (id=11):(Total: 8.274us, non-child: 8.274us, % non-child: 100.00%) BytesReceived(2s000ms): 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B, 225.00 B - BytesReceived: 225.00 B (225) - ConvertRowBatchTime: 1.024us - DeserializeRowBatchTimer: 6.288us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 966.88 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=5):(Total: 1m2s, non-child: 1s293ms, % non-child: 2.08%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 37.904us - BuildRows: 720 (720) - BuildRowsPartitioned: 720 (720) - BuildTime: 26.596us - GetNewBlockTime: 268.410us - HashBuckets: 1.79K (1792) - HashCollisions: 0 (0) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.08 MB (5321752) - PinTime: 0.000ns - ProbeRows: 40.74M (40744583) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s215ms - RowsReturned: 4.14M (4141897) - RowsReturnedRate: 66.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.442us EXCHANGE_NODE (id=10):(Total: 22.048us, non-child: 22.048us, % non-child: 100.00%) BytesReceived(2s000ms): 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB, 7.18 KB - BytesReceived: 7.18 KB (7349) - ConvertRowBatchTime: 11.992us - DeserializeRowBatchTimer: 20.862us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 720 (720) - RowsReturnedRate: 32.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=4):(Total: 1m, non-child: 52s425ms, % non-child: 86.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 73.966us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 60.074us - GetNewBlockTime: 187.162us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.17 MB (2277392) - PinTime: 0.000ns - ProbeRows: 2.16B (2164728988) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50s363ms - RowsReturned: 40.74M (40744583) - RowsReturnedRate: 668.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 900.000ns EXCHANGE_NODE (id=9):(Total: 36.664us, non-child: 36.664us, % non-child: 100.00%) BytesReceived(2s000ms): 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB, 23.37 KB - BytesReceived: 23.37 KB (23932) - ConvertRowBatchTime: 28.722us - DeserializeRowBatchTimer: 53.860us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 49.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 8s535ms, non-child: 8s535ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 345 Hdfs split stats (:<# splits>/): 1:33/7.59 GB 8:28/6.17 GB 7:28/6.17 GB 10:33/7.63 GB 0:28/6.19 GB 3:34/7.36 GB 2:29/6.78 GB 6:28/6.42 GB 5:35/7.58 GB 4:39/8.83 GB 9:30/7.20 GB Runtime filters: Only following filters arrived: , waited 502ms Hdfs Read Thread Concurrency Bucket: 0:95.31% 1:3.906% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0.7812% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:1035 BytesRead(2s000ms): 145.54 MB, 262.86 MB, 366.15 MB, 522.34 MB, 574.60 MB, 755.01 MB, 829.54 MB, 965.26 MB, 1.01 GB, 1.12 GB, 1.22 GB, 1.32 GB, 1.44 GB, 1.54 GB, 1.66 GB, 1.76 GB, 1.86 GB, 1.94 GB, 2.06 GB, 2.15 GB, 2.29 GB, 2.39 GB, 2.49 GB, 2.61 GB, 2.72 GB, 2.83 GB, 2.93 GB, 3.05 GB, 3.13 GB, 3.26 GB, 3.34 GB, 3.40 GB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 22.53 - BytesRead: 3.40 GB (3649353971) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.40 GB (3649353971) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.40 GB (3649353971) - DecompressionTime: 12s752ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 11 (11) - NumRowGroups: 345 (345) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 389.97 MB (408909216) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.16B (2164728988) - RowsReturned: 2.16B (2164728988) - RowsReturnedRate: 253.62 M/sec - ScanRangesComplete: 345 (345) - ScannerThreadsInvoluntaryContextSwitches: 84.46K (84462) - ScannerThreadsTotalWallClockTime: 23m57s - MaterializeTupleTime(*): 23m37s - ScannerThreadsSysTime: 2s260ms - ScannerThreadsUserTime: 4m36s - ScannerThreadsVoluntaryContextSwitches: 2.14M (2143719) - TotalRawHdfsReadTime(*): 2s267ms - TotalReadThroughput: 54.38 MB/sec Filter 0: - Rows processed: 5.65M (5652135) - Rows rejected: 0 (0) - Rows total: 5.65M (5652480) Filter 1: - Rows processed: 5.65M (5652135) - Rows rejected: 0 (0) - Rows total: 5.65M (5652480) Filter 2: - Rows processed: 5.65M (5652135) - Rows rejected: 0 (0) - Rows total: 5.65M (5652480) Fragment F03: Instance 5e42471e272c7b4a:f7fdeddcf24303c8 (host=d2421.halxg.cloudera.com:22000):(Total: 10.931ms, non-child: 3.447ms, % non-child: 31.54%) Hdfs split stats (:<# splits>/): 2:1/11.92 KB MemoryUsage(500.000ms): 72.00 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 158.00 KB (161792) - PerHostPeakMemUsage: 204.94 KB (209856) - PrepareTime: 95.408us - RowsProduced: 8 (8) - TotalCpuTime: 20.329ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 284.474ms - TotalStorageWaitTime: 6.693ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=11):(Total: 137.380us, non-child: 137.380us, % non-child: 100.00%) - BytesSent: 4.39 KB (4500) - NetworkThroughput(*): 1.12 KB/sec - OverallThroughput: 31.24 MB/sec - PeakMemoryUsage: 80.00 KB (81920) - SerializeBatchTime: 15.988us - ThriftTransmitTime(*): 3s920ms - UncompressedRowBatchSize: 6.17 KB (6320) HDFS_SCAN_NODE (id=3):(Total: 7.345ms, non-child: 7.345ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/11.92 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 12.41 KB (12711) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.41 KB (12711) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.41 KB (12711) - DecompressionTime: 2.528us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 70.00 KB (71680) - PerReadThreadRawHdfsThroughput: 652.50 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62 (62) - RowsReturned: 8 (8) - RowsReturnedRate: 1.09 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 7.051ms - MaterializeTupleTime(*): 20.340us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 18.578us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 5e42471e272c7b4a:f7fdeddcf24303c9 (host=d2405.halxg.cloudera.com:22000):(Total: 20.189ms, non-child: 2.692ms, % non-child: 13.34%) Hdfs split stats (:<# splits>/): 5:1/41.12 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 441.20 KB (451792) - PerHostPeakMemUsage: 441.20 KB (451792) - PrepareTime: 99.500us - RowsProduced: 720 (720) - TotalCpuTime: 27.463ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 279.068ms - TotalStorageWaitTime: 15.843ms DataStreamSender (dst_id=10):(Total: 212.316us, non-child: 212.316us, % non-child: 100.00%) - BytesSent: 143.54 KB (146980) - NetworkThroughput(*): 38.77 KB/sec - OverallThroughput: 660.20 MB/sec - PeakMemoryUsage: 160.00 KB (163840) - SerializeBatchTime: 113.308us - ThriftTransmitTime(*): 3s702ms - UncompressedRowBatchSize: 281.33 KB (288080) HDFS_SCAN_NODE (id=1):(Total: 17.284ms, non-child: 17.284ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 5:1/41.12 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 80.89 KB (82833) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.89 KB (82833) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.89 KB (82833) - DecompressionTime: 5.984us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 273.20 KB (279760) - PerReadThreadRawHdfsThroughput: 2.70 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.20K (7200) - RowsReturned: 720 (720) - RowsReturnedRate: 41.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.960ms - MaterializeTupleTime(*): 714.336us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 28.622us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 5e42471e272c7b4a:f7fdeddcf24303ca (host=d2407.halxg.cloudera.com:22000):(Total: 296.086ms, non-child: 2.968ms, % non-child: 1.00%) Hdfs split stats (:<# splits>/): 7:1/1.30 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.00 MB (2095960) - PerHostPeakMemUsage: 2.00 MB (2095960) - PrepareTime: 107.374us - RowsProduced: 1.80K (1800) - TotalCpuTime: 43.180ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 271.004ms - TotalStorageWaitTime: 10.200ms DataStreamSender (dst_id=9):(Total: 271.302ms, non-child: 271.302ms, % non-child: 100.00%) - BytesSent: 467.42 KB (478640) - NetworkThroughput(*): 127.27 KB/sec - OverallThroughput: 1.68 MB/sec - PeakMemoryUsage: 106.56 KB (109120) - SerializeBatchTime: 150.894us - ThriftTransmitTime(*): 3s672ms - UncompressedRowBatchSize: 984.53 KB (1008160) HDFS_SCAN_NODE (id=2):(Total: 21.815ms, non-child: 21.815ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/1.30 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 517.10 KB (529509) - BytesReadDataNodeCache: 0 - BytesReadLocal: 517.10 KB (529509) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 517.10 KB (529509) - DecompressionTime: 645.722us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.89 MB (1978648) - PerReadThreadRawHdfsThroughput: 3.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 86.40K (86400) - RowsReturned: 1.80K (1800) - RowsReturnedRate: 82.51 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 21.589ms - MaterializeTupleTime(*): 9.619ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 156.248us - TotalReadThroughput: 0.00 /sec