Query (id=24495d00ab75cd74:1dfb5758d7705ab6): Summary: Session ID: e5499476db360fb0:6fd0898bd868689c Session Type: BEESWAX Start Time: 2016-02-16 15:05:24.530898000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.5.0-cdh5-INTERNAL RELEASE (build 6e414261d589ed73c58aad9dfe299288703b9730) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.20.122.102:53271 Default Db: tpch_10000_decimal_parquet Sql Statement: select count(*) from customer, orders where c_mktsegment = 'BUILDING' and c_custkey = o_custkey and o_orderdate < '1995-03-15' Coordinator: d2402.halxg.cloudera.com:22000 Query Options (non default): EXPLAIN_LEVEL=2,NUM_SCANNER_THREADS=24,ENABLE_RUNTIME_FILTER_PROPAGATION=1,RUNTIME_BLOOM_FILTER_SIZE=1073741824,RUNTIME_FILTER_WAIT_TIME_MS=10000000 Plan: ---------------- Estimated Per-Host Requirements: Memory=705.28MB VCores=2 07:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=20 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 06:EXCHANGE [UNPARTITIONED] | hosts=20 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=20 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: o_custkey = c_custkey | runtime filters: RF000 <- c_custkey | hosts=20 per-host-mem=519.28MB | tuple-ids=1,0 row-size=67B cardinality=458630203 | |--05:EXCHANGE [HASH(c_custkey)] | | hosts=20 per-host-mem=0B | | tuple-ids=0 row-size=33B cardinality=300000000 | | | 00:SCAN HDFS [tpch_10000_decimal_parquet.customer, RANDOM] | partitions=1/1 files=484 size=117.35GB | predicates: c_mktsegment = 'BUILDING' | table stats: 1500000000 rows total | column stats: all | hosts=20 per-host-mem=176.00MB | tuple-ids=0 row-size=33B cardinality=300000000 | 04:EXCHANGE [HASH(o_custkey)] | hosts=20 per-host-mem=0B | tuple-ids=1 row-size=34B cardinality=1500000000 | 01:SCAN HDFS [tpch_10000_decimal_parquet.orders, RANDOM] partitions=1/1 files=2640 size=650.00GB predicates: o_orderdate < '1995-03-15' runtime filters: RF000 -> o_custkey table stats: 15000000000 rows total column stats: all hosts=20 per-host-mem=176.00MB tuple-ids=1 row-size=34B cardinality=1500000000 ---------------- Estimated Per-Host Mem: 739535150 Estimated Per-Host VCores: 2 Request Pool: default-pool Planner Timeline: 15.317ms - Analysis finished: 2.981ms (2.981ms) - Equivalence classes computed: 3.359ms (378.109us) - Single node plan created: 9.131ms (5.772ms) - Runtime filters computed: 9.251ms (119.971us) - Distributed plan created: 12.191ms (2.939ms) - Lineage info computed: 12.890ms (699.294us) - Planning finished: 15.317ms (2.427ms) Query Timeline: 19s474ms - Start execution: 51.162us (51.162us) - Planning finished: 39.051ms (39.000ms) - Ready to start 60 remote fragments: 231.911ms (192.860ms) - All 60 remote fragments started: 237.938ms (6.027ms) ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile 24495d00ab75cd74:1dfb5758d7705ab6:(Total: 193.474ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ------ Filter routing table ------ id: 0 src: 2 dst: 1 num. destinations: 20 num. pending: 20 Fragment start latencies: Count: 60, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 2ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F03:(Total: 186.808ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.00 KB (12288) - PerHostPeakMemUsage: 0 - PrepareTime: 186.432ms - RowsProduced: 0 (0) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 502.914ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 479.646us - CompileTime: 7.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 309.576ms - PrepareTime: 184.142ms AGGREGATION_NODE (id=7):(Total: 186.431ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.00 KB (4096) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6): BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 199.874ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.41 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241326080) - PerHostPeakMemUsage: 2.13 GB (2288287050) - PrepareTime: 199.176ms - RowsProduced: 0 (0) - TotalCpuTime: 6s786ms - TotalNetworkReceiveTime: 6s008ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 773.656ms, non-child: 773.656ms, % non-child: 100.00%) - CodegenTime: 204.825us - CompileTime: 65.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 512.309ms - PrepareTime: 194.041ms DataStreamSender (dst_id=6):(Total: 27.781us, non-child: 27.781us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 199.175ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 35.942ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 16s081ms, non-child: 9s150ms, % non-child: 56.90%) - BuildPartitionTime: 1s213ms - BuildRows: 15.00M (15000303) - BuildRowsPartitioned: 15.00M (15000303) - BuildTime: 1s841ms - GetNewBlockTime: 2.553ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 29.55M (29551616) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s312ms - RowsReturned: 5.91M (5909808) - RowsReturnedRate: 365.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.607us EXCHANGE_NODE (id=5):(Total: 3s030ms, non-child: 3s030ms, % non-child: 100.00%) - BytesReceived: 227.76 MB (238827441) - ConvertRowBatchTime: 286.254ms - DeserializeRowBatchTimer: 936.344ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000303) - RowsReturnedRate: 4.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s901ms, non-child: 3s901ms, % non-child: 100.00%) - BytesReceived: 658.22 MB (690197001) - ConvertRowBatchTime: 540.298ms - DeserializeRowBatchTimer: 2s464ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 29.55M (29551846) - RowsReturnedRate: 7.67 M/sec - SendersBlockedTimer: 6s841ms - SendersBlockedTotalTimer(*): 2m2s Averaged Fragment F01:(Total: 4s197ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 5.50 GB, max: 6.14 GB, avg: 5.87 GB, stddev: 143.57 MB - AverageThreadTokens: 19.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 438.43 MB (459724575) - PerHostPeakMemUsage: 1.84 GB (1971669461) - PrepareTime: 199.210ms - RowsProduced: 15.00M (15000303) - TotalCpuTime: 1m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.140ms - TotalStorageWaitTime: 2s331ms CodeGen:(Total: 670.998ms, non-child: 670.998ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.195ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 469.324ms - PrepareTime: 196.699ms DataStreamSender (dst_id=5):(Total: 3s807ms, non-child: 3s807ms, % non-child: 100.00%) - BytesSent: 227.76 MB (238827441) - NetworkThroughput(*): 47.30 MB/sec - OverallThroughput: 59.91 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s939ms - ThriftTransmitTime(*): 4s815ms - UncompressedRowBatchSize: 629.55 MB (660130583) HDFS_SCAN_NODE (id=0):(Total: 573.029ms, non-child: 573.029ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 21.37 - BytesRead: 318.26 MB (333724160) - BytesReadDataNodeCache: 0 - BytesReadLocal: 318.26 MB (333724160) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 318.26 MB (333724160) - DecompressionTime: 1s200ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 22 (22) - PeakMemoryUsage: 437.90 MB (459169154) - PerReadThreadRawHdfsThroughput: 603.51 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.00M (75000000) - RowsReturned: 15.00M (15000303) - RowsReturnedRate: 26.33 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.06K (3057) - ScannerThreadsTotalWallClockTime: 1m24s - MaterializeTupleTime(*): 1m19s - ScannerThreadsSysTime: 87.774ms - ScannerThreadsUserTime: 7s589ms - ScannerThreadsVoluntaryContextSwitches: 14.30K (14299) - TotalRawHdfsReadTime(*): 544.035ms - TotalReadThroughput: 71.24 MB/sec Averaged Fragment F00:(Total: 16s782ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 32.24 GB, max: 32.67 GB, avg: 32.50 GB, stddev: 128.27 MB - AverageThreadTokens: 22.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 1000.95 MB (1049576938) - PerHostPeakMemUsage: 2.13 GB (2288287050) - PrepareTime: 195.087ms - RowsProduced: 30.91M (30911382) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s939ms - TotalStorageWaitTime: 2s113ms CodeGen:(Total: 666.936ms, non-child: 666.936ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 466.447ms - PrepareTime: 192.097ms DataStreamSender (dst_id=4):(Total: 16s364ms, non-child: 16s364ms, % non-child: 100.00%) - BytesSent: 688.58 MB (722025357) - NetworkThroughput(*): 5.22 MB/sec - OverallThroughput: 41.81 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 5s568ms - ThriftTransmitTime(*): 2m13s - UncompressedRowBatchSize: 1.32 GB (1421899050) HDFS_SCAN_NODE (id=1):(Total: 584.045ms, non-child: 584.045ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 22.70 - BytesRead: 942.93 MB (988729659) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s048ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 22 (22) - NumScannerThreadsStarted: 22 (22) - PeakMemoryUsage: 1000.39 MB (1048989179) - PerReadThreadRawHdfsThroughput: 523.96 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 64.23M (64233853) - RowsReturned: 30.91M (30911843) - RowsReturnedRate: 52.97 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 466.151ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s855ms - TotalReadThroughput: 55.62 MB/sec Filter 0: - Rows processed: 819 (819) - Rows rejected: 0 (0) - Rows total: 819 (819) Fragment F02: Instance 24495d00ab75cd74:1dfb5758d7705ab9 (host=d2418.halxg.cloudera.com:22000):(Total: 194.794ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 21.66 MB, 159.87 MB, 287.89 MB, 287.91 MB, 415.87 MB, 415.84 MB, 543.88 MB, 671.89 MB, 671.86 MB, 767.83 MB, 863.83 MB, 959.83 MB, 1.03 GB, 1.12 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.15 GB (2303567640) - PrepareTime: 193.995ms - RowsProduced: 0 (0) - TotalCpuTime: 6s835ms - TotalNetworkReceiveTime: 5s645ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 739.865ms, non-child: 739.865ms, % non-child: 100.00%) - CodegenTime: 168.248us - CompileTime: 60.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 488.037ms - PrepareTime: 189.739ms DataStreamSender (dst_id=6):(Total: 13.238us, non-child: 13.238us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 193.994ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 29.044ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s419ms, non-child: 7s986ms, % non-child: 55.39%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s462ms - BuildRows: 15.00M (14997415) - BuildRowsPartitioned: 15.00M (14997415) - BuildTime: 1s843ms - GetNewBlockTime: 2.591ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 24.02M (24023040) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s891ms - RowsReturned: 4.81M (4805847) - RowsReturnedRate: 333.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.100us EXCHANGE_NODE (id=5):(Total: 2s810ms, non-child: 593.537ms, % non-child: 21.12%) BytesReceived(500.000ms): 0, 3.55 MB, 29.58 MB, 58.78 MB, 88.10 MB, 117.65 MB, 147.48 MB, 177.41 MB, 207.63 MB, 226.86 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB, 227.73 MB - BytesReceived: 227.73 MB (238790550) - ConvertRowBatchTime: 277.695ms - DeserializeRowBatchTimer: 938.300ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (14997415) - RowsReturnedRate: 5.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s622ms, non-child: 917.323ms, % non-child: 25.32%) BytesReceived(500.000ms): 0, 5.37 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 18.36 MB, 52.83 MB, 86.56 MB, 121.17 MB, 155.82 MB, 191.20 MB, 225.66 MB, 260.27 MB, 294.83 MB, 329.31 MB, 365.00 MB, 400.81 MB, 437.01 MB, 472.92 MB, 509.08 MB - BytesReceived: 533.47 MB (559387223) - ConvertRowBatchTime: 432.417ms - DeserializeRowBatchTimer: 1s819ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 24.02M (24023552) - RowsReturnedRate: 6.63 M/sec - SendersBlockedTimer: 6s622ms - SendersBlockedTotalTimer(*): 2m12s Instance 24495d00ab75cd74:1dfb5758d7705abd (host=d2411.halxg.cloudera.com:22000):(Total: 196.000ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.00 KB, 159.88 MB, 159.91 MB, 287.88 MB, 287.88 MB, 415.93 MB, 543.89 MB, 543.91 MB, 671.84 MB, 703.83 MB, 799.83 MB, 895.83 MB, 1023.83 MB, 1.09 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.42 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302515216) - PrepareTime: 195.505ms - RowsProduced: 0 (0) - TotalCpuTime: 6s821ms - TotalNetworkReceiveTime: 5s600ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 722.977ms, non-child: 722.977ms, % non-child: 100.00%) - CodegenTime: 199.916us - CompileTime: 62.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 467.630ms - PrepareTime: 189.566ms DataStreamSender (dst_id=6):(Total: 17.106us, non-child: 17.106us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 195.504ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 27.535ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s439ms, non-child: 8s034ms, % non-child: 55.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s158ms - BuildRows: 15.00M (14999136) - BuildRowsPartitioned: 15.00M (14999136) - BuildTime: 1s828ms - GetNewBlockTime: 2.312ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 24.02M (24022016) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s278ms - RowsReturned: 4.80M (4804680) - RowsReturnedRate: 332.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.690us EXCHANGE_NODE (id=5):(Total: 3s134ms, non-child: 605.808ms, % non-child: 19.33%) BytesReceived(500.000ms): 0, 16.50 MB, 45.43 MB, 74.77 MB, 104.30 MB, 134.01 MB, 163.78 MB, 193.88 MB, 220.79 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB, 227.74 MB - BytesReceived: 227.74 MB (238807086) - ConvertRowBatchTime: 284.254ms - DeserializeRowBatchTimer: 951.159ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (14999136) - RowsReturnedRate: 4.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s270ms, non-child: 980.394ms, % non-child: 29.97%) BytesReceived(500.000ms): 0, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.28 MB, 37.17 MB, 70.73 MB, 105.52 MB, 140.07 MB, 175.12 MB, 210.20 MB, 244.17 MB, 278.39 MB, 313.46 MB, 348.61 MB, 384.27 MB, 420.39 MB, 456.40 MB, 492.41 MB, 528.77 MB - BytesReceived: 533.53 MB (559442178) - ConvertRowBatchTime: 438.466ms - DeserializeRowBatchTimer: 1s924ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 24.02M (24023040) - RowsReturnedRate: 7.34 M/sec - SendersBlockedTimer: 6s592ms - SendersBlockedTotalTimer(*): 2m5s Instance 24495d00ab75cd74:1dfb5758d7705ac7 (host=d2403.halxg.cloudera.com:22000):(Total: 199.820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.00 KB, 159.88 MB, 159.93 MB, 287.86 MB, 287.93 MB, 415.89 MB, 543.91 MB, 543.86 MB, 671.89 MB, 703.83 MB, 799.83 MB, 895.83 MB, 991.83 MB, 1.06 GB, 1.15 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.42 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302586744) - PrepareTime: 199.191ms - RowsProduced: 0 (0) - TotalCpuTime: 6s773ms - TotalNetworkReceiveTime: 6s006ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 796.972ms, non-child: 796.972ms, % non-child: 100.00%) - CodegenTime: 179.686us - CompileTime: 67.217ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 533.688ms - PrepareTime: 194.284ms DataStreamSender (dst_id=6):(Total: 16.367us, non-child: 16.367us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 199.190ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 29.200ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 14s366ms, non-child: 7s564ms, % non-child: 52.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s147ms - BuildRows: 15.00M (14999644) - BuildRowsPartitioned: 15.00M (14999644) - BuildTime: 1s857ms - GetNewBlockTime: 3.378ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 24.05M (24045568) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s802ms - RowsReturned: 4.81M (4809955) - RowsReturnedRate: 334.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.220us EXCHANGE_NODE (id=5):(Total: 3s076ms, non-child: 621.892ms, % non-child: 20.21%) BytesReceived(500.000ms): 0, 14.35 MB, 43.19 MB, 72.53 MB, 101.97 MB, 131.63 MB, 161.48 MB, 191.60 MB, 219.05 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB - BytesReceived: 227.76 MB (238818540) - ConvertRowBatchTime: 281.473ms - DeserializeRowBatchTimer: 934.089ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (14999644) - RowsReturnedRate: 4.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s725ms, non-child: 961.624ms, % non-child: 25.81%) BytesReceived(500.000ms): 0, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.27 MB, 34.60 MB, 68.20 MB, 102.97 MB, 137.57 MB, 172.41 MB, 207.62 MB, 241.62 MB, 275.81 MB, 310.95 MB, 346.00 MB, 381.66 MB, 417.73 MB, 453.82 MB, 489.79 MB, 526.13 MB - BytesReceived: 533.99 MB (559924320) - ConvertRowBatchTime: 429.485ms - DeserializeRowBatchTimer: 1s896ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 24.05M (24045568) - RowsReturnedRate: 6.45 M/sec - SendersBlockedTimer: 6s618ms - SendersBlockedTotalTimer(*): 2m5s Instance 24495d00ab75cd74:1dfb5758d7705ac0 (host=d2410.halxg.cloudera.com:22000):(Total: 196.193ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 7.04 MB, 159.86 MB, 159.84 MB, 287.86 MB, 415.86 MB, 415.89 MB, 543.84 MB, 543.86 MB, 671.88 MB, 735.83 MB, 831.83 MB, 927.83 MB, 1023.83 MB, 1.09 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.41 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2301948400) - PrepareTime: 195.347ms - RowsProduced: 0 (0) - TotalCpuTime: 6s801ms - TotalNetworkReceiveTime: 5s467ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 776.993ms, non-child: 776.993ms, % non-child: 100.00%) - CodegenTime: 197.408us - CompileTime: 64.063ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 520.341ms - PrepareTime: 190.869ms DataStreamSender (dst_id=6):(Total: 17.048us, non-child: 17.048us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 195.346ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 32.721ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s379ms, non-child: 9s046ms, % non-child: 58.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s094ms - BuildRows: 15.00M (15000493) - BuildRowsPartitioned: 15.00M (15000493) - BuildTime: 1s841ms - GetNewBlockTime: 2.534ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.30M (27298816) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s319ms - RowsReturned: 5.46M (5457173) - RowsReturnedRate: 354.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.884us EXCHANGE_NODE (id=5):(Total: 3s148ms, non-child: 600.046ms, % non-child: 19.06%) BytesReceived(500.000ms): 0, 1.25 MB, 23.44 MB, 52.45 MB, 81.77 MB, 111.35 MB, 141.15 MB, 170.98 MB, 201.21 MB, 225.36 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB - BytesReceived: 227.76 MB (238825276) - ConvertRowBatchTime: 266.135ms - DeserializeRowBatchTimer: 953.747ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000493) - RowsReturnedRate: 4.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s184ms, non-child: 1s093ms, % non-child: 34.33%) BytesReceived(500.000ms): 0, 1.73 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 11.11 MB, 45.54 MB, 79.19 MB, 113.73 MB, 148.51 MB, 183.58 MB, 218.67 MB, 252.81 MB, 287.09 MB, 321.68 MB, 357.27 MB, 392.99 MB, 429.23 MB, 465.25 MB, 501.27 MB, 537.77 MB, 574.56 MB - BytesReceived: 607.08 MB (636567366) - ConvertRowBatchTime: 509.527ms - DeserializeRowBatchTimer: 2s161ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.30M (27298816) - RowsReturnedRate: 8.57 M/sec - SendersBlockedTimer: 6s625ms - SendersBlockedTotalTimer(*): 1m46s Instance 24495d00ab75cd74:1dfb5758d7705abf (host=d2417.halxg.cloudera.com:22000):(Total: 195.930ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 159.91 MB, 159.84 MB, 287.88 MB, 287.86 MB, 415.88 MB, 415.87 MB, 543.86 MB, 671.88 MB, 671.86 MB, 767.83 MB, 895.83 MB, 991.83 MB, 1.06 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302953568) - PrepareTime: 195.247ms - RowsProduced: 0 (0) - TotalCpuTime: 6s749ms - TotalNetworkReceiveTime: 5s787ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 789.313ms, non-child: 789.313ms, % non-child: 100.00%) - CodegenTime: 174.232us - CompileTime: 68.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 528.309ms - PrepareTime: 190.814ms DataStreamSender (dst_id=6):(Total: 15.160us, non-child: 15.160us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 195.246ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 32.429ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s366ms, non-child: 8s740ms, % non-child: 56.88%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s088ms - BuildRows: 15.00M (14999522) - BuildRowsPartitioned: 15.00M (14999522) - BuildTime: 1s839ms - GetNewBlockTime: 2.287ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.29M (27288576) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s056ms - RowsReturned: 5.46M (5456230) - RowsReturnedRate: 355.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.316us EXCHANGE_NODE (id=5):(Total: 3s142ms, non-child: 596.996ms, % non-child: 19.00%) BytesReceived(500.000ms): 0, 8.20 MB, 36.45 MB, 65.77 MB, 95.11 MB, 124.70 MB, 154.54 MB, 184.56 MB, 213.53 MB, 227.60 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB, 227.76 MB - BytesReceived: 227.76 MB (238821221) - ConvertRowBatchTime: 268.526ms - DeserializeRowBatchTimer: 949.907ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (14999522) - RowsReturnedRate: 4.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s484ms, non-child: 1s045ms, % non-child: 30.01%) BytesReceived(500.000ms): 0, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 26.51 MB, 60.36 MB, 94.84 MB, 129.57 MB, 164.10 MB, 199.26 MB, 233.22 MB, 267.61 MB, 302.81 MB, 337.39 MB, 373.20 MB, 409.15 MB, 445.28 MB, 481.20 MB, 517.49 MB, 554.13 MB, 590.86 MB - BytesReceived: 606.86 MB (636343953) - ConvertRowBatchTime: 485.153ms - DeserializeRowBatchTimer: 2s102ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.29M (27288576) - RowsReturnedRate: 7.83 M/sec - SendersBlockedTimer: 6s587ms - SendersBlockedTotalTimer(*): 2m5s Instance 24495d00ab75cd74:1dfb5758d7705abb (host=d2405.halxg.cloudera.com:22000):(Total: 197.075ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.00 KB, 159.86 MB, 159.89 MB, 287.88 MB, 287.86 MB, 415.91 MB, 543.91 MB, 543.86 MB, 671.84 MB, 703.83 MB, 799.83 MB, 895.83 MB, 1023.83 MB, 1.09 GB, 1.14 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302083592) - PrepareTime: 196.424ms - RowsProduced: 0 (0) - TotalCpuTime: 6s794ms - TotalNetworkReceiveTime: 6s302ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 774.356ms, non-child: 774.356ms, % non-child: 100.00%) - CodegenTime: 189.000us - CompileTime: 65.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 515.519ms - PrepareTime: 191.903ms DataStreamSender (dst_id=6):(Total: 12.384us, non-child: 12.384us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 196.422ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 32.211ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s383ms, non-child: 8s231ms, % non-child: 53.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s121ms - BuildRows: 15.00M (15001280) - BuildRowsPartitioned: 15.00M (15001280) - BuildTime: 1s843ms - GetNewBlockTime: 2.413ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.31M (27312128) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s480ms - RowsReturned: 5.46M (5456977) - RowsReturnedRate: 354.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.626us EXCHANGE_NODE (id=5):(Total: 3s120ms, non-child: 594.452ms, % non-child: 19.05%) BytesReceived(500.000ms): 0, 15.98 MB, 44.85 MB, 74.21 MB, 103.65 MB, 133.36 MB, 163.18 MB, 193.35 MB, 220.36 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB - BytesReceived: 227.77 MB (238834329) - ConvertRowBatchTime: 275.773ms - DeserializeRowBatchTimer: 921.082ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15001280) - RowsReturnedRate: 4.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s031ms, non-child: 1s034ms, % non-child: 25.67%) BytesReceived(500.000ms): 0, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.27 MB, 36.58 MB, 70.21 MB, 105.03 MB, 139.66 MB, 174.58 MB, 209.78 MB, 243.77 MB, 278.12 MB, 313.27 MB, 348.38 MB, 384.03 MB, 420.10 MB, 456.20 MB, 492.21 MB, 528.54 MB, 565.31 MB, 601.97 MB - BytesReceived: 607.34 MB (636841068) - ConvertRowBatchTime: 485.977ms - DeserializeRowBatchTimer: 2s069ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.31M (27312640) - RowsReturnedRate: 6.78 M/sec - SendersBlockedTimer: 6s616ms - SendersBlockedTotalTimer(*): 1m59s Instance 24495d00ab75cd74:1dfb5758d7705aca (host=d2409.halxg.cloudera.com:22000):(Total: 196.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 21.41 MB, 159.91 MB, 287.84 MB, 287.89 MB, 415.86 MB, 415.91 MB, 543.84 MB, 671.84 MB, 671.84 MB, 735.83 MB, 863.83 MB, 959.83 MB, 1.03 GB, 1.12 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302291688) - PrepareTime: 195.118ms - RowsProduced: 0 (0) - TotalCpuTime: 6s832ms - TotalNetworkReceiveTime: 5s644ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 746.419ms, non-child: 746.419ms, % non-child: 100.00%) - CodegenTime: 186.676us - CompileTime: 64.515ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 490.232ms - PrepareTime: 189.952ms DataStreamSender (dst_id=6):(Total: 29.516us, non-child: 29.516us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 195.116ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 31.134ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s409ms, non-child: 8s909ms, % non-child: 57.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s102ms - BuildRows: 15.01M (15012141) - BuildRowsPartitioned: 15.01M (15012141) - BuildTime: 1s834ms - GetNewBlockTime: 2.525ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.30M (27303936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s178ms - RowsReturned: 5.46M (5463659) - RowsReturnedRate: 354.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.220us EXCHANGE_NODE (id=5):(Total: 3s175ms, non-child: 602.774ms, % non-child: 18.98%) BytesReceived(500.000ms): 0, 3.44 MB, 29.47 MB, 58.67 MB, 88.02 MB, 117.61 MB, 147.47 MB, 177.41 MB, 207.61 MB, 227.01 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB, 227.91 MB - BytesReceived: 227.91 MB (238985842) - ConvertRowBatchTime: 269.599ms - DeserializeRowBatchTimer: 961.293ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.01M (15012141) - RowsReturnedRate: 4.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s324ms, non-child: 1s079ms, % non-child: 32.48%) BytesReceived(500.000ms): 0, 5.25 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 18.19 MB, 52.66 MB, 86.39 MB, 121.03 MB, 155.62 MB, 191.02 MB, 225.48 MB, 260.08 MB, 294.65 MB, 329.10 MB, 364.84 MB, 400.66 MB, 436.87 MB, 472.75 MB, 508.92 MB, 545.48 MB, 582.28 MB - BytesReceived: 607.15 MB (636642286) - ConvertRowBatchTime: 495.354ms - DeserializeRowBatchTimer: 2s158ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.30M (27303936) - RowsReturnedRate: 8.21 M/sec - SendersBlockedTimer: 6s627ms - SendersBlockedTotalTimer(*): 1m52s Instance 24495d00ab75cd74:1dfb5758d7705acb (host=d2419.halxg.cloudera.com:22000):(Total: 197.011ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 19.49 MB, 159.82 MB, 287.84 MB, 287.88 MB, 415.86 MB, 415.84 MB, 543.95 MB, 543.86 MB, 671.84 MB, 735.80 MB, 831.80 MB, 959.80 MB, 1.03 GB, 1.12 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241308160) - PerHostPeakMemUsage: 2.14 GB (2302948328) - PrepareTime: 196.392ms - RowsProduced: 0 (0) - TotalCpuTime: 6s826ms - TotalNetworkReceiveTime: 5s643ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 744.559ms, non-child: 744.559ms, % non-child: 100.00%) - CodegenTime: 186.460us - CompileTime: 50.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 500.703ms - PrepareTime: 191.113ms DataStreamSender (dst_id=6):(Total: 13.110us, non-child: 13.110us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 196.391ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 31.650ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s411ms, non-child: 8s911ms, % non-child: 57.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s125ms - BuildRows: 15.00M (15000856) - BuildRowsPartitioned: 15.00M (15000856) - BuildTime: 1s848ms - GetNewBlockTime: 2.349ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.29M (27290624) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s165ms - RowsReturned: 5.46M (5457781) - RowsReturnedRate: 354.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.668us EXCHANGE_NODE (id=5):(Total: 3s155ms, non-child: 591.187ms, % non-child: 18.74%) BytesReceived(500.000ms): 0, 2.79 MB, 28.14 MB, 57.25 MB, 86.55 MB, 116.14 MB, 145.91 MB, 175.83 MB, 206.09 MB, 226.66 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB - BytesReceived: 227.79 MB (238854213) - ConvertRowBatchTime: 271.874ms - DeserializeRowBatchTimer: 919.907ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000856) - RowsReturnedRate: 4.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s344ms, non-child: 1s055ms, % non-child: 31.55%) BytesReceived(500.000ms): 0, 4.39 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 16.51 MB, 51.09 MB, 84.83 MB, 119.40 MB, 154.08 MB, 189.37 MB, 224.45 MB, 258.41 MB, 292.91 MB, 327.36 MB, 363.00 MB, 398.75 MB, 434.91 MB, 470.85 MB, 506.93 MB, 543.42 MB, 580.21 MB - BytesReceived: 606.87 MB (636350937) - ConvertRowBatchTime: 497.778ms - DeserializeRowBatchTimer: 2s089ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.29M (27291136) - RowsReturnedRate: 8.16 M/sec - SendersBlockedTimer: 6s619ms - SendersBlockedTotalTimer(*): 2m12s Instance 24495d00ab75cd74:1dfb5758d7705ac4 (host=d2406.halxg.cloudera.com:22000):(Total: 198.436ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 159.86 MB, 159.89 MB, 287.86 MB, 287.93 MB, 415.86 MB, 415.87 MB, 543.86 MB, 671.86 MB, 671.86 MB, 767.83 MB, 863.83 MB, 959.83 MB, 1.06 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302228800) - PrepareTime: 197.717ms - RowsProduced: 0 (0) - TotalCpuTime: 6s755ms - TotalNetworkReceiveTime: 6s229ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 818.745ms, non-child: 818.745ms, % non-child: 100.00%) - CodegenTime: 305.398us - CompileTime: 70.892ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 553.315ms - PrepareTime: 192.771ms DataStreamSender (dst_id=6):(Total: 16.908us, non-child: 16.908us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 197.716ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 32.854ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s337ms, non-child: 8s253ms, % non-child: 53.81%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s185ms - BuildRows: 15.00M (15000636) - BuildRowsPartitioned: 15.00M (15000636) - BuildTime: 1s841ms - GetNewBlockTime: 2.278ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.30M (27298816) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s437ms - RowsReturned: 5.46M (5456652) - RowsReturnedRate: 355.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.768us EXCHANGE_NODE (id=5):(Total: 3s014ms, non-child: 598.188ms, % non-child: 19.84%) BytesReceived(500.000ms): 0, 7.64 MB, 35.81 MB, 65.11 MB, 94.52 MB, 124.04 MB, 153.92 MB, 183.96 MB, 213.04 MB, 227.58 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB - BytesReceived: 227.77 MB (238832742) - ConvertRowBatchTime: 280.236ms - DeserializeRowBatchTimer: 935.369ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000636) - RowsReturnedRate: 4.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s069ms, non-child: 1s031ms, % non-child: 25.35%) BytesReceived(500.000ms): 0, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 25.70 MB, 59.58 MB, 94.11 MB, 128.86 MB, 163.41 MB, 198.58 MB, 232.57 MB, 266.94 MB, 302.19 MB, 336.76 MB, 372.53 MB, 408.49 MB, 444.62 MB, 480.53 MB, 516.80 MB, 553.43 MB, 590.14 MB - BytesReceived: 607.06 MB (636543663) - ConvertRowBatchTime: 490.887ms - DeserializeRowBatchTimer: 2s046ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.30M (27299328) - RowsReturnedRate: 6.71 M/sec - SendersBlockedTimer: 6s622ms - SendersBlockedTotalTimer(*): 1m52s Instance 24495d00ab75cd74:1dfb5758d7705ac9 (host=d2415.halxg.cloudera.com:22000):(Total: 198.413ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 157.44 MB, 159.91 MB, 287.84 MB, 287.86 MB, 416.00 MB, 415.86 MB, 543.89 MB, 671.88 MB, 671.88 MB, 767.83 MB, 863.83 MB, 959.83 MB, 1.03 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302713976) - PrepareTime: 197.550ms - RowsProduced: 0 (0) - TotalCpuTime: 6s807ms - TotalNetworkReceiveTime: 6s374ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 762.559ms, non-child: 762.559ms, % non-child: 100.00%) - CodegenTime: 257.375us - CompileTime: 62.811ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 505.420ms - PrepareTime: 190.772ms DataStreamSender (dst_id=6):(Total: 14.494us, non-child: 14.494us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 197.549ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 33.123ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s394ms, non-child: 8s145ms, % non-child: 52.91%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s158ms - BuildRows: 15.00M (15003040) - BuildRowsPartitioned: 15.00M (15003040) - BuildTime: 1s855ms - GetNewBlockTime: 2.401ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.30M (27303936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s365ms - RowsReturned: 5.46M (5463343) - RowsReturnedRate: 354.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.082us EXCHANGE_NODE (id=5):(Total: 3s102ms, non-child: 593.016ms, % non-child: 19.12%) BytesReceived(500.000ms): 0, 6.35 MB, 34.08 MB, 63.35 MB, 92.73 MB, 122.30 MB, 152.15 MB, 182.18 MB, 211.60 MB, 227.49 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB - BytesReceived: 227.81 MB (238873213) - ConvertRowBatchTime: 282.036ms - DeserializeRowBatchTimer: 883.784ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15003040) - RowsReturnedRate: 4.84 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s147ms, non-child: 1s117ms, % non-child: 26.94%) BytesReceived(500.000ms): 0, 8.89 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.21 MB, 23.68 MB, 57.63 MB, 92.01 MB, 126.76 MB, 161.29 MB, 196.57 MB, 230.83 MB, 265.29 MB, 300.28 MB, 334.81 MB, 370.60 MB, 406.42 MB, 442.54 MB, 478.52 MB, 514.74 MB, 551.30 MB, 588.03 MB - BytesReceived: 607.15 MB (636642554) - ConvertRowBatchTime: 499.785ms - DeserializeRowBatchTimer: 2s158ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.30M (27303936) - RowsReturnedRate: 6.58 M/sec - SendersBlockedTimer: 6s619ms - SendersBlockedTotalTimer(*): 1m52s Instance 24495d00ab75cd74:1dfb5758d7705abe (host=d2402.halxg.cloudera.com:22000):(Total: 205.467ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 9.32 MB, 159.93 MB, 159.86 MB, 287.89 MB, 415.88 MB, 415.94 MB, 543.91 MB, 543.87 MB, 671.86 MB, 735.83 MB, 831.83 MB, 959.83 MB, 1.03 GB, 1.12 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.41 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 1.87 GB (2009996408) - PrepareTime: 204.588ms - RowsProduced: 0 (0) - TotalCpuTime: 6s690ms - TotalNetworkReceiveTime: 5s439ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 796.028ms, non-child: 796.028ms, % non-child: 100.00%) - CodegenTime: 194.018us - CompileTime: 69.043ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 525.300ms - PrepareTime: 199.906ms DataStreamSender (dst_id=6):(Total: 12.324us, non-child: 12.324us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 204.587ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 33.962ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 15s365ms, non-child: 9s031ms, % non-child: 58.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s243ms - BuildRows: 15.00M (15002582) - BuildRowsPartitioned: 15.00M (15002582) - BuildTime: 1s759ms - GetNewBlockTime: 2.432ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 27.32M (27322368) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s228ms - RowsReturned: 5.46M (5462470) - RowsReturnedRate: 355.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.724us EXCHANGE_NODE (id=5):(Total: 2s973ms, non-child: 620.041ms, % non-child: 20.85%) BytesReceived(500.000ms): 0, 1.59 MB, 24.78 MB, 53.87 MB, 83.23 MB, 112.78 MB, 142.54 MB, 172.40 MB, 202.64 MB, 225.92 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB - BytesReceived: 227.80 MB (238868749) - ConvertRowBatchTime: 291.712ms - DeserializeRowBatchTimer: 939.095ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15002582) - RowsReturnedRate: 5.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s360ms, non-child: 1s169ms, % non-child: 34.81%) BytesReceived(500.000ms): 0, 2.32 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 12.61 MB, 47.22 MB, 80.91 MB, 115.40 MB, 150.28 MB, 185.38 MB, 220.52 MB, 254.61 MB, 288.94 MB, 323.44 MB, 359.02 MB, 394.79 MB, 431.00 MB, 466.87 MB, 502.99 MB, 539.41 MB, 576.22 MB - BytesReceived: 607.58 MB (637093132) - ConvertRowBatchTime: 510.171ms - DeserializeRowBatchTimer: 2s315ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.32M (27322368) - RowsReturnedRate: 8.13 M/sec - SendersBlockedTimer: 6s535ms - SendersBlockedTotalTimer(*): 2m10s Instance 24495d00ab75cd74:1dfb5758d7705aba (host=d2412.halxg.cloudera.com:22000):(Total: 194.935ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 934.00 KB, 159.84 MB, 159.88 MB, 287.86 MB, 415.86 MB, 415.82 MB, 543.84 MB, 543.84 MB, 671.84 MB, 735.80 MB, 831.80 MB, 959.80 MB, 1.06 GB, 1.15 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241308160) - PerHostPeakMemUsage: 2.14 GB (2302229560) - PrepareTime: 194.347ms - RowsProduced: 0 (0) - TotalCpuTime: 6s386ms - TotalNetworkReceiveTime: 7s818ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 770.145ms, non-child: 770.145ms, % non-child: 100.00%) - CodegenTime: 205.134us - CompileTime: 60.229ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 518.472ms - PrepareTime: 188.597ms DataStreamSender (dst_id=6):(Total: 16.293us, non-child: 16.293us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 194.345ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 33.118ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 16s384ms, non-child: 7s649ms, % non-child: 46.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s228ms - BuildRows: 15.00M (15002134) - BuildRowsPartitioned: 15.00M (15002134) - BuildTime: 1s617ms - GetNewBlockTime: 2.203ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 30.54M (30543872) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s222ms - RowsReturned: 6.11M (6108974) - RowsReturnedRate: 372.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.939us EXCHANGE_NODE (id=5):(Total: 3s017ms, non-child: 569.131ms, % non-child: 18.86%) BytesReceived(500.000ms): 238.82 KB, 19.16 MB, 48.14 MB, 77.52 MB, 106.99 MB, 136.72 MB, 166.52 MB, 196.71 MB, 222.89 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB, 227.78 MB - BytesReceived: 227.78 MB (238839884) - ConvertRowBatchTime: 286.004ms - DeserializeRowBatchTimer: 889.570ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15002134) - RowsReturnedRate: 4.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 5s717ms, non-child: 1s186ms, % non-child: 20.75%) BytesReceived(500.000ms): 121.42 KB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.23 MB, 10.25 MB, 10.34 MB, 40.57 MB, 74.17 MB, 108.91 MB, 143.50 MB, 178.51 MB, 213.58 MB, 247.70 MB, 281.91 MB, 316.75 MB, 352.22 MB, 387.76 MB, 423.93 MB, 459.98 MB, 496.01 MB, 532.38 MB, 569.19 MB, 605.81 MB, 642.31 MB, 678.74 MB - BytesReceived: 679.95 MB (712976185) - ConvertRowBatchTime: 543.865ms - DeserializeRowBatchTimer: 2s331ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30.54M (30543872) - RowsReturnedRate: 5.34 M/sec - SendersBlockedTimer: 6s204ms - SendersBlockedTotalTimer(*): 2m4s Instance 24495d00ab75cd74:1dfb5758d7705ac5 (host=d2407.halxg.cloudera.com:22000):(Total: 195.702ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.00 KB, 159.86 MB, 159.89 MB, 287.86 MB, 287.98 MB, 415.95 MB, 543.89 MB, 543.86 MB, 671.86 MB, 671.84 MB, 799.83 MB, 895.83 MB, 991.83 MB, 1.06 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.15 GB (2303809512) - PrepareTime: 194.735ms - RowsProduced: 0 (0) - TotalCpuTime: 6s819ms - TotalNetworkReceiveTime: 6s328ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 741.848ms, non-child: 741.848ms, % non-child: 100.00%) - CodegenTime: 182.584us - CompileTime: 70.059ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 479.696ms - PrepareTime: 190.499ms DataStreamSender (dst_id=6):(Total: 251.844us, non-child: 251.844us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 194.734ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 35.605ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 16s409ms, non-child: 9s163ms, % non-child: 55.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s096ms - BuildRows: 15.00M (15002823) - BuildRowsPartitioned: 15.00M (15002823) - BuildTime: 1s847ms - GetNewBlockTime: 2.779ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 30.54M (30538752) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s442ms - RowsReturned: 6.11M (6112714) - RowsReturnedRate: 372.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.276us EXCHANGE_NODE (id=5):(Total: 3s183ms, non-child: 611.214ms, % non-child: 19.20%) BytesReceived(500.000ms): 0, 11.19 MB, 39.90 MB, 69.22 MB, 98.67 MB, 128.27 MB, 158.07 MB, 188.16 MB, 216.42 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB - BytesReceived: 227.80 MB (238866393) - ConvertRowBatchTime: 269.380ms - DeserializeRowBatchTimer: 953.167ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15002823) - RowsReturnedRate: 4.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s062ms, non-child: 1s197ms, % non-child: 29.48%) BytesReceived(500.000ms): 0, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.18 MB, 10.19 MB, 30.54 MB, 64.38 MB, 98.87 MB, 133.62 MB, 168.22 MB, 203.47 MB, 237.36 MB, 271.59 MB, 306.85 MB, 341.68 MB, 377.45 MB, 413.47 MB, 449.55 MB, 485.54 MB, 521.80 MB, 558.49 MB, 595.13 MB, 631.75 MB, 668.24 MB - BytesReceived: 679.84 MB (712862621) - ConvertRowBatchTime: 551.252ms - DeserializeRowBatchTimer: 2s374ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30.54M (30538752) - RowsReturnedRate: 7.52 M/sec - SendersBlockedTimer: 6s610ms - SendersBlockedTotalTimer(*): 1m46s Instance 24495d00ab75cd74:1dfb5758d7705abc (host=d2414.halxg.cloudera.com:22000):(Total: 200.517ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 157.03 MB, 159.86 MB, 287.86 MB, 287.86 MB, 415.84 MB, 415.84 MB, 543.84 MB, 671.86 MB, 671.84 MB, 767.83 MB, 863.83 MB, 959.83 MB, 1.03 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.41 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.14 GB (2302861704) - PrepareTime: 199.958ms - RowsProduced: 0 (0) - TotalCpuTime: 6s803ms - TotalNetworkReceiveTime: 6s773ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 770.095ms, non-child: 770.095ms, % non-child: 100.00%) - CodegenTime: 180.762us - CompileTime: 64.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 508.770ms - PrepareTime: 195.214ms DataStreamSender (dst_id=6):(Total: 13.632us, non-child: 13.632us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 199.957ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 34.402ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 16s387ms, non-child: 8s693ms, % non-child: 53.05%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s153ms - BuildRows: 15.00M (14995244) - BuildRowsPartitioned: 15.00M (14995244) - BuildTime: 1s842ms - GetNewBlockTime: 2.556ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 30.56M (30560256) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s906ms - RowsReturned: 6.11M (6108824) - RowsReturnedRate: 372.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.940us EXCHANGE_NODE (id=5):(Total: 3s094ms, non-child: 563.486ms, % non-child: 18.21%) BytesReceived(500.000ms): 0, 6.18 MB, 33.87 MB, 63.14 MB, 92.54 MB, 122.06 MB, 151.86 MB, 181.88 MB, 211.31 MB, 227.35 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB, 227.69 MB - BytesReceived: 227.69 MB (238751170) - ConvertRowBatchTime: 279.261ms - DeserializeRowBatchTimer: 874.510ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (14995244) - RowsReturnedRate: 4.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s599ms, non-child: 1s291ms, % non-child: 28.07%) BytesReceived(500.000ms): 0, 8.73 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 23.48 MB, 57.38 MB, 91.76 MB, 126.52 MB, 161.05 MB, 196.46 MB, 230.69 MB, 265.22 MB, 300.10 MB, 334.69 MB, 370.46 MB, 406.30 MB, 442.48 MB, 478.37 MB, 514.65 MB, 551.23 MB, 587.96 MB, 624.58 MB, 660.96 MB - BytesReceived: 680.37 MB (713418496) - ConvertRowBatchTime: 544.459ms - DeserializeRowBatchTimer: 2s511ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30.56M (30560256) - RowsReturnedRate: 6.64 M/sec - SendersBlockedTimer: 6s620ms - SendersBlockedTotalTimer(*): 1m52s Instance 24495d00ab75cd74:1dfb5758d7705ac3 (host=d2413.halxg.cloudera.com:22000):(Total: 201.525ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.00 KB, 159.91 MB, 159.82 MB, 287.82 MB, 287.88 MB, 415.86 MB, 543.86 MB, 543.84 MB, 671.84 MB, 703.80 MB, 799.80 MB, 895.80 MB, 991.80 MB, 1.06 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.40 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241308160) - PerHostPeakMemUsage: 2.15 GB (2303731352) - PrepareTime: 200.912ms - RowsProduced: 0 (0) - TotalCpuTime: 6s848ms - TotalNetworkReceiveTime: 5s539ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 793.519ms, non-child: 793.519ms, % non-child: 100.00%) - CodegenTime: 228.834us - CompileTime: 67.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 528.349ms - PrepareTime: 196.222ms DataStreamSender (dst_id=6):(Total: 13.524us, non-child: 13.524us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 200.911ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 34.038ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 16s365ms, non-child: 9s911ms, % non-child: 60.56%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s139ms - BuildRows: 15.00M (14995928) - BuildRowsPartitioned: 15.00M (14995928) - BuildTime: 1s899ms - GetNewBlockTime: 2.566ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 30.57M (30565376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s070ms - RowsReturned: 6.11M (6111611) - RowsReturnedRate: 373.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 932.000ns EXCHANGE_NODE (id=5):(Total: 3s085ms, non-child: 587.726ms, % non-child: 19.05%) BytesReceived(500.000ms): 0, 14.36 MB, 43.18 MB, 72.54 MB, 101.97 MB, 131.69 MB, 161.48 MB, 191.62 MB, 219.06 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB, 227.71 MB - BytesReceived: 227.71 MB (238769702) - ConvertRowBatchTime: 273.457ms - DeserializeRowBatchTimer: 904.182ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (14995928) - RowsReturnedRate: 4.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s368ms, non-child: 1s212ms, % non-child: 36.00%) BytesReceived(500.000ms): 0, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 10.21 MB, 34.65 MB, 68.26 MB, 103.10 MB, 137.66 MB, 172.47 MB, 207.73 MB, 241.68 MB, 275.90 MB, 311.01 MB, 346.09 MB, 381.84 MB, 417.86 MB, 453.94 MB, 489.98 MB, 526.30 MB, 563.00 MB, 599.67 MB, 636.26 MB, 672.71 MB - BytesReceived: 680.50 MB (713560005) - ConvertRowBatchTime: 542.726ms - DeserializeRowBatchTimer: 2s454ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 30.57M (30565888) - RowsReturnedRate: 9.07 M/sec - SendersBlockedTimer: 6s694ms - SendersBlockedTotalTimer(*): 2m7s Instance 24495d00ab75cd74:1dfb5758d7705ac8 (host=d2408.halxg.cloudera.com:22000):(Total: 193.870ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 150.66 MB, 159.88 MB, 287.91 MB, 287.88 MB, 415.89 MB, 415.86 MB, 543.91 MB, 671.88 MB, 671.86 MB, 767.83 MB, 863.83 MB, 959.83 MB, 1.03 GB, 1.12 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.15 GB (2303831992) - PrepareTime: 193.195ms - RowsProduced: 0 (0) - TotalCpuTime: 6s841ms - TotalNetworkReceiveTime: 5s666ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 736.941ms, non-child: 736.941ms, % non-child: 100.00%) - CodegenTime: 170.864us - CompileTime: 58.574ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 487.803ms - PrepareTime: 188.929ms DataStreamSender (dst_id=6):(Total: 14.478us, non-child: 14.478us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 193.194ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 40.127ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 17s407ms, non-child: 10s753ms, % non-child: 61.77%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s117ms - BuildRows: 15.00M (15001147) - BuildRowsPartitioned: 15.00M (15001147) - BuildTime: 1s868ms - GetNewBlockTime: 2.890ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 33.77M (33766400) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s983ms - RowsReturned: 6.75M (6754755) - RowsReturnedRate: 388.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.656us EXCHANGE_NODE (id=5):(Total: 3s169ms, non-child: 599.603ms, % non-child: 18.92%) BytesReceived(500.000ms): 0, 3.89 MB, 30.26 MB, 59.44 MB, 88.82 MB, 118.36 MB, 148.16 MB, 178.12 MB, 208.24 MB, 227.00 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB, 227.79 MB - BytesReceived: 227.79 MB (238851835) - ConvertRowBatchTime: 274.863ms - DeserializeRowBatchTimer: 925.506ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15001147) - RowsReturnedRate: 4.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s484ms, non-child: 1s410ms, % non-child: 40.48%) BytesReceived(500.000ms): 0, 5.83 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.20 MB, 10.21 MB, 19.15 MB, 53.57 MB, 87.33 MB, 122.01 MB, 156.58 MB, 191.85 MB, 226.28 MB, 260.94 MB, 295.56 MB, 330.09 MB, 365.82 MB, 401.54 MB, 437.74 MB, 473.68 MB, 509.83 MB, 546.37 MB, 583.11 MB, 619.77 MB, 656.19 MB, 692.57 MB, 729.06 MB - BytesReceived: 752.58 MB (789138148) - ConvertRowBatchTime: 612.092ms - DeserializeRowBatchTimer: 2s855ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 33.77M (33766400) - RowsReturnedRate: 9.69 M/sec - SendersBlockedTimer: 6s627ms - SendersBlockedTotalTimer(*): 1m53s Instance 24495d00ab75cd74:1dfb5758d7705ac6 (host=d2421.halxg.cloudera.com:22000):(Total: 200.420ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 27.16 MB, 159.91 MB, 288.01 MB, 287.93 MB, 415.86 MB, 415.86 MB, 543.86 MB, 671.86 MB, 671.86 MB, 767.83 MB, 863.83 MB, 959.83 MB, 1.03 GB, 1.12 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241333760) - PerHostPeakMemUsage: 2.15 GB (2303523144) - PrepareTime: 199.891ms - RowsProduced: 0 (0) - TotalCpuTime: 6s774ms - TotalNetworkReceiveTime: 5s994ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 871.222ms, non-child: 871.222ms, % non-child: 100.00%) - CodegenTime: 251.204us - CompileTime: 75.225ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 599.645ms - PrepareTime: 192.844ms DataStreamSender (dst_id=6):(Total: 28.236us, non-child: 28.236us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 199.890ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 40.533ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 17s278ms, non-child: 10s268ms, % non-child: 59.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s211ms - BuildRows: 14.99M (14993431) - BuildRowsPartitioned: 14.99M (14993431) - BuildTime: 1s903ms - GetNewBlockTime: 2.441ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 33.78M (33783808) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s331ms - RowsReturned: 6.76M (6756212) - RowsReturnedRate: 391.01 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.518us EXCHANGE_NODE (id=5):(Total: 2s932ms, non-child: 584.565ms, % non-child: 19.93%) BytesReceived(500.000ms): 0, 4.16 MB, 30.76 MB, 59.95 MB, 89.31 MB, 118.85 MB, 148.68 MB, 178.56 MB, 208.56 MB, 226.95 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB, 227.67 MB - BytesReceived: 227.67 MB (238724599) - ConvertRowBatchTime: 286.985ms - DeserializeRowBatchTimer: 897.339ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 14.99M (14993431) - RowsReturnedRate: 5.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s077ms, non-child: 1s346ms, % non-child: 33.01%) BytesReceived(500.000ms): 0, 6.16 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 10.19 MB, 19.72 MB, 54.08 MB, 87.91 MB, 122.58 MB, 157.19 MB, 192.52 MB, 226.85 MB, 261.55 MB, 296.16 MB, 330.65 MB, 366.35 MB, 402.14 MB, 438.29 MB, 474.22 MB, 510.39 MB, 546.91 MB, 583.66 MB, 620.29 MB, 656.70 MB, 693.09 MB, 729.58 MB - BytesReceived: 752.90 MB (789473628) - ConvertRowBatchTime: 621.617ms - DeserializeRowBatchTimer: 2s607ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 33.78M (33784320) - RowsReturnedRate: 8.28 M/sec - SendersBlockedTimer: 6s696ms - SendersBlockedTotalTimer(*): 1m47s Instance 24495d00ab75cd74:1dfb5758d7705ab8 (host=d2416.halxg.cloudera.com:22000):(Total: 194.183ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 159.82 MB, 159.84 MB, 287.82 MB, 287.86 MB, 415.82 MB, 415.84 MB, 543.84 MB, 671.88 MB, 671.84 MB, 767.80 MB, 895.80 MB, 991.80 MB, 1.06 GB, 1.16 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.37 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241308160) - PerHostPeakMemUsage: 2.14 GB (2302899744) - PrepareTime: 193.512ms - RowsProduced: 0 (0) - TotalCpuTime: 6s788ms - TotalNetworkReceiveTime: 6s864ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 738.577ms, non-child: 738.577ms, % non-child: 100.00%) - CodegenTime: 249.948us - CompileTime: 57.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 490.069ms - PrepareTime: 188.983ms DataStreamSender (dst_id=6):(Total: 12.396us, non-child: 12.396us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 193.511ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 42.840ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 18s403ms, non-child: 10s503ms, % non-child: 57.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s158ms - BuildRows: 15.00M (15001284) - BuildRowsPartitioned: 15.00M (15001284) - BuildTime: 1s829ms - GetNewBlockTime: 2.307ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 37.01M (37006336) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s725ms - RowsReturned: 7.40M (7398623) - RowsReturnedRate: 402.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.566us EXCHANGE_NODE (id=5):(Total: 3s114ms, non-child: 555.807ms, % non-child: 17.85%) BytesReceived(500.000ms): 0, 8.07 MB, 36.30 MB, 65.59 MB, 95.01 MB, 124.52 MB, 154.40 MB, 184.45 MB, 213.42 MB, 227.61 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB, 227.77 MB - BytesReceived: 227.77 MB (238837602) - ConvertRowBatchTime: 278.485ms - DeserializeRowBatchTimer: 882.092ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15001284) - RowsReturnedRate: 4.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s785ms, non-child: 1s538ms, % non-child: 32.16%) BytesReceived(500.000ms): 0, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 26.29 MB, 60.16 MB, 94.71 MB, 129.45 MB, 163.96 MB, 199.26 MB, 233.23 MB, 267.59 MB, 302.76 MB, 337.42 MB, 373.21 MB, 409.19 MB, 445.36 MB, 481.33 MB, 517.56 MB, 554.23 MB, 590.89 MB, 627.42 MB, 663.90 MB, 700.33 MB, 736.79 MB, 773.08 MB, 809.54 MB - BytesReceived: 825.50 MB (865599068) - ConvertRowBatchTime: 650.338ms - DeserializeRowBatchTimer: 3s106ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37006336) - RowsReturnedRate: 7.73 M/sec - SendersBlockedTimer: 6s574ms - SendersBlockedTotalTimer(*): 2m11s Instance 24495d00ab75cd74:1dfb5758d7705ac1 (host=d2404.halxg.cloudera.com:22000):(Total: 204.508ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 36.00 KB, 4.70 MB, 159.88 MB, 159.84 MB, 287.86 MB, 415.86 MB, 415.84 MB, 543.88 MB, 543.82 MB, 671.82 MB, 735.80 MB, 831.80 MB, 927.80 MB, 1023.80 MB, 1.09 GB, 1.13 GB, 1.13 GB, 1.14 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241308160) - PerHostPeakMemUsage: 2.14 GB (2301957112) - PrepareTime: 203.893ms - RowsProduced: 0 (0) - TotalCpuTime: 6s861ms - TotalNetworkReceiveTime: 6s079ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 762.329ms, non-child: 762.329ms, % non-child: 100.00%) - CodegenTime: 194.982us - CompileTime: 65.951ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 495.756ms - PrepareTime: 199.105ms DataStreamSender (dst_id=6):(Total: 12.848us, non-child: 12.848us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 203.892ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 45.622ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 18s385ms, non-child: 11s221ms, % non-child: 61.04%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s460ms - BuildRows: 15.00M (15003734) - BuildRowsPartitioned: 15.00M (15003734) - BuildTime: 1s887ms - GetNewBlockTime: 2.386ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 37.05M (37053440) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7s043ms - RowsReturned: 7.41M (7411810) - RowsReturnedRate: 403.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.252us EXCHANGE_NODE (id=5):(Total: 2s794ms, non-child: 604.796ms, % non-child: 21.64%) BytesReceived(500.000ms): 0, 888.25 KB, 22.15 MB, 51.18 MB, 80.51 MB, 110.07 MB, 139.79 MB, 169.72 MB, 199.89 MB, 224.74 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB, 227.81 MB - BytesReceived: 227.81 MB (238873009) - ConvertRowBatchTime: 286.162ms - DeserializeRowBatchTimer: 961.328ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15003734) - RowsReturnedRate: 5.37 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 4s369ms, non-child: 1s489ms, % non-child: 34.10%) BytesReceived(500.000ms): 0, 1.13 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.39 MB, 44.00 MB, 77.64 MB, 112.20 MB, 147.03 MB, 182.00 MB, 217.09 MB, 251.26 MB, 285.54 MB, 320.17 MB, 355.82 MB, 391.51 MB, 427.72 MB, 463.79 MB, 499.87 MB, 536.31 MB, 573.15 MB, 609.82 MB, 646.40 MB, 682.77 MB, 719.23 MB, 755.66 MB, 792.04 MB - BytesReceived: 826.55 MB (866696402) - ConvertRowBatchTime: 686.810ms - DeserializeRowBatchTimer: 2s915ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 37.05M (37053952) - RowsReturnedRate: 8.48 M/sec - SendersBlockedTimer: 6s673ms - SendersBlockedTotalTimer(*): 2m13s Instance 24495d00ab75cd74:1dfb5758d7705ac2 (host=d2420.halxg.cloudera.com:22000):(Total: 236.685ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 36.00 KB, 160.21 MB, 159.84 MB, 287.95 MB, 287.86 MB, 415.91 MB, 543.91 MB, 543.84 MB, 671.88 MB, 671.84 MB, 767.80 MB, 863.80 MB, 959.80 MB, 1.03 GB, 1.12 GB, 1.16 GB, 1.16 GB, 1.16 GB, 1.15 GB, 1.16 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.36 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 1.16 GB (1241308160) - PerHostPeakMemUsage: 2.15 GB (2305062536) - PrepareTime: 236.011ms - RowsProduced: 0 (0) - TotalCpuTime: 6s910ms - TotalNetworkReceiveTime: 4s955ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 128 (128) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 242.23 GB (260091396096) - PeakMemoryUsage: 1.12 GB (1207959552) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 819.654ms, non-child: 819.654ms, % non-child: 100.00%) - CodegenTime: 193.776us - CompileTime: 77.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 509.135ms - PrepareTime: 228.735ms DataStreamSender (dst_id=6):(Total: 14.716us, non-child: 14.716us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - SerializeBatchTime: 0.000ns - ThriftTransmitTime(*): 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 236.009ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 66.689ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 272.00 KB (278528) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 18s338ms, non-child: 11s982ms, % non-child: 65.34%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Runtime-Filter Disabled (FP Rate Too High) - BuildPartitionTime: 1s825ms - BuildRows: 14.99M (14993599) - BuildRowsPartitioned: 14.99M (14993599) - BuildTime: 1s933ms - GetNewBlockTime: 3.440ms - HashBuckets: 33.55M (33554432) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.13 GB (1218469888) - PinTime: 0.000ns - ProbeRows: 36.70M (36704256) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7s328ms - RowsReturned: 7.34M (7337883) - RowsReturnedRate: 400.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.782us EXCHANGE_NODE (id=5):(Total: 2s364ms, non-child: 931.471ms, % non-child: 39.39%) BytesReceived(500.000ms): 0, 10.18 MB, 38.69 MB, 68.01 MB, 97.40 MB, 126.99 MB, 156.78 MB, 186.87 MB, 215.38 MB, 227.61 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB, 227.66 MB - BytesReceived: 227.66 MB (238722866) - ConvertRowBatchTime: 441.165ms - DeserializeRowBatchTimer: 1s151ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 14.99M (14993599) - RowsReturnedRate: 6.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=4):(Total: 3s991ms, non-child: 3s991ms, % non-child: 100.00%) BytesReceived(500.000ms): 0, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 10.22 MB, 29.17 MB, 63.05 MB, 97.58 MB, 132.35 MB, 166.90 MB, 202.06 MB, 236.00 MB, 270.22 MB, 305.50 MB, 340.28 MB, 376.02 MB, 411.93 MB, 448.02 MB, 483.96 MB, 520.27 MB, 556.98 MB, 593.70 MB, 630.25 MB, 666.67 MB, 703.07 MB, 739.48 MB, 775.82 MB, 812.28 MB - BytesReceived: 828.21 MB (868436801) - ConvertRowBatchTime: 777.800ms - DeserializeRowBatchTimer: 5s390ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 36.70M (36704256) - RowsReturnedRate: 9.20 M/sec - SendersBlockedTimer: 11s434ms - SendersBlockedTotalTimer(*): 2m48s Fragment F01: Instance 24495d00ab75cd74:1dfb5758d7705ad0 (host=d2402.halxg.cloudera.com:22000):(Total: 3s832ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/504.26 MB 10:2/504.33 MB 0:3/756.45 MB 5:3/756.45 MB 1:2/504.27 MB 7:2/504.27 MB 3:3/756.41 MB 8:3/756.42 MB 4:1/252.18 MB 2:1/21.22 MB 9:2/504.28 MB MemoryUsage(500.000ms): 88.00 KB, 69.46 MB, 336.75 MB, 336.69 MB, 313.13 MB, 202.05 MB, 217.94 MB, 132.98 MB, 54.75 MB ThreadUsage(500.000ms): 1, 18, 18, 18, 18, 18, 18, 7, 4 - AverageThreadTokens: 13.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 337.45 MB (353840880) - PerHostPeakMemUsage: 1.37 GB (1466615224) - PrepareTime: 205.655ms - RowsProduced: 14.53M (14533756) - TotalCpuTime: 53s561ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13.522ms - TotalStorageWaitTime: 2s040ms CodeGen:(Total: 693.130ms, non-child: 693.130ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.610ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 484.498ms - PrepareTime: 200.914ms DataStreamSender (dst_id=5):(Total: 3s475ms, non-child: 3s475ms, % non-child: 100.00%) - BytesSent: 218.31 MB (228911258) - NetworkThroughput(*): 45.51 MB/sec - OverallThroughput: 62.82 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s788ms - ThriftTransmitTime(*): 4s796ms - UncompressedRowBatchSize: 609.97 MB (639598844) HDFS_SCAN_NODE (id=0):(Total: 547.457ms, non-child: 547.457ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 6:2/504.26 MB 10:2/504.33 MB 0:3/756.45 MB 5:3/756.45 MB 1:2/504.27 MB 7:2/504.27 MB 3:3/756.41 MB 8:3/756.42 MB 4:1/252.18 MB 2:1/21.22 MB 9:2/504.28 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:0% 2:0% 3:12.5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 38.12 MB, 227.03 MB, 227.03 MB, 227.03 MB, 227.03 MB, 268.36 MB, 308.43 MB, 308.43 MB - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 13.88 - BytesRead: 308.43 MB (323407329) - BytesReadDataNodeCache: 0 - BytesReadLocal: 308.43 MB (323407329) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 308.43 MB (323407329) - DecompressionTime: 1s174ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 336.90 MB (353267432) - PerReadThreadRawHdfsThroughput: 556.26 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 72.66M (72657881) - RowsReturned: 14.53M (14533756) - RowsReturnedRate: 26.55 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.36K (2359) - ScannerThreadsTotalWallClockTime: 51s258ms - MaterializeTupleTime(*): 47s833ms - ScannerThreadsSysTime: 62.983ms - ScannerThreadsUserTime: 7s200ms - ScannerThreadsVoluntaryContextSwitches: 14.03K (14028) - TotalRawHdfsReadTime(*): 554.464ms - TotalReadThroughput: 68.54 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad9 (host=d2405.halxg.cloudera.com:22000):(Total: 3s857ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/504.31 MB 0:1/252.13 MB 4:2/504.30 MB 7:5/1.10 GB 2:2/504.30 MB 8:2/504.30 MB 9:3/756.43 MB 5:1/252.15 MB 10:4/977.34 MB 3:1/252.17 MB MemoryUsage(500.000ms): 0, 88.00 KB, 432.99 MB, 434.00 MB, 433.78 MB, 424.28 MB, 361.25 MB, 249.91 MB, 181.75 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 23, 23, 23, 16 - AverageThreadTokens: 17.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 434.62 MB (455727280) - PerHostPeakMemUsage: 1.81 GB (1942239888) - PrepareTime: 195.715ms - RowsProduced: 14.06M (14060506) - TotalCpuTime: 1m19s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.362ms - TotalStorageWaitTime: 3s397ms CodeGen:(Total: 673.306ms, non-child: 673.306ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.043ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 475.622ms - PrepareTime: 193.071ms DataStreamSender (dst_id=5):(Total: 3s422ms, non-child: 3s422ms, % non-child: 100.00%) - BytesSent: 207.48 MB (217561993) - NetworkThroughput(*): 47.44 MB/sec - OverallThroughput: 60.63 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s741ms - ThriftTransmitTime(*): 4s373ms - UncompressedRowBatchSize: 590.11 MB (618772164) HDFS_SCAN_NODE (id=0):(Total: 616.312ms, non-child: 616.312ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 1:2/504.31 MB 0:1/252.13 MB 4:2/504.30 MB 7:5/1.10 GB 2:2/504.30 MB 8:2/504.30 MB 9:3/756.43 MB 5:1/252.15 MB 10:4/977.34 MB 3:1/252.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:46 BytesRead(500.000ms): 0, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB, 298.35 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 21.43 - BytesRead: 298.35 MB (312840050) - BytesReadDataNodeCache: 0 - BytesReadLocal: 298.35 MB (312840050) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 298.35 MB (312840050) - DecompressionTime: 1s086ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 434.12 MB (455203000) - PerReadThreadRawHdfsThroughput: 556.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 70.29M (70292347) - RowsReturned: 14.06M (14060506) - RowsReturnedRate: 22.81 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 2.61K (2606) - ScannerThreadsTotalWallClockTime: 1m18s - MaterializeTupleTime(*): 1m11s - ScannerThreadsSysTime: 57.979ms - ScannerThreadsUserTime: 6s960ms - ScannerThreadsVoluntaryContextSwitches: 13.56K (13559) - TotalRawHdfsReadTime(*): 535.795ms - TotalReadThroughput: 74.59 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705acd (host=d2407.halxg.cloudera.com:22000):(Total: 3s874ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/504.29 MB 6:1/252.16 MB 1:1/252.12 MB 7:4/1008.55 MB 0:3/756.45 MB 5:4/1008.56 MB 10:2/504.36 MB 2:2/504.28 MB 9:3/756.46 MB 3:2/418.99 MB MemoryUsage(500.000ms): 0, 88.00 KB, 438.04 MB, 439.25 MB, 438.83 MB, 438.91 MB, 400.49 MB, 273.79 MB, 252.49 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 22 - AverageThreadTokens: 18.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 439.68 MB (461035696) - PerHostPeakMemUsage: 1.82 GB (1959210792) - PrepareTime: 197.915ms - RowsProduced: 14.89M (14891581) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.139ms - TotalStorageWaitTime: 2s796ms CodeGen:(Total: 685.936ms, non-child: 685.936ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 485.180ms - PrepareTime: 195.104ms DataStreamSender (dst_id=5):(Total: 3s469ms, non-child: 3s469ms, % non-child: 100.00%) - BytesSent: 220.51 MB (231216907) - NetworkThroughput(*): 46.91 MB/sec - OverallThroughput: 63.56 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s765ms - ThriftTransmitTime(*): 4s700ms - UncompressedRowBatchSize: 624.99 MB (655345952) HDFS_SCAN_NODE (id=0):(Total: 590.521ms, non-child: 590.521ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 8:2/504.29 MB 6:1/252.16 MB 1:1/252.12 MB 7:4/1008.55 MB 0:3/756.45 MB 5:4/1008.56 MB 10:2/504.36 MB 2:2/504.28 MB 9:3/756.46 MB 3:2/418.99 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 302.67 MB, 302.67 MB, 302.67 MB, 302.67 MB, 316.03 MB, 316.03 MB, 316.03 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.71 - BytesRead: 316.03 MB (331380234) - BytesReadDataNodeCache: 0 - BytesReadLocal: 316.03 MB (331380234) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 316.03 MB (331380234) - DecompressionTime: 1s170ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 439.12 MB (460446136) - PerReadThreadRawHdfsThroughput: 461.13 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.47M (74474563) - RowsReturned: 14.89M (14891581) - RowsReturnedRate: 25.22 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.98K (2982) - ScannerThreadsTotalWallClockTime: 1m19s - MaterializeTupleTime(*): 1m14s - ScannerThreadsSysTime: 88.974ms - ScannerThreadsUserTime: 7s273ms - ScannerThreadsVoluntaryContextSwitches: 14.14K (14140) - TotalRawHdfsReadTime(*): 685.330ms - TotalReadThroughput: 79.01 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad8 (host=d2415.halxg.cloudera.com:22000):(Total: 3s908ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:3/756.39 MB 7:1/252.15 MB 9:3/756.48 MB 0:2/504.31 MB 3:2/504.35 MB 10:2/504.33 MB 5:2/504.33 MB 6:4/1008.58 MB 1:3/668.37 MB 4:3/509.35 MB MemoryUsage(500.000ms): 88.00 KB, 419.69 MB, 439.12 MB, 438.91 MB, 438.98 MB, 391.76 MB, 273.40 MB, 263.28 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 21.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 439.72 MB (461076680) - PerHostPeakMemUsage: 1.82 GB (1949759144) - PrepareTime: 195.926ms - RowsProduced: 14.89M (14893572) - TotalCpuTime: 1m21s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.966ms - TotalStorageWaitTime: 3s045ms CodeGen:(Total: 658.584ms, non-child: 658.584ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 459.970ms - PrepareTime: 193.791ms DataStreamSender (dst_id=5):(Total: 3s519ms, non-child: 3s519ms, % non-child: 100.00%) - BytesSent: 227.40 MB (238443928) - NetworkThroughput(*): 48.47 MB/sec - OverallThroughput: 64.61 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s816ms - ThriftTransmitTime(*): 4s691ms - UncompressedRowBatchSize: 625.07 MB (655433560) HDFS_SCAN_NODE (id=0):(Total: 569.050ms, non-child: 569.050ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 8:3/756.39 MB 7:1/252.15 MB 9:3/756.48 MB 0:2/504.31 MB 3:2/504.35 MB 10:2/504.33 MB 5:2/504.33 MB 6:4/1008.58 MB 1:3/668.37 MB 4:3/509.35 MB Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:50 BytesRead(500.000ms): 0, 285.50 MB, 302.97 MB, 302.97 MB, 302.97 MB, 302.97 MB, 316.33 MB, 316.33 MB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 22.86 - BytesRead: 316.33 MB (331700664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 316.33 MB (331700664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 316.33 MB (331700664) - DecompressionTime: 1s164ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 439.24 MB (460576968) - PerReadThreadRawHdfsThroughput: 539.75 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.51M (74505007) - RowsReturned: 14.89M (14893572) - RowsReturnedRate: 26.17 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 2.62K (2622) - ScannerThreadsTotalWallClockTime: 1m20s - MaterializeTupleTime(*): 1m14s - ScannerThreadsSysTime: 84.975ms - ScannerThreadsUserTime: 7s315ms - ScannerThreadsVoluntaryContextSwitches: 14.10K (14100) - TotalRawHdfsReadTime(*): 586.078ms - TotalReadThroughput: 79.08 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705adc (host=d2413.halxg.cloudera.com:22000):(Total: 4s038ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/186.19 MB 7:1/252.14 MB 6:1/252.16 MB 2:3/756.46 MB 1:3/756.42 MB 3:1/252.14 MB 10:2/504.27 MB 9:3/756.42 MB 0:4/1008.60 MB 4:2/504.32 MB 8:3/756.39 MB MemoryUsage(500.000ms): 0, 88.00 KB, 439.85 MB, 439.90 MB, 439.42 MB, 440.02 MB, 376.39 MB, 273.63 MB, 252.79 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 22 - AverageThreadTokens: 18.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 440.54 MB (461937080) - PerHostPeakMemUsage: 1.83 GB (1960140928) - PrepareTime: 197.869ms - RowsProduced: 14.94M (14943717) - TotalCpuTime: 1m24s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.038ms - TotalStorageWaitTime: 2s601ms CodeGen:(Total: 684.602ms, non-child: 684.602ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 484.567ms - PrepareTime: 195.921ms DataStreamSender (dst_id=5):(Total: 3s676ms, non-child: 3s676ms, % non-child: 100.00%) - BytesSent: 234.53 MB (245921415) - NetworkThroughput(*): 48.69 MB/sec - OverallThroughput: 63.79 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s924ms - ThriftTransmitTime(*): 4s816ms - UncompressedRowBatchSize: 627.17 MB (657640332) HDFS_SCAN_NODE (id=0):(Total: 544.475ms, non-child: 544.475ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 5:1/186.19 MB 7:1/252.14 MB 6:1/252.16 MB 2:3/756.46 MB 1:3/756.42 MB 3:1/252.14 MB 10:2/504.27 MB 9:3/756.42 MB 0:4/1008.60 MB 4:2/504.32 MB 8:3/756.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 303.67 MB, 303.67 MB, 303.67 MB, 303.67 MB, 303.67 MB, 317.03 MB, 317.03 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.71 - BytesRead: 317.03 MB (332426706) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.03 MB (332426706) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.03 MB (332426706) - DecompressionTime: 1s156ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 440.12 MB (461494456) - PerReadThreadRawHdfsThroughput: 499.28 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.71M (74713642) - RowsReturned: 14.94M (14943717) - RowsReturnedRate: 27.45 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.82K (2816) - ScannerThreadsTotalWallClockTime: 1m22s - MaterializeTupleTime(*): 1m18s - ScannerThreadsSysTime: 89.973ms - ScannerThreadsUserTime: 7s171ms - ScannerThreadsVoluntaryContextSwitches: 14.12K (14117) - TotalRawHdfsReadTime(*): 634.973ms - TotalReadThroughput: 79.26 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ada (host=d2414.halxg.cloudera.com:22000):(Total: 4s207ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/252.15 MB 8:2/504.30 MB 3:2/282.08 MB 1:1/252.14 MB 4:2/504.30 MB 7:3/756.39 MB 6:3/756.48 MB 0:3/756.38 MB 9:5/1.23 GB 5:1/252.13 MB 2:3/713.33 MB MemoryUsage(500.000ms): 88.00 KB, 426.80 MB, 443.09 MB, 442.70 MB, 442.71 MB, 426.90 MB, 268.67 MB, 273.38 MB, 59.39 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 3 - AverageThreadTokens: 19.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 443.64 MB (465189720) - PerHostPeakMemUsage: 1.83 GB (1962294200) - PrepareTime: 201.073ms - RowsProduced: 15.71M (15707864) - TotalCpuTime: 1m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16.802ms - TotalStorageWaitTime: 1s055ms CodeGen:(Total: 631.183ms, non-child: 631.183ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 428.558ms - PrepareTime: 199.008ms DataStreamSender (dst_id=5):(Total: 3s899ms, non-child: 3s899ms, % non-child: 100.00%) - BytesSent: 241.92 MB (253675402) - NetworkThroughput(*): 47.91 MB/sec - OverallThroughput: 62.04 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s025ms - ThriftTransmitTime(*): 5s049ms - UncompressedRowBatchSize: 659.25 MB (691268772) HDFS_SCAN_NODE (id=0):(Total: 493.745ms, non-child: 493.745ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 26 Hdfs split stats (:<# splits>/): 10:1/252.15 MB 8:2/504.30 MB 3:2/282.08 MB 1:1/252.14 MB 4:2/504.30 MB 7:3/756.39 MB 6:3/756.48 MB 0:3/756.38 MB 9:5/1.23 GB 5:1/252.13 MB 2:3/713.33 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 293.25 MB, 306.60 MB, 306.60 MB, 306.60 MB, 306.60 MB, 306.60 MB, 319.96 MB, 333.32 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 20.38 - BytesRead: 333.32 MB (349506579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 333.32 MB (349506579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 333.32 MB (349506579) - DecompressionTime: 1s216ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 443.12 MB (464649040) - PerReadThreadRawHdfsThroughput: 810.40 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 78.52M (78519091) - RowsReturned: 15.71M (15707864) - RowsReturnedRate: 31.81 M/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 2.79K (2786) - ScannerThreadsTotalWallClockTime: 1m24s - MaterializeTupleTime(*): 1m21s - ScannerThreadsSysTime: 74.976ms - ScannerThreadsUserTime: 7s637ms - ScannerThreadsVoluntaryContextSwitches: 14.83K (14830) - TotalRawHdfsReadTime(*): 411.299ms - TotalReadThroughput: 74.07 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad2 (host=d2411.halxg.cloudera.com:22000):(Total: 4s119ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/252.16 MB 2:3/756.50 MB 5:2/504.33 MB 9:3/756.41 MB 7:4/1008.52 MB 3:2/504.23 MB 0:2/504.29 MB 8:2/504.27 MB 1:2/504.31 MB 4:2/504.30 MB 6:1/252.17 MB MemoryUsage(500.000ms): 0, 88.00 KB, 448.14 MB, 448.25 MB, 447.37 MB, 447.85 MB, 416.05 MB, 265.93 MB, 252.72 MB, 11.11 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 22, 2 - AverageThreadTokens: 17.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.72 MB (470521968) - PerHostPeakMemUsage: 1.83 GB (1967362648) - PrepareTime: 194.437ms - RowsProduced: 15.10M (15101910) - TotalCpuTime: 1m26s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.702ms - TotalStorageWaitTime: 2s810ms CodeGen:(Total: 691.543ms, non-child: 691.543ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.330ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 494.480ms - PrepareTime: 192.285ms DataStreamSender (dst_id=5):(Total: 3s709ms, non-child: 3s709ms, % non-child: 100.00%) - BytesSent: 222.83 MB (233651864) - NetworkThroughput(*): 45.75 MB/sec - OverallThroughput: 60.07 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s868ms - ThriftTransmitTime(*): 4s870ms - UncompressedRowBatchSize: 633.81 MB (664602064) HDFS_SCAN_NODE (id=0):(Total: 589.288ms, non-child: 589.288ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 10:1/252.16 MB 2:3/756.50 MB 5:2/504.33 MB 9:3/756.41 MB 7:4/1008.52 MB 3:2/504.23 MB 0:2/504.29 MB 8:2/504.27 MB 1:2/504.31 MB 4:2/504.30 MB 6:1/252.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 307.16 MB, 307.16 MB, 307.16 MB, 307.16 MB, 307.16 MB, 307.16 MB, 320.51 MB, 320.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 20.00 - BytesRead: 320.51 MB (336078545) - BytesReadDataNodeCache: 0 - BytesReadLocal: 320.51 MB (336078545) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 320.51 MB (336078545) - DecompressionTime: 1s168ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 448.18 MB (469948592) - PerReadThreadRawHdfsThroughput: 457.18 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.54M (75544361) - RowsReturned: 15.10M (15101910) - RowsReturnedRate: 25.63 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.17K (3166) - ScannerThreadsTotalWallClockTime: 1m24s - MaterializeTupleTime(*): 1m19s - ScannerThreadsSysTime: 87.975ms - ScannerThreadsUserTime: 7s412ms - ScannerThreadsVoluntaryContextSwitches: 14.37K (14371) - TotalRawHdfsReadTime(*): 701.055ms - TotalReadThroughput: 71.22 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad4 (host=d2412.halxg.cloudera.com:22000):(Total: 4s222ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:3/756.40 MB 4:2/504.33 MB 3:4/792.82 MB 8:3/756.46 MB 10:3/756.41 MB 2:3/756.50 MB 9:3/756.44 MB 1:1/252.20 MB 6:3/756.51 MB MemoryUsage(500.000ms): 0, 222.17 MB, 432.19 MB, 448.08 MB, 447.38 MB, 448.19 MB, 360.06 MB, 273.71 MB, 255.54 MB, 10.97 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 2 - AverageThreadTokens: 19.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.70 MB (470497552) - PerHostPeakMemUsage: 1.83 GB (1967297848) - PrepareTime: 190.157ms - RowsProduced: 15.20M (15198124) - TotalCpuTime: 1m30s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.116ms - TotalStorageWaitTime: 953.733ms CodeGen:(Total: 626.901ms, non-child: 626.901ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 434.727ms - PrepareTime: 186.999ms DataStreamSender (dst_id=5):(Total: 3s890ms, non-child: 3s890ms, % non-child: 100.00%) - BytesSent: 237.60 MB (249138489) - NetworkThroughput(*): 47.30 MB/sec - OverallThroughput: 61.08 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s026ms - ThriftTransmitTime(*): 5s023ms - UncompressedRowBatchSize: 637.85 MB (668836244) HDFS_SCAN_NODE (id=0):(Total: 507.199ms, non-child: 507.199ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 0:3/756.40 MB 4:2/504.33 MB 3:4/792.82 MB 8:3/756.46 MB 10:3/756.41 MB 2:3/756.50 MB 9:3/756.44 MB 1:1/252.20 MB 6:3/756.51 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:11.11% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:50 BytesRead(500.000ms): 125.77 MB, 295.87 MB, 309.22 MB, 309.22 MB, 309.22 MB, 309.22 MB, 309.22 MB, 309.22 MB, 322.56 MB - AverageHdfsReadThreadConcurrency: 0.78 - AverageScannerThreadConcurrency: 20.56 - BytesRead: 322.56 MB (338227667) - BytesReadDataNodeCache: 0 - BytesReadLocal: 322.56 MB (338227667) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 322.56 MB (338227667) - DecompressionTime: 1s241ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 9 (9) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 448.12 MB (469883064) - PerReadThreadRawHdfsThroughput: 872.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.99M (75991705) - RowsReturned: 15.20M (15198124) - RowsReturnedRate: 29.96 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 3.57K (3570) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 1m24s - ScannerThreadsSysTime: 86.974ms - ScannerThreadsUserTime: 7s848ms - ScannerThreadsVoluntaryContextSwitches: 14.34K (14337) - TotalRawHdfsReadTime(*): 369.556ms - TotalReadThroughput: 71.68 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705adf (host=d2410.halxg.cloudera.com:22000):(Total: 4s244ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/252.15 MB 0:1/252.16 MB 4:1/252.12 MB 3:2/504.21 MB 2:1/252.16 MB 9:4/1008.50 MB 1:3/662.76 MB 5:4/1003.85 MB 7:2/504.27 MB 6:5/1.23 GB MemoryUsage(500.000ms): 88.00 KB, 824.00 KB, 434.67 MB, 434.93 MB, 434.86 MB, 434.71 MB, 372.71 MB, 269.60 MB, 248.72 MB, 412.00 KB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 23, 1 - AverageThreadTokens: 19.30 - BloomFilterBytes: 0 - PeakMemoryUsage: 435.61 MB (456767936) - PerHostPeakMemUsage: 1.87 GB (2004274800) - PrepareTime: 195.024ms - RowsProduced: 14.86M (14863613) - TotalCpuTime: 1m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.937ms - TotalStorageWaitTime: 3s004ms CodeGen:(Total: 674.829ms, non-child: 674.829ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.460ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 477.016ms - PrepareTime: 192.872ms DataStreamSender (dst_id=5):(Total: 3s813ms, non-child: 3s813ms, % non-child: 100.00%) - BytesSent: 222.75 MB (233567542) - NetworkThroughput(*): 47.14 MB/sec - OverallThroughput: 58.40 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s939ms - ThriftTransmitTime(*): 4s725ms - UncompressedRowBatchSize: 623.81 MB (654115136) HDFS_SCAN_NODE (id=0):(Total: 610.978ms, non-child: 610.978ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 8:1/252.15 MB 0:1/252.16 MB 4:1/252.12 MB 3:2/504.21 MB 2:1/252.16 MB 9:4/1008.50 MB 1:3/662.76 MB 5:4/1003.85 MB 7:2/504.27 MB 6:5/1.23 GB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 100.00 KB, 301.94 MB, 301.94 MB, 301.94 MB, 301.94 MB, 315.29 MB, 315.29 MB, 315.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.88 - BytesRead: 315.29 MB (330607251) - BytesReadDataNodeCache: 0 - BytesReadLocal: 315.29 MB (330607251) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 315.29 MB (330607251) - DecompressionTime: 1s188ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 435.12 MB (456251840) - PerReadThreadRawHdfsThroughput: 581.95 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.30M (74297752) - RowsReturned: 14.86M (14863613) - RowsReturnedRate: 24.33 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.53K (3534) - ScannerThreadsTotalWallClockTime: 1m27s - MaterializeTupleTime(*): 1m21s - ScannerThreadsSysTime: 69.978ms - ScannerThreadsUserTime: 7s780ms - ScannerThreadsVoluntaryContextSwitches: 14.15K (14149) - TotalRawHdfsReadTime(*): 541.787ms - TotalReadThroughput: 70.06 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705adb (host=d2416.halxg.cloudera.com:22000):(Total: 4s287ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/252.14 MB 5:1/252.10 MB 9:2/504.26 MB 3:1/252.17 MB 6:3/756.46 MB 8:1/252.19 MB 7:3/756.43 MB 1:2/504.31 MB 0:4/1008.64 MB 10:2/504.31 MB 4:4/943.42 MB MemoryUsage(500.000ms): 88.00 KB, 448.23 MB, 447.80 MB, 448.11 MB, 448.22 MB, 447.55 MB, 265.34 MB, 265.46 MB, 224.93 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 20 - AverageThreadTokens: 21.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.40 MB (470186576) - PerHostPeakMemUsage: 1.90 GB (2035565512) - PrepareTime: 190.616ms - RowsProduced: 14.95M (14951482) - TotalCpuTime: 1m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21.544ms - TotalStorageWaitTime: 1s091ms CodeGen:(Total: 628.781ms, non-child: 628.781ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.730ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 436.024ms - PrepareTime: 188.608ms DataStreamSender (dst_id=5):(Total: 3s968ms, non-child: 3s968ms, % non-child: 100.00%) - BytesSent: 237.21 MB (248731522) - NetworkThroughput(*): 47.49 MB/sec - OverallThroughput: 59.77 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s076ms - ThriftTransmitTime(*): 4s995ms - UncompressedRowBatchSize: 627.50 MB (657982060) HDFS_SCAN_NODE (id=0):(Total: 491.607ms, non-child: 491.607ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 2:1/252.14 MB 5:1/252.10 MB 9:2/504.26 MB 3:1/252.17 MB 6:3/756.46 MB 8:1/252.19 MB 7:3/756.43 MB 1:2/504.31 MB 0:4/1008.64 MB 10:2/504.31 MB 4:4/943.42 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 317.12 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.50 - BytesRead: 317.12 MB (332525537) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.12 MB (332525537) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.12 MB (332525537) - DecompressionTime: 1s170ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 447.87 MB (469621328) - PerReadThreadRawHdfsThroughput: 736.46 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.74M (74735364) - RowsReturned: 14.95M (14951482) - RowsReturnedRate: 30.41 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.20K (3198) - ScannerThreadsTotalWallClockTime: 1m29s - MaterializeTupleTime(*): 1m27s - ScannerThreadsSysTime: 69.977ms - ScannerThreadsUserTime: 7s274ms - ScannerThreadsVoluntaryContextSwitches: 14.14K (14137) - TotalRawHdfsReadTime(*): 430.604ms - TotalReadThroughput: 70.47 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705acc (host=d2406.halxg.cloudera.com:22000):(Total: 4s251ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/252.11 MB 2:1/252.21 MB 4:3/756.45 MB 1:2/504.28 MB 10:2/504.32 MB 8:2/504.37 MB 3:4/951.88 MB 0:4/1008.64 MB 9:2/504.34 MB 6:3/756.42 MB MemoryUsage(500.000ms): 88.00 KB, 364.24 MB, 441.12 MB, 440.52 MB, 441.19 MB, 425.29 MB, 290.24 MB, 273.19 MB, 189.42 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 16 - AverageThreadTokens: 20.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 441.80 MB (463263856) - PerHostPeakMemUsage: 1.85 GB (1986338584) - PrepareTime: 197.580ms - RowsProduced: 14.97M (14966195) - TotalCpuTime: 1m28s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.906ms - TotalStorageWaitTime: 3s110ms CodeGen:(Total: 678.605ms, non-child: 678.605ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.742ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 479.348ms - PrepareTime: 194.858ms DataStreamSender (dst_id=5):(Total: 3s834ms, non-child: 3s834ms, % non-child: 100.00%) - BytesSent: 235.85 MB (247305930) - NetworkThroughput(*): 49.35 MB/sec - OverallThroughput: 61.51 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s996ms - ThriftTransmitTime(*): 4s779ms - UncompressedRowBatchSize: 628.12 MB (658629548) HDFS_SCAN_NODE (id=0):(Total: 598.772ms, non-child: 598.772ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 7:1/252.11 MB 2:1/252.21 MB 4:3/756.45 MB 1:2/504.28 MB 10:2/504.32 MB 8:2/504.37 MB 3:4/951.88 MB 0:4/1008.64 MB 9:2/504.34 MB 6:3/756.42 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:0% 2:0% 3:12.5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 241.06 MB, 304.19 MB, 304.19 MB, 304.19 MB, 304.19 MB, 304.19 MB, 317.55 MB, 317.55 MB - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 22.00 - BytesRead: 317.55 MB (332970606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.55 MB (332970606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.55 MB (332970606) - DecompressionTime: 1s171ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 441.18 MB (462608488) - PerReadThreadRawHdfsThroughput: 555.03 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.84M (74836323) - RowsReturned: 14.97M (14966195) - RowsReturnedRate: 24.99 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.08K (3085) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 1m20s - ScannerThreadsSysTime: 103.974ms - ScannerThreadsUserTime: 7s429ms - ScannerThreadsVoluntaryContextSwitches: 14.45K (14454) - TotalRawHdfsReadTime(*): 572.120ms - TotalReadThroughput: 70.57 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad1 (host=d2417.halxg.cloudera.com:22000):(Total: 4s286ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/200.84 MB 0:2/504.27 MB 3:4/1008.58 MB 2:2/504.29 MB 10:1/252.14 MB 7:3/756.44 MB 5:4/1008.50 MB 9:3/756.39 MB 1:2/504.35 MB 4:2/504.27 MB MemoryUsage(500.000ms): 88.00 KB, 440.35 MB, 441.05 MB, 440.69 MB, 440.90 MB, 424.72 MB, 255.40 MB, 273.60 MB, 190.36 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 16 - AverageThreadTokens: 20.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 441.67 MB (463124680) - PerHostPeakMemUsage: 1.87 GB (2010017312) - PrepareTime: 197.801ms - RowsProduced: 14.97M (14972775) - TotalCpuTime: 1m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.394ms - TotalStorageWaitTime: 1s178ms CodeGen:(Total: 650.567ms, non-child: 650.567ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 451.001ms - PrepareTime: 195.403ms DataStreamSender (dst_id=5):(Total: 3s918ms, non-child: 3s918ms, % non-child: 100.00%) - BytesSent: 233.95 MB (245312437) - NetworkThroughput(*): 48.14 MB/sec - OverallThroughput: 59.71 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s019ms - ThriftTransmitTime(*): 4s859ms - UncompressedRowBatchSize: 628.39 MB (658919116) HDFS_SCAN_NODE (id=0):(Total: 550.777ms, non-child: 550.777ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 6:1/200.84 MB 0:2/504.27 MB 3:4/1008.58 MB 2:2/504.29 MB 10:1/252.14 MB 7:3/756.44 MB 5:4/1008.50 MB 9:3/756.39 MB 1:2/504.35 MB 4:2/504.27 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 304.42 MB, 304.42 MB, 304.42 MB, 304.42 MB, 304.42 MB, 304.42 MB, 317.78 MB, 317.78 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.00 - BytesRead: 317.78 MB (333213686) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.78 MB (333213686) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.78 MB (333213686) - DecompressionTime: 1s194ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 441.18 MB (462608576) - PerReadThreadRawHdfsThroughput: 560.63 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.89M (74892557) - RowsReturned: 14.97M (14972775) - RowsReturnedRate: 27.18 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.07K (3071) - ScannerThreadsTotalWallClockTime: 1m28s - MaterializeTupleTime(*): 1m25s - ScannerThreadsSysTime: 77.975ms - ScannerThreadsUserTime: 7s638ms - ScannerThreadsVoluntaryContextSwitches: 14.29K (14291) - TotalRawHdfsReadTime(*): 566.818ms - TotalReadThroughput: 70.62 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad5 (host=d2403.halxg.cloudera.com:22000):(Total: 4s244ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:1/252.13 MB 7:2/504.34 MB 9:2/504.26 MB 5:4/1008.62 MB 8:3/756.39 MB 1:1/252.16 MB 3:4/1008.58 MB 4:2/502.50 MB 6:1/252.19 MB 0:4/1008.51 MB MemoryUsage(500.000ms): 0, 88.00 KB, 446.74 MB, 447.75 MB, 448.18 MB, 447.69 MB, 400.11 MB, 273.46 MB, 265.73 MB, 32.81 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 2 - AverageThreadTokens: 17.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.54 MB (470325512) - PerHostPeakMemUsage: 1.85 GB (1986817560) - PrepareTime: 199.059ms - RowsProduced: 15.10M (15101159) - TotalCpuTime: 1m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.712ms - TotalStorageWaitTime: 3s105ms CodeGen:(Total: 692.166ms, non-child: 692.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 491.343ms - PrepareTime: 196.633ms DataStreamSender (dst_id=5):(Total: 3s770ms, non-child: 3s770ms, % non-child: 100.00%) - BytesSent: 223.38 MB (234233618) - NetworkThroughput(*): 48.13 MB/sec - OverallThroughput: 59.25 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s913ms - ThriftTransmitTime(*): 4s641ms - UncompressedRowBatchSize: 633.78 MB (664569008) HDFS_SCAN_NODE (id=0):(Total: 654.040ms, non-child: 654.040ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 2:1/252.13 MB 7:2/504.34 MB 9:2/504.26 MB 5:4/1008.62 MB 8:3/756.39 MB 1:1/252.16 MB 3:4/1008.58 MB 4:2/502.50 MB 6:1/252.19 MB 0:4/1008.51 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 307.05 MB, 307.05 MB, 307.05 MB, 307.05 MB, 307.05 MB, 307.05 MB, 307.05 MB, 320.40 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 20.25 - BytesRead: 320.40 MB (335958599) - BytesReadDataNodeCache: 0 - BytesReadLocal: 320.40 MB (335958599) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 320.40 MB (335958599) - DecompressionTime: 1s180ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 447.99 MB (469752064) - PerReadThreadRawHdfsThroughput: 563.08 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.52M (75517409) - RowsReturned: 15.10M (15101159) - RowsReturnedRate: 23.09 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.19K (3188) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 1m19s - ScannerThreadsSysTime: 95.973ms - ScannerThreadsUserTime: 7s484ms - ScannerThreadsVoluntaryContextSwitches: 14.21K (14207) - TotalRawHdfsReadTime(*): 569.009ms - TotalReadThroughput: 71.20 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ace (host=d2409.halxg.cloudera.com:22000):(Total: 4s255ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:2/403.55 MB 9:2/504.24 MB 7:1/252.17 MB 6:2/504.30 MB 10:2/504.31 MB 4:2/504.26 MB 8:1/252.12 MB 5:3/756.41 MB 1:3/756.42 MB 0:3/756.54 MB 2:4/1008.63 MB MemoryUsage(500.000ms): 88.00 KB, 148.15 MB, 438.86 MB, 438.84 MB, 438.77 MB, 430.66 MB, 305.05 MB, 273.64 MB, 218.40 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 18 - AverageThreadTokens: 20.78 - BloomFilterBytes: 0 - PeakMemoryUsage: 439.50 MB (460847536) - PerHostPeakMemUsage: 1.86 GB (1994727664) - PrepareTime: 196.199ms - RowsProduced: 15.49M (15490432) - TotalCpuTime: 1m27s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.896ms - TotalStorageWaitTime: 2s705ms CodeGen:(Total: 678.211ms, non-child: 678.211ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 476.853ms - PrepareTime: 193.690ms DataStreamSender (dst_id=5):(Total: 3s861ms, non-child: 3s861ms, % non-child: 100.00%) - BytesSent: 229.80 MB (240958947) - NetworkThroughput(*): 46.88 MB/sec - OverallThroughput: 59.51 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s960ms - ThriftTransmitTime(*): 4s902ms - UncompressedRowBatchSize: 650.12 MB (681700064) HDFS_SCAN_NODE (id=0):(Total: 573.047ms, non-child: 573.047ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 3:2/403.55 MB 9:2/504.24 MB 7:1/252.17 MB 6:2/504.30 MB 10:2/504.31 MB 4:2/504.26 MB 8:1/252.12 MB 5:3/756.41 MB 1:3/756.42 MB 0:3/756.54 MB 2:4/1008.63 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:50 BytesRead(500.000ms): 0, 97.90 MB, 301.90 MB, 301.90 MB, 301.90 MB, 301.90 MB, 315.25 MB, 315.25 MB, 328.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.25 - BytesRead: 328.60 MB (344563816) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.60 MB (344563816) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.60 MB (344563816) - DecompressionTime: 1s205ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 438.93 MB (460249688) - PerReadThreadRawHdfsThroughput: 617.22 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.44M (77435076) - RowsReturned: 15.49M (15490432) - RowsReturnedRate: 27.03 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 2.89K (2886) - ScannerThreadsTotalWallClockTime: 1m25s - MaterializeTupleTime(*): 1m19s - ScannerThreadsSysTime: 139.966ms - ScannerThreadsUserTime: 7s458ms - ScannerThreadsVoluntaryContextSwitches: 15.85K (15845) - TotalRawHdfsReadTime(*): 532.387ms - TotalReadThroughput: 73.02 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad6 (host=d2408.halxg.cloudera.com:22000):(Total: 4s275ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/504.37 MB 9:2/504.26 MB 5:3/756.51 MB 0:1/252.16 MB 4:2/504.31 MB 2:1/252.14 MB 3:1/252.14 MB 7:2/504.32 MB 8:1/252.15 MB 10:3/756.41 MB 1:5/1.23 GB MemoryUsage(500.000ms): 88.00 KB, 239.55 MB, 448.07 MB, 447.93 MB, 448.12 MB, 439.92 MB, 408.16 MB, 265.46 MB, 244.62 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 22 - AverageThreadTokens: 21.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.73 MB (470530336) - PerHostPeakMemUsage: 1.88 GB (2023917304) - PrepareTime: 195.589ms - RowsProduced: 14.48M (14482867) - TotalCpuTime: 1m31s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16.003ms - TotalStorageWaitTime: 3s217ms CodeGen:(Total: 667.202ms, non-child: 667.202ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.604ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 468.659ms - PrepareTime: 193.418ms DataStreamSender (dst_id=5):(Total: 3s870ms, non-child: 3s870ms, % non-child: 100.00%) - BytesSent: 211.34 MB (221603561) - NetworkThroughput(*): 46.51 MB/sec - OverallThroughput: 54.60 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s935ms - ThriftTransmitTime(*): 4s544ms - UncompressedRowBatchSize: 607.83 MB (637359324) HDFS_SCAN_NODE (id=0):(Total: 582.975ms, non-child: 582.975ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 23 Hdfs split stats (:<# splits>/): 6:2/504.37 MB 9:2/504.26 MB 5:3/756.51 MB 0:1/252.16 MB 4:2/504.31 MB 2:1/252.14 MB 3:1/252.14 MB 7:2/504.32 MB 8:1/252.15 MB 10:3/756.41 MB 1:5/1.23 GB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:0% 2:0% 3:12.5% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:46 BytesRead(500.000ms): 0, 148.92 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB, 307.18 MB - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 22.75 - BytesRead: 307.18 MB (322102672) - BytesReadDataNodeCache: 0 - BytesReadLocal: 307.18 MB (322102672) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 307.18 MB (322102672) - DecompressionTime: 1s139ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 448.18 MB (469948696) - PerReadThreadRawHdfsThroughput: 520.88 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 72.40M (72404061) - RowsReturned: 14.48M (14482867) - RowsReturnedRate: 24.84 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 3.48K (3485) - ScannerThreadsTotalWallClockTime: 1m30s - MaterializeTupleTime(*): 1m24s - ScannerThreadsSysTime: 70.976ms - ScannerThreadsUserTime: 7s338ms - ScannerThreadsVoluntaryContextSwitches: 14.09K (14092) - TotalRawHdfsReadTime(*): 589.735ms - TotalReadThroughput: 68.26 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705acf (host=d2419.halxg.cloudera.com:22000):(Total: 4s386ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.17 MB 10:1/252.14 MB 7:3/756.49 MB 5:2/504.33 MB 4:1/252.11 MB 6:2/504.38 MB 0:3/756.47 MB 9:4/1008.64 MB 2:3/756.42 MB 8:4/1008.62 MB MemoryUsage(500.000ms): 88.00 KB, 446.74 MB, 447.25 MB, 447.67 MB, 448.12 MB, 447.51 MB, 312.96 MB, 265.79 MB, 257.33 MB, 36.00 KB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 1 - AverageThreadTokens: 19.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.83 MB (470628472) - PerHostPeakMemUsage: 1.90 GB (2042932920) - PrepareTime: 192.845ms - RowsProduced: 15.12M (15116787) - TotalCpuTime: 1m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.534ms - TotalStorageWaitTime: 991.696ms CodeGen:(Total: 606.865ms, non-child: 606.865ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 411.586ms - PrepareTime: 189.914ms DataStreamSender (dst_id=5):(Total: 4s012ms, non-child: 4s012ms, % non-child: 100.00%) - BytesSent: 228.89 MB (240007031) - NetworkThroughput(*): 46.59 MB/sec - OverallThroughput: 57.04 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s046ms - ThriftTransmitTime(*): 4s912ms - UncompressedRowBatchSize: 634.44 MB (665256776) HDFS_SCAN_NODE (id=0):(Total: 550.176ms, non-child: 550.176ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 1:1/252.17 MB 10:1/252.14 MB 7:3/756.49 MB 5:2/504.33 MB 4:1/252.11 MB 6:2/504.38 MB 0:3/756.47 MB 9:4/1008.64 MB 2:3/756.42 MB 8:4/1008.62 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 307.20 MB, 307.20 MB, 307.20 MB, 307.20 MB, 307.20 MB, 307.20 MB, 307.20 MB, 307.30 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 320.56 MB (336134289) - BytesReadDataNodeCache: 0 - BytesReadLocal: 320.56 MB (336134289) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 320.56 MB (336134289) - DecompressionTime: 1s212ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 448.28 MB (470054832) - PerReadThreadRawHdfsThroughput: 838.68 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.56M (75557357) - RowsReturned: 15.12M (15116787) - RowsReturnedRate: 27.48 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.62K (3624) - ScannerThreadsTotalWallClockTime: 1m29s - MaterializeTupleTime(*): 1m27s - ScannerThreadsSysTime: 90.975ms - ScannerThreadsUserTime: 7s963ms - ScannerThreadsVoluntaryContextSwitches: 14.21K (14207) - TotalRawHdfsReadTime(*): 382.224ms - TotalReadThroughput: 68.29 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad7 (host=d2421.halxg.cloudera.com:22000):(Total: 4s407ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/504.25 MB 8:2/504.30 MB 7:2/504.25 MB 6:3/756.43 MB 9:3/756.52 MB 2:2/504.28 MB 3:2/504.35 MB 10:2/504.27 MB 4:3/756.41 MB 1:3/756.42 MB MemoryUsage(500.000ms): 88.00 KB, 447.53 MB, 447.64 MB, 447.73 MB, 447.83 MB, 447.83 MB, 297.05 MB, 265.88 MB, 262.92 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 23 - AverageThreadTokens: 21.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.53 MB (470317576) - PerHostPeakMemUsage: 1.90 GB (2042736208) - PrepareTime: 195.947ms - RowsProduced: 15.11M (15111018) - TotalCpuTime: 1m33s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.317ms - TotalStorageWaitTime: 1s179ms CodeGen:(Total: 596.818ms, non-child: 596.818ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.471ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 399.025ms - PrepareTime: 193.703ms DataStreamSender (dst_id=5):(Total: 3s986ms, non-child: 3s986ms, % non-child: 100.00%) - BytesSent: 240.64 MB (252332845) - NetworkThroughput(*): 48.53 MB/sec - OverallThroughput: 60.37 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s076ms - ThriftTransmitTime(*): 4s958ms - UncompressedRowBatchSize: 634.20 MB (665002896) HDFS_SCAN_NODE (id=0):(Total: 601.192ms, non-child: 601.192ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 0:2/504.25 MB 8:2/504.30 MB 7:2/504.25 MB 6:3/756.43 MB 9:3/756.52 MB 2:2/504.28 MB 3:2/504.35 MB 10:2/504.27 MB 4:3/756.41 MB 1:3/756.42 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 307.14 MB, 307.14 MB, 307.14 MB, 307.14 MB, 307.14 MB, 307.14 MB, 307.14 MB, 320.49 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.88 - BytesRead: 320.49 MB (336058985) - BytesReadDataNodeCache: 0 - BytesReadLocal: 320.49 MB (336058985) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 320.49 MB (336058985) - DecompressionTime: 1s193ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 447.99 MB (469752368) - PerReadThreadRawHdfsThroughput: 583.00 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.54M (75539400) - RowsReturned: 15.11M (15111018) - RowsReturnedRate: 25.14 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.92K (2919) - ScannerThreadsTotalWallClockTime: 1m30s - MaterializeTupleTime(*): 1m27s - ScannerThreadsSysTime: 87.976ms - ScannerThreadsUserTime: 7s642ms - ScannerThreadsVoluntaryContextSwitches: 14.26K (14262) - TotalRawHdfsReadTime(*): 549.723ms - TotalReadThroughput: 71.22 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ad3 (host=d2418.halxg.cloudera.com:22000):(Total: 4s399ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/252.11 MB 10:1/252.11 MB 4:2/504.32 MB 7:1/252.17 MB 9:2/504.29 MB 5:3/756.40 MB 6:5/1.23 GB 3:2/504.25 MB 2:2/504.29 MB 0:3/756.42 MB 8:2/504.29 MB MemoryUsage(500.000ms): 88.00 KB, 258.05 MB, 447.55 MB, 447.87 MB, 448.16 MB, 439.55 MB, 336.84 MB, 265.81 MB, 263.37 MB, 11.21 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 23, 2 - AverageThreadTokens: 19.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 448.60 MB (470391144) - PerHostPeakMemUsage: 1.90 GB (2043250256) - PrepareTime: 195.492ms - RowsProduced: 15.10M (15103071) - TotalCpuTime: 1m32s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17.353ms - TotalStorageWaitTime: 2s760ms CodeGen:(Total: 671.934ms, non-child: 671.934ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 474.078ms - PrepareTime: 193.424ms DataStreamSender (dst_id=5):(Total: 3s998ms, non-child: 3s998ms, % non-child: 100.00%) - BytesSent: 228.54 MB (239646652) - NetworkThroughput(*): 47.19 MB/sec - OverallThroughput: 57.16 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s878ms - ThriftTransmitTime(*): 4s842ms - UncompressedRowBatchSize: 633.86 MB (664653156) HDFS_SCAN_NODE (id=0):(Total: 582.325ms, non-child: 582.325ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 1:1/252.11 MB 10:1/252.11 MB 4:2/504.32 MB 7:1/252.17 MB 9:2/504.29 MB 5:3/756.40 MB 6:5/1.23 GB 3:2/504.25 MB 2:2/504.29 MB 0:3/756.42 MB 8:2/504.29 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:0% 2:0% 3:0% 4:11.11% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 161.89 MB, 307.10 MB, 307.10 MB, 307.10 MB, 307.10 MB, 307.10 MB, 307.10 MB, 320.45 MB, 320.45 MB - AverageHdfsReadThreadConcurrency: 0.44 - AverageScannerThreadConcurrency: 20.44 - BytesRead: 320.45 MB (336014935) - BytesReadDataNodeCache: 0 - BytesReadLocal: 320.45 MB (336014935) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 320.45 MB (336014935) - DecompressionTime: 1s195ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 11 (11) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 448.05 MB (469817696) - PerReadThreadRawHdfsThroughput: 673.47 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.53M (75531229) - RowsReturned: 15.10M (15103071) - RowsReturnedRate: 25.94 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.07K (3067) - ScannerThreadsTotalWallClockTime: 1m30s - MaterializeTupleTime(*): 1m24s - ScannerThreadsSysTime: 93.972ms - ScannerThreadsUserTime: 7s598ms - ScannerThreadsVoluntaryContextSwitches: 14.20K (14201) - TotalRawHdfsReadTime(*): 475.816ms - TotalReadThroughput: 64.09 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705add (host=d2404.halxg.cloudera.com:22000):(Total: 4s453ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/252.20 MB 4:2/504.24 MB 0:3/756.35 MB 7:1/252.14 MB 6:1/252.14 MB 8:3/756.39 MB 9:3/694.59 MB 1:4/1008.66 MB 2:3/756.50 MB 3:3/756.47 MB MemoryUsage(500.000ms): 88.00 KB, 488.00 KB, 441.26 MB, 440.91 MB, 440.74 MB, 440.87 MB, 401.29 MB, 281.60 MB, 273.50 MB, 158.55 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 15 - AverageThreadTokens: 20.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 441.65 MB (463100072) - PerHostPeakMemUsage: 1.91 GB (2052674400) - PrepareTime: 202.369ms - RowsProduced: 14.96M (14958237) - TotalCpuTime: 1m34s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13.770ms - TotalStorageWaitTime: 2s988ms CodeGen:(Total: 674.813ms, non-child: 674.813ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.455ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 469.878ms - PrepareTime: 200.009ms DataStreamSender (dst_id=5):(Total: 4s042ms, non-child: 4s042ms, % non-child: 100.00%) - BytesSent: 224.67 MB (235579872) - NetworkThroughput(*): 46.79 MB/sec - OverallThroughput: 55.57 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 1s944ms - ThriftTransmitTime(*): 4s801ms - UncompressedRowBatchSize: 627.78 MB (658279332) HDFS_SCAN_NODE (id=0):(Total: 597.722ms, non-child: 597.722ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 24 Hdfs split stats (:<# splits>/): 5:1/252.20 MB 4:2/504.24 MB 0:3/756.35 MB 7:1/252.14 MB 6:1/252.14 MB 8:3/756.39 MB 9:3/694.59 MB 1:4/1008.66 MB 2:3/756.50 MB 3:3/756.47 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 0, 303.90 MB, 303.90 MB, 303.90 MB, 303.90 MB, 303.90 MB, 317.26 MB, 317.26 MB, 317.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.00 - BytesRead: 317.26 MB (332667983) - BytesReadDataNodeCache: 0 - BytesReadLocal: 317.26 MB (332667983) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 317.26 MB (332667983) - DecompressionTime: 1s182ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 441.12 MB (462543008) - PerReadThreadRawHdfsThroughput: 531.34 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.77M (74768133) - RowsReturned: 14.96M (14958237) - RowsReturnedRate: 25.03 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.89K (2886) - ScannerThreadsTotalWallClockTime: 1m32s - MaterializeTupleTime(*): 1m26s - ScannerThreadsSysTime: 81.978ms - ScannerThreadsUserTime: 7s410ms - ScannerThreadsVoluntaryContextSwitches: 14.20K (14203) - TotalRawHdfsReadTime(*): 597.084ms - TotalReadThroughput: 63.45 MB/sec Instance 24495d00ab75cd74:1dfb5758d7705ade (host=d2420.halxg.cloudera.com:22000):(Total: 4s397ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/504.30 MB 2:1/252.13 MB 5:3/756.40 MB 4:3/712.41 MB 7:3/756.41 MB 10:2/504.32 MB 9:2/504.31 MB 1:3/756.54 MB 0:4/980.24 MB 6:2/504.25 MB MemoryUsage(500.000ms): 0, 88.00 KB, 212.72 MB, 442.88 MB, 442.99 MB, 443.13 MB, 410.65 MB, 305.29 MB, 273.59 MB, 225.35 MB, 5.74 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 20, 1 - AverageThreadTokens: 17.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 443.63 MB (465180952) - PerHostPeakMemUsage: 1.90 GB (2035216032) - PrepareTime: 246.936ms - RowsProduced: 15.56M (15557403) - TotalCpuTime: 1m29s - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13.787ms - TotalStorageWaitTime: 2s597ms CodeGen:(Total: 853.980ms, non-child: 853.980ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 3.739ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 604.070ms - PrepareTime: 244.361ms DataStreamSender (dst_id=5):(Total: 4s018ms, non-child: 4s018ms, % non-child: 100.00%) - BytesSent: 227.69 MB (238747608) - NetworkThroughput(*): 45.26 MB/sec - OverallThroughput: 56.65 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 2s039ms - ThriftTransmitTime(*): 5s030ms - UncompressedRowBatchSize: 652.93 MB (684647312) HDFS_SCAN_NODE (id=0):(Total: 608.919ms, non-child: 608.919ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 25 Hdfs split stats (:<# splits>/): 8:2/504.30 MB 2:1/252.13 MB 5:3/756.40 MB 4:3/712.41 MB 7:3/756.41 MB 10:2/504.32 MB 9:2/504.31 MB 1:3/756.54 MB 0:4/980.24 MB 6:2/504.25 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:50 BytesRead(500.000ms): 0, 144.43 MB, 304.83 MB, 304.83 MB, 304.83 MB, 304.83 MB, 318.18 MB, 318.18 MB, 330.06 MB, 330.06 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 20.00 - BytesRead: 330.06 MB (346097075) - BytesReadDataNodeCache: 0 - BytesReadLocal: 330.06 MB (346097075) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 330.06 MB (346097075) - DecompressionTime: 1s591ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 443.18 MB (464705816) - PerReadThreadRawHdfsThroughput: 554.87 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.79M (77786742) - RowsReturned: 15.56M (15557403) - RowsReturnedRate: 25.55 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 3.31K (3309) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 1m21s - ScannerThreadsSysTime: 136.969ms - ScannerThreadsUserTime: 9s939ms - ScannerThreadsVoluntaryContextSwitches: 14.47K (14467) - TotalRawHdfsReadTime(*): 594.850ms - TotalReadThroughput: 66.01 MB/sec Fragment F00: Instance 24495d00ab75cd74:1dfb5758d7705aef (host=d2403.halxg.cloudera.com:22000):(Total: 14s684ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:10/2.47 GB 10:14/3.46 GB 9:14/3.46 GB 2:8/1.98 GB 4:15/3.57 GB 5:11/2.72 GB 3:13/3.22 GB 7:8/1.98 GB 8:15/3.71 GB 0:13/3.22 GB 6:11/2.72 GB MemoryUsage(500.000ms): 0, 88.00 KB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1011.09 MB, 1013.19 MB, 1013.12 MB, 1013.37 MB, 1013.17 MB, 1013.46 MB, 1013.35 MB, 1012.99 MB, 1005.47 MB, 1005.15 MB, 910.25 MB, 831.21 MB, 831.36 MB, 831.18 MB, 831.09 MB, 831.61 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 1014.02 MB (1063274080) - PerHostPeakMemUsage: 2.14 GB (2302586744) - PrepareTime: 192.169ms - RowsProduced: 23.28M (23277529) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s951ms - TotalStorageWaitTime: 2s483ms CodeGen:(Total: 668.565ms, non-child: 668.565ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 470.695ms - PrepareTime: 189.463ms DataStreamSender (dst_id=4):(Total: 14s311ms, non-child: 14s311ms, % non-child: 100.00%) - BytesSent: 525.31 MB (550829224) - NetworkThroughput(*): 3.87 MB/sec - OverallThroughput: 36.70 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s311ms - ThriftTransmitTime(*): 2m15s - UncompressedRowBatchSize: 1021.02 MB (1070620200) HDFS_SCAN_NODE (id=1):(Total: 537.916ms, non-child: 537.916ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 1:10/2.47 GB 10:14/3.46 GB 9:14/3.46 GB 2:8/1.98 GB 4:15/3.57 GB 5:11/2.72 GB 3:13/3.22 GB 7:8/1.98 GB 8:15/3.71 GB 0:13/3.22 GB 6:11/2.72 GB BytesRead(500.000ms): 0, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001403732) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 783.739ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.44 MB (1062667864) - PerReadThreadRawHdfsThroughput: 433.71 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 48.53M (48525325) - RowsReturned: 23.28M (23277529) - RowsReturnedRate: 43.27 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s201ms - TotalReadThroughput: 63.67 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae3 (host=d2405.halxg.cloudera.com:22000):(Total: 14s702ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:7/1.73 GB 2:16/3.96 GB 9:14/3.46 GB 1:11/2.72 GB 10:10/2.47 GB 4:11/2.72 GB 0:14/3.46 GB 5:17/4.21 GB 3:10/2.47 GB 6:13/2.88 GB 8:10/2.47 GB MemoryUsage(500.000ms): 0, 88.00 KB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1010.61 MB, 1013.69 MB, 1013.52 MB, 1013.20 MB, 1013.30 MB, 1013.04 MB, 1013.23 MB, 1013.31 MB, 997.19 MB, 878.71 MB, 839.15 MB, 831.43 MB, 831.47 MB, 831.05 MB, 831.44 MB, 831.28 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.91 MB (1063159416) - PerHostPeakMemUsage: 2.14 GB (2302083592) - PrepareTime: 193.223ms - RowsProduced: 25.22M (25218095) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s941ms - TotalStorageWaitTime: 2s344ms CodeGen:(Total: 653.147ms, non-child: 653.147ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 452.261ms - PrepareTime: 190.683ms DataStreamSender (dst_id=4):(Total: 14s325ms, non-child: 14s325ms, % non-child: 100.00%) - BytesSent: 550.35 MB (577085668) - NetworkThroughput(*): 4.03 MB/sec - OverallThroughput: 38.42 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s306ms - ThriftTransmitTime(*): 2m16s - UncompressedRowBatchSize: 1.08 GB (1159920996) HDFS_SCAN_NODE (id=1):(Total: 547.371ms, non-child: 547.371ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 7:7/1.73 GB 2:16/3.96 GB 9:14/3.46 GB 1:11/2.72 GB 10:10/2.47 GB 4:11/2.72 GB 0:14/3.46 GB 5:17/4.21 GB 3:10/2.47 GB 6:13/2.88 GB 8:10/2.47 GB BytesRead(500.000ms): 0, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.02 MB (1001405926) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 811.347ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.31 MB (1062536968) - PerReadThreadRawHdfsThroughput: 413.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 52.53M (52527847) - RowsReturned: 25.22M (25218095) - RowsReturnedRate: 46.07 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s308ms - TotalReadThroughput: 63.67 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705aed (host=d2407.halxg.cloudera.com:22000):(Total: 14s729ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:15/3.71 GB 1:8/1.85 GB 3:11/2.72 GB 0:16/3.81 GB 9:16/3.81 GB 2:8/1.98 GB 7:11/2.72 GB 8:13/3.22 GB 6:9/2.23 GB 4:15/3.71 GB 10:11/2.72 GB MemoryUsage(500.000ms): 0, 88.00 KB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1012.26 MB, 1013.34 MB, 1013.46 MB, 1012.95 MB, 1013.34 MB, 1013.27 MB, 1013.43 MB, 1013.10 MB, 1013.17 MB, 973.79 MB, 831.13 MB, 831.57 MB, 831.57 MB, 830.97 MB, 831.38 MB, 830.98 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.86 MB (1063110360) - PerHostPeakMemUsage: 2.15 GB (2303809512) - PrepareTime: 192.845ms - RowsProduced: 24.91M (24911274) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s921ms - TotalStorageWaitTime: 1s581ms CodeGen:(Total: 627.888ms, non-child: 627.888ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.686ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 431.254ms - PrepareTime: 190.425ms DataStreamSender (dst_id=4):(Total: 14s362ms, non-child: 14s362ms, % non-child: 100.00%) - BytesSent: 550.29 MB (577020521) - NetworkThroughput(*): 4.24 MB/sec - OverallThroughput: 38.31 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s409ms - ThriftTransmitTime(*): 2m9s - UncompressedRowBatchSize: 1.07 GB (1145834508) HDFS_SCAN_NODE (id=1):(Total: 536.972ms, non-child: 536.972ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 5:15/3.71 GB 1:8/1.85 GB 3:11/2.72 GB 0:16/3.81 GB 9:16/3.81 GB 2:8/1.98 GB 7:11/2.72 GB 8:13/3.22 GB 6:9/2.23 GB 4:15/3.71 GB 10:11/2.72 GB BytesRead(500.000ms): 0, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001397451) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 830.597ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.31 MB (1062536920) - PerReadThreadRawHdfsThroughput: 560.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 51.88M (51880164) - RowsReturned: 24.91M (24911274) - RowsReturnedRate: 46.39 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s703ms - TotalReadThroughput: 63.67 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae0 (host=d2416.halxg.cloudera.com:22000):(Total: 14s637ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:11/2.72 GB 0:10/2.47 GB 9:11/2.72 GB 1:13/3.22 GB 4:11/2.72 GB 10:15/3.71 GB 3:13/3.07 GB 5:12/2.97 GB 7:12/2.80 GB 8:13/3.22 GB 2:12/2.79 GB MemoryUsage(500.000ms): 88.00 KB, 983.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1011.41 MB, 1013.19 MB, 1013.15 MB, 1013.67 MB, 1013.25 MB, 1013.39 MB, 1013.27 MB, 1013.26 MB, 1013.50 MB, 1013.55 MB, 965.60 MB, 831.58 MB, 831.03 MB, 831.05 MB, 831.47 MB, 831.29 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 1014.00 MB (1063257736) - PerHostPeakMemUsage: 2.14 GB (2302899744) - PrepareTime: 197.783ms - RowsProduced: 23.28M (23281944) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s938ms - TotalStorageWaitTime: 1s866ms CodeGen:(Total: 720.274ms, non-child: 720.274ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 517.653ms - PrepareTime: 195.287ms DataStreamSender (dst_id=4):(Total: 14s251ms, non-child: 14s251ms, % non-child: 100.00%) - BytesSent: 511.04 MB (535864138) - NetworkThroughput(*): 3.76 MB/sec - OverallThroughput: 35.86 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s235ms - ThriftTransmitTime(*): 2m15s - UncompressedRowBatchSize: 1021.27 MB (1070879316) HDFS_SCAN_NODE (id=1):(Total: 558.854ms, non-child: 558.854ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 6:11/2.72 GB 0:10/2.47 GB 9:11/2.72 GB 1:13/3.22 GB 4:11/2.72 GB 10:15/3.71 GB 3:13/3.07 GB 5:12/2.97 GB 7:12/2.80 GB 8:13/3.22 GB 2:12/2.79 GB BytesRead(500.000ms): 0, 915.61 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001403953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 796.323ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.44 MB (1062667912) - PerReadThreadRawHdfsThroughput: 584.92 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 48.53M (48534591) - RowsReturned: 23.28M (23282968) - RowsReturnedRate: 41.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s632ms - TotalReadThroughput: 63.67 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae2 (host=d2412.halxg.cloudera.com:22000):(Total: 15s677ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:9/2.23 GB 1:13/3.22 GB 4:11/2.72 GB 5:14/3.46 GB 10:11/2.72 GB 9:10/2.47 GB 8:17/4.21 GB 7:11/2.72 GB 2:10/2.47 GB 6:14/3.46 GB 3:12/2.97 GB MemoryUsage(500.000ms): 0, 88.00 KB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.77 MB, 1010.70 MB, 1010.78 MB, 1012.84 MB, 1013.79 MB, 1013.03 MB, 1012.82 MB, 1013.20 MB, 1013.06 MB, 1013.13 MB, 1013.47 MB, 933.97 MB, 831.19 MB, 831.93 MB, 831.58 MB, 831.32 MB, 831.30 MB, 831.49 MB, 831.05 MB, 831.15 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.61 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.96 MB (1063216776) - PerHostPeakMemUsage: 2.14 GB (2302229560) - PrepareTime: 193.275ms - RowsProduced: 28.65M (28652460) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s956ms - TotalStorageWaitTime: 2s356ms CodeGen:(Total: 674.390ms, non-child: 674.390ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 10.660ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 471.331ms - PrepareTime: 190.956ms DataStreamSender (dst_id=4):(Total: 15s261ms, non-child: 15s261ms, % non-child: 100.00%) - BytesSent: 631.63 MB (662315036) - NetworkThroughput(*): 5.03 MB/sec - OverallThroughput: 41.39 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s935ms - ThriftTransmitTime(*): 2m5s - UncompressedRowBatchSize: 1.23 GB (1317911088) HDFS_SCAN_NODE (id=1):(Total: 586.629ms, non-child: 586.629ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 0:9/2.23 GB 1:13/3.22 GB 4:11/2.72 GB 5:14/3.46 GB 10:11/2.72 GB 9:10/2.47 GB 8:17/4.21 GB 7:11/2.72 GB 2:10/2.47 GB 6:14/3.46 GB 3:12/2.97 GB BytesRead(500.000ms): 0, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001405098) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 942.097ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.38 MB (1062602416) - PerReadThreadRawHdfsThroughput: 784.24 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 59.58M (59578550) - RowsReturned: 28.65M (28652460) - RowsReturnedRate: 48.84 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s217ms - TotalReadThroughput: 59.69 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705af1 (host=d2415.halxg.cloudera.com:22000):(Total: 15s703ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:11/2.72 GB 6:13/3.22 GB 3:8/1.98 GB 9:9/2.23 GB 2:13/3.22 GB 0:14/3.46 GB 1:15/3.71 GB 8:11/2.72 GB 10:11/2.72 GB 5:19/4.70 GB 7:8/1.98 GB MemoryUsage(500.000ms): 88.00 KB, 960.72 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1011.21 MB, 1013.14 MB, 1013.47 MB, 1013.19 MB, 1013.06 MB, 1013.49 MB, 1013.56 MB, 1013.08 MB, 1013.45 MB, 989.46 MB, 846.85 MB, 831.25 MB, 831.39 MB, 831.40 MB, 831.15 MB, 831.74 MB, 830.90 MB, 831.28 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.93 MB (1063183960) - PerHostPeakMemUsage: 2.14 GB (2302713976) - PrepareTime: 191.819ms - RowsProduced: 27.86M (27858852) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s948ms - TotalStorageWaitTime: 1s659ms CodeGen:(Total: 645.032ms, non-child: 645.032ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.216ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 447.932ms - PrepareTime: 187.627ms DataStreamSender (dst_id=4):(Total: 15s328ms, non-child: 15s328ms, % non-child: 100.00%) - BytesSent: 618.44 MB (648484411) - NetworkThroughput(*): 4.50 MB/sec - OverallThroughput: 40.35 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s959ms - ThriftTransmitTime(*): 2m17s - UncompressedRowBatchSize: 1.19 GB (1281375732) HDFS_SCAN_NODE (id=1):(Total: 541.013ms, non-child: 541.013ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 4:11/2.72 GB 6:13/3.22 GB 3:8/1.98 GB 9:9/2.23 GB 2:13/3.22 GB 0:14/3.46 GB 1:15/3.71 GB 8:11/2.72 GB 10:11/2.72 GB 5:19/4.70 GB 7:8/1.98 GB BytesRead(500.000ms): 0, 892.87 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB, 955.04 MB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.04 MB (1001434282) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 928.636ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.38 MB (1062602416) - PerReadThreadRawHdfsThroughput: 609.00 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 57.94M (57942457) - RowsReturned: 27.86M (27858852) - RowsReturnedRate: 51.49 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s568ms - TotalReadThroughput: 59.69 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705aea (host=d2420.halxg.cloudera.com:22000):(Total: 15s721ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:7/1.73 GB 10:14/3.46 GB 2:14/3.46 GB 8:11/2.72 GB 4:12/2.97 GB 9:18/4.32 GB 7:11/2.72 GB 5:9/2.23 GB 6:13/3.22 GB 3:10/2.47 GB 0:12/2.97 GB MemoryUsage(500.000ms): 0, 88.00 KB, 967.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1011.63 MB, 1012.83 MB, 1013.01 MB, 1013.40 MB, 1013.40 MB, 1013.31 MB, 1013.09 MB, 1013.00 MB, 1013.03 MB, 1013.34 MB, 1005.45 MB, 957.88 MB, 831.24 MB, 831.21 MB, 831.60 MB, 831.73 MB, 831.82 MB, 831.38 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.61 - BloomFilterBytes: 0 - PeakMemoryUsage: 1014.01 MB (1063265928) - PerHostPeakMemUsage: 2.15 GB (2305062536) - PrepareTime: 229.561ms - RowsProduced: 23.77M (23770075) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s895ms - TotalStorageWaitTime: 2s316ms CodeGen:(Total: 703.648ms, non-child: 703.648ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.659ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 468.550ms - PrepareTime: 224.359ms DataStreamSender (dst_id=4):(Total: 15s284ms, non-child: 15s284ms, % non-child: 100.00%) - BytesSent: 514.83 MB (539839009) - NetworkThroughput(*): 3.76 MB/sec - OverallThroughput: 33.68 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 4s867ms - ThriftTransmitTime(*): 2m16s - UncompressedRowBatchSize: 1.02 GB (1093328184) HDFS_SCAN_NODE (id=1):(Total: 642.124ms, non-child: 642.124ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 1:7/1.73 GB 10:14/3.46 GB 2:14/3.46 GB 8:11/2.72 GB 4:12/2.97 GB 9:18/4.32 GB 7:11/2.72 GB 5:9/2.23 GB 6:13/3.22 GB 3:10/2.47 GB 0:12/2.97 GB BytesRead(500.000ms): 0, 897.74 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB, 955.00 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.00 MB (1001394124) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 960.109ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.44 MB (1062667912) - PerReadThreadRawHdfsThroughput: 407.04 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 49.54M (49544068) - RowsReturned: 23.77M (23770075) - RowsReturnedRate: 37.02 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s346ms - TotalReadThroughput: 59.69 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705af2 (host=d2409.halxg.cloudera.com:22000):(Total: 16s718ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:12/2.85 GB 0:11/2.72 GB 6:9/2.23 GB 1:13/3.22 GB 9:9/2.23 GB 2:9/2.23 GB 8:15/3.61 GB 7:13/3.22 GB 5:14/3.46 GB 4:14/3.46 GB 10:14/3.46 GB MemoryUsage(500.000ms): 88.00 KB, 791.55 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1010.81 MB, 1012.61 MB, 1013.26 MB, 1013.28 MB, 1013.24 MB, 1013.19 MB, 1013.17 MB, 1013.17 MB, 1013.41 MB, 997.43 MB, 910.91 MB, 831.36 MB, 831.23 MB, 831.55 MB, 831.04 MB, 831.50 MB, 831.52 MB, 831.37 MB, 823.51 MB, 783.33 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.92 MB (1063167664) - PerHostPeakMemUsage: 2.14 GB (2302291688) - PrepareTime: 189.622ms - RowsProduced: 30.77M (30765728) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s955ms - TotalStorageWaitTime: 1s991ms CodeGen:(Total: 621.417ms, non-child: 621.417ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 427.766ms - PrepareTime: 187.278ms DataStreamSender (dst_id=4):(Total: 16s325ms, non-child: 16s325ms, % non-child: 100.00%) - BytesSent: 682.38 MB (715526152) - NetworkThroughput(*): 4.93 MB/sec - OverallThroughput: 41.80 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 5s546ms - ThriftTransmitTime(*): 2m18s - UncompressedRowBatchSize: 1.32 GB (1415220924) HDFS_SCAN_NODE (id=1):(Total: 552.712ms, non-child: 552.712ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 3:12/2.85 GB 0:11/2.72 GB 6:9/2.23 GB 1:13/3.22 GB 9:9/2.23 GB 2:9/2.23 GB 8:15/3.61 GB 7:13/3.22 GB 5:14/3.46 GB 4:14/3.46 GB 10:14/3.46 GB BytesRead(500.000ms): 0, 694.27 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB, 954.98 MB - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 954.98 MB (1001366803) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s037ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.38 MB (1062602416) - PerReadThreadRawHdfsThroughput: 471.28 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 63.93M (63925205) - RowsReturned: 30.77M (30766752) - RowsReturnedRate: 55.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s026ms - TotalReadThroughput: 56.18 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae8 (host=d2410.halxg.cloudera.com:22000):(Total: 16s688ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:16/3.96 GB 0:9/2.23 GB 6:13/3.22 GB 4:13/3.22 GB 2:14/3.46 GB 9:12/2.97 GB 1:8/1.98 GB 5:17/4.04 GB 7:17/4.20 GB 3:12/2.97 GB MemoryUsage(500.000ms): 88.00 KB, 318.26 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.48 MB, 1010.59 MB, 1013.51 MB, 1013.49 MB, 1013.21 MB, 1012.70 MB, 1013.19 MB, 1013.31 MB, 1013.17 MB, 1013.03 MB, 934.19 MB, 830.98 MB, 831.30 MB, 831.20 MB, 831.11 MB, 831.60 MB, 831.19 MB, 831.20 MB, 831.39 MB, 807.35 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1014.01 MB (1063265928) - PerHostPeakMemUsage: 2.14 GB (2301948400) - PrepareTime: 191.491ms - RowsProduced: 30.68M (30683106) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s926ms - TotalStorageWaitTime: 1s813ms CodeGen:(Total: 655.052ms, non-child: 655.052ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.251ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 458.236ms - PrepareTime: 189.028ms DataStreamSender (dst_id=4):(Total: 16s298ms, non-child: 16s298ms, % non-child: 100.00%) - BytesSent: 689.25 MB (722727780) - NetworkThroughput(*): 4.99 MB/sec - OverallThroughput: 42.29 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 5s539ms - ThriftTransmitTime(*): 2m18s - UncompressedRowBatchSize: 1.31 GB (1411451964) HDFS_SCAN_NODE (id=1):(Total: 554.582ms, non-child: 554.582ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 8:16/3.96 GB 0:9/2.23 GB 6:13/3.22 GB 4:13/3.22 GB 2:14/3.46 GB 9:12/2.97 GB 1:8/1.98 GB 5:17/4.04 GB 7:17/4.20 GB 3:12/2.97 GB BytesRead(500.000ms): 0, 218.25 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 954.99 MB (1001382970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s050ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.44 MB (1062667912) - PerReadThreadRawHdfsThroughput: 564.44 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 63.76M (63763244) - RowsReturned: 30.68M (30684130) - RowsReturnedRate: 55.33 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s691ms - TotalReadThroughput: 56.18 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae4 (host=d2414.halxg.cloudera.com:22000):(Total: 16s639ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:9/2.23 GB 5:16/3.96 GB 9:16/3.96 GB 1:10/2.47 GB 3:7/1.73 GB 4:14/3.46 GB 7:9/2.23 GB 2:13/3.22 GB 10:13/3.22 GB 0:15/3.71 GB 8:10/2.47 GB MemoryUsage(500.000ms): 88.00 KB, 793.22 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1011.35 MB, 1012.91 MB, 1013.08 MB, 1012.99 MB, 1013.39 MB, 1013.09 MB, 1013.25 MB, 1013.22 MB, 1013.28 MB, 1013.17 MB, 926.46 MB, 831.47 MB, 831.14 MB, 831.14 MB, 831.64 MB, 831.18 MB, 831.54 MB, 831.53 MB, 831.53 MB, 823.21 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.88 MB (1063126744) - PerHostPeakMemUsage: 2.14 GB (2302861704) - PrepareTime: 192.146ms - RowsProduced: 30.03M (30033721) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s959ms - TotalStorageWaitTime: 2s390ms CodeGen:(Total: 701.114ms, non-child: 701.114ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.507ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 502.444ms - PrepareTime: 189.740ms DataStreamSender (dst_id=4):(Total: 16s198ms, non-child: 16s198ms, % non-child: 100.00%) - BytesSent: 664.82 MB (697113393) - NetworkThroughput(*): 4.59 MB/sec - OverallThroughput: 41.04 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 5s401ms - ThriftTransmitTime(*): 2m24s - UncompressedRowBatchSize: 1.29 GB (1381559400) HDFS_SCAN_NODE (id=1):(Total: 602.379ms, non-child: 602.379ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 6:9/2.23 GB 5:16/3.96 GB 9:16/3.96 GB 1:10/2.47 GB 3:7/1.73 GB 4:14/3.46 GB 7:9/2.23 GB 2:13/3.22 GB 10:13/3.22 GB 0:15/3.71 GB 8:10/2.47 GB BytesRead(500.000ms): 0, 693.48 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB - AverageHdfsReadThreadConcurrency: 0.21 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.02 MB (1001410734) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s056ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.31 MB (1062536920) - PerReadThreadRawHdfsThroughput: 465.98 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 62.44M (62442145) - RowsReturned: 30.03M (30034745) - RowsReturnedRate: 49.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s049ms - TotalReadThroughput: 56.18 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae9 (host=d2404.halxg.cloudera.com:22000):(Total: 16s703ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:11/2.72 GB 1:8/1.98 GB 4:6/1.48 GB 5:11/2.72 GB 7:12/2.97 GB 10:13/3.22 GB 0:14/3.46 GB 6:11/2.72 GB 3:16/3.96 GB 8:17/4.21 GB 9:12/2.97 GB MemoryUsage(500.000ms): 88.00 KB, 300.94 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.49 MB, 1010.43 MB, 1013.27 MB, 1013.15 MB, 1013.60 MB, 1013.59 MB, 1013.30 MB, 1013.20 MB, 1013.24 MB, 1005.29 MB, 965.83 MB, 831.15 MB, 830.97 MB, 831.12 MB, 831.44 MB, 831.11 MB, 831.52 MB, 831.72 MB, 831.47 MB, 823.47 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1014.06 MB (1063323288) - PerHostPeakMemUsage: 2.14 GB (2301957112) - PrepareTime: 197.088ms - RowsProduced: 29.65M (29654079) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s954ms - TotalStorageWaitTime: 1s935ms CodeGen:(Total: 647.330ms, non-child: 647.330ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 446.138ms - PrepareTime: 194.210ms DataStreamSender (dst_id=4):(Total: 16s296ms, non-child: 16s296ms, % non-child: 100.00%) - BytesSent: 671.59 MB (704215061) - NetworkThroughput(*): 5.10 MB/sec - OverallThroughput: 41.21 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 5s563ms - ThriftTransmitTime(*): 2m11s - UncompressedRowBatchSize: 1.27 GB (1364033736) HDFS_SCAN_NODE (id=1):(Total: 577.524ms, non-child: 577.524ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 2:11/2.72 GB 1:8/1.98 GB 4:6/1.48 GB 5:11/2.72 GB 7:12/2.97 GB 10:13/3.22 GB 0:14/3.46 GB 6:11/2.72 GB 3:16/3.96 GB 8:17/4.21 GB 9:12/2.97 GB BytesRead(500.000ms): 0, 186.25 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.02 MB (1001411581) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s008ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.50 MB (1062733456) - PerReadThreadRawHdfsThroughput: 530.99 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 61.66M (61655602) - RowsReturned: 29.65M (29654079) - RowsReturnedRate: 51.35 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s798ms - TotalReadThroughput: 56.18 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705aee (host=d2421.halxg.cloudera.com:22000):(Total: 16s609ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:14/3.46 GB 9:9/2.23 GB 6:8/1.98 GB 4:13/3.05 GB 10:15/3.71 GB 7:14/3.46 GB 8:10/2.47 GB 1:14/3.46 GB 0:12/2.97 GB 3:10/2.47 GB 5:13/3.22 GB MemoryUsage(500.000ms): 88.00 KB, 528.05 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1011.90 MB, 1013.13 MB, 1013.17 MB, 1013.06 MB, 1013.54 MB, 1012.61 MB, 1013.33 MB, 1013.00 MB, 1013.28 MB, 989.66 MB, 862.97 MB, 831.52 MB, 831.44 MB, 831.16 MB, 831.25 MB, 831.36 MB, 831.05 MB, 831.26 MB, 823.21 MB, 695.11 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.99 MB (1063249552) - PerHostPeakMemUsage: 2.15 GB (2303523144) - PrepareTime: 193.801ms - RowsProduced: 31.71M (31706465) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s954ms - TotalStorageWaitTime: 1s829ms CodeGen:(Total: 738.461ms, non-child: 738.461ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 540.666ms - PrepareTime: 189.686ms DataStreamSender (dst_id=4):(Total: 16s235ms, non-child: 16s235ms, % non-child: 100.00%) - BytesSent: 705.97 MB (740259207) - NetworkThroughput(*): 5.35 MB/sec - OverallThroughput: 43.48 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 5s543ms - ThriftTransmitTime(*): 2m12s - UncompressedRowBatchSize: 1.36 GB (1458493296) HDFS_SCAN_NODE (id=1):(Total: 541.383ms, non-child: 541.383ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 2:14/3.46 GB 9:9/2.23 GB 6:8/1.98 GB 4:13/3.05 GB 10:15/3.71 GB 7:14/3.46 GB 8:10/2.47 GB 1:14/3.46 GB 0:12/2.97 GB 3:10/2.47 GB 5:13/3.22 GB BytesRead(500.000ms): 0, 403.78 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001403165) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s031ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.44 MB (1062667912) - PerReadThreadRawHdfsThroughput: 463.12 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 65.87M (65866425) - RowsReturned: 31.71M (31707489) - RowsReturnedRate: 58.57 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s062ms - TotalReadThroughput: 56.18 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae5 (host=d2411.halxg.cloudera.com:22000):(Total: 17s722ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:9/2.23 GB 8:9/2.23 GB 6:15/3.71 GB 3:16/3.76 GB 4:11/2.72 GB 2:12/2.97 GB 9:9/2.23 GB 0:13/3.22 GB 5:14/3.46 GB 10:9/2.23 GB 7:15/3.71 GB MemoryUsage(500.000ms): 0, 2.32 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.02 MB, 1011.01 MB, 1013.20 MB, 1012.95 MB, 1013.22 MB, 1013.25 MB, 1013.21 MB, 1013.28 MB, 1013.42 MB, 997.47 MB, 942.13 MB, 831.26 MB, 831.22 MB, 831.13 MB, 831.22 MB, 831.41 MB, 831.33 MB, 831.01 MB, 815.28 MB, 743.13 MB, 647.22 MB, 647.16 MB, 647.20 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.92 MB (1063167656) - PerHostPeakMemUsage: 2.14 GB (2302515216) - PrepareTime: 190.332ms - RowsProduced: 35.58M (35582832) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s938ms - TotalStorageWaitTime: 1s954ms CodeGen:(Total: 618.668ms, non-child: 618.668ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.463ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 423.864ms - PrepareTime: 186.829ms DataStreamSender (dst_id=4):(Total: 17s306ms, non-child: 17s306ms, % non-child: 100.00%) - BytesSent: 791.03 MB (829459881) - NetworkThroughput(*): 5.39 MB/sec - OverallThroughput: 45.71 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s160ms - ThriftTransmitTime(*): 2m26s - UncompressedRowBatchSize: 1.52 GB (1636859328) HDFS_SCAN_NODE (id=1):(Total: 573.988ms, non-child: 573.988ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 1:9/2.23 GB 8:9/2.23 GB 6:15/3.71 GB 3:16/3.76 GB 4:11/2.72 GB 2:12/2.97 GB 9:9/2.23 GB 0:13/3.22 GB 5:14/3.46 GB 10:9/2.23 GB 7:15/3.71 GB BytesRead(500.000ms): 0, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001401771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s162ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.38 MB (1062602416) - PerReadThreadRawHdfsThroughput: 454.23 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.85M (73848012) - RowsReturned: 35.58M (35583856) - RowsReturnedRate: 61.99 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s102ms - TotalReadThroughput: 53.06 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705af3 (host=d2419.halxg.cloudera.com:22000):(Total: 17s638ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:15/3.71 GB 4:8/1.98 GB 1:15/3.71 GB 10:15/3.71 GB 0:13/3.22 GB 6:12/2.97 GB 7:10/2.47 GB 2:11/2.72 GB 8:7/1.73 GB 9:15/3.71 GB 3:10/2.47 GB MemoryUsage(500.000ms): 88.00 KB, 394.44 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1011.46 MB, 1012.46 MB, 1013.32 MB, 1013.23 MB, 1013.17 MB, 1013.63 MB, 1013.21 MB, 1013.40 MB, 1013.53 MB, 1005.19 MB, 918.12 MB, 839.13 MB, 831.03 MB, 831.51 MB, 831.27 MB, 831.42 MB, 831.38 MB, 831.23 MB, 807.01 MB, 735.11 MB, 679.49 MB, 647.40 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.83 MB (1063077632) - PerHostPeakMemUsage: 2.14 GB (2302948328) - PrepareTime: 194.422ms - RowsProduced: 34.83M (34834903) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s947ms - TotalStorageWaitTime: 2s449ms CodeGen:(Total: 704.426ms, non-child: 704.426ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 7.427ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 503.598ms - PrepareTime: 191.934ms DataStreamSender (dst_id=4):(Total: 17s212ms, non-child: 17s212ms, % non-child: 100.00%) - BytesSent: 769.51 MB (806894843) - NetworkThroughput(*): 5.78 MB/sec - OverallThroughput: 44.71 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s073ms - ThriftTransmitTime(*): 2m13s - UncompressedRowBatchSize: 1.49 GB (1602444012) HDFS_SCAN_NODE (id=1):(Total: 586.757ms, non-child: 586.757ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 5:15/3.71 GB 4:8/1.98 GB 1:15/3.71 GB 10:15/3.71 GB 0:13/3.22 GB 6:12/2.97 GB 7:10/2.47 GB 2:11/2.72 GB 8:7/1.73 GB 9:15/3.71 GB 3:10/2.47 GB BytesRead(500.000ms): 0, 274.44 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB - AverageHdfsReadThreadConcurrency: 0.31 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.02 MB (1001410388) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s153ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.25 MB (1062471376) - PerReadThreadRawHdfsThroughput: 408.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 72.31M (72312756) - RowsReturned: 34.84M (34835927) - RowsReturnedRate: 59.37 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s335ms - TotalReadThroughput: 53.06 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705aec (host=d2406.halxg.cloudera.com:22000):(Total: 17s697ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:11/2.72 GB 6:12/2.97 GB 8:7/1.73 GB 3:13/3.22 GB 0:15/3.71 GB 5:12/2.97 GB 9:10/2.47 GB 2:16/3.85 GB 10:13/3.22 GB 1:8/1.98 GB 7:15/3.71 GB MemoryUsage(500.000ms): 88.00 KB, 992.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1010.75 MB, 1013.17 MB, 1013.25 MB, 1012.97 MB, 1013.29 MB, 1013.42 MB, 1013.09 MB, 1012.78 MB, 1012.69 MB, 989.71 MB, 862.87 MB, 831.30 MB, 831.30 MB, 831.27 MB, 831.44 MB, 831.18 MB, 831.22 MB, 831.56 MB, 823.24 MB, 783.57 MB, 647.19 MB, 647.16 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.88 MB (1063134936) - PerHostPeakMemUsage: 2.14 GB (2302228800) - PrepareTime: 192.253ms - RowsProduced: 34.01M (34005356) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s954ms - TotalStorageWaitTime: 1s841ms CodeGen:(Total: 644.763ms, non-child: 644.763ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 4.540ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 448.886ms - PrepareTime: 189.885ms DataStreamSender (dst_id=4):(Total: 17s291ms, non-child: 17s291ms, % non-child: 100.00%) - BytesSent: 776.60 MB (814323073) - NetworkThroughput(*): 5.56 MB/sec - OverallThroughput: 44.91 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s268ms - ThriftTransmitTime(*): 2m19s - UncompressedRowBatchSize: 1.46 GB (1564306848) HDFS_SCAN_NODE (id=1):(Total: 566.995ms, non-child: 566.995ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 4:11/2.72 GB 6:12/2.97 GB 8:7/1.73 GB 3:13/3.22 GB 0:15/3.71 GB 5:12/2.97 GB 9:10/2.47 GB 2:16/3.85 GB 10:13/3.22 GB 1:8/1.98 GB 7:15/3.71 GB BytesRead(500.000ms): 0, 924.86 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.03 MB (1001418177) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s124ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.31 MB (1062536968) - PerReadThreadRawHdfsThroughput: 453.19 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 70.61M (70613806) - RowsReturned: 34.01M (34005356) - RowsReturnedRate: 59.97 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s107ms - TotalReadThroughput: 53.06 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae1 (host=d2418.halxg.cloudera.com:22000):(Total: 18s702ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:5/1.24 GB 7:6/1.48 GB 10:8/1.98 GB 1:14/3.46 GB 6:11/2.72 GB 5:14/3.46 GB 9:13/3.22 GB 4:15/3.71 GB 8:16/3.96 GB 0:14/3.46 GB 3:16/3.96 GB MemoryUsage(500.000ms): 88.00 KB, 845.14 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.03 MB, 1012.97 MB, 1013.41 MB, 1013.33 MB, 1013.19 MB, 1013.31 MB, 1013.00 MB, 1013.35 MB, 1013.36 MB, 989.89 MB, 862.54 MB, 831.73 MB, 831.42 MB, 831.13 MB, 831.68 MB, 830.99 MB, 831.57 MB, 831.38 MB, 823.47 MB, 727.06 MB, 647.32 MB, 647.27 MB, 647.50 MB, 647.34 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.78 MB (1063020192) - PerHostPeakMemUsage: 2.15 GB (2303567640) - PrepareTime: 190.864ms - RowsProduced: 38.62M (38620050) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s954ms - TotalStorageWaitTime: 1s658ms CodeGen:(Total: 631.668ms, non-child: 631.668ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.146ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 436.519ms - PrepareTime: 188.460ms DataStreamSender (dst_id=4):(Total: 18s295ms, non-child: 18s295ms, % non-child: 100.00%) - BytesSent: 866.58 MB (908673066) - NetworkThroughput(*): 6.13 MB/sec - OverallThroughput: 47.37 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s875ms - ThriftTransmitTime(*): 2m21s - UncompressedRowBatchSize: 1.65 GB (1776569964) HDFS_SCAN_NODE (id=1):(Total: 565.434ms, non-child: 565.434ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 2:5/1.24 GB 7:6/1.48 GB 10:8/1.98 GB 1:14/3.46 GB 6:11/2.72 GB 5:14/3.46 GB 9:13/3.22 GB 4:15/3.71 GB 8:16/3.96 GB 0:14/3.46 GB 3:16/3.96 GB BytesRead(500.000ms): 0, 763.39 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB, 954.99 MB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 954.99 MB (1001383172) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s269ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.25 MB (1062471328) - PerReadThreadRawHdfsThroughput: 553.70 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 80.11M (80111445) - RowsReturned: 38.62M (38620050) - RowsReturnedRate: 68.30 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s724ms - TotalReadThroughput: 50.26 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705af0 (host=d2408.halxg.cloudera.com:22000):(Total: 18s723ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:5/1.24 GB 2:7/1.73 GB 0:16/3.96 GB 7:12/2.97 GB 9:6/1.48 GB 3:14/3.46 GB 4:16/3.96 GB 1:15/3.71 GB 5:15/3.71 GB 10:12/2.97 GB 6:13/3.22 GB MemoryUsage(500.000ms): 88.00 KB, 932.04 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.28 MB, 1012.59 MB, 1012.67 MB, 1013.24 MB, 1013.24 MB, 1013.28 MB, 1013.43 MB, 1013.10 MB, 1013.38 MB, 1013.08 MB, 1013.14 MB, 934.04 MB, 831.03 MB, 831.44 MB, 831.17 MB, 831.61 MB, 831.36 MB, 831.06 MB, 831.44 MB, 831.16 MB, 767.42 MB, 687.01 MB, 647.35 MB, 647.49 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.95 MB (1063208536) - PerHostPeakMemUsage: 2.15 GB (2303831992) - PrepareTime: 189.211ms - RowsProduced: 35.63M (35631415) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s910ms - TotalStorageWaitTime: 1s410ms CodeGen:(Total: 601.508ms, non-child: 601.508ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 5.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 407.451ms - PrepareTime: 186.808ms DataStreamSender (dst_id=4):(Total: 18s280ms, non-child: 18s280ms, % non-child: 100.00%) - BytesSent: 796.06 MB (834726985) - NetworkThroughput(*): 9.11 MB/sec - OverallThroughput: 43.55 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s535ms - ThriftTransmitTime(*): 1m27s - UncompressedRowBatchSize: 1.53 GB (1639097148) HDFS_SCAN_NODE (id=1):(Total: 598.726ms, non-child: 598.726ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 8:5/1.24 GB 2:7/1.73 GB 0:16/3.96 GB 7:12/2.97 GB 9:6/1.48 GB 3:14/3.46 GB 4:16/3.96 GB 1:15/3.71 GB 5:15/3.71 GB 10:12/2.97 GB 6:13/3.22 GB BytesRead(500.000ms): 0, 869.26 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB, 955.01 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.01 MB (1001401417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s224ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.44 MB (1062667864) - PerReadThreadRawHdfsThroughput: 533.18 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.94M (73942628) - RowsReturned: 35.63M (35632439) - RowsReturnedRate: 59.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s791ms - TotalReadThroughput: 50.26 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae7 (host=d2417.halxg.cloudera.com:22000):(Total: 18s634ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:10/2.47 GB 0:11/2.72 GB 4:13/3.22 GB 2:9/2.23 GB 5:13/3.22 GB 9:10/2.47 GB 10:17/4.21 GB 6:10/2.47 GB 8:13/3.22 GB 7:12/2.97 GB 3:14/3.46 GB MemoryUsage(500.000ms): 88.00 KB, 939.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1011.44 MB, 1013.15 MB, 1013.53 MB, 1013.16 MB, 1013.13 MB, 1013.35 MB, 1013.07 MB, 1013.35 MB, 1013.13 MB, 1005.30 MB, 910.50 MB, 839.24 MB, 831.54 MB, 831.38 MB, 831.62 MB, 831.44 MB, 831.16 MB, 831.33 MB, 815.38 MB, 727.17 MB, 655.52 MB, 655.53 MB, 647.48 MB, 647.25 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 23.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.85 MB (1063093928) - PerHostPeakMemUsage: 2.14 GB (2302953568) - PrepareTime: 191.856ms - RowsProduced: 37.89M (37886188) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s944ms - TotalStorageWaitTime: 2s508ms CodeGen:(Total: 700.982ms, non-child: 700.982ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 8.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 501.811ms - PrepareTime: 189.105ms DataStreamSender (dst_id=4):(Total: 18s174ms, non-child: 18s174ms, % non-child: 100.00%) - BytesSent: 858.96 MB (900680818) - NetworkThroughput(*): 5.83 MB/sec - OverallThroughput: 47.26 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s770ms - ThriftTransmitTime(*): 2m27s - UncompressedRowBatchSize: 1.62 GB (1742790660) HDFS_SCAN_NODE (id=1):(Total: 619.182ms, non-child: 619.182ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 1:10/2.47 GB 0:11/2.72 GB 4:13/3.22 GB 2:9/2.23 GB 5:13/3.22 GB 9:10/2.47 GB 10:17/4.21 GB 6:10/2.47 GB 8:13/3.22 GB 7:12/2.97 GB 3:14/3.46 GB BytesRead(500.000ms): 0, 873.16 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB, 955.02 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.02 MB (1001415125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s221ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.25 MB (1062471376) - PerReadThreadRawHdfsThroughput: 665.18 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 78.57M (78569197) - RowsReturned: 37.89M (37886188) - RowsReturnedRate: 61.19 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s435ms - TotalReadThroughput: 50.26 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705aeb (host=d2413.halxg.cloudera.com:22000):(Total: 18s648ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:15/3.71 GB 4:10/2.29 GB 3:11/2.72 GB 7:7/1.73 GB 0:11/2.72 GB 1:11/2.72 GB 8:15/3.71 GB 5:10/2.47 GB 2:14/3.46 GB 10:15/3.71 GB 9:13/3.22 GB MemoryUsage(500.000ms): 0, 88.00 KB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.18 MB, 1012.16 MB, 1012.99 MB, 1013.33 MB, 1013.00 MB, 1012.85 MB, 1012.92 MB, 1013.06 MB, 1013.61 MB, 1013.24 MB, 989.53 MB, 863.06 MB, 831.35 MB, 831.12 MB, 831.29 MB, 831.18 MB, 831.51 MB, 831.79 MB, 831.09 MB, 831.51 MB, 807.34 MB, 719.73 MB, 647.51 MB, 647.15 MB, 647.34 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24 - AverageThreadTokens: 22.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 1013.88 MB (1063134936) - PerHostPeakMemUsage: 2.15 GB (2303731352) - PrepareTime: 193.586ms - RowsProduced: 35.81M (35805427) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s911ms - TotalStorageWaitTime: 3s460ms CodeGen:(Total: 689.004ms, non-child: 689.004ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 490.143ms - PrepareTime: 190.771ms DataStreamSender (dst_id=4):(Total: 18s132ms, non-child: 18s132ms, % non-child: 100.00%) - BytesSent: 804.96 MB (844059060) - NetworkThroughput(*): 5.49 MB/sec - OverallThroughput: 44.39 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s587ms - ThriftTransmitTime(*): 2m26s - UncompressedRowBatchSize: 1.53 GB (1647059076) HDFS_SCAN_NODE (id=1):(Total: 673.984ms, non-child: 673.984ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 6:15/3.71 GB 4:10/2.29 GB 3:11/2.72 GB 7:7/1.73 GB 0:11/2.72 GB 1:11/2.72 GB 8:15/3.71 GB 5:10/2.47 GB 2:14/3.46 GB 10:15/3.71 GB 9:13/3.22 GB BytesRead(500.000ms): 0, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB, 955.03 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 23.00 - BytesRead: 955.03 MB (1001419728) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s249ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 23 (23) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 1013.31 MB (1062536968) - PerReadThreadRawHdfsThroughput: 527.23 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.31M (74311471) - RowsReturned: 35.81M (35805427) - RowsReturnedRate: 53.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s811ms - TotalReadThroughput: 50.26 MB/sec Filter 0: - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance 24495d00ab75cd74:1dfb5758d7705ae6 (host=d2402.halxg.cloudera.com:22000):(Total: 18s662ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:14/3.46 GB 8:14/3.29 GB 1:14/3.46 GB 4:14/3.46 GB 10:13/3.11 GB 3:9/2.23 GB 0:12/2.97 GB 7:11/2.72 GB 2:10/2.27 GB 6:10/2.47 GB 5:12/2.97 GB MemoryUsage(500.000ms): 88.00 KB, 66.75 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.49 MB, 719.45 MB, 720.97 MB, 720.77 MB, 720.92 MB, 720.94 MB, 754.05 MB, 745.41 MB, 634.17 MB, 626.57 MB, 626.47 MB, 626.43 MB, 626.69 MB, 626.27 MB, 618.83 MB, 554.19 MB, 490.68 MB, 490.85 MB, 490.34 MB, 490.98 MB, 490.83 MB, 482.56 MB, 450.75 MB, 362.69 MB ThreadUsage(500.000ms): 1, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18 - AverageThreadTokens: 17.55 - BloomFilterBytes: 0 - PeakMemoryUsage: 754.45 MB (791099512) - PerHostPeakMemUsage: 1.87 GB (2009996408) - PrepareTime: 204.395ms - RowsProduced: 36.05M (36048147) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s933ms - TotalStorageWaitTime: 2s409ms CodeGen:(Total: 691.380ms, non-child: 691.380ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2080424) - OptimizationTime: 481.741ms - PrepareTime: 199.416ms DataStreamSender (dst_id=4):(Total: 18s113ms, non-child: 18s113ms, % non-child: 100.00%) - BytesSent: 791.94 MB (830409823) - NetworkThroughput(*): 6.91 MB/sec - OverallThroughput: 43.72 MB/sec - PeakMemoryUsage: 640.00 KB (655360) - SerializeBatchTime: 6s488ms - ThriftTransmitTime(*): 1m54s - UncompressedRowBatchSize: 1.54 GB (1658224620) HDFS_SCAN_NODE (id=1):(Total: 716.383ms, non-child: 716.383ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled Hdfs split stats (:<# splits>/): 9:14/3.46 GB 8:14/3.29 GB 1:14/3.46 GB 4:14/3.46 GB 10:13/3.11 GB 3:9/2.23 GB 0:12/2.97 GB 7:11/2.72 GB 2:10/2.27 GB 6:10/2.47 GB 5:12/2.97 GB BytesRead(500.000ms): 0, 1.56 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 671.75 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB, 713.28 MB - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 17.00 - BytesRead: 713.28 MB (747923589) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 1s328ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 753.91 MB (790534264) - PerReadThreadRawHdfsThroughput: 594.62 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 74.78M (74782130) - RowsReturned: 36.05M (36049171) - RowsReturnedRate: 50.32 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 9s323ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s199ms - TotalReadThroughput: 37.54 MB/sec Filter 0: - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384)