================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+---------+-----------+ | 06:AGGREGATE | 1 | 212.63us | 0ns | 212.63us | 1 | 1 | | 05:EXCHANGE | 1 | 14.97us | 0ns | 14.97us | 1 | 1 | | 03:AGGREGATE | 1 | 2.07ms | 0ns | 2.07ms | 1 | 1 | | 02:HASH JOIN | 1 | 95.18s | 0ns | 95.18s | 0 | 3 | | |--04:EXCHANGE | 1 | 112.85s | 0ns | 112.85s | 350.01M | 180.00M | | | 01:SCAN HDFS | 14 | 291.26ms | 0ns | 336.07ms | 350.01M | 180.00M | | 00:SCAN HDFS | 1 | 9.94ms | 0ns | 9.94ms | 0 | 3 | +-----------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=b743dc00e069930c:9836407000000000): Summary: Session ID: 51409a856c4dc7f1:bbede1cd58ae2182 Session Type: BEESWAX Start Time: 2017-02-19 07:45:40.807096000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 9873c749fd7f33af9861000d458b87f91ef35b78) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:41722 Default Db: tpch_300_parquet Sql Statement: -- Description : Large broadcast join with no rows qualifying from the probe side. -- Target test case : Broadcast large amounts of data over the network while stressing the -- exchange operator along with HashTable build. SELECT /* +straight_join */ count(*) FROM nation JOIN /* +broadcast */ lineitem ON l_orderkey = n_nationkey WHERE l_partkey > 0 AND l_suppkey > 0 AND l_linenumber > 0 AND n_regionkey < 0 AND l_orderkey < 350000000 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=6.24GB VCores=2 PLAN-ROOT SINK | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=1 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: n_nationkey = l_orderkey | runtime filters: RF000 <- l_orderkey | hosts=1 per-host-mem=5.90GB | tuple-ids=0,1 row-size=48B cardinality=3 | |--04:EXCHANGE [BROADCAST] | | hosts=14 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_linenumber > 0, l_orderkey < 350000000, l_partkey > 0, l_suppkey > 0 | table stats: 1799989091 rows total | column stats: all | hosts=14 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 00:SCAN HDFS [tpch_300_parquet.nation, RANDOM] partitions=1/1 files=1 size=2.19KB predicates: n_regionkey < 0, tpch_300_parquet.nation.n_nationkey < 350000000 runtime filters: RF000 -> n_nationkey table stats: 25 rows total column stats: all hosts=1 per-host-mem=32.00MB tuple-ids=0 row-size=16B cardinality=3 ---------------- Estimated Per-Host Mem: 6705060455 Estimated Per-Host VCores: 2 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 5.996ms - Analysis finished: 1.901ms (1.901ms) - Equivalence classes computed: 2.021ms (119.974us) - Single node plan created: 3.364ms (1.343ms) - Runtime filters computed: 3.488ms (124.065us) - Distributed plan created: 3.729ms (240.412us) - Lineage info computed: 3.858ms (129.648us) - Planning finished: 5.996ms (2.137ms) Query Timeline: 3m32s - Query submitted: 43.622us (43.622us) - Planning finished: 8.548ms (8.504ms) - Submit for admission: 9.921ms (1.372ms) - Completed admission: 10.025ms (104.138us) - Ready to start 16 fragment instances: 10.376ms (351.429us) - All 16 fragment instances started: 13.353ms (2.976ms) - Rows available: 3m32s (3m32s) - First row fetched: 3m32s (12.824ms) - ComputeScanRangeAssignmentTimer: 605.469us ImpalaServer: - ClientFetchWaitTimer: 12.835ms - RowMaterializationTimer: 4.216ms Execution Profile b743dc00e069930c:9836407000000000:(Total: 3m32s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 2 0 1 LOCAL false 0 (1) N/A N/A true Fragment instance start latencies: Count: 16, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: vb0206.halxg.cloudera.com:22000(1.11 GB) vb0220.halxg.cloudera.com:22000(1.10 GB) vb0228.halxg.cloudera.com:22000(1.09 GB) vb0222.halxg.cloudera.com:22000(1.11 GB) vb0224.halxg.cloudera.com:22000(1.11 GB) vb0232.halxg.cloudera.com:22000(1.11 GB) vb0234.halxg.cloudera.com:22000(1.11 GB) vb0218.halxg.cloudera.com:22000(1.10 GB) vb0214.halxg.cloudera.com:22000(26.43 GB) vb0212.halxg.cloudera.com:22000(1.11 GB) vb0216.halxg.cloudera.com:22000(1.11 GB) vb0208.halxg.cloudera.com:22000(1.10 GB) vb0230.halxg.cloudera.com:22000(1.11 GB) vb0204.halxg.cloudera.com:22000(1.11 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F02: Instance b743dc00e069930c:9836407000000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 3m32s, non-child: 13.456ms, % non-child: 0.01%) MemoryUsage(4s000ms): 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PerHostPeakMemUsage: 1.11 GB (1188340671) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 3m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3m32s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.000ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 12.975ms - ExecTreeExecTime: 6.472us - OpenTime: 3m32s - ExecTreeOpenTime: 3m32s - PrepareTime: 21.218ms - ExecTreePrepareTime: 71.011us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 20.970ms, non-child: 20.970ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.400ms AGGREGATION_NODE (id=6):(Total: 3m32s, non-child: 212.631us, % non-child: 0.00%) - BuildTime: 6.783us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 3m32s, non-child: 14.968us, % non-child: 0.00%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.423us - DeserializeRowBatchTimer: 8.320us - FirstBatchArrivalWaitTime: 3m32s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3m32s, non-child: 7.050ms, % non-child: 0.00%) split sizes: min: 2.19 KB, max: 2.19 KB, avg: 2.19 KB, stddev: 0 completion times: min:3m32s max:3m32s mean: 3m32s stddev:0.000ns execution rates: min:10.00 B/sec max:10.00 B/sec mean:10.00 B/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 26.43 GB (28380916821) - PerHostPeakMemUsage: 26.43 GB (28380916821) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1m43s - TotalNetworkSendTime: 467.194us - TotalStorageWaitTime: 8.686ms - TotalThreadsInvoluntaryContextSwitches: 24.71K (24709) - TotalThreadsTotalWallClockTime: 7m4s - TotalThreadsSysTime: 13s453ms - TotalThreadsUserTime: 1m41s - TotalThreadsVoluntaryContextSwitches: 341.30K (341301) Fragment Instance Lifecycle Timings: - ExecTime: 847.916us - ExecTreeExecTime: 4.070us - OpenTime: 3m32s - ExecTreeOpenTime: 3m31s - PrepareTime: 31.862ms - ExecTreePrepareTime: 333.266us DataStreamSender (dst_id=5):(Total: 69.562us, non-child: 69.562us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 493.74 KB/sec - OverallThroughput: 224.62 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.782us - TransmitDataRPCTime: 31.646us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 358.743ms, non-child: 358.743ms, % non-child: 100.00%) - CodegenTime: 1.811ms - CompileTime: 85.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 90 (90) - NumInstructions: 2.93K (2928) - OptimizationTime: 246.902ms - PeakMemoryUsage: 1.43 MB (1499136) - PrepareTime: 25.728ms AGGREGATION_NODE (id=3):(Total: 3m31s, non-child: 2.067ms, % non-child: 0.00%) - BuildTime: 1.993ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 3m31s, non-child: 1m35s, % non-child: 44.91%) - BuildRows: 350.01M (350008706) - BuildTime: 1m33s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 26.42 GB (28364049664) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.557us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 1m15s - BuildRowsPartitioned: 350.01M (350008706) - GetNewBlockTime: 18.181ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 17s838ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.42 GB (28364002432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=4):(Total: 1m56s, non-child: 1m56s, % non-child: 100.00%) - BytesReceived: 6.99 GB (7501460242) - ConvertRowBatchTime: 12s655ms - DeserializeRowBatchTimer: 2m51s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 350.01M (350008706) - RowsReturnedRate: 3.00 M/sec - SendersBlockedTimer: 2m54s - SendersBlockedTotalTimer(*): 34m28s HDFS_SCAN_NODE (id=0):(Total: 9.938ms, non-child: 9.938ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 KB (2497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 KB (2497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 KB (2497) - DecompressionTime: 8.391us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 73.00 KB (74752) - PerReadThreadRawHdfsThroughput: 62.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.127ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 25 (25) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 9.218ms - MaterializeTupleTime(*): 30.958us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 38.396us - TotalReadThroughput: 0.00 /sec Filter 0 (16.00 MB): - Rows processed: 25 (25) - Rows rejected: 0 (0) - Rows total: 25 (25) Fragment F00: Instance b743dc00e069930c:983640700000000f (host=vb0214.halxg.cloudera.com:22000):(Total: 3m32s, non-child: 7.050ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/2.19 KB Filter 0 arrival: 3m14s MemoryUsage(4s000ms): 183.10 MB, 412.24 MB, 636.24 MB, 876.24 MB, 1.07 GB, 1.30 GB, 1.54 GB, 1.76 GB, 1.98 GB, 2.22 GB, 2.45 GB, 2.67 GB, 2.89 GB, 3.11 GB, 3.34 GB, 3.56 GB, 3.79 GB, 4.01 GB, 4.23 GB, 4.47 GB, 4.69 GB, 4.92 GB, 5.15 GB, 5.37 GB, 5.61 GB, 5.82 GB, 6.04 GB, 6.26 GB, 6.48 GB, 6.72 GB, 6.93 GB, 7.15 GB, 7.37 GB, 7.61 GB, 7.82 GB, 8.03 GB, 8.26 GB, 8.48 GB, 8.72 GB, 8.93 GB, 9.15 GB, 9.36 GB, 9.59 GB, 9.81 GB, 10.03 GB, 10.25 GB, 10.48 GB, 10.66 GB, 11.13 GB, 13.90 GB, 17.37 GB, 20.95 GB, 24.62 GB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 26.43 GB (28380916821) - PerHostPeakMemUsage: 26.43 GB (28380916821) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1m43s - TotalNetworkSendTime: 467.194us - TotalStorageWaitTime: 8.686ms - TotalThreadsInvoluntaryContextSwitches: 24.71K (24709) - TotalThreadsTotalWallClockTime: 7m4s - TotalThreadsSysTime: 13s453ms - TotalThreadsUserTime: 1m41s - TotalThreadsVoluntaryContextSwitches: 341.30K (341301) Fragment Instance Lifecycle Timings: - ExecTime: 847.916us - ExecTreeExecTime: 4.070us - OpenTime: 3m32s - ExecTreeOpenTime: 3m31s - PrepareTime: 31.862ms - ExecTreePrepareTime: 333.266us DataStreamSender (dst_id=5):(Total: 69.562us, non-child: 69.562us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 493.74 KB/sec - OverallThroughput: 224.62 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.782us - TransmitDataRPCTime: 31.646us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 358.743ms, non-child: 358.743ms, % non-child: 100.00%) - CodegenTime: 1.811ms - CompileTime: 85.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 90 (90) - NumInstructions: 2.93K (2928) - OptimizationTime: 246.902ms - PeakMemoryUsage: 1.43 MB (1499136) - PrepareTime: 25.728ms AGGREGATION_NODE (id=3):(Total: 3m31s, non-child: 2.067ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1.993ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 3m31s, non-child: 1m35s, % non-child: 44.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 350.01M (350008706) - BuildTime: 1m33s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 26.42 GB (28364049664) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.557us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 1m15s - BuildRowsPartitioned: 350.01M (350008706) - GetNewBlockTime: 18.181ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 17s838ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.42 GB (28364002432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=4):(Total: 1m56s, non-child: 1m52s, % non-child: 96.69%) BytesReceived(4s000ms): 66.96 MB, 215.06 MB, 362.06 MB, 511.80 MB, 661.55 MB, 810.23 MB, 962.32 MB, 1.09 GB, 1.24 GB, 1.39 GB, 1.53 GB, 1.68 GB, 1.82 GB, 1.97 GB, 2.11 GB, 2.26 GB, 2.41 GB, 2.56 GB, 2.70 GB, 2.85 GB, 2.99 GB, 3.14 GB, 3.30 GB, 3.44 GB, 3.58 GB, 3.73 GB, 3.87 GB, 4.02 GB, 4.16 GB, 4.30 GB, 4.45 GB, 4.59 GB, 4.74 GB, 4.88 GB, 5.02 GB, 5.16 GB, 5.31 GB, 5.46 GB, 5.60 GB, 5.75 GB, 5.89 GB, 6.03 GB, 6.17 GB, 6.32 GB, 6.46 GB, 6.61 GB, 6.75 GB, 6.87 GB, 6.97 GB, 6.99 GB, 6.99 GB, 6.99 GB, 6.99 GB - BytesReceived: 6.99 GB (7501460242) - ConvertRowBatchTime: 12s655ms - DeserializeRowBatchTimer: 2m51s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 350.01M (350008706) - RowsReturnedRate: 3.00 M/sec - SendersBlockedTimer: 2m54s - SendersBlockedTotalTimer(*): 34m28s HDFS_SCAN_NODE (id=0):(Total: 9.938ms, non-child: 9.938ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/2.19 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FooterProcessingTime: (Avg: 5.915ms ; Min: 5.915ms ; Max: 5.915ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 KB (2497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 KB (2497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 KB (2497) - DecompressionTime: 8.391us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 73.00 KB (74752) - PerReadThreadRawHdfsThroughput: 62.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.127ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 25 (25) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 9.218ms - MaterializeTupleTime(*): 30.958us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 38.396us - TotalReadThroughput: 0.00 /sec Filter 0 (16.00 MB): - Rows processed: 25 (25) - Rows rejected: 0 (0) - Rows total: 25 (25) Averaged Fragment F01:(Total: 3m3s, non-child: 2m27s, % non-child: 80.25%) split sizes: min: 4.45 GB, max: 4.70 GB, avg: 4.60 GB, stddev: 110.56 MB completion times: min:3m max:3m14s mean: 3m3s stddev:3s641ms execution rates: min:24.49 MB/sec max:26.58 MB/sec mean:25.60 MB/sec stddev:638.62 KB/sec num instances: 14 - AverageThreadTokens: 11.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1186349442) - PerHostPeakMemUsage: 1.84 GB (1974382900) - RowsProduced: 25.00M (25000621) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 554.652ms - TotalThreadsInvoluntaryContextSwitches: 24.14K (24144) - TotalThreadsTotalWallClockTime: 35m20s - TotalThreadsSysTime: 1s971ms - TotalThreadsUserTime: 54s992ms - TotalThreadsVoluntaryContextSwitches: 41.07K (41069) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 347.192ms - OpenTime: 33.525ms - ExecTreeOpenTime: 50.600us - PrepareTime: 25.007ms - ExecTreePrepareTime: 285.734us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 100 (100) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 824.57 MB (864625810) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s979ms, non-child: 35s979ms, % non-child: 100.00%) - BytesSent: 511.00 MB (535818588) - NetworkThroughput(*): 282.81 MB/sec - OverallThroughput: 14.23 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.00M (25000621) - SerializeBatchTime: 34s159ms - TransmitDataRPCTime: 1s810ms - UncompressedRowBatchSize: 882.26 MB (925120683) CodeGen:(Total: 56.092ms, non-child: 56.092ms, % non-child: 100.00%) - CodegenTime: 1.420ms - CompileTime: 10.028ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.698ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.795ms HDFS_SCAN_NODE (id=1):(Total: 291.261ms, non-child: 291.261ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.53 - BytesRead: 1.52 GB (1627133960) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.52 GB (1627133960) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.52 GB (1627133960) - DecompressionTime: 9s171ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1186084158) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.070ms - RowBatchQueuePutWaitTime: 31m55s - RowsRead: 128.57M (128570649) - RowsReturned: 25.00M (25000621) - RowsReturnedRate: 86.01 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.81K (10815) - ScannerThreadsTotalWallClockTime: 32m16s - MaterializeTupleTime(*): 11s013ms - ScannerThreadsSysTime: 1s223ms - ScannerThreadsUserTime: 20s326ms - ScannerThreadsVoluntaryContextSwitches: 24.57K (24575) - TotalRawHdfsReadTime(*): 1s072ms - TotalReadThroughput: 8.44 MB/sec Fragment F01: Instance b743dc00e069930c:9836407000000004 (host=vb0214.halxg.cloudera.com:22000):(Total: 3m14s, non-child: 2m42s, % non-child: 83.62%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 4:2/506.80 MB 0:1/253.39 MB 8:2/506.80 MB 9:2/506.77 MB 3:1/253.37 MB 5:3/760.16 MB 2:4/959.93 MB 1:3/760.19 MB MemoryUsage(4s000ms): 1.00 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.08 GB, 1.05 GB, 1.05 GB, 1.02 GB, 1019.11 MB, 991.66 MB, 977.38 MB, 942.78 MB, 933.68 MB, 914.22 MB, 912.60 MB, 893.54 MB, 878.37 MB, 865.39 MB, 838.77 MB, 819.25 MB, 785.99 MB, 765.07 MB, 755.07 MB, 734.26 MB, 708.50 MB, 679.80 MB, 674.82 MB, 656.20 MB, 691.95 MB, 681.97 MB, 662.07 MB, 644.38 MB, 671.61 MB, 685.56 MB, 665.64 MB, 641.48 MB, 635.39 MB, 621.78 MB, 597.91 MB, 567.55 MB, 627.60 MB, 563.19 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9 - AverageThreadTokens: 12.84 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188457595) - PerHostPeakMemUsage: 11.38 GB (12220909618) - RowsProduced: 25.73M (25731516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m43s - TotalStorageWaitTime: 568.243ms - TotalThreadsInvoluntaryContextSwitches: 17.55K (17549) - TotalThreadsTotalWallClockTime: 41m34s - TotalThreadsSysTime: 1s573ms - TotalThreadsUserTime: 49s192ms - TotalThreadsVoluntaryContextSwitches: 38.80K (38804) Fragment Instance Lifecycle Timings: - ExecTime: 3m14s - ExecTreeExecTime: 359.671ms - OpenTime: 33.115ms - ExecTreeOpenTime: 53.616us - PrepareTime: 26.710ms - ExecTreePrepareTime: 285.320us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 1.41K (1411) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 11.27 GB (12104761344) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 31s477ms, non-child: 31s477ms, % non-child: 100.00%) - BytesSent: 525.93 MB (551479392) - NetworkThroughput(*): 316.05 MB/sec - OverallThroughput: 16.71 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.73M (25731516) - SerializeBatchTime: 29s803ms - TransmitDataRPCTime: 1s664ms - UncompressedRowBatchSize: 908.06 MB (952166628) CodeGen:(Total: 57.155ms, non-child: 57.155ms, % non-child: 100.00%) - CodegenTime: 1.471ms - CompileTime: 9.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.494ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.361ms HDFS_SCAN_NODE (id=1):(Total: 312.878ms, non-child: 312.878ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 4:2/506.80 MB 0:1/253.39 MB 8:2/506.80 MB 9:2/506.77 MB 3:1/253.37 MB 5:3/760.16 MB 2:4/959.93 MB 1:3/760.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.23% 1:0.5141% 2:0% 3:0% 4:0% 5:0% 6:0.2571% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 911.72 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1.04 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.11 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.31 GB, 1.53 GB - FooterProcessingTime: (Avg: 3.281ms ; Min: 1.901ms ; Max: 6.371ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.84 - BytesRead: 1.53 GB (1645560524) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.53 GB (1645560524) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.53 GB (1645560524) - DecompressionTime: 8s434ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188277880) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.044ms - RowBatchQueuePutWaitTime: 38m - RowsRead: 130.03M (130033379) - RowsReturned: 25.73M (25731516) - RowsReturnedRate: 82.24 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.62K (6617) - ScannerThreadsTotalWallClockTime: 38m20s - MaterializeTupleTime(*): 10s168ms - ScannerThreadsSysTime: 977.846ms - ScannerThreadsUserTime: 18s977ms - ScannerThreadsVoluntaryContextSwitches: 25.27K (25271) - TotalRawHdfsReadTime(*): 1s146ms - TotalReadThroughput: 8.07 MB/sec Instance b743dc00e069930c:9836407000000006 (host=vb0218.halxg.cloudera.com:22000):(Total: 3m6s, non-child: 2m27s, % non-child: 78.75%) Hdfs split stats (:<# splits>/): 8:1/253.38 MB 1:1/253.39 MB 9:1/253.38 MB 10:1/253.40 MB 5:2/506.79 MB 2:5/1.24 GB 7:2/506.80 MB 6:2/506.81 MB 3:3/760.16 MB 0:1/253.39 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.07 GB, 1.03 GB, 982.42 MB, 933.77 MB, 921.82 MB, 910.47 MB, 902.77 MB, 895.31 MB, 860.51 MB, 818.06 MB, 771.03 MB, 726.54 MB, 696.16 MB, 687.85 MB, 663.78 MB, 641.80 MB, 681.76 MB, 643.95 MB, 674.42 MB, 646.40 MB, 605.62 MB, 568.54 MB, 539.09 MB, 498.45 MB, 474.40 MB, 439.61 MB, 584.95 MB, 620.41 MB, 679.60 MB, 693.49 MB, 644.02 MB, 606.01 MB, 563.14 MB, 521.06 MB, 503.63 MB, 463.82 MB, 432.25 MB, 404.06 MB, 370.01 MB, 324.88 MB, 258.51 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 9, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6 - AverageThreadTokens: 11.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1184890721) - PerHostPeakMemUsage: 1.10 GB (1184890721) - RowsProduced: 27.36M (27356338) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 557.633ms - TotalThreadsInvoluntaryContextSwitches: 26.58K (26577) - TotalThreadsTotalWallClockTime: 36m7s - TotalThreadsSysTime: 2s029ms - TotalThreadsUserTime: 59s119ms - TotalThreadsVoluntaryContextSwitches: 44.47K (44471) Fragment Instance Lifecycle Timings: - ExecTime: 3m6s - ExecTreeExecTime: 364.788ms - OpenTime: 33.798ms - ExecTreeOpenTime: 50.249us - PrepareTime: 24.601ms - ExecTreePrepareTime: 326.029us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 39s309ms, non-child: 39s309ms, % non-child: 100.00%) - BytesSent: 559.15 MB (586311676) - NetworkThroughput(*): 299.77 MB/sec - OverallThroughput: 14.22 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 27.36M (27356338) - SerializeBatchTime: 37s434ms - TransmitDataRPCTime: 1s865ms - UncompressedRowBatchSize: 965.40 MB (1012291378) CodeGen:(Total: 55.789ms, non-child: 55.789ms, % non-child: 100.00%) - CodegenTime: 1.481ms - CompileTime: 10.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.816ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.225ms HDFS_SCAN_NODE (id=1):(Total: 302.965ms, non-child: 302.965ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.38 MB 1:1/253.39 MB 9:1/253.38 MB 10:1/253.40 MB 5:2/506.79 MB 2:5/1.24 GB 7:2/506.80 MB 6:2/506.81 MB 3:3/760.16 MB 0:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.46% 1:0.5362% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1000.54 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1007.89 MB, 1.06 GB, 1.06 GB, 1.13 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.32 GB, 1.39 GB, 1.49 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 3.249ms ; Min: 2.388ms ; Max: 5.549ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.62 - BytesRead: 1.55 GB (1664143743) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664143743) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664143743) - DecompressionTime: 9s488ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1184711006) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.698ms - RowBatchQueuePutWaitTime: 32m38s - RowsRead: 131.50M (131502589) - RowsReturned: 27.36M (27356338) - RowsReturnedRate: 90.30 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.19K (12191) - ScannerThreadsTotalWallClockTime: 33m1s - MaterializeTupleTime(*): 11s287ms - ScannerThreadsSysTime: 1s221ms - ScannerThreadsUserTime: 21s107ms - ScannerThreadsVoluntaryContextSwitches: 26.86K (26859) - TotalRawHdfsReadTime(*): 1s205ms - TotalReadThroughput: 8.51 MB/sec Instance b743dc00e069930c:9836407000000002 (host=vb0216.halxg.cloudera.com:22000):(Total: 3m5s, non-child: 2m27s, % non-child: 79.15%) Hdfs split stats (:<# splits>/): 1:1/253.38 MB 3:2/506.78 MB 10:1/253.39 MB 7:2/506.78 MB 9:5/1.24 GB 6:1/253.41 MB 5:2/506.78 MB 2:1/253.41 MB 0:4/1013.59 MB MemoryUsage(4s000ms): 983.52 MB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1022.24 MB, 965.65 MB, 930.98 MB, 915.14 MB, 893.69 MB, 864.78 MB, 836.29 MB, 801.33 MB, 757.67 MB, 723.96 MB, 682.00 MB, 651.75 MB, 656.30 MB, 660.80 MB, 619.23 MB, 592.65 MB, 555.75 MB, 554.47 MB, 609.52 MB, 625.96 MB, 694.27 MB, 745.14 MB, 728.19 MB, 713.75 MB, 686.31 MB, 731.01 MB, 680.09 MB, 601.68 MB, 558.29 MB, 536.55 MB, 524.03 MB, 481.41 MB, 432.31 MB, 409.36 MB, 396.24 MB, 340.57 MB, 301.00 MB, 265.22 MB, 228.44 MB, 193.10 MB ThreadUsage(4s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 9, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6 - AverageThreadTokens: 11.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1190697269) - PerHostPeakMemUsage: 1.11 GB (1190697269) - RowsProduced: 26.59M (26594701) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 581.362ms - TotalThreadsInvoluntaryContextSwitches: 26.35K (26352) - TotalThreadsTotalWallClockTime: 34m56s - TotalThreadsSysTime: 2s001ms - TotalThreadsUserTime: 58s222ms - TotalThreadsVoluntaryContextSwitches: 43.58K (43579) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 344.662ms - OpenTime: 33.786ms - ExecTreeOpenTime: 50.438us - PrepareTime: 24.812ms - ExecTreePrepareTime: 299.020us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 38s428ms, non-child: 38s428ms, % non-child: 100.00%) - BytesSent: 543.60 MB (570003508) - NetworkThroughput(*): 288.88 MB/sec - OverallThroughput: 14.15 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 26.59M (26594701) - SerializeBatchTime: 36s538ms - TransmitDataRPCTime: 1s881ms - UncompressedRowBatchSize: 938.52 MB (984107841) CodeGen:(Total: 56.082ms, non-child: 56.082ms, % non-child: 100.00%) - CodegenTime: 1.456ms - CompileTime: 10.199ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.863ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.460ms HDFS_SCAN_NODE (id=1):(Total: 287.358ms, non-child: 287.358ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.38 MB 3:2/506.78 MB 10:1/253.39 MB 7:2/506.78 MB 9:5/1.24 GB 6:1/253.41 MB 5:2/506.78 MB 2:1/253.41 MB 0:4/1013.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 877.02 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1002.31 MB, 1.01 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.10 GB, 1.20 GB, 1.27 GB, 1.39 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 3.689ms ; Min: 2.759ms ; Max: 5.466ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 1.55 GB (1664130351) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664130351) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664130351) - DecompressionTime: 9s514ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1190350634) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.971ms - RowBatchQueuePutWaitTime: 31m27s - RowsRead: 131.50M (131502389) - RowsReturned: 26.59M (26594701) - RowsReturnedRate: 92.55 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.18K (12181) - ScannerThreadsTotalWallClockTime: 31m50s - MaterializeTupleTime(*): 11s295ms - ScannerThreadsSysTime: 1s262ms - ScannerThreadsUserTime: 21s013ms - ScannerThreadsVoluntaryContextSwitches: 26.14K (26138) - TotalRawHdfsReadTime(*): 1s106ms - TotalReadThroughput: 8.53 MB/sec Instance b743dc00e069930c:9836407000000003 (host=vb0212.halxg.cloudera.com:22000):(Total: 3m5s, non-child: 2m30s, % non-child: 81.14%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 1:3/760.18 MB 5:1/253.39 MB 4:2/506.79 MB 7:3/760.20 MB 0:1/253.40 MB 6:2/506.82 MB 3:2/506.82 MB 2:3/760.21 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1.04 GB, 1015.42 MB, 963.05 MB, 922.38 MB, 893.77 MB, 884.26 MB, 879.80 MB, 855.56 MB, 839.64 MB, 787.11 MB, 738.88 MB, 691.10 MB, 660.00 MB, 633.39 MB, 626.12 MB, 735.43 MB, 728.37 MB, 745.15 MB, 733.59 MB, 703.49 MB, 752.81 MB, 710.84 MB, 664.79 MB, 632.75 MB, 604.08 MB, 559.03 MB, 578.80 MB, 615.19 MB, 631.21 MB, 633.89 MB, 570.79 MB, 492.21 MB, 456.97 MB, 415.62 MB, 387.12 MB, 348.23 MB, 305.01 MB, 274.73 MB, 246.84 MB, 169.61 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 8, 7, 7, 7, 7, 7, 7, 6, 4 - AverageThreadTokens: 11.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1190322977) - PerHostPeakMemUsage: 1.11 GB (1190322977) - RowsProduced: 23.47M (23465800) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m31s - TotalStorageWaitTime: 527.019ms - TotalThreadsInvoluntaryContextSwitches: 24.43K (24433) - TotalThreadsTotalWallClockTime: 36m10s - TotalThreadsSysTime: 1s959ms - TotalThreadsUserTime: 53s665ms - TotalThreadsVoluntaryContextSwitches: 38.81K (38815) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 333.427ms - OpenTime: 33.732ms - ExecTreeOpenTime: 48.188us - PrepareTime: 23.371ms - ExecTreePrepareTime: 312.786us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s654ms, non-child: 34s654ms, % non-child: 100.00%) - BytesSent: 479.63 MB (502926019) - NetworkThroughput(*): 260.27 MB/sec - OverallThroughput: 13.84 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 23.47M (23465800) - SerializeBatchTime: 32s802ms - TransmitDataRPCTime: 1s842ms - UncompressedRowBatchSize: 828.10 MB (868326276) CodeGen:(Total: 54.655ms, non-child: 54.655ms, % non-child: 100.00%) - CodegenTime: 1.380ms - CompileTime: 10.174ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.801ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.034ms HDFS_SCAN_NODE (id=1):(Total: 282.132ms, non-child: 282.132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 1:3/760.18 MB 5:1/253.39 MB 4:2/506.79 MB 7:3/760.20 MB 0:1/253.40 MB 6:2/506.82 MB 3:2/506.82 MB 2:3/760.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(4s000ms): 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1023.25 MB, 1.14 GB, 1.16 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.34 GB, 1.39 GB, 1.43 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 3.650ms ; Min: 2.608ms ; Max: 5.503ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.70 - BytesRead: 1.47 GB (1576589528) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576589528) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576589528) - DecompressionTime: 9s206ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1190177234) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.611ms - RowBatchQueuePutWaitTime: 32m43s - RowsRead: 124.58M (124581157) - RowsReturned: 23.47M (23465800) - RowsReturnedRate: 83.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.22K (11223) - ScannerThreadsTotalWallClockTime: 33m4s - MaterializeTupleTime(*): 11s073ms - ScannerThreadsSysTime: 1s232ms - ScannerThreadsUserTime: 20s367ms - ScannerThreadsVoluntaryContextSwitches: 23.09K (23090) - TotalRawHdfsReadTime(*): 1s013ms - TotalReadThroughput: 8.11 MB/sec Instance b743dc00e069930c:9836407000000005 (host=vb0204.halxg.cloudera.com:22000):(Total: 3m5s, non-child: 2m24s, % non-child: 77.86%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 2:1/253.41 MB 7:2/506.80 MB 6:1/253.41 MB 1:2/506.79 MB 8:2/506.78 MB 3:5/1.24 GB 4:4/1013.63 MB 0:1/253.40 MB MemoryUsage(4s000ms): 995.03 MB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.06 GB, 1020.98 MB, 966.66 MB, 929.30 MB, 910.43 MB, 907.71 MB, 870.62 MB, 834.55 MB, 785.31 MB, 740.63 MB, 716.72 MB, 677.49 MB, 645.82 MB, 661.06 MB, 694.49 MB, 675.82 MB, 643.68 MB, 603.48 MB, 574.88 MB, 547.20 MB, 509.96 MB, 567.27 MB, 740.68 MB, 766.73 MB, 745.10 MB, 739.46 MB, 711.75 MB, 652.01 MB, 577.63 MB, 532.54 MB, 525.67 MB, 515.86 MB, 473.58 MB, 437.26 MB, 408.46 MB, 383.04 MB, 348.71 MB, 333.60 MB, 269.91 MB, 208.77 MB, 163.32 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 12, 11, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6, 5 - AverageThreadTokens: 11.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188324287) - PerHostPeakMemUsage: 1.11 GB (1188340671) - RowsProduced: 27.05M (27045946) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m25s - TotalStorageWaitTime: 552.124ms - TotalThreadsInvoluntaryContextSwitches: 26.57K (26575) - TotalThreadsTotalWallClockTime: 34m47s - TotalThreadsSysTime: 1s958ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 44.22K (44221) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 402.272ms - OpenTime: 33.370ms - ExecTreeOpenTime: 49.620us - PrepareTime: 22.738ms - ExecTreePrepareTime: 215.207us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 40s638ms, non-child: 40s638ms, % non-child: 100.00%) - BytesSent: 552.79 MB (579639503) - NetworkThroughput(*): 278.95 MB/sec - OverallThroughput: 13.60 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 27.05M (27045946) - SerializeBatchTime: 38s646ms - TransmitDataRPCTime: 1s981ms - UncompressedRowBatchSize: 954.44 MB (1000805662) CodeGen:(Total: 54.148ms, non-child: 54.148ms, % non-child: 100.00%) - CodegenTime: 1.225ms - CompileTime: 9.633ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.835ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.079ms HDFS_SCAN_NODE (id=1):(Total: 336.071ms, non-child: 336.071ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 2:1/253.41 MB 7:2/506.80 MB 6:1/253.41 MB 1:2/506.79 MB 8:2/506.78 MB 3:5/1.24 GB 4:4/1013.63 MB 0:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0% 2:0% 3:0% 4:0% 5:0.2695% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 881.21 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1.02 GB, 1.10 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.26 GB, 1.50 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 3.639ms ; Min: 2.282ms ; Max: 5.774ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.27 - BytesRead: 1.55 GB (1664181733) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664181733) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664181733) - DecompressionTime: 9s822ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188043196) - PerReadThreadRawHdfsThroughput: 1.51 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.135ms - RowBatchQueuePutWaitTime: 31m18s - RowsRead: 131.50M (131502331) - RowsReturned: 27.05M (27045946) - RowsReturnedRate: 80.48 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.92K (11923) - ScannerThreadsTotalWallClockTime: 31m42s - MaterializeTupleTime(*): 11s840ms - ScannerThreadsSysTime: 1s185ms - ScannerThreadsUserTime: 21s976ms - ScannerThreadsVoluntaryContextSwitches: 26.56K (26562) - TotalRawHdfsReadTime(*): 1s027ms - TotalReadThroughput: 8.56 MB/sec Instance b743dc00e069930c:983640700000000c (host=vb0220.halxg.cloudera.com:22000):(Total: 3m4s, non-child: 2m28s, % non-child: 80.54%) Hdfs split stats (:<# splits>/): 8:2/506.79 MB 5:2/506.80 MB 10:1/253.39 MB 9:2/506.77 MB 7:1/253.41 MB 2:3/732.64 MB 3:4/1013.58 MB 0:3/760.18 MB 1:1/253.41 MB MemoryUsage(4s000ms): 975.97 MB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.04 GB, 1023.27 MB, 993.29 MB, 953.20 MB, 913.09 MB, 878.60 MB, 859.06 MB, 834.23 MB, 817.06 MB, 780.78 MB, 739.24 MB, 682.80 MB, 651.77 MB, 650.40 MB, 637.58 MB, 629.52 MB, 661.67 MB, 708.61 MB, 692.88 MB, 678.27 MB, 804.46 MB, 823.08 MB, 784.56 MB, 749.69 MB, 723.99 MB, 710.59 MB, 679.06 MB, 706.83 MB, 679.75 MB, 651.38 MB, 625.19 MB, 575.38 MB, 511.28 MB, 474.98 MB, 435.59 MB, 398.96 MB, 363.12 MB, 319.28 MB, 273.09 MB, 230.84 MB, 123.23 MB ThreadUsage(4s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 11, 11, 8, 8, 8, 8, 8, 7, 7, 6, 3 - AverageThreadTokens: 11.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1184766159) - PerHostPeakMemUsage: 1.10 GB (1184766159) - RowsProduced: 24.28M (24277670) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m29s - TotalStorageWaitTime: 553.236ms - TotalThreadsInvoluntaryContextSwitches: 25.66K (25660) - TotalThreadsTotalWallClockTime: 36m1s - TotalThreadsSysTime: 2s040ms - TotalThreadsUserTime: 55s339ms - TotalThreadsVoluntaryContextSwitches: 40.37K (40368) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 345.193ms - OpenTime: 33.594ms - ExecTreeOpenTime: 47.820us - PrepareTime: 27.118ms - ExecTreePrepareTime: 292.305us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s600ms, non-child: 35s600ms, % non-child: 100.00%) - BytesSent: 496.22 MB (520319489) - NetworkThroughput(*): 285.88 MB/sec - OverallThroughput: 13.94 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.28M (24277670) - SerializeBatchTime: 33s856ms - TransmitDataRPCTime: 1s735ms - UncompressedRowBatchSize: 856.75 MB (898368646) CodeGen:(Total: 58.171ms, non-child: 58.171ms, % non-child: 100.00%) - CodegenTime: 1.474ms - CompileTime: 10.186ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.642ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.791ms HDFS_SCAN_NODE (id=1):(Total: 287.647ms, non-child: 287.647ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.79 MB 5:2/506.80 MB 10:1/253.39 MB 9:2/506.77 MB 7:1/253.41 MB 2:3/732.64 MB 3:4/1013.58 MB 0:3/760.18 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0.271% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 869.12 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 993.28 MB, 1.03 GB, 1.05 GB, 1.06 GB, 1.13 GB, 1.20 GB, 1.21 GB, 1.26 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.53 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 3.891ms ; Min: 2.384ms ; Max: 7.258ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.70 - BytesRead: 1.54 GB (1654662021) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1654662021) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1654662021) - DecompressionTime: 9s541ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1184654028) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.224ms - RowBatchQueuePutWaitTime: 32m34s - RowsRead: 130.75M (130748945) - RowsReturned: 24.28M (24277670) - RowsReturnedRate: 84.40 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.92K (11917) - ScannerThreadsTotalWallClockTime: 32m56s - MaterializeTupleTime(*): 11s461ms - ScannerThreadsSysTime: 1s301ms - ScannerThreadsUserTime: 21s003ms - ScannerThreadsVoluntaryContextSwitches: 23.89K (23895) - TotalRawHdfsReadTime(*): 1s062ms - TotalReadThroughput: 8.53 MB/sec Instance b743dc00e069930c:9836407000000009 (host=vb0224.halxg.cloudera.com:22000):(Total: 3m4s, non-child: 2m27s, % non-child: 79.90%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 1:1/253.41 MB 10:1/253.38 MB 9:1/253.40 MB 5:2/506.78 MB 0:2/506.77 MB 4:2/506.76 MB 8:2/506.78 MB 7:3/760.18 MB 6:2/481.03 MB 2:2/506.80 MB MemoryUsage(4s000ms): 984.94 MB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.06 GB, 1.01 GB, 978.83 MB, 938.87 MB, 914.47 MB, 904.63 MB, 884.10 MB, 858.83 MB, 829.20 MB, 782.43 MB, 755.85 MB, 706.47 MB, 674.38 MB, 644.74 MB, 660.63 MB, 655.32 MB, 628.68 MB, 651.05 MB, 629.63 MB, 623.87 MB, 642.15 MB, 667.87 MB, 662.22 MB, 669.42 MB, 696.11 MB, 713.16 MB, 696.88 MB, 716.99 MB, 689.37 MB, 634.69 MB, 587.91 MB, 548.50 MB, 517.98 MB, 458.50 MB, 422.75 MB, 377.57 MB, 355.85 MB, 284.25 MB, 236.57 MB, 162.33 MB, 92.95 MB ThreadUsage(4s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 10, 9, 8, 8, 8, 8, 8, 7, 6, 4, 2 - AverageThreadTokens: 11.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1187857228) - PerHostPeakMemUsage: 1.11 GB (1187857228) - RowsProduced: 25.26M (25256825) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 503.324ms - TotalThreadsInvoluntaryContextSwitches: 25.02K (25021) - TotalThreadsTotalWallClockTime: 35m27s - TotalThreadsSysTime: 2s072ms - TotalThreadsUserTime: 56s415ms - TotalThreadsVoluntaryContextSwitches: 41.91K (41915) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 341.663ms - OpenTime: 32.805ms - ExecTreeOpenTime: 49.443us - PrepareTime: 26.592ms - ExecTreePrepareTime: 315.732us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s691ms, non-child: 36s691ms, % non-child: 100.00%) - BytesSent: 516.24 MB (541321888) - NetworkThroughput(*): 290.32 MB/sec - OverallThroughput: 14.07 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.26M (25256825) - SerializeBatchTime: 34s903ms - TransmitDataRPCTime: 1s778ms - UncompressedRowBatchSize: 891.31 MB (934601201) CodeGen:(Total: 56.881ms, non-child: 56.881ms, % non-child: 100.00%) - CodegenTime: 1.429ms - CompileTime: 9.648ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.389ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.303ms HDFS_SCAN_NODE (id=1):(Total: 284.506ms, non-child: 284.506ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 1:1/253.41 MB 10:1/253.38 MB 9:1/253.40 MB 5:2/506.78 MB 0:2/506.77 MB 4:2/506.76 MB 8:2/506.78 MB 7:3/760.18 MB 6:2/481.03 MB 2:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 877.02 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1.03 GB, 1.05 GB, 1.07 GB, 1.13 GB, 1.13 GB, 1.16 GB, 1.23 GB, 1.30 GB, 1.34 GB, 1.38 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.53 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 3.772ms ; Min: 2.250ms ; Max: 5.646ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.55 - BytesRead: 1.54 GB (1655172689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1655172689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1655172689) - DecompressionTime: 9s441ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1187643721) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.522ms - RowBatchQueuePutWaitTime: 32m1s - RowsRead: 130.80M (130797981) - RowsReturned: 25.26M (25256825) - RowsReturnedRate: 88.77 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.98K (10981) - ScannerThreadsTotalWallClockTime: 32m23s - MaterializeTupleTime(*): 11s327ms - ScannerThreadsSysTime: 1s262ms - ScannerThreadsUserTime: 20s929ms - ScannerThreadsVoluntaryContextSwitches: 24.86K (24864) - TotalRawHdfsReadTime(*): 1s150ms - TotalReadThroughput: 8.56 MB/sec Instance b743dc00e069930c:983640700000000b (host=vb0222.halxg.cloudera.com:22000):(Total: 3m3s, non-child: 2m27s, % non-child: 80.72%) Hdfs split stats (:<# splits>/): 6:1/253.38 MB 3:3/514.23 MB 10:1/253.41 MB 4:3/760.21 MB 9:1/253.37 MB 8:2/506.80 MB 7:2/506.80 MB 5:2/506.79 MB 1:1/253.40 MB 2:3/760.16 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.06 GB, 1.03 GB, 998.94 MB, 951.86 MB, 920.37 MB, 901.13 MB, 896.41 MB, 869.36 MB, 844.34 MB, 797.77 MB, 755.88 MB, 717.29 MB, 685.69 MB, 658.53 MB, 703.57 MB, 698.82 MB, 721.39 MB, 693.04 MB, 668.50 MB, 661.30 MB, 658.82 MB, 619.37 MB, 589.88 MB, 597.65 MB, 617.35 MB, 647.37 MB, 621.42 MB, 687.83 MB, 647.23 MB, 586.45 MB, 523.76 MB, 490.13 MB, 439.64 MB, 372.87 MB, 350.04 MB, 314.78 MB, 275.49 MB, 236.50 MB, 190.94 MB, 125.50 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 9, 8, 7, 6, 6, 6, 6, 5, 4, 3 - AverageThreadTokens: 11.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188669136) - PerHostPeakMemUsage: 1.11 GB (1188669136) - RowsProduced: 24.52M (24523519) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 477.937ms - TotalThreadsInvoluntaryContextSwitches: 22.61K (22614) - TotalThreadsTotalWallClockTime: 34m35s - TotalThreadsSysTime: 1s872ms - TotalThreadsUserTime: 51s880ms - TotalThreadsVoluntaryContextSwitches: 41.33K (41334) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 352.581ms - OpenTime: 34.093ms - ExecTreeOpenTime: 61.570us - PrepareTime: 21.604ms - ExecTreePrepareTime: 190.332us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s981ms, non-child: 34s981ms, % non-child: 100.00%) - BytesSent: 501.25 MB (525595582) - NetworkThroughput(*): 276.00 MB/sec - OverallThroughput: 14.33 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.52M (24523519) - SerializeBatchTime: 33s156ms - TransmitDataRPCTime: 1s816ms - UncompressedRowBatchSize: 865.43 MB (907466011) CodeGen:(Total: 53.623ms, non-child: 53.623ms, % non-child: 100.00%) - CodegenTime: 1.319ms - CompileTime: 10.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.769ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 19.914ms HDFS_SCAN_NODE (id=1):(Total: 298.058ms, non-child: 298.058ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.38 MB 3:3/514.23 MB 10:1/253.41 MB 4:3/760.21 MB 9:1/253.37 MB 8:2/506.80 MB 7:2/506.80 MB 5:2/506.79 MB 1:1/253.40 MB 2:3/760.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1015.44 MB, 1.06 GB, 1.08 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.18 GB, 1.23 GB, 1.23 GB, 1.23 GB, 1.27 GB, 1.33 GB, 1.39 GB, 1.39 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 3.021ms ; Min: 1.932ms ; Max: 5.382ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.34 - BytesRead: 1.47 GB (1579318713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1579318713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1579318713) - DecompressionTime: 8s112ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188254917) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.779ms - RowBatchQueuePutWaitTime: 31m13s - RowsRead: 124.77M (124773003) - RowsReturned: 24.52M (24523519) - RowsReturnedRate: 82.28 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.00K (9002) - ScannerThreadsTotalWallClockTime: 31m32s - MaterializeTupleTime(*): 9s950ms - ScannerThreadsSysTime: 1s145ms - ScannerThreadsUserTime: 18s231ms - ScannerThreadsVoluntaryContextSwitches: 24.13K (24132) - TotalRawHdfsReadTime(*): 1s029ms - TotalReadThroughput: 8.23 MB/sec Instance b743dc00e069930c:9836407000000001 (host=vb0230.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m26s, % non-child: 80.88%) Hdfs split stats (:<# splits>/): 9:1/253.41 MB 2:1/253.39 MB 5:2/506.78 MB 3:2/506.81 MB 6:1/253.38 MB 7:2/506.78 MB 4:2/506.81 MB 1:3/760.19 MB 0:5/1.24 GB MemoryUsage(4s000ms): 1.10 GB, 1.11 GB, 1.11 GB, 1.09 GB, 1.04 GB, 1.01 GB, 986.83 MB, 939.26 MB, 904.59 MB, 881.37 MB, 862.52 MB, 835.70 MB, 806.93 MB, 768.26 MB, 713.09 MB, 675.10 MB, 628.72 MB, 584.18 MB, 653.74 MB, 665.08 MB, 693.79 MB, 697.20 MB, 706.19 MB, 772.02 MB, 746.43 MB, 704.81 MB, 742.97 MB, 756.15 MB, 772.02 MB, 745.90 MB, 712.17 MB, 665.63 MB, 639.00 MB, 596.19 MB, 534.76 MB, 481.83 MB, 453.88 MB, 429.07 MB, 391.90 MB, 328.33 MB, 291.32 MB, 272.80 MB, 201.68 MB, 141.10 MB, 95.53 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 11, 10, 9, 8, 8, 8, 8, 7, 7, 7, 5, 4, 3 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1193325947) - PerHostPeakMemUsage: 1.11 GB (1193325947) - RowsProduced: 25.08M (25076265) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 561.463ms - TotalThreadsInvoluntaryContextSwitches: 19.60K (19599) - TotalThreadsTotalWallClockTime: 34m6s - TotalThreadsSysTime: 1s810ms - TotalThreadsUserTime: 52s564ms - TotalThreadsVoluntaryContextSwitches: 42.20K (42201) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 320.061ms - OpenTime: 33.023ms - ExecTreeOpenTime: 52.414us - PrepareTime: 21.451ms - ExecTreePrepareTime: 182.591us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s392ms, non-child: 34s392ms, % non-child: 100.00%) - BytesSent: 512.53 MB (537431466) - NetworkThroughput(*): 299.89 MB/sec - OverallThroughput: 14.90 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.08M (25076265) - SerializeBatchTime: 32s674ms - TransmitDataRPCTime: 1s709ms - UncompressedRowBatchSize: 884.93 MB (927919769) CodeGen:(Total: 52.379ms, non-child: 52.379ms, % non-child: 100.00%) - CodegenTime: 1.412ms - CompileTime: 9.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.641ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 19.602ms HDFS_SCAN_NODE (id=1):(Total: 266.878ms, non-child: 266.878ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.41 MB 2:1/253.39 MB 5:2/506.78 MB 3:2/506.81 MB 6:1/253.38 MB 7:2/506.78 MB 4:2/506.81 MB 1:3/760.19 MB 0:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0.2755% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1.08 GB, 1.14 GB, 1.20 GB, 1.22 GB, 1.28 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.47 GB, 1.52 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 3.631ms ; Min: 2.075ms ; Max: 5.650ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 1.55 GB (1664143238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664143238) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664143238) - DecompressionTime: 8s539ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1192814432) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.925ms - RowBatchQueuePutWaitTime: 30m45s - RowsRead: 131.50M (131502184) - RowsReturned: 25.08M (25076265) - RowsReturnedRate: 93.96 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.56K (9560) - ScannerThreadsTotalWallClockTime: 31m5s - MaterializeTupleTime(*): 10s306ms - ScannerThreadsSysTime: 1s110ms - ScannerThreadsUserTime: 19s148ms - ScannerThreadsVoluntaryContextSwitches: 24.63K (24628) - TotalRawHdfsReadTime(*): 1s063ms - TotalReadThroughput: 8.74 MB/sec Instance b743dc00e069930c:983640700000000e (host=vb0206.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m25s, % non-child: 80.34%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 9:3/760.18 MB 6:2/506.81 MB 7:1/253.39 MB 5:2/506.80 MB 4:3/760.17 MB 1:2/506.77 MB 0:3/760.20 MB MemoryUsage(4s000ms): 1.08 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.07 GB, 1.04 GB, 988.14 MB, 933.83 MB, 914.36 MB, 904.95 MB, 902.09 MB, 879.54 MB, 851.92 MB, 793.53 MB, 760.93 MB, 699.20 MB, 680.56 MB, 661.60 MB, 671.76 MB, 696.49 MB, 718.53 MB, 688.39 MB, 664.05 MB, 711.16 MB, 661.16 MB, 612.48 MB, 595.27 MB, 550.27 MB, 532.82 MB, 625.09 MB, 629.82 MB, 614.75 MB, 571.71 MB, 552.68 MB, 503.53 MB, 452.86 MB, 421.17 MB, 390.29 MB, 346.04 MB, 294.74 MB, 265.68 MB, 215.57 MB, 159.57 MB, 93.35 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9, 7, 7, 7, 7, 7, 6, 6, 5, 4, 2 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1187318507) - PerHostPeakMemUsage: 1.11 GB (1187318507) - RowsProduced: 24.21M (24210513) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 570.341ms - TotalThreadsInvoluntaryContextSwitches: 24.07K (24068) - TotalThreadsTotalWallClockTime: 34m8s - TotalThreadsSysTime: 2s218ms - TotalThreadsUserTime: 53s798ms - TotalThreadsVoluntaryContextSwitches: 39.85K (39848) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 320.677ms - OpenTime: 33.134ms - ExecTreeOpenTime: 43.011us - PrepareTime: 24.900ms - ExecTreePrepareTime: 286.944us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s272ms, non-child: 35s272ms, % non-child: 100.00%) - BytesSent: 494.84 MB (518880607) - NetworkThroughput(*): 290.41 MB/sec - OverallThroughput: 14.03 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.21M (24210513) - SerializeBatchTime: 33s559ms - TransmitDataRPCTime: 1s703ms - UncompressedRowBatchSize: 854.38 MB (895883569) CodeGen:(Total: 55.616ms, non-child: 55.616ms, % non-child: 100.00%) - CodegenTime: 1.412ms - CompileTime: 9.685ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.714ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.679ms HDFS_SCAN_NODE (id=1):(Total: 265.295ms, non-child: 265.295ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 9:3/760.18 MB 6:2/506.81 MB 7:1/253.39 MB 5:2/506.80 MB 4:3/760.17 MB 1:2/506.77 MB 0:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0% 2:0% 3:0% 4:0.2762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(4s000ms): 987.04 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1002.34 MB, 1.02 GB, 1.06 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.26 GB, 1.38 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 3.944ms ; Min: 2.617ms ; Max: 6.889ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 1.47 GB (1576537765) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576537765) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576537765) - DecompressionTime: 9s078ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1187107040) - PerReadThreadRawHdfsThroughput: 1.54 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.656ms - RowBatchQueuePutWaitTime: 30m46s - RowsRead: 124.58M (124580613) - RowsReturned: 24.21M (24210513) - RowsReturnedRate: 91.26 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.60K (10601) - ScannerThreadsTotalWallClockTime: 31m7s - MaterializeTupleTime(*): 10s858ms - ScannerThreadsSysTime: 1s399ms - ScannerThreadsUserTime: 19s830ms - ScannerThreadsVoluntaryContextSwitches: 23.80K (23801) - TotalRawHdfsReadTime(*): 955.516ms - TotalReadThroughput: 8.31 MB/sec Instance b743dc00e069930c:983640700000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m24s, % non-child: 80.01%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 4:2/506.76 MB 2:1/253.42 MB 10:2/445.01 MB 8:3/760.18 MB 3:1/187.22 MB 7:2/506.79 MB 5:4/1013.55 MB 0:3/760.18 MB MemoryUsage(4s000ms): 1.07 GB, 1.09 GB, 1.09 GB, 1.08 GB, 1.04 GB, 1.01 GB, 1001.49 MB, 950.90 MB, 906.89 MB, 885.48 MB, 870.33 MB, 857.60 MB, 846.46 MB, 800.27 MB, 762.12 MB, 791.91 MB, 742.51 MB, 707.29 MB, 691.20 MB, 674.44 MB, 622.60 MB, 667.12 MB, 679.27 MB, 643.69 MB, 656.82 MB, 645.43 MB, 635.83 MB, 670.12 MB, 695.12 MB, 661.82 MB, 646.78 MB, 661.12 MB, 671.06 MB, 615.25 MB, 532.71 MB, 487.87 MB, 453.19 MB, 406.89 MB, 382.63 MB, 355.45 MB, 306.95 MB, 264.08 MB, 216.79 MB, 184.30 MB, 137.51 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 9, 8, 7, 7, 7, 7, 6, 6, 6, 6, 5 - AverageThreadTokens: 11.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.09 GB (1170440817) - PerHostPeakMemUsage: 1.09 GB (1170440817) - RowsProduced: 24.20M (24199028) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m25s - TotalStorageWaitTime: 598.269ms - TotalThreadsInvoluntaryContextSwitches: 24.86K (24861) - TotalThreadsTotalWallClockTime: 34m21s - TotalThreadsSysTime: 2s105ms - TotalThreadsUserTime: 54s840ms - TotalThreadsVoluntaryContextSwitches: 40.09K (40089) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 352.014ms - OpenTime: 33.917ms - ExecTreeOpenTime: 49.827us - PrepareTime: 27.316ms - ExecTreePrepareTime: 330.418us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s811ms, non-child: 35s811ms, % non-child: 100.00%) - BytesSent: 494.62 MB (518648130) - NetworkThroughput(*): 259.97 MB/sec - OverallThroughput: 13.81 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.20M (24199028) - SerializeBatchTime: 33s898ms - TransmitDataRPCTime: 1s902ms - UncompressedRowBatchSize: 853.98 MB (895458584) CodeGen:(Total: 58.655ms, non-child: 58.655ms, % non-child: 100.00%) - CodegenTime: 1.433ms - CompileTime: 10.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.637ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.928ms HDFS_SCAN_NODE (id=1):(Total: 296.834ms, non-child: 296.834ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 4:2/506.76 MB 2:1/253.42 MB 10:2/445.01 MB 8:3/760.18 MB 3:1/187.22 MB 7:2/506.79 MB 5:4/1013.55 MB 0:3/760.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.2762% 2:0.2762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 966.91 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 980.56 MB, 991.00 MB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.15 GB, 1.18 GB, 1.18 GB, 1.24 GB, 1.26 GB, 1.30 GB, 1.37 GB, 1.43 GB, 1.43 GB, 1.43 GB, 1.47 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB - FooterProcessingTime: (Avg: 4.244ms ; Min: 2.556ms ; Max: 7.028ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.39 - BytesRead: 1.51 GB (1619983151) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.51 GB (1619983151) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.51 GB (1619983151) - DecompressionTime: 9s327ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.09 GB (1169994846) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.749ms - RowBatchQueuePutWaitTime: 30m58s - RowsRead: 128.00M (128001189) - RowsReturned: 24.20M (24199028) - RowsReturnedRate: 81.52 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.24K (11239) - ScannerThreadsTotalWallClockTime: 31m20s - MaterializeTupleTime(*): 11s238ms - ScannerThreadsSysTime: 1s343ms - ScannerThreadsUserTime: 20s519ms - ScannerThreadsVoluntaryContextSwitches: 23.80K (23800) - TotalRawHdfsReadTime(*): 1s102ms - TotalReadThroughput: 8.54 MB/sec Instance b743dc00e069930c:9836407000000008 (host=vb0232.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m23s, % non-child: 79.32%) Hdfs split stats (:<# splits>/): 6:2/506.80 MB 9:3/760.17 MB 7:1/253.39 MB 8:5/1.24 GB 1:2/260.77 MB 5:3/760.18 MB 4:1/253.40 MB 2:1/253.40 MB 0:1/253.38 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.06 GB, 1.02 GB, 996.66 MB, 962.26 MB, 937.81 MB, 917.35 MB, 889.32 MB, 871.67 MB, 839.33 MB, 808.14 MB, 777.86 MB, 734.46 MB, 693.21 MB, 667.65 MB, 641.83 MB, 599.58 MB, 609.82 MB, 604.91 MB, 643.95 MB, 616.18 MB, 601.13 MB, 622.23 MB, 674.08 MB, 721.77 MB, 683.12 MB, 665.31 MB, 708.82 MB, 662.25 MB, 605.80 MB, 567.94 MB, 525.75 MB, 478.56 MB, 437.72 MB, 403.89 MB, 350.19 MB, 311.18 MB, 271.43 MB, 217.29 MB, 140.65 MB, 78.58 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 10, 10, 9, 8, 7, 7, 7, 7, 6, 5, 4, 2 - AverageThreadTokens: 11.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1186998238) - PerHostPeakMemUsage: 1.11 GB (1186998238) - RowsProduced: 24.90M (24904227) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m24s - TotalStorageWaitTime: 552.960ms - TotalThreadsInvoluntaryContextSwitches: 24.13K (24130) - TotalThreadsTotalWallClockTime: 34m19s - TotalThreadsSysTime: 1s909ms - TotalThreadsUserTime: 55s733ms - TotalThreadsVoluntaryContextSwitches: 40.91K (40914) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 362.199ms - OpenTime: 33.561ms - ExecTreeOpenTime: 51.933us - PrepareTime: 29.567ms - ExecTreePrepareTime: 324.546us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 37s023ms, non-child: 37s023ms, % non-child: 100.00%) - BytesSent: 509.00 MB (533725492) - NetworkThroughput(*): 253.49 MB/sec - OverallThroughput: 13.75 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.90M (24904227) - SerializeBatchTime: 35s005ms - TransmitDataRPCTime: 2s007ms - UncompressedRowBatchSize: 878.86 MB (921553699) CodeGen:(Total: 60.530ms, non-child: 60.530ms, % non-child: 100.00%) - CodegenTime: 1.478ms - CompileTime: 10.166ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.639ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 27.158ms HDFS_SCAN_NODE (id=1):(Total: 302.835ms, non-child: 302.835ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/506.80 MB 9:3/760.17 MB 7:1/253.39 MB 8:5/1.24 GB 1:2/260.77 MB 5:3/760.18 MB 4:1/253.40 MB 2:1/253.40 MB 0:1/253.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.554% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1005.00 MB, 1.03 GB, 1.06 GB, 1.14 GB, 1.14 GB, 1.16 GB, 1.23 GB, 1.31 GB, 1.39 GB, 1.39 GB, 1.40 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 3.928ms ; Min: 2.779ms ; Max: 6.016ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 1.47 GB (1579317980) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1579317980) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1579317980) - DecompressionTime: 9s145ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1186784731) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.098ms - RowBatchQueuePutWaitTime: 30m57s - RowsRead: 124.77M (124770123) - RowsReturned: 24.90M (24904227) - RowsReturnedRate: 82.24 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.24K (10240) - ScannerThreadsTotalWallClockTime: 31m18s - MaterializeTupleTime(*): 10s929ms - ScannerThreadsSysTime: 1s150ms - ScannerThreadsUserTime: 20s317ms - ScannerThreadsVoluntaryContextSwitches: 24.46K (24461) - TotalRawHdfsReadTime(*): 1s009ms - TotalReadThroughput: 8.34 MB/sec Instance b743dc00e069930c:983640700000000d (host=vb0208.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m25s, % non-child: 80.44%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 7:1/234.34 MB 5:2/506.78 MB 4:3/760.21 MB 8:3/760.15 MB 1:2/506.82 MB 3:1/253.41 MB 2:4/1013.57 MB 0:2/506.80 MB MemoryUsage(4s000ms): 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.07 GB, 1.01 GB, 981.46 MB, 934.46 MB, 926.43 MB, 922.02 MB, 896.80 MB, 881.18 MB, 846.33 MB, 813.71 MB, 795.09 MB, 750.42 MB, 713.42 MB, 697.30 MB, 677.61 MB, 629.78 MB, 584.04 MB, 547.87 MB, 507.74 MB, 496.23 MB, 521.52 MB, 498.92 MB, 511.67 MB, 697.94 MB, 683.37 MB, 754.63 MB, 787.07 MB, 756.09 MB, 711.73 MB, 653.29 MB, 579.74 MB, 526.47 MB, 495.00 MB, 460.32 MB, 415.16 MB, 350.42 MB, 296.67 MB, 271.09 MB, 162.90 MB, 56.72 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 10, 9, 8, 8, 8, 8, 8, 8, 7, 4, 1 - AverageThreadTokens: 11.59 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1176299451) - PerHostPeakMemUsage: 1.10 GB (1176299451) - RowsProduced: 24.00M (24004509) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m25s - TotalStorageWaitTime: 555.139ms - TotalThreadsInvoluntaryContextSwitches: 26.14K (26140) - TotalThreadsTotalWallClockTime: 34m50s - TotalThreadsSysTime: 2s046ms - TotalThreadsUserTime: 54s715ms - TotalThreadsVoluntaryContextSwitches: 39.59K (39588) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 340.772ms - OpenTime: 33.753ms - ExecTreeOpenTime: 51.722us - PrepareTime: 25.816ms - ExecTreePrepareTime: 323.629us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s939ms, non-child: 34s939ms, % non-child: 100.00%) - BytesSent: 490.64 MB (514476323) - NetworkThroughput(*): 281.95 MB/sec - OverallThroughput: 14.04 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.00M (24004509) - SerializeBatchTime: 33s191ms - TransmitDataRPCTime: 1s740ms - UncompressedRowBatchSize: 847.11 MB (888260613) CodeGen:(Total: 57.008ms, non-child: 57.008ms, % non-child: 100.00%) - CodegenTime: 1.452ms - CompileTime: 10.143ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.859ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.455ms HDFS_SCAN_NODE (id=1):(Total: 285.114ms, non-child: 285.114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 7:1/234.34 MB 5:2/506.78 MB 4:3/760.21 MB 8:3/760.15 MB 1:2/506.82 MB 3:1/253.41 MB 2:4/1013.57 MB 0:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 996.04 MB, 1016.93 MB, 1.05 GB, 1.07 GB, 1.14 GB, 1.36 GB, 1.38 GB, 1.48 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 3.564ms ; Min: 2.589ms ; Max: 6.955ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.59 - BytesRead: 1.54 GB (1657536250) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1657536250) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1657536250) - DecompressionTime: 9s582ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1176020400) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.541ms - RowBatchQueuePutWaitTime: 31m27s - RowsRead: 130.98M (130980854) - RowsReturned: 24.00M (24004509) - RowsReturnedRate: 84.19 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.56K (12562) - ScannerThreadsTotalWallClockTime: 31m50s - MaterializeTupleTime(*): 11s465ms - ScannerThreadsSysTime: 1s281ms - ScannerThreadsUserTime: 21s031ms - ScannerThreadsVoluntaryContextSwitches: 23.60K (23602) - TotalRawHdfsReadTime(*): 1s076ms - TotalReadThroughput: 8.76 MB/sec Instance b743dc00e069930c:9836407000000007 (host=vb0234.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m25s, % non-child: 80.68%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:2/506.77 MB 1:1/253.39 MB 7:3/760.20 MB 6:3/760.17 MB 3:3/760.18 MB 2:2/258.65 MB 0:2/506.79 MB MemoryUsage(4s000ms): 986.22 MB, 1.11 GB, 1.11 GB, 1.11 GB, 1.09 GB, 1.06 GB, 1.03 GB, 992.79 MB, 944.90 MB, 914.81 MB, 896.35 MB, 891.71 MB, 868.38 MB, 836.13 MB, 779.93 MB, 742.38 MB, 699.06 MB, 665.45 MB, 633.43 MB, 610.55 MB, 716.98 MB, 708.33 MB, 716.44 MB, 706.30 MB, 676.30 MB, 637.47 MB, 654.44 MB, 622.54 MB, 616.84 MB, 715.35 MB, 676.42 MB, 663.75 MB, 618.40 MB, 579.80 MB, 518.64 MB, 471.96 MB, 428.83 MB, 385.40 MB, 351.73 MB, 299.38 MB, 266.83 MB, 219.85 MB, 166.40 MB, 107.86 MB, 65.68 MB ThreadUsage(4s000ms): 11, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 11, 10, 9, 8, 7, 7, 7, 6, 6, 5, 4, 3, 2 - AverageThreadTokens: 11.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1190523869) - PerHostPeakMemUsage: 1.11 GB (1190523869) - RowsProduced: 23.36M (23361849) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 606.073ms - TotalThreadsInvoluntaryContextSwitches: 24.44K (24443) - TotalThreadsTotalWallClockTime: 33m23s - TotalThreadsSysTime: 1s995ms - TotalThreadsUserTime: 53s300ms - TotalThreadsVoluntaryContextSwitches: 38.82K (38824) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 320.701ms - OpenTime: 33.671ms - ExecTreeOpenTime: 48.557us - PrepareTime: 23.500ms - ExecTreePrepareTime: 315.420us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s490ms, non-child: 34s490ms, % non-child: 100.00%) - BytesSent: 477.51 MB (500701167) - NetworkThroughput(*): 277.52 MB/sec - OverallThroughput: 13.84 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 23.36M (23361849) - SerializeBatchTime: 32s761ms - TransmitDataRPCTime: 1s720ms - UncompressedRowBatchSize: 824.43 MB (864479689) CodeGen:(Total: 54.590ms, non-child: 54.590ms, % non-child: 100.00%) - CodegenTime: 1.457ms - CompileTime: 10.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.678ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.136ms HDFS_SCAN_NODE (id=1):(Total: 269.087ms, non-child: 269.087ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:2/506.77 MB 1:1/253.39 MB 7:3/760.20 MB 6:3/760.17 MB 3:3/760.18 MB 2:2/258.65 MB 0:2/506.79 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0.2778% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 878.77 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1.13 GB, 1.17 GB, 1.23 GB, 1.23 GB, 1.23 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.34 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 4.236ms ; Min: 2.803ms ; Max: 13.078ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.12 - BytesRead: 1.47 GB (1578597766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1578597766) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1578597766) - DecompressionTime: 9s168ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1190344154) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.026ms - RowBatchQueuePutWaitTime: 30m1s - RowsRead: 124.71M (124712354) - RowsReturned: 23.36M (23361849) - RowsReturnedRate: 86.82 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.18K (11184) - ScannerThreadsTotalWallClockTime: 30m23s - MaterializeTupleTime(*): 10s981ms - ScannerThreadsSysTime: 1s250ms - ScannerThreadsUserTime: 20s117ms - ScannerThreadsVoluntaryContextSwitches: 22.95K (22949) - TotalRawHdfsReadTime(*): 1s067ms - TotalReadThroughput: 8.34 MB/sec ================================================================================ ================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+---------+-----------+ | 06:AGGREGATE | 1 | 311.91us | 0ns | 311.91us | 1 | 1 | | 05:EXCHANGE | 1 | 20.82us | 0ns | 20.82us | 1 | 1 | | 03:AGGREGATE | 1 | 2.51ms | 0ns | 2.51ms | 1 | 1 | | 02:HASH JOIN | 1 | 92.46s | 0ns | 92.46s | 0 | 3 | | |--04:EXCHANGE | 1 | 113.77s | 0ns | 113.77s | 350.01M | 180.00M | | | 01:SCAN HDFS | 14 | 298.42ms | 0ns | 362.73ms | 350.01M | 180.00M | | 00:SCAN HDFS | 1 | 7.45ms | 0ns | 7.45ms | 0 | 3 | +-----------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=ef4ccc78afa62d0c:3736f25300000000): Summary: Session ID: 2246603385fb8500:c4fa623f904d0abe Session Type: BEESWAX Start Time: 2017-02-19 07:49:13.166133000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 9873c749fd7f33af9861000d458b87f91ef35b78) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:42105 Default Db: tpch_300_parquet Sql Statement: -- Description : Large broadcast join with no rows qualifying from the probe side. -- Target test case : Broadcast large amounts of data over the network while stressing the -- exchange operator along with HashTable build. SELECT /* +straight_join */ count(*) FROM nation JOIN /* +broadcast */ lineitem ON l_orderkey = n_nationkey WHERE l_partkey > 0 AND l_suppkey > 0 AND l_linenumber > 0 AND n_regionkey < 0 AND l_orderkey < 350000000 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=6.24GB VCores=2 PLAN-ROOT SINK | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=1 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: n_nationkey = l_orderkey | runtime filters: RF000 <- l_orderkey | hosts=1 per-host-mem=5.90GB | tuple-ids=0,1 row-size=48B cardinality=3 | |--04:EXCHANGE [BROADCAST] | | hosts=14 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_linenumber > 0, l_orderkey < 350000000, l_partkey > 0, l_suppkey > 0 | table stats: 1799989091 rows total | column stats: all | hosts=14 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 00:SCAN HDFS [tpch_300_parquet.nation, RANDOM] partitions=1/1 files=1 size=2.19KB predicates: n_regionkey < 0, tpch_300_parquet.nation.n_nationkey < 350000000 runtime filters: RF000 -> n_nationkey table stats: 25 rows total column stats: all hosts=1 per-host-mem=32.00MB tuple-ids=0 row-size=16B cardinality=3 ---------------- Estimated Per-Host Mem: 6705060455 Estimated Per-Host VCores: 2 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 6.671ms - Analysis finished: 1.868ms (1.868ms) - Equivalence classes computed: 1.998ms (130.818us) - Single node plan created: 3.772ms (1.773ms) - Runtime filters computed: 3.886ms (113.992us) - Distributed plan created: 4.126ms (240.288us) - Lineage info computed: 4.257ms (130.538us) - Planning finished: 6.671ms (2.414ms) Query Timeline: 3m32s - Query submitted: 52.789us (52.789us) - Planning finished: 9.207ms (9.154ms) - Submit for admission: 10.492ms (1.284ms) - Completed admission: 10.610ms (118.167us) - Ready to start 16 fragment instances: 10.933ms (323.398us) - All 16 fragment instances started: 796.823ms (785.889ms) - Rows available: 3m32s (3m31s) - First row fetched: 3m32s (31.930ms) - ComputeScanRangeAssignmentTimer: 585.312us ImpalaServer: - ClientFetchWaitTimer: 31.940ms - RowMaterializationTimer: 4.416ms Execution Profile ef4ccc78afa62d0c:3736f25300000000:(Total: 3m32s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 2 0 1 LOCAL false 0 (1) N/A N/A true Fragment instance start latencies: Count: 16, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 518ms, 99.9th %-ile: 786ms Per Node Peak Memory Usage: vb0206.halxg.cloudera.com:22000(1.10 GB) vb0220.halxg.cloudera.com:22000(1.10 GB) vb0228.halxg.cloudera.com:22000(1.09 GB) vb0222.halxg.cloudera.com:22000(1.11 GB) vb0224.halxg.cloudera.com:22000(1.10 GB) vb0232.halxg.cloudera.com:22000(1.11 GB) vb0234.halxg.cloudera.com:22000(1.11 GB) vb0218.halxg.cloudera.com:22000(1.10 GB) vb0214.halxg.cloudera.com:22000(26.43 GB) vb0212.halxg.cloudera.com:22000(1.11 GB) vb0216.halxg.cloudera.com:22000(1.10 GB) vb0208.halxg.cloudera.com:22000(1.10 GB) vb0230.halxg.cloudera.com:22000(1.11 GB) vb0204.halxg.cloudera.com:22000(1.10 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F02: Instance ef4ccc78afa62d0c:3736f25300000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 3m32s, non-child: 32.983ms, % non-child: 0.02%) MemoryUsage(4s000ms): 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PerHostPeakMemUsage: 1.10 GB (1185338421) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 3m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3m32s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.000ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 32.050ms - ExecTreeExecTime: 7.097us - OpenTime: 3m32s - ExecTreeOpenTime: 3m32s - PrepareTime: 22.185ms - ExecTreePrepareTime: 160.658us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 21.459ms, non-child: 21.459ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.863ms AGGREGATION_NODE (id=6):(Total: 3m32s, non-child: 311.906us, % non-child: 0.00%) - BuildTime: 7.943us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 3m32s, non-child: 20.816us, % non-child: 0.00%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 2.148us - DeserializeRowBatchTimer: 15.534us - FirstBatchArrivalWaitTime: 3m32s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3m32s, non-child: 267.312ms, % non-child: 0.13%) split sizes: min: 2.19 KB, max: 2.19 KB, avg: 2.19 KB, stddev: 0 completion times: min:3m32s max:3m32s mean: 3m32s stddev:0.000ns execution rates: min:10.00 B/sec max:10.00 B/sec mean:10.00 B/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 26.43 GB (28380916821) - PerHostPeakMemUsage: 26.43 GB (28380916821) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1m45s - TotalNetworkSendTime: 406.526us - TotalStorageWaitTime: 6.073ms - TotalThreadsInvoluntaryContextSwitches: 23.50K (23504) - TotalThreadsTotalWallClockTime: 7m3s - TotalThreadsSysTime: 13s521ms - TotalThreadsUserTime: 1m38s - TotalThreadsVoluntaryContextSwitches: 341.20K (341203) Fragment Instance Lifecycle Timings: - ExecTime: 762.155us - ExecTreeExecTime: 4.163us - OpenTime: 3m31s - ExecTreeOpenTime: 3m31s - PrepareTime: 352.884ms - ExecTreePrepareTime: 391.418us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 2.42K (2419) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 26.40 GB (28345106432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 3.776ms, non-child: 3.776ms, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 451.48 KB/sec - OverallThroughput: 4.14 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.101us - TransmitDataRPCTime: 34.608us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 400.097ms, non-child: 400.097ms, % non-child: 100.00%) - CodegenTime: 1.660ms - CompileTime: 84.798ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 90 (90) - NumInstructions: 2.93K (2928) - OptimizationTime: 232.151ms - PeakMemoryUsage: 1.43 MB (1499136) - PrepareTime: 82.602ms AGGREGATION_NODE (id=3):(Total: 3m31s, non-child: 2.508ms, % non-child: 0.00%) - BuildTime: 2.435ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 3m31s, non-child: 1m32s, % non-child: 43.71%) - BuildRows: 350.01M (350008706) - BuildTime: 1m31s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 26.42 GB (28364049664) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.503us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 1m13s - BuildRowsPartitioned: 350.01M (350008706) - GetNewBlockTime: 18.042ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 17s475ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.42 GB (28364002432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=4):(Total: 1m59s, non-child: 1m59s, % non-child: 100.00%) - BytesReceived: 6.99 GB (7501460242) - ConvertRowBatchTime: 12s355ms - DeserializeRowBatchTimer: 2m50s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 350.01M (350008706) - RowsReturnedRate: 2.94 M/sec - SendersBlockedTimer: 2m53s - SendersBlockedTotalTimer(*): 34m21s HDFS_SCAN_NODE (id=0):(Total: 7.445ms, non-child: 7.445ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 KB (2497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 KB (2497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 KB (2497) - DecompressionTime: 7.338us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 73.00 KB (74752) - PerReadThreadRawHdfsThroughput: 59.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.566ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 25 (25) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 6.631ms - MaterializeTupleTime(*): 30.733us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 40.354us - TotalReadThroughput: 0.00 /sec Filter 0 (16.00 MB): - Rows processed: 25 (25) - Rows rejected: 0 (0) - Rows total: 25 (25) Fragment F00: Instance ef4ccc78afa62d0c:3736f2530000000f (host=vb0214.halxg.cloudera.com:22000):(Total: 3m32s, non-child: 267.312ms, % non-child: 0.13%) Hdfs split stats (:<# splits>/): 6:1/2.19 KB Filter 0 arrival: 3m14s MemoryUsage(4s000ms): 166.84 MB, 396.25 MB, 620.23 MB, 873.24 MB, 1.07 GB, 1.29 GB, 1.51 GB, 1.73 GB, 1.96 GB, 2.18 GB, 2.40 GB, 2.62 GB, 2.84 GB, 3.07 GB, 3.31 GB, 3.52 GB, 3.74 GB, 3.97 GB, 4.18 GB, 4.40 GB, 4.62 GB, 4.86 GB, 5.08 GB, 5.29 GB, 5.51 GB, 5.73 GB, 5.97 GB, 6.20 GB, 6.42 GB, 6.66 GB, 6.89 GB, 7.11 GB, 7.35 GB, 7.57 GB, 7.79 GB, 8.01 GB, 8.23 GB, 8.47 GB, 8.68 GB, 8.90 GB, 9.12 GB, 9.36 GB, 9.56 GB, 9.79 GB, 10.03 GB, 10.25 GB, 10.48 GB, 10.65 GB, 11.05 GB, 13.89 GB, 17.43 GB, 21.22 GB, 24.72 GB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 26.43 GB (28380916821) - PerHostPeakMemUsage: 26.43 GB (28380916821) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1m45s - TotalNetworkSendTime: 406.526us - TotalStorageWaitTime: 6.073ms - TotalThreadsInvoluntaryContextSwitches: 23.50K (23504) - TotalThreadsTotalWallClockTime: 7m3s - TotalThreadsSysTime: 13s521ms - TotalThreadsUserTime: 1m38s - TotalThreadsVoluntaryContextSwitches: 341.20K (341203) Fragment Instance Lifecycle Timings: - ExecTime: 762.155us - ExecTreeExecTime: 4.163us - OpenTime: 3m31s - ExecTreeOpenTime: 3m31s - PrepareTime: 352.884ms - ExecTreePrepareTime: 391.418us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 2.42K (2419) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 26.40 GB (28345106432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 3.776ms, non-child: 3.776ms, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 451.48 KB/sec - OverallThroughput: 4.14 KB/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 10.101us - TransmitDataRPCTime: 34.608us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 400.097ms, non-child: 400.097ms, % non-child: 100.00%) - CodegenTime: 1.660ms - CompileTime: 84.798ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 90 (90) - NumInstructions: 2.93K (2928) - OptimizationTime: 232.151ms - PeakMemoryUsage: 1.43 MB (1499136) - PrepareTime: 82.602ms AGGREGATION_NODE (id=3):(Total: 3m31s, non-child: 2.508ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 2.435ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 3m31s, non-child: 1m32s, % non-child: 43.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 350.01M (350008706) - BuildTime: 1m31s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 26.42 GB (28364049664) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.503us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 1m13s - BuildRowsPartitioned: 350.01M (350008706) - GetNewBlockTime: 18.042ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 17s475ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.42 GB (28364002432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=4):(Total: 1m59s, non-child: 1m53s, % non-child: 95.55%) BytesReceived(4s000ms): 59.81 MB, 206.53 MB, 356.50 MB, 505.63 MB, 654.60 MB, 802.67 MB, 950.31 MB, 1.07 GB, 1.22 GB, 1.36 GB, 1.51 GB, 1.65 GB, 1.79 GB, 1.94 GB, 2.09 GB, 2.23 GB, 2.38 GB, 2.52 GB, 2.67 GB, 2.81 GB, 2.95 GB, 3.10 GB, 3.24 GB, 3.39 GB, 3.53 GB, 3.67 GB, 3.82 GB, 3.97 GB, 4.12 GB, 4.27 GB, 4.42 GB, 4.57 GB, 4.72 GB, 4.86 GB, 5.01 GB, 5.15 GB, 5.30 GB, 5.44 GB, 5.58 GB, 5.73 GB, 5.87 GB, 6.02 GB, 6.16 GB, 6.31 GB, 6.46 GB, 6.60 GB, 6.75 GB, 6.87 GB, 6.96 GB, 6.99 GB, 6.99 GB, 6.99 GB, 6.99 GB - BytesReceived: 6.99 GB (7501460242) - ConvertRowBatchTime: 12s355ms - DeserializeRowBatchTimer: 2m50s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 350.01M (350008706) - RowsReturnedRate: 2.94 M/sec - SendersBlockedTimer: 2m53s - SendersBlockedTotalTimer(*): 34m21s HDFS_SCAN_NODE (id=0):(Total: 7.445ms, non-child: 7.445ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/2.19 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FooterProcessingTime: (Avg: 4.005ms ; Min: 4.005ms ; Max: 4.005ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 KB (2497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 KB (2497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 KB (2497) - DecompressionTime: 7.338us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 73.00 KB (74752) - PerReadThreadRawHdfsThroughput: 59.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.566ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 25 (25) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 6.631ms - MaterializeTupleTime(*): 30.733us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 40.354us - TotalReadThroughput: 0.00 /sec Filter 0 (16.00 MB): - Rows processed: 25 (25) - Rows rejected: 0 (0) - Rows total: 25 (25) Averaged Fragment F01:(Total: 3m4s, non-child: 2m27s, % non-child: 80.23%) split sizes: min: 4.45 GB, max: 4.70 GB, avg: 4.60 GB, stddev: 110.56 MB completion times: min:2m59s max:3m14s mean: 3m4s stddev:3s696ms execution rates: min:24.49 MB/sec max:26.70 MB/sec mean:25.54 MB/sec stddev:592.87 KB/sec num instances: 14 - AverageThreadTokens: 11.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1185685772) - PerHostPeakMemUsage: 1.84 GB (1973742019) - RowsProduced: 25.00M (25000621) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 604.148ms - TotalThreadsInvoluntaryContextSwitches: 24.46K (24463) - TotalThreadsTotalWallClockTime: 35m7s - TotalThreadsSysTime: 1s985ms - TotalThreadsUserTime: 55s367ms - TotalThreadsVoluntaryContextSwitches: 41.04K (41041) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 354.504ms - OpenTime: 33.609ms - ExecTreeOpenTime: 49.216us - PrepareTime: 29.501ms - ExecTreePrepareTime: 318.319us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s084ms, non-child: 36s084ms, % non-child: 100.00%) - BytesSent: 511.00 MB (535818588) - NetworkThroughput(*): 287.57 MB/sec - OverallThroughput: 14.19 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.00M (25000621) - SerializeBatchTime: 34s292ms - TransmitDataRPCTime: 1s782ms - UncompressedRowBatchSize: 882.26 MB (925120683) CodeGen:(Total: 56.483ms, non-child: 56.483ms, % non-child: 100.00%) - CodegenTime: 1.411ms - CompileTime: 10.102ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.736ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.089ms HDFS_SCAN_NODE (id=1):(Total: 298.423ms, non-child: 298.423ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.43 - BytesRead: 1.52 GB (1627133960) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.52 GB (1627133960) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.52 GB (1627133960) - DecompressionTime: 9s288ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1185371242) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.531ms - RowBatchQueuePutWaitTime: 31m40s - RowsRead: 128.57M (128570649) - RowsReturned: 25.00M (25000621) - RowsReturnedRate: 84.03 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.80K (10796) - ScannerThreadsTotalWallClockTime: 32m2s - MaterializeTupleTime(*): 11s129ms - ScannerThreadsSysTime: 1s230ms - ScannerThreadsUserTime: 20s579ms - ScannerThreadsVoluntaryContextSwitches: 24.58K (24577) - TotalRawHdfsReadTime(*): 1s075ms - TotalReadThroughput: 8.43 MB/sec Fragment F01: Instance ef4ccc78afa62d0c:3736f25300000004 (host=vb0214.halxg.cloudera.com:22000):(Total: 3m14s, non-child: 2m43s, % non-child: 83.91%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 4:2/506.80 MB 0:1/253.39 MB 8:2/506.80 MB 9:2/506.77 MB 3:1/253.37 MB 5:3/760.16 MB 2:4/959.93 MB 1:3/760.19 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.07 GB, 1.05 GB, 1.01 GB, 1000.31 MB, 968.10 MB, 956.12 MB, 935.38 MB, 932.90 MB, 932.99 MB, 932.73 MB, 933.54 MB, 913.53 MB, 908.10 MB, 905.73 MB, 889.06 MB, 872.56 MB, 866.54 MB, 835.91 MB, 820.39 MB, 808.97 MB, 777.73 MB, 743.87 MB, 734.24 MB, 721.37 MB, 703.66 MB, 688.47 MB, 670.49 MB, 663.44 MB, 643.03 MB, 619.15 MB, 576.81 MB, 566.86 MB, 552.73 MB, 533.38 MB, 507.07 MB, 559.14 MB, 563.00 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 9 - AverageThreadTokens: 12.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1182987107) - PerHostPeakMemUsage: 11.38 GB (12215758176) - RowsProduced: 25.73M (25731516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m43s - TotalStorageWaitTime: 586.131ms - TotalThreadsInvoluntaryContextSwitches: 17.98K (17982) - TotalThreadsTotalWallClockTime: 41m35s - TotalThreadsSysTime: 1s564ms - TotalThreadsUserTime: 49s135ms - TotalThreadsVoluntaryContextSwitches: 38.48K (38482) Fragment Instance Lifecycle Timings: - ExecTime: 3m14s - ExecTreeExecTime: 358.312ms - OpenTime: 33.548ms - ExecTreeOpenTime: 48.917us - PrepareTime: 81.957ms - ExecTreePrepareTime: 312.758us DataStreamSender (dst_id=4):(Total: 30s911ms, non-child: 30s911ms, % non-child: 100.00%) - BytesSent: 525.93 MB (551479392) - NetworkThroughput(*): 347.90 MB/sec - OverallThroughput: 17.01 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.73M (25731516) - SerializeBatchTime: 29s392ms - TransmitDataRPCTime: 1s511ms - UncompressedRowBatchSize: 908.06 MB (952166628) CodeGen:(Total: 55.237ms, non-child: 55.237ms, % non-child: 100.00%) - CodegenTime: 1.275ms - CompileTime: 9.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.842ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.964ms HDFS_SCAN_NODE (id=1):(Total: 313.778ms, non-child: 313.778ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 4:2/506.80 MB 0:1/253.39 MB 8:2/506.80 MB 9:2/506.77 MB 3:1/253.37 MB 5:3/760.16 MB 2:4/959.93 MB 1:3/760.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1002.30 MB, 1.17 GB, 1.51 GB - FooterProcessingTime: (Avg: 3.279ms ; Min: 1.958ms ; Max: 6.770ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.86 - BytesRead: 1.53 GB (1645560524) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.53 GB (1645560524) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.53 GB (1645560524) - DecompressionTime: 8s597ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1182773600) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.516ms - RowBatchQueuePutWaitTime: 38m - RowsRead: 130.03M (130033379) - RowsReturned: 25.73M (25731516) - RowsReturnedRate: 82.01 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7.34K (7336) - ScannerThreadsTotalWallClockTime: 38m21s - MaterializeTupleTime(*): 10s371ms - ScannerThreadsSysTime: 971.846ms - ScannerThreadsUserTime: 19s406ms - ScannerThreadsVoluntaryContextSwitches: 25.28K (25278) - TotalRawHdfsReadTime(*): 1s113ms - TotalReadThroughput: 8.09 MB/sec Instance ef4ccc78afa62d0c:3736f25300000006 (host=vb0218.halxg.cloudera.com:22000):(Total: 3m7s, non-child: 2m27s, % non-child: 78.71%) Hdfs split stats (:<# splits>/): 8:1/253.38 MB 1:1/253.39 MB 9:1/253.38 MB 10:1/253.40 MB 5:2/506.79 MB 2:5/1.24 GB 7:2/506.80 MB 6:2/506.81 MB 3:3/760.16 MB 0:1/253.39 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1012.36 MB, 952.87 MB, 937.36 MB, 926.52 MB, 919.81 MB, 906.74 MB, 885.45 MB, 846.58 MB, 806.22 MB, 767.77 MB, 737.68 MB, 715.97 MB, 702.72 MB, 677.78 MB, 642.34 MB, 613.75 MB, 574.66 MB, 612.61 MB, 571.06 MB, 526.55 MB, 488.58 MB, 535.86 MB, 501.90 MB, 551.52 MB, 529.57 MB, 628.70 MB, 642.19 MB, 726.65 MB, 690.69 MB, 650.25 MB, 602.34 MB, 553.87 MB, 522.29 MB, 510.33 MB, 482.33 MB, 439.27 MB, 389.94 MB, 368.71 MB, 329.84 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 10, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 11.74 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1182653177) - PerHostPeakMemUsage: 1.10 GB (1182653177) - RowsProduced: 27.36M (27356338) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 615.997ms - TotalThreadsInvoluntaryContextSwitches: 25.74K (25737) - TotalThreadsTotalWallClockTime: 36m42s - TotalThreadsSysTime: 2s010ms - TotalThreadsUserTime: 59s497ms - TotalThreadsVoluntaryContextSwitches: 44.81K (44809) Fragment Instance Lifecycle Timings: - ExecTime: 3m7s - ExecTreeExecTime: 362.521ms - OpenTime: 33.653ms - ExecTreeOpenTime: 46.704us - PrepareTime: 24.444ms - ExecTreePrepareTime: 329.748us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 39s640ms, non-child: 39s640ms, % non-child: 100.00%) - BytesSent: 559.15 MB (586311676) - NetworkThroughput(*): 299.83 MB/sec - OverallThroughput: 14.11 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 27.36M (27356338) - SerializeBatchTime: 37s765ms - TransmitDataRPCTime: 1s864ms - UncompressedRowBatchSize: 965.40 MB (1012291378) CodeGen:(Total: 55.637ms, non-child: 55.637ms, % non-child: 100.00%) - CodegenTime: 1.346ms - CompileTime: 10.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.804ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.062ms HDFS_SCAN_NODE (id=1):(Total: 301.782ms, non-child: 301.782ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.38 MB 1:1/253.39 MB 9:1/253.38 MB 10:1/253.40 MB 5:2/506.79 MB 2:5/1.24 GB 7:2/506.80 MB 6:2/506.81 MB 3:3/760.16 MB 0:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0.2667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.14 GB, 1.14 GB, 1.22 GB, 1.22 GB, 1.36 GB, 1.40 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.411ms ; Min: 2.690ms ; Max: 8.264ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.74 - BytesRead: 1.55 GB (1664143743) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664143743) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664143743) - DecompressionTime: 9s555ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1182207206) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.253ms - RowBatchQueuePutWaitTime: 33m11s - RowsRead: 131.50M (131502589) - RowsReturned: 27.36M (27356338) - RowsReturnedRate: 90.65 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.30K (11299) - ScannerThreadsTotalWallClockTime: 33m34s - MaterializeTupleTime(*): 11s446ms - ScannerThreadsSysTime: 1s226ms - ScannerThreadsUserTime: 21s281ms - ScannerThreadsVoluntaryContextSwitches: 26.85K (26848) - TotalRawHdfsReadTime(*): 1s149ms - TotalReadThroughput: 8.46 MB/sec Instance ef4ccc78afa62d0c:3736f25300000002 (host=vb0216.halxg.cloudera.com:22000):(Total: 3m6s, non-child: 2m26s, % non-child: 78.79%) Hdfs split stats (:<# splits>/): 1:1/253.38 MB 3:2/506.78 MB 10:1/253.39 MB 7:2/506.78 MB 9:5/1.24 GB 6:1/253.41 MB 5:2/506.78 MB 2:1/253.41 MB 0:4/1013.59 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.07 GB, 1.02 GB, 980.02 MB, 932.90 MB, 920.57 MB, 917.34 MB, 893.66 MB, 873.68 MB, 840.73 MB, 798.00 MB, 772.22 MB, 730.51 MB, 693.86 MB, 681.17 MB, 724.90 MB, 691.75 MB, 640.48 MB, 618.78 MB, 585.39 MB, 554.76 MB, 531.07 MB, 528.50 MB, 622.70 MB, 682.54 MB, 677.95 MB, 652.55 MB, 679.34 MB, 658.26 MB, 695.67 MB, 647.82 MB, 586.90 MB, 532.13 MB, 521.57 MB, 492.60 MB, 449.89 MB, 412.06 MB, 375.77 MB, 352.08 MB, 307.98 MB, 234.92 MB, 173.03 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 10, 8, 8, 8, 8, 8, 8, 8, 8, 7, 5, 4 - AverageThreadTokens: 11.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1185717161) - PerHostPeakMemUsage: 1.10 GB (1185717161) - RowsProduced: 26.59M (26594701) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 620.689ms - TotalThreadsInvoluntaryContextSwitches: 26.13K (26133) - TotalThreadsTotalWallClockTime: 35m37s - TotalThreadsSysTime: 2s134ms - TotalThreadsUserTime: 59s218ms - TotalThreadsVoluntaryContextSwitches: 43.82K (43816) Fragment Instance Lifecycle Timings: - ExecTime: 3m6s - ExecTreeExecTime: 385.239ms - OpenTime: 32.721ms - ExecTreeOpenTime: 45.129us - PrepareTime: 24.946ms - ExecTreePrepareTime: 283.882us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 39s175ms, non-child: 39s175ms, % non-child: 100.00%) - BytesSent: 543.60 MB (570003508) - NetworkThroughput(*): 273.23 MB/sec - OverallThroughput: 13.88 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 26.59M (26594701) - SerializeBatchTime: 37s176ms - TransmitDataRPCTime: 1s989ms - UncompressedRowBatchSize: 938.52 MB (984107841) CodeGen:(Total: 55.278ms, non-child: 55.278ms, % non-child: 100.00%) - CodegenTime: 1.428ms - CompileTime: 9.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.340ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.783ms HDFS_SCAN_NODE (id=1):(Total: 325.117ms, non-child: 325.117ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.38 MB 3:2/506.78 MB 10:1/253.39 MB 7:2/506.78 MB 9:5/1.24 GB 6:1/253.41 MB 5:2/506.78 MB 2:1/253.41 MB 0:4/1013.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0% 2:0.2681% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 995.59 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1012.77 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.08 GB, 1.14 GB, 1.28 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.44 GB, 1.47 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.887ms ; Min: 2.800ms ; Max: 8.432ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.46 - BytesRead: 1.55 GB (1664130351) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664130351) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664130351) - DecompressionTime: 9s670ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1185275270) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.497ms - RowBatchQueuePutWaitTime: 32m8s - RowsRead: 131.50M (131502389) - RowsReturned: 26.59M (26594701) - RowsReturnedRate: 81.80 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.82K (11825) - ScannerThreadsTotalWallClockTime: 32m31s - MaterializeTupleTime(*): 11s606ms - ScannerThreadsSysTime: 1s349ms - ScannerThreadsUserTime: 21s425ms - ScannerThreadsVoluntaryContextSwitches: 26.18K (26175) - TotalRawHdfsReadTime(*): 1s149ms - TotalReadThroughput: 8.51 MB/sec Instance ef4ccc78afa62d0c:3736f25300000005 (host=vb0204.halxg.cloudera.com:22000):(Total: 3m6s, non-child: 2m25s, % non-child: 78.19%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 2:1/253.41 MB 7:2/506.80 MB 6:1/253.41 MB 1:2/506.79 MB 8:2/506.78 MB 3:5/1.24 GB 4:4/1013.63 MB 0:1/253.40 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.06 GB, 1.03 GB, 1002.37 MB, 943.93 MB, 914.39 MB, 906.29 MB, 892.82 MB, 868.59 MB, 834.87 MB, 779.18 MB, 750.00 MB, 709.33 MB, 674.00 MB, 652.47 MB, 717.16 MB, 744.06 MB, 692.17 MB, 680.42 MB, 649.00 MB, 607.67 MB, 566.09 MB, 533.96 MB, 634.78 MB, 656.51 MB, 652.76 MB, 648.17 MB, 630.62 MB, 678.50 MB, 659.52 MB, 599.62 MB, 575.94 MB, 549.09 MB, 518.79 MB, 487.54 MB, 456.93 MB, 424.25 MB, 386.19 MB, 367.02 MB, 325.43 MB, 284.54 MB, 211.44 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6 - AverageThreadTokens: 11.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1185322037) - PerHostPeakMemUsage: 1.10 GB (1185338421) - RowsProduced: 27.05M (27045946) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 613.495ms - TotalThreadsInvoluntaryContextSwitches: 27.11K (27105) - TotalThreadsTotalWallClockTime: 35m50s - TotalThreadsSysTime: 2s137ms - TotalThreadsUserTime: 1m - TotalThreadsVoluntaryContextSwitches: 44.58K (44583) Fragment Instance Lifecycle Timings: - ExecTime: 3m6s - ExecTreeExecTime: 425.190ms - OpenTime: 34.714ms - ExecTreeOpenTime: 57.442us - PrepareTime: 22.731ms - ExecTreePrepareTime: 309.680us DataStreamSender (dst_id=4):(Total: 40s209ms, non-child: 40s209ms, % non-child: 100.00%) - BytesSent: 552.79 MB (579639503) - NetworkThroughput(*): 276.67 MB/sec - OverallThroughput: 13.75 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 27.05M (27045946) - SerializeBatchTime: 38s201ms - TransmitDataRPCTime: 1s998ms - UncompressedRowBatchSize: 954.44 MB (1000805662) CodeGen:(Total: 55.108ms, non-child: 55.108ms, % non-child: 100.00%) - CodegenTime: 1.420ms - CompileTime: 10.309ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 23.448ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 20.767ms HDFS_SCAN_NODE (id=1):(Total: 362.733ms, non-child: 362.733ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 2:1/253.41 MB 7:2/506.80 MB 6:1/253.41 MB 1:2/506.79 MB 8:2/506.78 MB 3:5/1.24 GB 4:4/1013.63 MB 0:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1002.40 MB, 1.07 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.15 GB, 1.32 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.48 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.223ms ; Min: 3.102ms ; Max: 7.615ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.56 - BytesRead: 1.55 GB (1664181733) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664181733) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664181733) - DecompressionTime: 9s827ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1185042986) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.067ms - RowBatchQueuePutWaitTime: 32m21s - RowsRead: 131.50M (131502331) - RowsReturned: 27.05M (27045946) - RowsReturnedRate: 74.56 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.35K (12352) - ScannerThreadsTotalWallClockTime: 32m44s - MaterializeTupleTime(*): 11s936ms - ScannerThreadsSysTime: 1s292ms - ScannerThreadsUserTime: 21s936ms - ScannerThreadsVoluntaryContextSwitches: 26.61K (26606) - TotalRawHdfsReadTime(*): 1s073ms - TotalReadThroughput: 8.53 MB/sec Instance ef4ccc78afa62d0c:3736f25300000003 (host=vb0212.halxg.cloudera.com:22000):(Total: 3m5s, non-child: 2m30s, % non-child: 81.41%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 1:3/760.18 MB 5:1/253.39 MB 4:2/506.79 MB 7:3/760.20 MB 0:1/253.40 MB 6:2/506.82 MB 3:2/506.82 MB 2:3/760.21 MB MemoryUsage(4s000ms): 1.10 GB, 1.11 GB, 1.11 GB, 1.11 GB, 1.09 GB, 1.05 GB, 1.02 GB, 1002.63 MB, 963.73 MB, 918.86 MB, 895.52 MB, 872.98 MB, 861.68 MB, 825.75 MB, 798.46 MB, 741.50 MB, 706.09 MB, 671.58 MB, 645.70 MB, 608.84 MB, 590.58 MB, 653.85 MB, 675.46 MB, 686.54 MB, 664.77 MB, 644.72 MB, 628.84 MB, 659.05 MB, 618.13 MB, 619.98 MB, 685.75 MB, 658.90 MB, 624.91 MB, 591.08 MB, 561.90 MB, 508.88 MB, 458.01 MB, 423.88 MB, 400.40 MB, 385.53 MB, 345.99 MB, 318.32 MB, 261.65 MB, 232.44 MB, 182.50 MB, 115.09 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 10, 10, 9, 8, 7, 7, 7, 7, 7, 7, 6, 6, 4, 3 - AverageThreadTokens: 11.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1195827527) - PerHostPeakMemUsage: 1.11 GB (1195827527) - RowsProduced: 23.47M (23465800) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m31s - TotalStorageWaitTime: 572.164ms - TotalThreadsInvoluntaryContextSwitches: 24.24K (24236) - TotalThreadsTotalWallClockTime: 34m26s - TotalThreadsSysTime: 1s987ms - TotalThreadsUserTime: 52s920ms - TotalThreadsVoluntaryContextSwitches: 38.90K (38901) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 327.175ms - OpenTime: 34.129ms - ExecTreeOpenTime: 45.865us - PrepareTime: 23.890ms - ExecTreePrepareTime: 325.100us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s149ms, non-child: 34s149ms, % non-child: 100.00%) - BytesSent: 479.63 MB (502926019) - NetworkThroughput(*): 279.18 MB/sec - OverallThroughput: 14.05 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 23.47M (23465800) - SerializeBatchTime: 32s423ms - TransmitDataRPCTime: 1s717ms - UncompressedRowBatchSize: 828.10 MB (868326276) CodeGen:(Total: 55.428ms, non-child: 55.428ms, % non-child: 100.00%) - CodegenTime: 1.475ms - CompileTime: 10.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.796ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.485ms HDFS_SCAN_NODE (id=1):(Total: 274.589ms, non-child: 274.589ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 1:3/760.18 MB 5:1/253.39 MB 4:2/506.79 MB 7:3/760.20 MB 0:1/253.40 MB 6:2/506.82 MB 3:2/506.82 MB 2:3/760.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(4s000ms): 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1023.25 MB, 1.09 GB, 1.15 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.23 GB, 1.31 GB, 1.31 GB, 1.35 GB, 1.45 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 5.768ms ; Min: 2.994ms ; Max: 7.649ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.16 - BytesRead: 1.47 GB (1576589528) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576589528) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576589528) - DecompressionTime: 9s058ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1195514684) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.519ms - RowBatchQueuePutWaitTime: 30m59s - RowsRead: 124.58M (124581157) - RowsReturned: 23.47M (23465800) - RowsReturnedRate: 85.46 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.85K (10851) - ScannerThreadsTotalWallClockTime: 31m21s - MaterializeTupleTime(*): 10s784ms - ScannerThreadsSysTime: 1s197ms - ScannerThreadsUserTime: 19s988ms - ScannerThreadsVoluntaryContextSwitches: 23.05K (23048) - TotalRawHdfsReadTime(*): 1s022ms - TotalReadThroughput: 8.13 MB/sec Instance ef4ccc78afa62d0c:3736f25300000009 (host=vb0224.halxg.cloudera.com:22000):(Total: 3m5s, non-child: 2m28s, % non-child: 79.90%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 1:1/253.41 MB 10:1/253.38 MB 9:1/253.40 MB 5:2/506.78 MB 0:2/506.77 MB 4:2/506.76 MB 8:2/506.78 MB 7:3/760.18 MB 6:2/481.03 MB 2:2/506.80 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.07 GB, 1.03 GB, 1005.17 MB, 961.74 MB, 925.45 MB, 893.19 MB, 872.86 MB, 853.88 MB, 820.74 MB, 783.54 MB, 734.82 MB, 699.24 MB, 648.91 MB, 619.56 MB, 596.27 MB, 638.50 MB, 648.12 MB, 660.02 MB, 714.06 MB, 707.20 MB, 672.46 MB, 712.06 MB, 755.47 MB, 745.66 MB, 766.86 MB, 715.31 MB, 694.77 MB, 659.78 MB, 624.04 MB, 590.89 MB, 561.88 MB, 519.42 MB, 479.54 MB, 462.19 MB, 441.81 MB, 420.42 MB, 377.46 MB, 343.45 MB, 307.88 MB, 264.73 MB, 252.05 MB, 163.13 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 11, 10, 10, 9, 9, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 11.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1186234556) - PerHostPeakMemUsage: 1.10 GB (1186234556) - RowsProduced: 25.26M (25256825) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 612.305ms - TotalThreadsInvoluntaryContextSwitches: 25.19K (25191) - TotalThreadsTotalWallClockTime: 35m - TotalThreadsSysTime: 1s903ms - TotalThreadsUserTime: 56s442ms - TotalThreadsVoluntaryContextSwitches: 42.06K (42061) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 346.209ms - OpenTime: 33.803ms - ExecTreeOpenTime: 56.042us - PrepareTime: 26.713ms - ExecTreePrepareTime: 308.849us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s889ms, non-child: 36s889ms, % non-child: 100.00%) - BytesSent: 516.24 MB (541321888) - NetworkThroughput(*): 294.47 MB/sec - OverallThroughput: 13.99 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.26M (25256825) - SerializeBatchTime: 35s127ms - TransmitDataRPCTime: 1s753ms - UncompressedRowBatchSize: 891.31 MB (934601201) CodeGen:(Total: 57.956ms, non-child: 57.956ms, % non-child: 100.00%) - CodegenTime: 1.418ms - CompileTime: 10.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.744ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.411ms HDFS_SCAN_NODE (id=1):(Total: 287.948ms, non-child: 287.948ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 1:1/253.41 MB 10:1/253.38 MB 9:1/253.40 MB 5:2/506.78 MB 0:2/506.77 MB 4:2/506.76 MB 8:2/506.78 MB 7:3/760.18 MB 6:2/481.03 MB 2:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 993.84 MB, 1014.72 MB, 1.07 GB, 1.13 GB, 1.19 GB, 1.29 GB, 1.30 GB, 1.30 GB, 1.37 GB, 1.44 GB, 1.47 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 6.285ms ; Min: 2.805ms ; Max: 8.871ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.36 - BytesRead: 1.54 GB (1655172689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1655172689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1655172689) - DecompressionTime: 9s414ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1185287825) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.238ms - RowBatchQueuePutWaitTime: 31m33s - RowsRead: 130.80M (130797981) - RowsReturned: 25.26M (25256825) - RowsReturnedRate: 87.71 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.96K (10958) - ScannerThreadsTotalWallClockTime: 31m55s - MaterializeTupleTime(*): 11s171ms - ScannerThreadsSysTime: 1s186ms - ScannerThreadsUserTime: 20s747ms - ScannerThreadsVoluntaryContextSwitches: 24.84K (24843) - TotalRawHdfsReadTime(*): 1s220ms - TotalReadThroughput: 8.53 MB/sec Instance ef4ccc78afa62d0c:3736f2530000000c (host=vb0220.halxg.cloudera.com:22000):(Total: 3m4s, non-child: 2m28s, % non-child: 80.48%) Hdfs split stats (:<# splits>/): 8:2/506.79 MB 5:2/506.80 MB 10:1/253.39 MB 9:2/506.77 MB 7:1/253.41 MB 2:3/732.64 MB 3:4/1013.58 MB 0:3/760.18 MB 1:1/253.41 MB MemoryUsage(4s000ms): 1.08 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.04 GB, 1.01 GB, 993.50 MB, 950.97 MB, 910.84 MB, 891.56 MB, 875.80 MB, 849.71 MB, 834.89 MB, 785.86 MB, 756.82 MB, 703.92 MB, 670.10 MB, 627.76 MB, 615.61 MB, 653.55 MB, 690.80 MB, 717.14 MB, 721.24 MB, 669.91 MB, 686.68 MB, 697.75 MB, 664.18 MB, 614.94 MB, 711.77 MB, 691.98 MB, 672.66 MB, 680.77 MB, 693.91 MB, 655.23 MB, 602.43 MB, 548.04 MB, 463.52 MB, 425.44 MB, 395.45 MB, 350.89 MB, 313.27 MB, 289.92 MB, 220.46 MB, 163.82 MB, 101.22 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 10, 10, 7, 7, 7, 7, 7, 7, 5, 4, 3 - AverageThreadTokens: 11.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1182532785) - PerHostPeakMemUsage: 1.10 GB (1182532785) - RowsProduced: 24.28M (24277670) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m29s - TotalStorageWaitTime: 626.031ms - TotalThreadsInvoluntaryContextSwitches: 25.39K (25389) - TotalThreadsTotalWallClockTime: 35m14s - TotalThreadsSysTime: 2s120ms - TotalThreadsUserTime: 55s712ms - TotalThreadsVoluntaryContextSwitches: 40.24K (40242) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 355.750ms - OpenTime: 33.610ms - ExecTreeOpenTime: 49.667us - PrepareTime: 27.628ms - ExecTreePrepareTime: 315.877us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s682ms, non-child: 35s682ms, % non-child: 100.00%) - BytesSent: 496.22 MB (520319489) - NetworkThroughput(*): 282.74 MB/sec - OverallThroughput: 13.91 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.28M (24277670) - SerializeBatchTime: 33s918ms - TransmitDataRPCTime: 1s755ms - UncompressedRowBatchSize: 856.75 MB (898368646) CodeGen:(Total: 58.643ms, non-child: 58.643ms, % non-child: 100.00%) - CodegenTime: 1.489ms - CompileTime: 10.251ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.595ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 25.222ms HDFS_SCAN_NODE (id=1):(Total: 299.793ms, non-child: 299.793ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.79 MB 5:2/506.80 MB 10:1/253.39 MB 9:2/506.77 MB 7:1/253.41 MB 2:3/732.64 MB 3:4/1013.58 MB 0:3/760.18 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.46% 1:0.271% 2:0% 3:0.271% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 986.43 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 993.34 MB, 1014.22 MB, 1.05 GB, 1.13 GB, 1.19 GB, 1.21 GB, 1.21 GB, 1.27 GB, 1.30 GB, 1.30 GB, 1.31 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.50 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 6.598ms ; Min: 2.874ms ; Max: 9.562ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.47 - BytesRead: 1.54 GB (1654662021) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1654662021) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1654662021) - DecompressionTime: 9s577ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1182118476) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.418ms - RowBatchQueuePutWaitTime: 31m47s - RowsRead: 130.75M (130748945) - RowsReturned: 24.28M (24277670) - RowsReturnedRate: 80.98 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.67K (11666) - ScannerThreadsTotalWallClockTime: 32m10s - MaterializeTupleTime(*): 11s617ms - ScannerThreadsSysTime: 1s290ms - ScannerThreadsUserTime: 21s265ms - ScannerThreadsVoluntaryContextSwitches: 23.86K (23864) - TotalRawHdfsReadTime(*): 1s069ms - TotalReadThroughput: 8.55 MB/sec Instance ef4ccc78afa62d0c:3736f25300000001 (host=vb0230.halxg.cloudera.com:22000):(Total: 3m3s, non-child: 2m27s, % non-child: 80.19%) Hdfs split stats (:<# splits>/): 9:1/253.41 MB 2:1/253.39 MB 5:2/506.78 MB 3:2/506.81 MB 6:1/253.38 MB 7:2/506.78 MB 4:2/506.81 MB 1:3/760.19 MB 0:5/1.24 GB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.06 GB, 1.02 GB, 1003.21 MB, 959.64 MB, 924.79 MB, 904.73 MB, 889.43 MB, 871.56 MB, 841.18 MB, 809.17 MB, 761.39 MB, 716.22 MB, 684.09 MB, 649.19 MB, 622.75 MB, 655.70 MB, 701.41 MB, 680.26 MB, 635.84 MB, 672.87 MB, 643.39 MB, 641.32 MB, 634.80 MB, 670.37 MB, 658.54 MB, 711.26 MB, 686.97 MB, 705.46 MB, 660.96 MB, 624.84 MB, 590.26 MB, 518.28 MB, 470.21 MB, 411.22 MB, 383.41 MB, 347.68 MB, 305.36 MB, 255.79 MB, 180.89 MB, 143.68 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 11, 10, 8, 7, 7, 7, 7, 6, 6, 4, 4 - AverageThreadTokens: 11.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1189256093) - PerHostPeakMemUsage: 1.11 GB (1189256093) - RowsProduced: 25.08M (25076265) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 575.695ms - TotalThreadsInvoluntaryContextSwitches: 21.17K (21170) - TotalThreadsTotalWallClockTime: 34m54s - TotalThreadsSysTime: 1s923ms - TotalThreadsUserTime: 55s441ms - TotalThreadsVoluntaryContextSwitches: 41.47K (41469) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 326.988ms - OpenTime: 32.750ms - ExecTreeOpenTime: 50.003us - PrepareTime: 25.402ms - ExecTreePrepareTime: 349.884us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s078ms, non-child: 36s078ms, % non-child: 100.00%) - BytesSent: 512.53 MB (537431466) - NetworkThroughput(*): 289.40 MB/sec - OverallThroughput: 14.21 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.08M (25076265) - SerializeBatchTime: 34s297ms - TransmitDataRPCTime: 1s771ms - UncompressedRowBatchSize: 884.93 MB (927919769) CodeGen:(Total: 55.577ms, non-child: 55.577ms, % non-child: 100.00%) - CodegenTime: 1.438ms - CompileTime: 9.705ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.247ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.081ms HDFS_SCAN_NODE (id=1):(Total: 270.702ms, non-child: 270.702ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.41 MB 2:1/253.39 MB 5:2/506.78 MB 3:2/506.81 MB 6:1/253.38 MB 7:2/506.78 MB 4:2/506.81 MB 1:3/760.19 MB 0:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1.06 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.21 GB, 1.22 GB, 1.26 GB, 1.31 GB, 1.38 GB, 1.39 GB, 1.47 GB, 1.48 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.194ms ; Min: 3.022ms ; Max: 6.954ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 1.55 GB (1664143238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664143238) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664143238) - DecompressionTime: 9s291ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1189209506) - PerReadThreadRawHdfsThroughput: 1.53 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.047ms - RowBatchQueuePutWaitTime: 31m28s - RowsRead: 131.50M (131502184) - RowsReturned: 25.08M (25076265) - RowsReturnedRate: 92.63 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.97K (6972) - ScannerThreadsTotalWallClockTime: 31m50s - MaterializeTupleTime(*): 11s058ms - ScannerThreadsSysTime: 1s179ms - ScannerThreadsUserTime: 20s696ms - ScannerThreadsVoluntaryContextSwitches: 24.66K (24656) - TotalRawHdfsReadTime(*): 1s012ms - TotalReadThroughput: 8.65 MB/sec Instance ef4ccc78afa62d0c:3736f2530000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 3m2s, non-child: 2m26s, % non-child: 80.44%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 4:2/506.76 MB 2:1/253.42 MB 10:2/445.01 MB 8:3/760.18 MB 3:1/187.22 MB 7:2/506.79 MB 5:4/1013.55 MB 0:3/760.18 MB MemoryUsage(4s000ms): 1.08 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.06 GB, 1.03 GB, 1.00 GB, 967.62 MB, 924.85 MB, 897.26 MB, 880.16 MB, 869.11 MB, 852.30 MB, 829.81 MB, 777.77 MB, 781.24 MB, 774.13 MB, 730.59 MB, 700.99 MB, 687.52 MB, 660.76 MB, 646.97 MB, 646.67 MB, 681.91 MB, 640.95 MB, 672.53 MB, 655.34 MB, 641.29 MB, 672.42 MB, 715.46 MB, 671.59 MB, 656.76 MB, 631.28 MB, 665.12 MB, 633.68 MB, 555.43 MB, 497.21 MB, 472.28 MB, 449.48 MB, 404.58 MB, 377.82 MB, 325.01 MB, 276.30 MB, 211.94 MB, 139.71 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 9, 8, 8, 8, 8, 8, 8, 6, 5, 4 - AverageThreadTokens: 11.57 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.09 GB (1172444283) - PerHostPeakMemUsage: 1.09 GB (1172444283) - RowsProduced: 24.20M (24199028) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 584.726ms - TotalThreadsInvoluntaryContextSwitches: 25.32K (25322) - TotalThreadsTotalWallClockTime: 35m12s - TotalThreadsSysTime: 2s004ms - TotalThreadsUserTime: 54s546ms - TotalThreadsVoluntaryContextSwitches: 40.12K (40115) Fragment Instance Lifecycle Timings: - ExecTime: 3m2s - ExecTreeExecTime: 348.999ms - OpenTime: 33.653ms - ExecTreeOpenTime: 50.756us - PrepareTime: 27.110ms - ExecTreePrepareTime: 346.077us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s360ms, non-child: 35s360ms, % non-child: 100.00%) - BytesSent: 494.62 MB (518648130) - NetworkThroughput(*): 279.08 MB/sec - OverallThroughput: 13.99 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.20M (24199028) - SerializeBatchTime: 33s578ms - TransmitDataRPCTime: 1s772ms - UncompressedRowBatchSize: 853.98 MB (895458584) CodeGen:(Total: 58.228ms, non-child: 58.228ms, % non-child: 100.00%) - CodegenTime: 1.423ms - CompileTime: 10.244ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.737ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.675ms HDFS_SCAN_NODE (id=1):(Total: 294.122ms, non-child: 294.122ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 4:2/506.76 MB 2:1/253.42 MB 10:2/445.01 MB 8:3/760.18 MB 3:1/187.22 MB 7:2/506.79 MB 5:4/1013.55 MB 0:3/760.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.5479% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 1.01 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.06 GB, 1.12 GB, 1.18 GB, 1.18 GB, 1.25 GB, 1.26 GB, 1.29 GB, 1.36 GB, 1.43 GB, 1.43 GB, 1.43 GB, 1.44 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB - FooterProcessingTime: (Avg: 5.839ms ; Min: 3.129ms ; Max: 9.196ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.57 - BytesRead: 1.51 GB (1619983151) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.51 GB (1619983151) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.51 GB (1619983151) - DecompressionTime: 9s291ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.09 GB (1172063856) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.487ms - RowBatchQueuePutWaitTime: 31m48s - RowsRead: 128.00M (128001189) - RowsReturned: 24.20M (24199028) - RowsReturnedRate: 82.28 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.68K (11681) - ScannerThreadsTotalWallClockTime: 32m9s - MaterializeTupleTime(*): 11s081ms - ScannerThreadsSysTime: 1s266ms - ScannerThreadsUserTime: 20s465ms - ScannerThreadsVoluntaryContextSwitches: 23.78K (23781) - TotalRawHdfsReadTime(*): 1s007ms - TotalReadThroughput: 8.47 MB/sec Instance ef4ccc78afa62d0c:3736f25300000008 (host=vb0232.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m24s, % non-child: 79.53%) Hdfs split stats (:<# splits>/): 6:2/506.80 MB 9:3/760.17 MB 7:1/253.39 MB 8:5/1.24 GB 1:2/260.77 MB 5:3/760.18 MB 4:1/253.40 MB 2:1/253.40 MB 0:1/253.38 MB MemoryUsage(4s000ms): 1.08 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1.01 GB, 989.17 MB, 958.41 MB, 937.97 MB, 911.38 MB, 883.40 MB, 856.59 MB, 820.90 MB, 787.88 MB, 754.62 MB, 721.72 MB, 679.17 MB, 637.49 MB, 625.20 MB, 575.14 MB, 593.71 MB, 640.56 MB, 627.24 MB, 659.35 MB, 638.77 MB, 639.90 MB, 655.41 MB, 720.40 MB, 701.60 MB, 674.67 MB, 640.94 MB, 610.99 MB, 544.85 MB, 490.35 MB, 464.26 MB, 433.89 MB, 396.00 MB, 356.20 MB, 316.28 MB, 278.49 MB, 232.74 MB, 203.83 MB, 143.14 MB, 110.99 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 11, 11, 10, 9, 8, 8, 7, 7, 7, 6, 6, 5, 5, 4, 4 - AverageThreadTokens: 11.02 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188624425) - PerHostPeakMemUsage: 1.11 GB (1188624425) - RowsProduced: 24.90M (24904227) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m25s - TotalStorageWaitTime: 567.294ms - TotalThreadsInvoluntaryContextSwitches: 24.75K (24753) - TotalThreadsTotalWallClockTime: 33m23s - TotalThreadsSysTime: 1s830ms - TotalThreadsUserTime: 55s764ms - TotalThreadsVoluntaryContextSwitches: 41.03K (41028) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 366.910ms - OpenTime: 34.320ms - ExecTreeOpenTime: 54.622us - PrepareTime: 23.428ms - ExecTreePrepareTime: 265.105us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s866ms, non-child: 36s866ms, % non-child: 100.00%) - BytesSent: 509.00 MB (533725492) - NetworkThroughput(*): 270.62 MB/sec - OverallThroughput: 13.81 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.90M (24904227) - SerializeBatchTime: 34s976ms - TransmitDataRPCTime: 1s880ms - UncompressedRowBatchSize: 878.86 MB (921553699) CodeGen:(Total: 55.279ms, non-child: 55.279ms, % non-child: 100.00%) - CodegenTime: 1.452ms - CompileTime: 10.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.933ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.165ms HDFS_SCAN_NODE (id=1):(Total: 307.597ms, non-child: 307.597ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/506.80 MB 9:3/760.17 MB 7:1/253.39 MB 8:5/1.24 GB 1:2/260.77 MB 5:3/760.18 MB 4:1/253.40 MB 2:1/253.40 MB 0:1/253.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.2747% 2:0% 3:0.2747% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 988.87 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1.06 GB, 1.14 GB, 1.16 GB, 1.23 GB, 1.23 GB, 1.28 GB, 1.35 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 6.361ms ; Min: 2.921ms ; Max: 18.966ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.02 - BytesRead: 1.47 GB (1579317980) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1579317980) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1579317980) - DecompressionTime: 9s068ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188353504) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.055ms - RowBatchQueuePutWaitTime: 30m - RowsRead: 124.77M (124770123) - RowsReturned: 24.90M (24904227) - RowsReturnedRate: 80.96 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.94K (10937) - ScannerThreadsTotalWallClockTime: 30m21s - MaterializeTupleTime(*): 10s845ms - ScannerThreadsSysTime: 1s137ms - ScannerThreadsUserTime: 20s227ms - ScannerThreadsVoluntaryContextSwitches: 24.47K (24467) - TotalRawHdfsReadTime(*): 978.417ms - TotalReadThroughput: 8.28 MB/sec Instance ef4ccc78afa62d0c:3736f2530000000e (host=vb0206.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m25s, % non-child: 80.36%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 9:3/760.18 MB 6:2/506.81 MB 7:1/253.39 MB 5:2/506.80 MB 4:3/760.17 MB 1:2/506.77 MB 0:3/760.20 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.07 GB, 1.05 GB, 1007.63 MB, 955.34 MB, 922.22 MB, 911.14 MB, 904.10 MB, 893.77 MB, 856.55 MB, 818.43 MB, 772.41 MB, 725.60 MB, 696.15 MB, 671.60 MB, 640.91 MB, 623.57 MB, 685.85 MB, 687.84 MB, 651.93 MB, 696.90 MB, 656.71 MB, 610.32 MB, 583.59 MB, 562.64 MB, 512.20 MB, 654.11 MB, 670.46 MB, 655.67 MB, 612.49 MB, 543.66 MB, 474.77 MB, 411.44 MB, 384.82 MB, 344.96 MB, 308.54 MB, 255.69 MB, 229.71 MB, 198.44 MB, 147.81 MB, 97.61 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 9, 7, 7, 6, 6, 6, 5, 5, 5, 4, 3 - AverageThreadTokens: 11.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1186390691) - PerHostPeakMemUsage: 1.10 GB (1186390691) - RowsProduced: 24.21M (24210513) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 618.931ms - TotalThreadsInvoluntaryContextSwitches: 24.32K (24318) - TotalThreadsTotalWallClockTime: 33m44s - TotalThreadsSysTime: 1s998ms - TotalThreadsUserTime: 53s805ms - TotalThreadsVoluntaryContextSwitches: 39.98K (39982) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 331.134ms - OpenTime: 33.079ms - ExecTreeOpenTime: 44.519us - PrepareTime: 29.471ms - ExecTreePrepareTime: 298.092us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s267ms, non-child: 35s267ms, % non-child: 100.00%) - BytesSent: 494.84 MB (518880607) - NetworkThroughput(*): 288.93 MB/sec - OverallThroughput: 14.03 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.21M (24210513) - SerializeBatchTime: 33s545ms - TransmitDataRPCTime: 1s712ms - UncompressedRowBatchSize: 854.38 MB (895883569) CodeGen:(Total: 60.188ms, non-child: 60.188ms, % non-child: 100.00%) - CodegenTime: 1.388ms - CompileTime: 9.700ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.634ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 27.310ms HDFS_SCAN_NODE (id=1):(Total: 278.548ms, non-child: 278.548ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 9:3/760.18 MB 6:2/506.81 MB 7:1/253.39 MB 5:2/506.80 MB 4:3/760.17 MB 1:2/506.77 MB 0:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(4s000ms): 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1002.32 MB, 1.09 GB, 1.14 GB, 1.14 GB, 1.21 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.24 GB, 1.43 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 6.314ms ; Min: 3.086ms ; Max: 8.691ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.18 - BytesRead: 1.47 GB (1576537765) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576537765) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576537765) - DecompressionTime: 9s011ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1186210976) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.964ms - RowBatchQueuePutWaitTime: 30m21s - RowsRead: 124.58M (124580613) - RowsReturned: 24.21M (24210513) - RowsReturnedRate: 86.92 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.82K (10824) - ScannerThreadsTotalWallClockTime: 30m43s - MaterializeTupleTime(*): 10s799ms - ScannerThreadsSysTime: 1s276ms - ScannerThreadsUserTime: 19s787ms - ScannerThreadsVoluntaryContextSwitches: 23.81K (23807) - TotalRawHdfsReadTime(*): 979.730ms - TotalReadThroughput: 8.31 MB/sec Instance ef4ccc78afa62d0c:3736f25300000007 (host=vb0234.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m26s, % non-child: 80.97%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:2/506.77 MB 1:1/253.39 MB 7:3/760.20 MB 6:3/760.17 MB 3:3/760.18 MB 2:2/258.65 MB 0:2/506.79 MB MemoryUsage(4s000ms): 1.04 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.04 GB, 1001.58 MB, 964.10 MB, 934.20 MB, 915.24 MB, 906.76 MB, 891.98 MB, 856.25 MB, 814.52 MB, 775.74 MB, 741.80 MB, 710.81 MB, 678.20 MB, 651.39 MB, 621.58 MB, 655.16 MB, 686.49 MB, 655.69 MB, 631.76 MB, 598.86 MB, 616.98 MB, 593.81 MB, 566.47 MB, 637.15 MB, 673.98 MB, 668.64 MB, 638.89 MB, 600.90 MB, 567.56 MB, 504.12 MB, 448.06 MB, 403.81 MB, 370.94 MB, 318.71 MB, 268.00 MB, 217.27 MB, 177.04 MB, 122.96 MB, 79.60 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 11, 10, 10, 8, 7, 7, 7, 6, 5, 4, 4, 3, 2 - AverageThreadTokens: 11.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188584243) - PerHostPeakMemUsage: 1.11 GB (1188584243) - RowsProduced: 23.36M (23361849) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 626.845ms - TotalThreadsInvoluntaryContextSwitches: 24.48K (24485) - TotalThreadsTotalWallClockTime: 33m33s - TotalThreadsSysTime: 2s018ms - TotalThreadsUserTime: 52s618ms - TotalThreadsVoluntaryContextSwitches: 38.94K (38944) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 342.926ms - OpenTime: 33.751ms - ExecTreeOpenTime: 48.319us - PrepareTime: 23.505ms - ExecTreePrepareTime: 324.786us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s114ms, non-child: 34s114ms, % non-child: 100.00%) - BytesSent: 477.51 MB (500701167) - NetworkThroughput(*): 281.92 MB/sec - OverallThroughput: 14.00 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 23.36M (23361849) - SerializeBatchTime: 32s411ms - TransmitDataRPCTime: 1s693ms - UncompressedRowBatchSize: 824.43 MB (864479689) CodeGen:(Total: 54.626ms, non-child: 54.626ms, % non-child: 100.00%) - CodegenTime: 1.490ms - CompileTime: 10.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.757ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.070ms HDFS_SCAN_NODE (id=1):(Total: 288.465ms, non-child: 288.465ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:2/506.77 MB 1:1/253.39 MB 7:3/760.20 MB 6:3/760.17 MB 3:3/760.18 MB 2:2/258.65 MB 0:2/506.79 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.17% 1:0.5525% 2:0.2762% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 947.45 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1004.31 MB, 1.06 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.22 GB, 1.23 GB, 1.24 GB, 1.35 GB, 1.43 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 6.180ms ; Min: 2.885ms ; Max: 9.130ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.12 - BytesRead: 1.47 GB (1578597766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1578597766) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1578597766) - DecompressionTime: 9s009ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188404528) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.391ms - RowBatchQueuePutWaitTime: 30m10s - RowsRead: 124.71M (124712354) - RowsReturned: 23.36M (23361849) - RowsReturnedRate: 80.99 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.17K (11174) - ScannerThreadsTotalWallClockTime: 30m32s - MaterializeTupleTime(*): 10s743ms - ScannerThreadsSysTime: 1s269ms - ScannerThreadsUserTime: 19s748ms - ScannerThreadsVoluntaryContextSwitches: 22.96K (22957) - TotalRawHdfsReadTime(*): 1s086ms - TotalReadThroughput: 8.32 MB/sec Instance ef4ccc78afa62d0c:3736f2530000000b (host=vb0222.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m23s, % non-child: 79.80%) Hdfs split stats (:<# splits>/): 6:1/253.38 MB 3:3/514.23 MB 10:1/253.41 MB 4:3/760.21 MB 9:1/253.37 MB 8:2/506.80 MB 7:2/506.80 MB 5:2/506.79 MB 1:1/253.40 MB 2:3/760.16 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.06 GB, 1.02 GB, 978.43 MB, 929.29 MB, 908.49 MB, 899.51 MB, 881.25 MB, 862.25 MB, 820.27 MB, 764.94 MB, 721.89 MB, 686.33 MB, 654.94 MB, 679.60 MB, 684.20 MB, 709.48 MB, 689.14 MB, 651.69 MB, 645.99 MB, 643.75 MB, 610.49 MB, 572.63 MB, 611.51 MB, 573.94 MB, 610.25 MB, 649.43 MB, 651.30 MB, 614.29 MB, 540.40 MB, 474.92 MB, 436.95 MB, 380.51 MB, 359.74 MB, 335.15 MB, 288.74 MB, 263.42 MB, 220.58 MB, 176.37 MB, 120.94 MB, 68.04 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 12, 9, 7, 6, 6, 6, 6, 6, 6, 5, 4, 3, 2 - AverageThreadTokens: 11.05 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188856679) - PerHostPeakMemUsage: 1.11 GB (1188856679) - RowsProduced: 24.52M (24523519) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m24s - TotalStorageWaitTime: 582.145ms - TotalThreadsInvoluntaryContextSwitches: 25.63K (25631) - TotalThreadsTotalWallClockTime: 33m10s - TotalThreadsSysTime: 1s996ms - TotalThreadsUserTime: 55s195ms - TotalThreadsVoluntaryContextSwitches: 40.51K (40509) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 347.695ms - OpenTime: 32.605ms - ExecTreeOpenTime: 40.153us - PrepareTime: 25.715ms - ExecTreePrepareTime: 349.587us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s090ms, non-child: 36s090ms, % non-child: 100.00%) - BytesSent: 501.25 MB (525595582) - NetworkThroughput(*): 273.70 MB/sec - OverallThroughput: 13.89 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.52M (24523519) - SerializeBatchTime: 34s249ms - TransmitDataRPCTime: 1s831ms - UncompressedRowBatchSize: 865.43 MB (907466011) CodeGen:(Total: 55.944ms, non-child: 55.944ms, % non-child: 100.00%) - CodegenTime: 1.240ms - CompileTime: 9.568ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.251ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.612ms HDFS_SCAN_NODE (id=1):(Total: 290.364ms, non-child: 290.364ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.38 MB 3:3/514.23 MB 10:1/253.41 MB 4:3/760.21 MB 9:1/253.37 MB 8:2/506.80 MB 7:2/506.80 MB 5:2/506.79 MB 1:1/253.40 MB 2:3/760.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0.2778% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1.03 GB, 1.06 GB, 1.13 GB, 1.14 GB, 1.14 GB, 1.19 GB, 1.23 GB, 1.23 GB, 1.23 GB, 1.30 GB, 1.31 GB, 1.37 GB, 1.44 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 6.601ms ; Min: 2.384ms ; Max: 21.252ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.05 - BytesRead: 1.47 GB (1579318713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1579318713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1579318713) - DecompressionTime: 9s188ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188810092) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.387ms - RowBatchQueuePutWaitTime: 29m48s - RowsRead: 124.77M (124773003) - RowsReturned: 24.52M (24523519) - RowsReturnedRate: 84.46 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.95K (11945) - ScannerThreadsTotalWallClockTime: 30m10s - MaterializeTupleTime(*): 11s071ms - ScannerThreadsSysTime: 1s228ms - ScannerThreadsUserTime: 20s397ms - ScannerThreadsVoluntaryContextSwitches: 24.16K (24158) - TotalRawHdfsReadTime(*): 1s067ms - TotalReadThroughput: 8.37 MB/sec Instance ef4ccc78afa62d0c:3736f2530000000d (host=vb0208.halxg.cloudera.com:22000):(Total: 2m59s, non-child: 2m24s, % non-child: 80.47%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 7:1/234.34 MB 5:2/506.78 MB 4:3/760.21 MB 8:3/760.15 MB 1:2/506.82 MB 3:1/253.41 MB 2:4/1013.57 MB 0:2/506.80 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.03 GB, 994.87 MB, 956.61 MB, 927.93 MB, 910.92 MB, 878.75 MB, 858.30 MB, 827.90 MB, 790.41 MB, 750.81 MB, 722.89 MB, 672.17 MB, 643.73 MB, 588.64 MB, 563.56 MB, 523.70 MB, 601.58 MB, 641.07 MB, 627.61 MB, 629.65 MB, 720.47 MB, 741.53 MB, 749.30 MB, 758.88 MB, 686.47 MB, 673.72 MB, 661.62 MB, 623.62 MB, 576.12 MB, 516.37 MB, 477.26 MB, 450.84 MB, 426.85 MB, 385.01 MB, 320.64 MB, 263.66 MB, 236.88 MB, 180.53 MB, 112.09 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 11, 11, 10, 9, 8, 8, 8, 8, 7, 7, 6, 6, 4, 3 - AverageThreadTokens: 11.09 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1184170053) - PerHostPeakMemUsage: 1.10 GB (1184170053) - RowsProduced: 24.00M (24004509) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m25s - TotalStorageWaitTime: 655.620ms - TotalThreadsInvoluntaryContextSwitches: 25.04K (25042) - TotalThreadsTotalWallClockTime: 33m12s - TotalThreadsSysTime: 2s166ms - TotalThreadsUserTime: 54s196ms - TotalThreadsVoluntaryContextSwitches: 39.63K (39635) Fragment Instance Lifecycle Timings: - ExecTime: 2m59s - ExecTreeExecTime: 338.001ms - OpenTime: 34.184ms - ExecTreeOpenTime: 50.893us - PrepareTime: 26.073ms - ExecTreePrepareTime: 337.052us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s740ms, non-child: 34s740ms, % non-child: 100.00%) - BytesSent: 490.64 MB (514476323) - NetworkThroughput(*): 288.37 MB/sec - OverallThroughput: 14.12 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.00M (24004509) - SerializeBatchTime: 33s029ms - TransmitDataRPCTime: 1s701ms - UncompressedRowBatchSize: 847.11 MB (888260613) CodeGen:(Total: 57.627ms, non-child: 57.627ms, % non-child: 100.00%) - CodegenTime: 1.469ms - CompileTime: 10.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 23.184ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.639ms HDFS_SCAN_NODE (id=1):(Total: 282.379ms, non-child: 282.379ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 7:1/234.34 MB 5:2/506.78 MB 4:3/760.21 MB 8:3/760.15 MB 1:2/506.82 MB 3:1/253.41 MB 2:4/1013.57 MB 0:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 996.06 MB, 1.14 GB, 1.22 GB, 1.22 GB, 1.26 GB, 1.38 GB, 1.42 GB, 1.46 GB, 1.53 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 5.200ms ; Min: 2.704ms ; Max: 8.290ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.09 - BytesRead: 1.54 GB (1657536250) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1657536250) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1657536250) - DecompressionTime: 9s475ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1183924884) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.594ms - RowBatchQueuePutWaitTime: 29m51s - RowsRead: 130.98M (130980854) - RowsReturned: 24.00M (24004509) - RowsReturnedRate: 85.01 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.33K (11331) - ScannerThreadsTotalWallClockTime: 30m13s - MaterializeTupleTime(*): 11s277ms - ScannerThreadsSysTime: 1s351ms - ScannerThreadsUserTime: 20s738ms - ScannerThreadsVoluntaryContextSwitches: 23.59K (23592) - TotalRawHdfsReadTime(*): 1s128ms - TotalReadThroughput: 8.81 MB/sec ================================================================================ ================================================================================ SUMMARY: +-----------------+--------+----------+---------+----------+---------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +-----------------+--------+----------+---------+----------+---------+-----------+ | 06:AGGREGATE | 1 | 192.55us | 0ns | 192.55us | 1 | 1 | | 05:EXCHANGE | 1 | 15.56us | 0ns | 15.56us | 1 | 1 | | 03:AGGREGATE | 1 | 2.18ms | 0ns | 2.18ms | 1 | 1 | | 02:HASH JOIN | 1 | 95.22s | 0ns | 95.22s | 0 | 3 | | |--04:EXCHANGE | 1 | 112.52s | 0ns | 112.52s | 350.01M | 180.00M | | | 01:SCAN HDFS | 14 | 306.07ms | 0ns | 341.66ms | 350.01M | 180.00M | | 00:SCAN HDFS | 1 | 7.71ms | 0ns | 7.71ms | 0 | 3 | +-----------------+--------+----------+---------+----------+---------+-----------+ PROFILE: Query (id=aa4a715d244baecb:2bb62d6f00000000): Summary: Session ID: 14bfecb126bd3cd:b4c6c4bc85ca35a2 Session Type: BEESWAX Start Time: 2017-02-19 07:52:45.999297000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 9873c749fd7f33af9861000d458b87f91ef35b78) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:42388 Default Db: tpch_300_parquet Sql Statement: -- Description : Large broadcast join with no rows qualifying from the probe side. -- Target test case : Broadcast large amounts of data over the network while stressing the -- exchange operator along with HashTable build. SELECT /* +straight_join */ count(*) FROM nation JOIN /* +broadcast */ lineitem ON l_orderkey = n_nationkey WHERE l_partkey > 0 AND l_suppkey > 0 AND l_linenumber > 0 AND n_regionkey < 0 AND l_orderkey < 350000000 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=6.24GB VCores=2 PLAN-ROOT SINK | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | hosts=1 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=1 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: n_nationkey = l_orderkey | runtime filters: RF000 <- l_orderkey | hosts=1 per-host-mem=5.90GB | tuple-ids=0,1 row-size=48B cardinality=3 | |--04:EXCHANGE [BROADCAST] | | hosts=14 per-host-mem=0B | | tuple-ids=1 row-size=32B cardinality=179998909 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_linenumber > 0, l_orderkey < 350000000, l_partkey > 0, l_suppkey > 0 | table stats: 1799989091 rows total | column stats: all | hosts=14 per-host-mem=352.00MB | tuple-ids=1 row-size=32B cardinality=179998909 | 00:SCAN HDFS [tpch_300_parquet.nation, RANDOM] partitions=1/1 files=1 size=2.19KB predicates: n_regionkey < 0, tpch_300_parquet.nation.n_nationkey < 350000000 runtime filters: RF000 -> n_nationkey table stats: 25 rows total column stats: all hosts=1 per-host-mem=32.00MB tuple-ids=0 row-size=16B cardinality=3 ---------------- Estimated Per-Host Mem: 6705060455 Estimated Per-Host VCores: 2 Request Pool: root.jenkins Admission result: Admitted immediately Planner Timeline: 5.891ms - Analysis finished: 1.849ms (1.849ms) - Equivalence classes computed: 1.967ms (117.164us) - Single node plan created: 3.319ms (1.352ms) - Runtime filters computed: 3.433ms (113.808us) - Distributed plan created: 3.668ms (235.114us) - Lineage info computed: 3.797ms (129.348us) - Planning finished: 5.891ms (2.093ms) Query Timeline: 3m32s - Query submitted: 44.764us (44.764us) - Planning finished: 8.347ms (8.303ms) - Submit for admission: 9.564ms (1.216ms) - Completed admission: 9.690ms (126.184us) - Ready to start 16 fragment instances: 9.974ms (283.997us) - All 16 fragment instances started: 874.978ms (865.004ms) - Rows available: 3m32s (3m31s) - First row fetched: 3m32s (51.817ms) - ComputeScanRangeAssignmentTimer: 557.251us ImpalaServer: - ClientFetchWaitTimer: 51.829ms - RowMaterializationTimer: 5.227ms Execution Profile aa4a715d244baecb:2bb62d6f00000000:(Total: 3m32s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 2 0 1 LOCAL false 0 (1) N/A N/A true Fragment instance start latencies: Count: 16, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 166ms, 99.9th %-ile: 864ms Per Node Peak Memory Usage: vb0206.halxg.cloudera.com:22000(1.11 GB) vb0220.halxg.cloudera.com:22000(1.10 GB) vb0228.halxg.cloudera.com:22000(1.09 GB) vb0222.halxg.cloudera.com:22000(1.11 GB) vb0224.halxg.cloudera.com:22000(1.11 GB) vb0232.halxg.cloudera.com:22000(1.11 GB) vb0234.halxg.cloudera.com:22000(1.11 GB) vb0218.halxg.cloudera.com:22000(1.10 GB) vb0214.halxg.cloudera.com:22000(26.43 GB) vb0212.halxg.cloudera.com:22000(1.11 GB) vb0216.halxg.cloudera.com:22000(1.11 GB) vb0208.halxg.cloudera.com:22000(1.10 GB) vb0230.halxg.cloudera.com:22000(1.11 GB) vb0204.halxg.cloudera.com:22000(1.10 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F02: Instance aa4a715d244baecb:2bb62d6f00000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 3m32s, non-child: 52.390ms, % non-child: 0.02%) MemoryUsage(4s000ms): 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB, 16.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.01 KB (28680) - PerHostPeakMemUsage: 1.10 GB (1183702743) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 3m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3m32s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.000ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 51.936ms - ExecTreeExecTime: 6.519us - OpenTime: 3m32s - ExecTreeOpenTime: 3m32s - PrepareTime: 20.966ms - ExecTreePrepareTime: 77.284us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 20.669ms, non-child: 20.669ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.135ms AGGREGATION_NODE (id=6):(Total: 3m32s, non-child: 192.549us, % non-child: 0.00%) - BuildTime: 8.374us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 20.00 KB (20480) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=5):(Total: 3m32s, non-child: 15.556us, % non-child: 0.00%) BytesReceived(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.751us - DeserializeRowBatchTimer: 8.447us - FirstBatchArrivalWaitTime: 3m32s - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3m31s, non-child: 250.846ms, % non-child: 0.12%) split sizes: min: 2.19 KB, max: 2.19 KB, avg: 2.19 KB, stddev: 0 completion times: min:3m32s max:3m32s mean: 3m32s stddev:0.000ns execution rates: min:10.00 B/sec max:10.00 B/sec mean:10.00 B/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 26.43 GB (28380916821) - PerHostPeakMemUsage: 26.43 GB (28380916821) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1m42s - TotalNetworkSendTime: 457.402us - TotalStorageWaitTime: 6.363ms - TotalThreadsInvoluntaryContextSwitches: 24.50K (24504) - TotalThreadsTotalWallClockTime: 7m2s - TotalThreadsSysTime: 13s940ms - TotalThreadsUserTime: 1m40s - TotalThreadsVoluntaryContextSwitches: 341.31K (341306) Fragment Instance Lifecycle Timings: - ExecTime: 818.848us - ExecTreeExecTime: 4.243us - OpenTime: 3m31s - ExecTreeOpenTime: 3m31s - PrepareTime: 469.517ms - ExecTreePrepareTime: 394.804us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 2.42K (2419) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 26.40 GB (28345106432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 194.757ms, non-child: 194.757ms, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 439.64 KB/sec - OverallThroughput: 82.00 B/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.873us - TransmitDataRPCTime: 35.540us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 341.910ms, non-child: 341.910ms, % non-child: 100.00%) - CodegenTime: 1.662ms - CompileTime: 84.429ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 90 (90) - NumInstructions: 2.93K (2928) - OptimizationTime: 232.196ms - PeakMemoryUsage: 1.43 MB (1499136) - PrepareTime: 24.748ms AGGREGATION_NODE (id=3):(Total: 3m31s, non-child: 2.179ms, % non-child: 0.00%) - BuildTime: 2.153ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 3m31s, non-child: 1m35s, % non-child: 45.09%) - BuildRows: 350.01M (350008706) - BuildTime: 1m33s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 26.42 GB (28364049664) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.397us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 1m15s - BuildRowsPartitioned: 350.01M (350008706) - GetNewBlockTime: 18.017ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 17s898ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.42 GB (28364002432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=4):(Total: 1m55s, non-child: 1m55s, % non-child: 100.00%) - BytesReceived: 6.99 GB (7501460242) - ConvertRowBatchTime: 12s562ms - DeserializeRowBatchTimer: 2m52s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 350.01M (350008706) - RowsReturnedRate: 3.02 M/sec - SendersBlockedTimer: 2m53s - SendersBlockedTotalTimer(*): 34m18s HDFS_SCAN_NODE (id=0):(Total: 7.705ms, non-child: 7.705ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 KB (2497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 KB (2497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 KB (2497) - DecompressionTime: 7.447us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 73.00 KB (74752) - PerReadThreadRawHdfsThroughput: 53.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.813ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 25 (25) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 6.847ms - MaterializeTupleTime(*): 31.003us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 44.221us - TotalReadThroughput: 0.00 /sec Filter 0 (16.00 MB): - Rows processed: 25 (25) - Rows rejected: 0 (0) - Rows total: 25 (25) Fragment F00: Instance aa4a715d244baecb:2bb62d6f0000000f (host=vb0214.halxg.cloudera.com:22000):(Total: 3m31s, non-child: 250.846ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 6:1/2.19 KB Filter 0 arrival: 3m13s MemoryUsage(4s000ms): 146.91 MB, 380.24 MB, 620.24 MB, 860.24 MB, 1.05 GB, 1.29 GB, 1.51 GB, 1.75 GB, 1.98 GB, 2.20 GB, 2.42 GB, 2.65 GB, 2.86 GB, 3.09 GB, 3.31 GB, 3.53 GB, 3.76 GB, 3.98 GB, 4.21 GB, 4.43 GB, 4.67 GB, 4.89 GB, 5.11 GB, 5.34 GB, 5.56 GB, 5.78 GB, 6.00 GB, 6.23 GB, 6.45 GB, 6.67 GB, 6.88 GB, 7.11 GB, 7.33 GB, 7.55 GB, 7.76 GB, 8.01 GB, 8.23 GB, 8.46 GB, 8.68 GB, 8.90 GB, 9.12 GB, 9.36 GB, 9.57 GB, 9.80 GB, 10.02 GB, 10.24 GB, 10.48 GB, 10.67 GB, 11.25 GB, 14.28 GB, 17.83 GB, 21.38 GB, 24.84 GB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 16.00 MB (16777216) - PeakMemoryUsage: 26.43 GB (28380916821) - PerHostPeakMemUsage: 26.43 GB (28380916821) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1m42s - TotalNetworkSendTime: 457.402us - TotalStorageWaitTime: 6.363ms - TotalThreadsInvoluntaryContextSwitches: 24.50K (24504) - TotalThreadsTotalWallClockTime: 7m2s - TotalThreadsSysTime: 13s940ms - TotalThreadsUserTime: 1m40s - TotalThreadsVoluntaryContextSwitches: 341.31K (341306) Fragment Instance Lifecycle Timings: - ExecTime: 818.848us - ExecTreeExecTime: 4.243us - OpenTime: 3m31s - ExecTreeOpenTime: 3m31s - PrepareTime: 469.517ms - ExecTreePrepareTime: 394.804us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 2.42K (2419) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 26.40 GB (28345106432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=5):(Total: 194.757ms, non-child: 194.757ms, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 439.64 KB/sec - OverallThroughput: 82.00 B/sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 11.873us - TransmitDataRPCTime: 35.540us - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 341.910ms, non-child: 341.910ms, % non-child: 100.00%) - CodegenTime: 1.662ms - CompileTime: 84.429ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 90 (90) - NumInstructions: 2.93K (2928) - OptimizationTime: 232.196ms - PeakMemoryUsage: 1.43 MB (1499136) - PrepareTime: 24.748ms AGGREGATION_NODE (id=3):(Total: 3m31s, non-child: 2.179ms, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 2.153ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=2):(Total: 3m31s, non-child: 1m35s, % non-child: 45.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 350.01M (350008706) - BuildTime: 1m33s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 26.42 GB (28364049664) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.397us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 1m15s - BuildRowsPartitioned: 350.01M (350008706) - GetNewBlockTime: 18.017ms - HashBuckets: 536.87M (536870912) - HashCollisions: 0 (0) - HashTablesBuildTime: 17s898ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 26.42 GB (28364002432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=4):(Total: 1m55s, non-child: 1m52s, % non-child: 97.05%) BytesReceived(4s000ms): 50.46 MB, 196.91 MB, 346.98 MB, 496.56 MB, 644.94 MB, 802.66 MB, 957.18 MB, 1.08 GB, 1.23 GB, 1.38 GB, 1.52 GB, 1.67 GB, 1.81 GB, 1.95 GB, 2.10 GB, 2.24 GB, 2.39 GB, 2.53 GB, 2.68 GB, 2.82 GB, 2.97 GB, 3.12 GB, 3.26 GB, 3.41 GB, 3.56 GB, 3.70 GB, 3.85 GB, 3.99 GB, 4.13 GB, 4.28 GB, 4.42 GB, 4.56 GB, 4.71 GB, 4.85 GB, 4.99 GB, 5.14 GB, 5.29 GB, 5.44 GB, 5.58 GB, 5.73 GB, 5.88 GB, 6.02 GB, 6.16 GB, 6.31 GB, 6.46 GB, 6.60 GB, 6.75 GB, 6.87 GB, 6.97 GB, 6.99 GB, 6.99 GB, 6.99 GB, 6.99 GB - BytesReceived: 6.99 GB (7501460242) - ConvertRowBatchTime: 12s562ms - DeserializeRowBatchTimer: 2m52s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 350.01M (350008706) - RowsReturnedRate: 3.02 M/sec - SendersBlockedTimer: 2m53s - SendersBlockedTotalTimer(*): 34m18s HDFS_SCAN_NODE (id=0):(Total: 7.705ms, non-child: 7.705ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/2.19 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 BytesRead(4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FooterProcessingTime: (Avg: 4.102ms ; Min: 4.102ms ; Max: 4.102ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.44 KB (2497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 KB (2497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 KB (2497) - DecompressionTime: 7.447us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 73.00 KB (74752) - PerReadThreadRawHdfsThroughput: 53.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.813ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 25 (25) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 6.847ms - MaterializeTupleTime(*): 31.003us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsReadTime(*): 44.221us - TotalReadThroughput: 0.00 /sec Filter 0 (16.00 MB): - Rows processed: 25 (25) - Rows rejected: 0 (0) - Rows total: 25 (25) Averaged Fragment F01:(Total: 3m3s, non-child: 2m27s, % non-child: 80.00%) split sizes: min: 4.45 GB, max: 4.70 GB, avg: 4.60 GB, stddev: 110.56 MB completion times: min:2m58s max:3m13s mean: 3m3s stddev:3s699ms execution rates: min:24.58 MB/sec max:26.51 MB/sec mean:25.59 MB/sec stddev:568.87 KB/sec num instances: 14 - AverageThreadTokens: 11.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1184425697) - PerHostPeakMemUsage: 1.83 GB (1969926981) - RowsProduced: 25.00M (25000621) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 609.951ms - TotalThreadsInvoluntaryContextSwitches: 24.16K (24160) - TotalThreadsTotalWallClockTime: 35m26s - TotalThreadsSysTime: 1s977ms - TotalThreadsUserTime: 55s758ms - TotalThreadsVoluntaryContextSwitches: 41.06K (41062) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 362.294ms - OpenTime: 33.676ms - ExecTreeOpenTime: 48.683us - PrepareTime: 25.383ms - ExecTreePrepareTime: 325.541us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s434ms, non-child: 36s434ms, % non-child: 100.00%) - BytesSent: 511.00 MB (535818588) - NetworkThroughput(*): 279.43 MB/sec - OverallThroughput: 14.05 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.00M (25000621) - SerializeBatchTime: 34s588ms - TransmitDataRPCTime: 1s836ms - UncompressedRowBatchSize: 882.26 MB (925120683) CodeGen:(Total: 56.518ms, non-child: 56.518ms, % non-child: 100.00%) - CodegenTime: 1.413ms - CompileTime: 10.089ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.789ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.086ms HDFS_SCAN_NODE (id=1):(Total: 306.071ms, non-child: 306.071ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.56 - BytesRead: 1.52 GB (1627133960) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.52 GB (1627133960) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.52 GB (1627133960) - DecompressionTime: 9s333ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1184165566) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.411ms - RowBatchQueuePutWaitTime: 32m - RowsRead: 128.57M (128570649) - RowsReturned: 25.00M (25000621) - RowsReturnedRate: 81.85 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.77K (10766) - ScannerThreadsTotalWallClockTime: 32m22s - MaterializeTupleTime(*): 11s219ms - ScannerThreadsSysTime: 1s228ms - ScannerThreadsUserTime: 20s692ms - ScannerThreadsVoluntaryContextSwitches: 24.58K (24584) - TotalRawHdfsReadTime(*): 1s081ms - TotalReadThroughput: 8.44 MB/sec Fragment F01: Instance aa4a715d244baecb:2bb62d6f00000004 (host=vb0214.halxg.cloudera.com:22000):(Total: 3m13s, non-child: 2m41s, % non-child: 83.39%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 4:2/506.80 MB 0:1/253.39 MB 8:2/506.80 MB 9:2/506.77 MB 3:1/253.37 MB 5:3/760.16 MB 2:4/959.93 MB 1:3/760.19 MB MemoryUsage(4s000ms): 1.02 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.09 GB, 1.08 GB, 1.07 GB, 1.06 GB, 1.05 GB, 1.03 GB, 1.01 GB, 999.16 MB, 973.59 MB, 936.77 MB, 916.16 MB, 902.82 MB, 896.01 MB, 887.01 MB, 869.87 MB, 852.22 MB, 847.72 MB, 832.50 MB, 814.40 MB, 788.42 MB, 762.67 MB, 756.56 MB, 748.27 MB, 728.62 MB, 742.49 MB, 737.87 MB, 728.02 MB, 730.29 MB, 767.70 MB, 764.82 MB, 747.82 MB, 734.73 MB, 699.94 MB, 680.95 MB, 644.17 MB, 635.76 MB, 630.81 MB, 627.56 MB, 602.01 MB, 594.49 MB, 554.24 MB, 652.43 MB, 479.77 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 8 - AverageThreadTokens: 12.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.09 GB (1168772155) - PerHostPeakMemUsage: 11.33 GB (12165773742) - RowsProduced: 25.73M (25731516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m42s - TotalStorageWaitTime: 541.031ms - TotalThreadsInvoluntaryContextSwitches: 16.98K (16976) - TotalThreadsTotalWallClockTime: 41m26s - TotalThreadsSysTime: 1s663ms - TotalThreadsUserTime: 49s163ms - TotalThreadsVoluntaryContextSwitches: 39.50K (39501) Fragment Instance Lifecycle Timings: - ExecTime: 3m13s - ExecTreeExecTime: 384.374ms - OpenTime: 34.108ms - ExecTreeOpenTime: 53.198us - PrepareTime: 24.293ms - ExecTreePrepareTime: 428.238us DataStreamSender (dst_id=4):(Total: 31s749ms, non-child: 31s749ms, % non-child: 100.00%) - BytesSent: 525.93 MB (551479392) - NetworkThroughput(*): 317.00 MB/sec - OverallThroughput: 16.57 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.73M (25731516) - SerializeBatchTime: 30s082ms - TransmitDataRPCTime: 1s659ms - UncompressedRowBatchSize: 908.06 MB (952166628) CodeGen:(Total: 55.720ms, non-child: 55.720ms, % non-child: 100.00%) - CodegenTime: 1.205ms - CompileTime: 9.911ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 23.121ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.190ms HDFS_SCAN_NODE (id=1):(Total: 338.270ms, non-child: 338.270ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 4:2/506.80 MB 0:1/253.39 MB 8:2/506.80 MB 9:2/506.77 MB 3:1/253.37 MB 5:3/760.16 MB 2:4/959.93 MB 1:3/760.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.74% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0.2584% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 927.31 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 984.64 MB, 1.01 GB, 1.04 GB, 1.04 GB, 1.06 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.12 GB, 1.13 GB, 1.35 GB, 1.52 GB - FooterProcessingTime: (Avg: 3.898ms ; Min: 2.087ms ; Max: 6.394ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 11.86 - BytesRead: 1.53 GB (1645560524) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.53 GB (1645560524) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.53 GB (1645560524) - DecompressionTime: 8s329ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.09 GB (1168725568) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.007ms - RowBatchQueuePutWaitTime: 37m52s - RowsRead: 130.03M (130033379) - RowsReturned: 25.73M (25731516) - RowsReturnedRate: 76.07 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.03K (6031) - ScannerThreadsTotalWallClockTime: 38m12s - MaterializeTupleTime(*): 10s057ms - ScannerThreadsSysTime: 1s000ms - ScannerThreadsUserTime: 18s779ms - ScannerThreadsVoluntaryContextSwitches: 25.31K (25314) - TotalRawHdfsReadTime(*): 1s037ms - TotalReadThroughput: 8.11 MB/sec Instance aa4a715d244baecb:2bb62d6f00000006 (host=vb0218.halxg.cloudera.com:22000):(Total: 3m7s, non-child: 2m27s, % non-child: 78.55%) Hdfs split stats (:<# splits>/): 8:1/253.38 MB 1:1/253.39 MB 9:1/253.38 MB 10:1/253.40 MB 5:2/506.79 MB 2:5/1.24 GB 7:2/506.80 MB 6:2/506.81 MB 3:3/760.16 MB 0:1/253.39 MB MemoryUsage(4s000ms): 1005.46 MB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1004.82 MB, 953.92 MB, 933.59 MB, 925.15 MB, 914.63 MB, 905.06 MB, 876.80 MB, 845.68 MB, 800.39 MB, 764.69 MB, 735.92 MB, 712.14 MB, 700.62 MB, 664.98 MB, 633.22 MB, 614.18 MB, 578.43 MB, 592.24 MB, 561.60 MB, 519.86 MB, 523.45 MB, 517.16 MB, 486.01 MB, 536.36 MB, 529.56 MB, 691.01 MB, 709.45 MB, 717.61 MB, 676.77 MB, 630.40 MB, 583.26 MB, 539.33 MB, 505.78 MB, 479.89 MB, 439.42 MB, 397.96 MB, 369.05 MB, 342.69 MB, 294.66 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 10, 9, 8, 8, 8, 8, 7, 7, 7, 7, 7 - AverageThreadTokens: 11.63 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1182917213) - PerHostPeakMemUsage: 1.10 GB (1182917213) - RowsProduced: 27.36M (27356338) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 663.647ms - TotalThreadsInvoluntaryContextSwitches: 25.86K (25864) - TotalThreadsTotalWallClockTime: 36m18s - TotalThreadsSysTime: 1s960ms - TotalThreadsUserTime: 1m - TotalThreadsVoluntaryContextSwitches: 44.89K (44886) Fragment Instance Lifecycle Timings: - ExecTime: 3m7s - ExecTreeExecTime: 378.236ms - OpenTime: 34.475ms - ExecTreeOpenTime: 56.490us - PrepareTime: 28.102ms - ExecTreePrepareTime: 327.769us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 39s817ms, non-child: 39s817ms, % non-child: 100.00%) - BytesSent: 559.15 MB (586311676) - NetworkThroughput(*): 303.79 MB/sec - OverallThroughput: 14.04 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 27.36M (27356338) - SerializeBatchTime: 37s967ms - TransmitDataRPCTime: 1s840ms - UncompressedRowBatchSize: 965.40 MB (1012291378) CodeGen:(Total: 60.105ms, non-child: 60.105ms, % non-child: 100.00%) - CodegenTime: 1.307ms - CompileTime: 10.848ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.800ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 25.856ms HDFS_SCAN_NODE (id=1):(Total: 319.193ms, non-child: 319.193ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.38 MB 1:1/253.39 MB 9:1/253.38 MB 10:1/253.40 MB 5:2/506.79 MB 2:5/1.24 GB 7:2/506.80 MB 6:2/506.81 MB 3:3/760.16 MB 0:1/253.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.47% 1:0.2667% 2:0% 3:0% 4:0% 5:0% 6:0.2667% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 895.21 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1023.24 MB, 1.06 GB, 1.06 GB, 1.06 GB, 1.11 GB, 1.14 GB, 1.14 GB, 1.22 GB, 1.23 GB, 1.44 GB, 1.49 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.902ms ; Min: 2.421ms ; Max: 9.410ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.63 - BytesRead: 1.55 GB (1664143743) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664143743) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664143743) - DecompressionTime: 9s649ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1182604370) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.390ms - RowBatchQueuePutWaitTime: 32m48s - RowsRead: 131.50M (131502589) - RowsReturned: 27.36M (27356338) - RowsReturnedRate: 85.70 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.12K (12116) - ScannerThreadsTotalWallClockTime: 33m11s - MaterializeTupleTime(*): 11s624ms - ScannerThreadsSysTime: 1s203ms - ScannerThreadsUserTime: 21s570ms - ScannerThreadsVoluntaryContextSwitches: 26.87K (26869) - TotalRawHdfsReadTime(*): 1s220ms - TotalReadThroughput: 8.46 MB/sec Instance aa4a715d244baecb:2bb62d6f00000002 (host=vb0216.halxg.cloudera.com:22000):(Total: 3m6s, non-child: 2m26s, % non-child: 78.20%) Hdfs split stats (:<# splits>/): 1:1/253.38 MB 3:2/506.78 MB 10:1/253.39 MB 7:2/506.78 MB 9:5/1.24 GB 6:1/253.41 MB 5:2/506.78 MB 2:1/253.41 MB 0:4/1013.59 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.07 GB, 1.02 GB, 983.79 MB, 938.15 MB, 922.00 MB, 909.08 MB, 889.52 MB, 864.93 MB, 828.64 MB, 795.60 MB, 755.27 MB, 719.63 MB, 685.89 MB, 658.79 MB, 688.52 MB, 669.61 MB, 631.70 MB, 609.79 MB, 568.28 MB, 600.29 MB, 589.83 MB, 609.92 MB, 604.55 MB, 686.70 MB, 675.79 MB, 663.67 MB, 661.46 MB, 765.80 MB, 731.28 MB, 666.53 MB, 625.03 MB, 556.68 MB, 539.78 MB, 510.05 MB, 470.00 MB, 447.72 MB, 423.31 MB, 386.13 MB, 351.54 MB, 317.46 MB, 256.30 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 10, 9, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 11.68 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1186718411) - PerHostPeakMemUsage: 1.11 GB (1186718411) - RowsProduced: 26.59M (26594701) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 600.323ms - TotalThreadsInvoluntaryContextSwitches: 25.75K (25748) - TotalThreadsTotalWallClockTime: 36m20s - TotalThreadsSysTime: 2s054ms - TotalThreadsUserTime: 1m - TotalThreadsVoluntaryContextSwitches: 43.84K (43845) Fragment Instance Lifecycle Timings: - ExecTime: 3m6s - ExecTreeExecTime: 402.339ms - OpenTime: 33.803ms - ExecTreeOpenTime: 55.588us - PrepareTime: 25.593ms - ExecTreePrepareTime: 355.746us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 40s343ms, non-child: 40s343ms, % non-child: 100.00%) - BytesSent: 543.60 MB (570003508) - NetworkThroughput(*): 237.56 MB/sec - OverallThroughput: 13.47 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 26.59M (26594701) - SerializeBatchTime: 38s044ms - TransmitDataRPCTime: 2s288ms - UncompressedRowBatchSize: 938.52 MB (984107841) CodeGen:(Total: 56.753ms, non-child: 56.753ms, % non-child: 100.00%) - CodegenTime: 1.490ms - CompileTime: 10.212ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.821ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.142ms HDFS_SCAN_NODE (id=1):(Total: 341.658ms, non-child: 341.658ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.38 MB 3:2/506.78 MB 10:1/253.39 MB 7:2/506.78 MB 9:5/1.24 GB 6:1/253.41 MB 5:2/506.78 MB 2:1/253.41 MB 0:4/1013.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0.2681% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1.04 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.13 GB, 1.15 GB, 1.22 GB, 1.26 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.41 GB, 1.54 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.613ms ; Min: 3.041ms ; Max: 9.117ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.68 - BytesRead: 1.55 GB (1664130351) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664130351) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664130351) - DecompressionTime: 9s883ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1186638032) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.954ms - RowBatchQueuePutWaitTime: 32m50s - RowsRead: 131.50M (131502389) - RowsReturned: 26.59M (26594701) - RowsReturnedRate: 77.84 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.38K (11385) - ScannerThreadsTotalWallClockTime: 33m13s - MaterializeTupleTime(*): 12s005ms - ScannerThreadsSysTime: 1s293ms - ScannerThreadsUserTime: 22s016ms - ScannerThreadsVoluntaryContextSwitches: 26.16K (26163) - TotalRawHdfsReadTime(*): 1s051ms - TotalReadThroughput: 8.51 MB/sec Instance aa4a715d244baecb:2bb62d6f00000005 (host=vb0204.halxg.cloudera.com:22000):(Total: 3m6s, non-child: 2m25s, % non-child: 78.30%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 2:1/253.41 MB 7:2/506.80 MB 6:1/253.41 MB 1:2/506.79 MB 8:2/506.78 MB 3:5/1.24 GB 4:4/1013.63 MB 0:1/253.40 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.07 GB, 1019.80 MB, 968.13 MB, 938.58 MB, 923.95 MB, 919.17 MB, 887.53 MB, 865.04 MB, 815.46 MB, 776.71 MB, 750.30 MB, 719.19 MB, 688.28 MB, 694.33 MB, 724.98 MB, 676.50 MB, 629.45 MB, 594.12 MB, 554.54 MB, 510.88 MB, 472.46 MB, 478.61 MB, 592.37 MB, 653.08 MB, 699.89 MB, 709.20 MB, 691.92 MB, 722.49 MB, 656.42 MB, 584.18 MB, 533.83 MB, 502.77 MB, 469.98 MB, 445.53 MB, 409.89 MB, 385.39 MB, 356.34 MB, 329.54 MB, 291.60 MB, 233.97 MB, 184.55 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 10, 8, 8, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6 - AverageThreadTokens: 11.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1183686359) - PerHostPeakMemUsage: 1.10 GB (1183702743) - RowsProduced: 27.05M (27045946) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 585.733ms - TotalThreadsInvoluntaryContextSwitches: 26.30K (26304) - TotalThreadsTotalWallClockTime: 35m7s - TotalThreadsSysTime: 2s040ms - TotalThreadsUserTime: 1m - TotalThreadsVoluntaryContextSwitches: 44.54K (44543) Fragment Instance Lifecycle Timings: - ExecTime: 3m6s - ExecTreeExecTime: 397.877ms - OpenTime: 34.309ms - ExecTreeOpenTime: 50.495us - PrepareTime: 26.873ms - ExecTreePrepareTime: 333.368us DataStreamSender (dst_id=4):(Total: 40s002ms, non-child: 40s002ms, % non-child: 100.00%) - BytesSent: 552.79 MB (579639503) - NetworkThroughput(*): 283.87 MB/sec - OverallThroughput: 13.82 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 27.05M (27045946) - SerializeBatchTime: 38s044ms - TransmitDataRPCTime: 1s947ms - UncompressedRowBatchSize: 954.44 MB (1000805662) CodeGen:(Total: 58.480ms, non-child: 58.480ms, % non-child: 100.00%) - CodegenTime: 1.651ms - CompileTime: 10.199ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 23.209ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.507ms HDFS_SCAN_NODE (id=1):(Total: 335.810ms, non-child: 335.810ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.39 MB 2:1/253.41 MB 7:2/506.80 MB 6:1/253.41 MB 1:2/506.79 MB 8:2/506.78 MB 3:5/1.24 GB 4:4/1013.63 MB 0:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1.01 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.11 GB, 1.28 GB, 1.39 GB, 1.46 GB, 1.47 GB, 1.47 GB, 1.54 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.425ms ; Min: 2.942ms ; Max: 8.035ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.32 - BytesRead: 1.55 GB (1664181733) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664181733) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664181733) - DecompressionTime: 9s784ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1183337774) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.899ms - RowBatchQueuePutWaitTime: 31m38s - RowsRead: 131.50M (131502331) - RowsReturned: 27.05M (27045946) - RowsReturnedRate: 80.54 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.74K (11741) - ScannerThreadsTotalWallClockTime: 32m1s - MaterializeTupleTime(*): 11s865ms - ScannerThreadsSysTime: 1s260ms - ScannerThreadsUserTime: 21s858ms - ScannerThreadsVoluntaryContextSwitches: 26.57K (26573) - TotalRawHdfsReadTime(*): 1s053ms - TotalReadThroughput: 8.53 MB/sec Instance aa4a715d244baecb:2bb62d6f00000003 (host=vb0212.halxg.cloudera.com:22000):(Total: 3m5s, non-child: 2m30s, % non-child: 81.12%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 1:3/760.18 MB 5:1/253.39 MB 4:2/506.79 MB 7:3/760.20 MB 0:1/253.40 MB 6:2/506.82 MB 3:2/506.82 MB 2:3/760.21 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.07 GB, 1.06 GB, 1.01 GB, 961.93 MB, 928.50 MB, 912.86 MB, 898.97 MB, 897.86 MB, 873.84 MB, 845.78 MB, 809.06 MB, 759.58 MB, 718.81 MB, 698.04 MB, 672.21 MB, 659.52 MB, 694.18 MB, 665.13 MB, 715.75 MB, 681.20 MB, 647.94 MB, 625.92 MB, 656.58 MB, 620.28 MB, 587.03 MB, 562.60 MB, 576.93 MB, 574.52 MB, 667.58 MB, 667.69 MB, 631.58 MB, 591.13 MB, 514.21 MB, 458.95 MB, 421.36 MB, 379.48 MB, 345.31 MB, 310.27 MB, 270.35 MB, 210.16 MB, 164.70 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 11, 10, 8, 7, 7, 7, 7, 6, 6, 5, 5 - AverageThreadTokens: 11.58 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188988067) - PerHostPeakMemUsage: 1.11 GB (1188988067) - RowsProduced: 23.47M (23465800) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m31s - TotalStorageWaitTime: 573.682ms - TotalThreadsInvoluntaryContextSwitches: 24.32K (24323) - TotalThreadsTotalWallClockTime: 35m47s - TotalThreadsSysTime: 2s024ms - TotalThreadsUserTime: 53s583ms - TotalThreadsVoluntaryContextSwitches: 39.07K (39071) Fragment Instance Lifecycle Timings: - ExecTime: 3m5s - ExecTreeExecTime: 351.828ms - OpenTime: 33.958ms - ExecTreeOpenTime: 51.317us - PrepareTime: 27.525ms - ExecTreePrepareTime: 305.040us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s678ms, non-child: 34s678ms, % non-child: 100.00%) - BytesSent: 479.63 MB (502926019) - NetworkThroughput(*): 263.73 MB/sec - OverallThroughput: 13.83 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 23.47M (23465800) - SerializeBatchTime: 32s851ms - TransmitDataRPCTime: 1s818ms - UncompressedRowBatchSize: 828.10 MB (868326276) CodeGen:(Total: 58.901ms, non-child: 58.901ms, % non-child: 100.00%) - CodegenTime: 1.506ms - CompileTime: 10.182ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 23.018ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 25.136ms HDFS_SCAN_NODE (id=1):(Total: 298.219ms, non-child: 298.219ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 1:3/760.18 MB 5:1/253.39 MB 4:2/506.79 MB 7:3/760.20 MB 0:1/253.40 MB 6:2/506.82 MB 3:2/506.82 MB 2:3/760.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0% 2:0.2695% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(4s000ms): 1000.40 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1002.37 MB, 1023.25 MB, 1.06 GB, 1.06 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.15 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.27 GB, 1.32 GB, 1.44 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 5.578ms ; Min: 3.019ms ; Max: 7.522ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.58 - BytesRead: 1.47 GB (1576589528) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576589528) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576589528) - DecompressionTime: 9s210ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188542096) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.433ms - RowBatchQueuePutWaitTime: 32m20s - RowsRead: 124.58M (124581157) - RowsReturned: 23.47M (23465800) - RowsReturnedRate: 78.69 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.98K (10981) - ScannerThreadsTotalWallClockTime: 32m41s - MaterializeTupleTime(*): 11s034ms - ScannerThreadsSysTime: 1s253ms - ScannerThreadsUserTime: 20s315ms - ScannerThreadsVoluntaryContextSwitches: 23.10K (23096) - TotalRawHdfsReadTime(*): 1s018ms - TotalReadThroughput: 8.11 MB/sec Instance aa4a715d244baecb:2bb62d6f00000009 (host=vb0224.halxg.cloudera.com:22000):(Total: 3m4s, non-child: 2m27s, % non-child: 79.69%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 1:1/253.41 MB 10:1/253.38 MB 9:1/253.40 MB 5:2/506.78 MB 0:2/506.77 MB 4:2/506.76 MB 8:2/506.78 MB 7:3/760.18 MB 6:2/481.03 MB 2:2/506.80 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1.00 GB, 973.54 MB, 935.03 MB, 915.32 MB, 902.11 MB, 875.22 MB, 849.00 MB, 813.68 MB, 773.76 MB, 749.21 MB, 709.27 MB, 671.82 MB, 642.27 MB, 675.47 MB, 656.77 MB, 658.85 MB, 652.29 MB, 625.59 MB, 602.30 MB, 568.91 MB, 579.79 MB, 597.12 MB, 716.68 MB, 750.68 MB, 775.18 MB, 766.62 MB, 737.92 MB, 689.35 MB, 635.72 MB, 584.92 MB, 537.67 MB, 500.77 MB, 466.21 MB, 421.82 MB, 383.55 MB, 338.36 MB, 260.87 MB, 220.70 MB, 170.54 MB, 91.36 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 10, 9, 9, 8, 8, 8, 8, 7, 6, 5, 4, 2 - AverageThreadTokens: 11.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1189784875) - PerHostPeakMemUsage: 1.11 GB (1189784875) - RowsProduced: 25.26M (25256825) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 660.214ms - TotalThreadsInvoluntaryContextSwitches: 24.95K (24952) - TotalThreadsTotalWallClockTime: 35m18s - TotalThreadsSysTime: 1s987ms - TotalThreadsUserTime: 56s966ms - TotalThreadsVoluntaryContextSwitches: 41.95K (41948) Fragment Instance Lifecycle Timings: - ExecTime: 3m4s - ExecTreeExecTime: 372.628ms - OpenTime: 33.037ms - ExecTreeOpenTime: 42.880us - PrepareTime: 25.725ms - ExecTreePrepareTime: 309.962us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 37s106ms, non-child: 37s106ms, % non-child: 100.00%) - BytesSent: 516.24 MB (541321888) - NetworkThroughput(*): 293.76 MB/sec - OverallThroughput: 13.91 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.26M (25256825) - SerializeBatchTime: 35s339ms - TransmitDataRPCTime: 1s757ms - UncompressedRowBatchSize: 891.31 MB (934601201) CodeGen:(Total: 56.377ms, non-child: 56.377ms, % non-child: 100.00%) - CodegenTime: 1.230ms - CompileTime: 9.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.513ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 23.642ms HDFS_SCAN_NODE (id=1):(Total: 315.693ms, non-child: 315.693ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.39 MB 1:1/253.41 MB 10:1/253.38 MB 9:1/253.40 MB 5:2/506.78 MB 0:2/506.77 MB 4:2/506.76 MB 8:2/506.78 MB 7:3/760.18 MB 6:2/481.03 MB 2:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1002.27 MB, 1.04 GB, 1.06 GB, 1.11 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.20 GB, 1.27 GB, 1.44 GB, 1.50 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 5.455ms ; Min: 2.979ms ; Max: 7.173ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.47 - BytesRead: 1.54 GB (1655172689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1655172689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1655172689) - DecompressionTime: 9s496ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1189472032) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.684ms - RowBatchQueuePutWaitTime: 31m51s - RowsRead: 130.80M (130797981) - RowsReturned: 25.26M (25256825) - RowsReturnedRate: 80.00 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.90K (10903) - ScannerThreadsTotalWallClockTime: 32m14s - MaterializeTupleTime(*): 11s422ms - ScannerThreadsSysTime: 1s234ms - ScannerThreadsUserTime: 21s070ms - ScannerThreadsVoluntaryContextSwitches: 24.88K (24878) - TotalRawHdfsReadTime(*): 1s282ms - TotalReadThroughput: 8.56 MB/sec Instance aa4a715d244baecb:2bb62d6f0000000c (host=vb0220.halxg.cloudera.com:22000):(Total: 3m4s, non-child: 2m27s, % non-child: 80.33%) Hdfs split stats (:<# splits>/): 8:2/506.79 MB 5:2/506.80 MB 10:1/253.39 MB 9:2/506.77 MB 7:1/253.41 MB 2:3/732.64 MB 3:4/1013.58 MB 0:3/760.18 MB 1:1/253.41 MB MemoryUsage(4s000ms): 1.09 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.05 GB, 1016.01 MB, 970.20 MB, 935.41 MB, 921.18 MB, 911.94 MB, 884.82 MB, 875.07 MB, 832.01 MB, 806.05 MB, 761.63 MB, 741.26 MB, 688.28 MB, 666.34 MB, 653.62 MB, 610.10 MB, 627.12 MB, 617.69 MB, 567.99 MB, 621.73 MB, 602.82 MB, 543.73 MB, 511.62 MB, 680.16 MB, 683.91 MB, 650.33 MB, 659.55 MB, 721.59 MB, 722.91 MB, 686.28 MB, 616.67 MB, 538.29 MB, 487.18 MB, 435.06 MB, 388.09 MB, 353.53 MB, 314.91 MB, 243.92 MB, 181.85 MB, 112.97 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 10, 8, 8, 7, 7, 7, 6, 5, 5, 3 - AverageThreadTokens: 11.68 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1186192559) - PerHostPeakMemUsage: 1.10 GB (1186192559) - RowsProduced: 24.28M (24277670) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m28s - TotalStorageWaitTime: 577.540ms - TotalThreadsInvoluntaryContextSwitches: 26.39K (26393) - TotalThreadsTotalWallClockTime: 35m50s - TotalThreadsSysTime: 2s024ms - TotalThreadsUserTime: 55s799ms - TotalThreadsVoluntaryContextSwitches: 40.27K (40270) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 351.799ms - OpenTime: 33.785ms - ExecTreeOpenTime: 50.679us - PrepareTime: 26.384ms - ExecTreePrepareTime: 313.605us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s840ms, non-child: 35s840ms, % non-child: 100.00%) - BytesSent: 496.22 MB (520319489) - NetworkThroughput(*): 280.67 MB/sec - OverallThroughput: 13.85 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.28M (24277670) - SerializeBatchTime: 34s063ms - TransmitDataRPCTime: 1s767ms - UncompressedRowBatchSize: 856.75 MB (898368646) CodeGen:(Total: 57.648ms, non-child: 57.648ms, % non-child: 100.00%) - CodegenTime: 1.458ms - CompileTime: 10.256ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.783ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.039ms HDFS_SCAN_NODE (id=1):(Total: 293.453ms, non-child: 293.453ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.79 MB 5:2/506.80 MB 10:1/253.39 MB 9:2/506.77 MB 7:1/253.41 MB 2:3/732.64 MB 3:4/1013.58 MB 0:3/760.18 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1002.39 MB, 1.04 GB, 1.06 GB, 1.06 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.16 GB, 1.36 GB, 1.38 GB, 1.38 GB, 1.42 GB, 1.51 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 5.614ms ; Min: 2.719ms ; Max: 8.292ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.68 - BytesRead: 1.54 GB (1654662021) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1654662021) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1654662021) - DecompressionTime: 9s594ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1185940640) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.328ms - RowBatchQueuePutWaitTime: 32m23s - RowsRead: 130.75M (130748945) - RowsReturned: 24.28M (24277670) - RowsReturnedRate: 82.73 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 12.68K (12676) - ScannerThreadsTotalWallClockTime: 32m46s - MaterializeTupleTime(*): 11s508ms - ScannerThreadsSysTime: 1s215ms - ScannerThreadsUserTime: 21s245ms - ScannerThreadsVoluntaryContextSwitches: 23.85K (23851) - TotalRawHdfsReadTime(*): 1s040ms - TotalReadThroughput: 8.58 MB/sec Instance aa4a715d244baecb:2bb62d6f00000001 (host=vb0230.halxg.cloudera.com:22000):(Total: 3m3s, non-child: 2m26s, % non-child: 79.86%) Hdfs split stats (:<# splits>/): 9:1/253.41 MB 2:1/253.39 MB 5:2/506.78 MB 3:2/506.81 MB 6:1/253.38 MB 7:2/506.78 MB 4:2/506.81 MB 1:3/760.19 MB 0:5/1.24 GB MemoryUsage(4s000ms): 1.02 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.05 GB, 1.03 GB, 1006.98 MB, 946.73 MB, 907.24 MB, 892.91 MB, 884.32 MB, 865.45 MB, 830.78 MB, 796.68 MB, 729.47 MB, 695.11 MB, 655.16 MB, 645.36 MB, 691.77 MB, 723.33 MB, 781.21 MB, 748.34 MB, 710.84 MB, 680.38 MB, 650.67 MB, 642.04 MB, 619.71 MB, 596.08 MB, 599.23 MB, 610.21 MB, 617.07 MB, 722.09 MB, 696.49 MB, 651.26 MB, 591.19 MB, 517.54 MB, 464.26 MB, 451.64 MB, 407.42 MB, 346.99 MB, 315.29 MB, 278.91 MB, 203.75 MB, 146.02 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 11, 10, 8, 8, 8, 7, 7, 7, 6, 4, 3 - AverageThreadTokens: 11.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1190124575) - PerHostPeakMemUsage: 1.11 GB (1190124575) - RowsProduced: 25.08M (25076265) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m27s - TotalStorageWaitTime: 633.275ms - TotalThreadsInvoluntaryContextSwitches: 21.55K (21552) - TotalThreadsTotalWallClockTime: 35m4s - TotalThreadsSysTime: 1s968ms - TotalThreadsUserTime: 56s709ms - TotalThreadsVoluntaryContextSwitches: 41.19K (41188) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 331.310ms - OpenTime: 33.055ms - ExecTreeOpenTime: 42.408us - PrepareTime: 24.151ms - ExecTreePrepareTime: 300.052us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s571ms, non-child: 36s571ms, % non-child: 100.00%) - BytesSent: 512.53 MB (537431466) - NetworkThroughput(*): 298.00 MB/sec - OverallThroughput: 14.01 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 25.08M (25076265) - SerializeBatchTime: 34s843ms - TransmitDataRPCTime: 1s719ms - UncompressedRowBatchSize: 884.93 MB (927919769) CodeGen:(Total: 54.739ms, non-child: 54.739ms, % non-child: 100.00%) - CodegenTime: 1.445ms - CompileTime: 9.708ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.622ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.880ms HDFS_SCAN_NODE (id=1):(Total: 274.494ms, non-child: 274.494ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.41 MB 2:1/253.39 MB 5:2/506.78 MB 3:2/506.81 MB 6:1/253.38 MB 7:2/506.78 MB 4:2/506.81 MB 1:3/760.19 MB 0:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0.2725% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 923.90 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1002.35 MB, 1012.79 MB, 1.07 GB, 1.14 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.27 GB, 1.31 GB, 1.31 GB, 1.34 GB, 1.39 GB, 1.42 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB, 1.55 GB - FooterProcessingTime: (Avg: 5.525ms ; Min: 2.883ms ; Max: 8.689ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 10.48 - BytesRead: 1.55 GB (1664143238) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.55 GB (1664143238) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.55 GB (1664143238) - DecompressionTime: 9s571ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1189746188) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.572ms - RowBatchQueuePutWaitTime: 31m38s - RowsRead: 131.50M (131502184) - RowsReturned: 25.08M (25076265) - RowsReturnedRate: 91.35 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.98K (9983) - ScannerThreadsTotalWallClockTime: 32m1s - MaterializeTupleTime(*): 11s467ms - ScannerThreadsSysTime: 1s215ms - ScannerThreadsUserTime: 21s264ms - ScannerThreadsVoluntaryContextSwitches: 24.63K (24628) - TotalRawHdfsReadTime(*): 1s101ms - TotalReadThroughput: 8.65 MB/sec Instance aa4a715d244baecb:2bb62d6f0000000b (host=vb0222.halxg.cloudera.com:22000):(Total: 3m2s, non-child: 2m25s, % non-child: 79.69%) Hdfs split stats (:<# splits>/): 6:1/253.38 MB 3:3/514.23 MB 10:1/253.41 MB 4:3/760.21 MB 9:1/253.37 MB 8:2/506.80 MB 7:2/506.80 MB 5:2/506.79 MB 1:1/253.40 MB 2:3/760.16 MB MemoryUsage(4s000ms): 1.03 GB, 1.10 GB, 1.11 GB, 1.10 GB, 1.08 GB, 1.05 GB, 1.02 GB, 991.87 MB, 938.08 MB, 902.41 MB, 884.83 MB, 874.09 MB, 855.03 MB, 822.65 MB, 778.04 MB, 719.51 MB, 680.72 MB, 648.32 MB, 652.89 MB, 673.01 MB, 730.16 MB, 757.54 MB, 739.86 MB, 701.27 MB, 736.85 MB, 702.67 MB, 670.33 MB, 646.04 MB, 607.33 MB, 583.26 MB, 630.01 MB, 642.58 MB, 644.85 MB, 613.10 MB, 552.87 MB, 496.07 MB, 434.33 MB, 412.86 MB, 380.09 MB, 353.79 MB, 308.35 MB, 254.57 MB, 227.27 MB, 183.36 MB, 95.90 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 11, 9, 8, 7, 7, 7, 7, 6, 6, 6, 5, 3 - AverageThreadTokens: 11.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1190525909) - PerHostPeakMemUsage: 1.11 GB (1190525909) - RowsProduced: 24.52M (24523519) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 566.476ms - TotalThreadsInvoluntaryContextSwitches: 25.36K (25362) - TotalThreadsTotalWallClockTime: 34m13s - TotalThreadsSysTime: 1s946ms - TotalThreadsUserTime: 55s902ms - TotalThreadsVoluntaryContextSwitches: 40.58K (40584) Fragment Instance Lifecycle Timings: - ExecTime: 3m2s - ExecTreeExecTime: 366.292ms - OpenTime: 32.773ms - ExecTreeOpenTime: 40.738us - PrepareTime: 24.874ms - ExecTreePrepareTime: 295.679us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s651ms, non-child: 36s651ms, % non-child: 100.00%) - BytesSent: 501.25 MB (525595582) - NetworkThroughput(*): 257.49 MB/sec - OverallThroughput: 13.68 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.52M (24523519) - SerializeBatchTime: 34s694ms - TransmitDataRPCTime: 1s946ms - UncompressedRowBatchSize: 865.43 MB (907466011) CodeGen:(Total: 55.152ms, non-child: 55.152ms, % non-child: 100.00%) - CodegenTime: 1.391ms - CompileTime: 9.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.354ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.606ms HDFS_SCAN_NODE (id=1):(Total: 309.599ms, non-child: 309.599ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.38 MB 3:3/514.23 MB 10:1/253.41 MB 4:3/760.21 MB 9:1/253.37 MB 8:2/506.80 MB 7:2/506.80 MB 5:2/506.79 MB 1:1/253.40 MB 2:3/760.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0% 2:0% 3:0% 4:0.274% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 937.69 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1005.01 MB, 1.02 GB, 1.06 GB, 1.16 GB, 1.23 GB, 1.23 GB, 1.23 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.32 GB, 1.39 GB, 1.44 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 5.664ms ; Min: 2.824ms ; Max: 8.609ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.26 - BytesRead: 1.47 GB (1579318713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1579318713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1579318713) - DecompressionTime: 9s339ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1190046146) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.086ms - RowBatchQueuePutWaitTime: 30m49s - RowsRead: 124.77M (124773003) - RowsReturned: 24.52M (24523519) - RowsReturnedRate: 79.21 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.53K (11530) - ScannerThreadsTotalWallClockTime: 31m11s - MaterializeTupleTime(*): 11s329ms - ScannerThreadsSysTime: 1s189ms - ScannerThreadsUserTime: 20s801ms - ScannerThreadsVoluntaryContextSwitches: 24.17K (24170) - TotalRawHdfsReadTime(*): 1s052ms - TotalReadThroughput: 8.25 MB/sec Instance aa4a715d244baecb:2bb62d6f0000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m25s, % non-child: 80.15%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 4:2/506.76 MB 2:1/253.42 MB 10:2/445.01 MB 8:3/760.18 MB 3:1/187.22 MB 7:2/506.79 MB 5:4/1013.55 MB 0:3/760.18 MB MemoryUsage(4s000ms): 984.07 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.06 GB, 1.04 GB, 1.01 GB, 970.85 MB, 915.95 MB, 893.85 MB, 885.81 MB, 878.89 MB, 862.42 MB, 838.41 MB, 786.44 MB, 821.60 MB, 789.32 MB, 756.65 MB, 733.77 MB, 724.67 MB, 693.90 MB, 659.29 MB, 662.62 MB, 641.87 MB, 603.90 MB, 558.35 MB, 525.17 MB, 541.50 MB, 540.63 MB, 553.45 MB, 543.32 MB, 561.21 MB, 650.00 MB, 675.10 MB, 605.95 MB, 536.51 MB, 508.76 MB, 471.94 MB, 444.39 MB, 401.78 MB, 351.36 MB, 300.18 MB, 255.79 MB, 181.31 MB, 109.52 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 10, 8, 8, 8, 8, 7, 6, 6, 5, 4, 3 - AverageThreadTokens: 11.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.09 GB (1166745681) - PerHostPeakMemUsage: 1.09 GB (1166745681) - RowsProduced: 24.20M (24199028) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 643.273ms - TotalThreadsInvoluntaryContextSwitches: 24.99K (24990) - TotalThreadsTotalWallClockTime: 34m26s - TotalThreadsSysTime: 1s951ms - TotalThreadsUserTime: 54s695ms - TotalThreadsVoluntaryContextSwitches: 40.09K (40094) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 350.466ms - OpenTime: 33.947ms - ExecTreeOpenTime: 46.794us - PrepareTime: 22.462ms - ExecTreePrepareTime: 324.709us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s608ms, non-child: 35s608ms, % non-child: 100.00%) - BytesSent: 494.62 MB (518648130) - NetworkThroughput(*): 272.67 MB/sec - OverallThroughput: 13.89 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.20M (24199028) - SerializeBatchTime: 33s784ms - TransmitDataRPCTime: 1s814ms - UncompressedRowBatchSize: 853.98 MB (895458584) CodeGen:(Total: 53.923ms, non-child: 53.923ms, % non-child: 100.00%) - CodegenTime: 1.325ms - CompileTime: 10.306ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.811ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 20.234ms HDFS_SCAN_NODE (id=1):(Total: 294.856ms, non-child: 294.856ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 4:2/506.76 MB 2:1/253.42 MB 10:2/445.01 MB 8:3/760.18 MB 3:1/187.22 MB 7:2/506.79 MB 5:4/1013.55 MB 0:3/760.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.2755% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0.2755% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 867.10 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 980.55 MB, 1.03 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.04 GB, 1.05 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.11 GB, 1.18 GB, 1.22 GB, 1.26 GB, 1.26 GB, 1.30 GB, 1.43 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB - FooterProcessingTime: (Avg: 6.288ms ; Min: 3.093ms ; Max: 8.331ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 10.40 - BytesRead: 1.51 GB (1619983151) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.51 GB (1619983151) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.51 GB (1619983151) - DecompressionTime: 9s269ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.09 GB (1166567916) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.936ms - RowBatchQueuePutWaitTime: 31m3s - RowsRead: 128.00M (128001189) - RowsReturned: 24.20M (24199028) - RowsReturnedRate: 82.07 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.27K (11274) - ScannerThreadsTotalWallClockTime: 31m25s - MaterializeTupleTime(*): 11s113ms - ScannerThreadsSysTime: 1s263ms - ScannerThreadsUserTime: 20s440ms - ScannerThreadsVoluntaryContextSwitches: 23.84K (23836) - TotalRawHdfsReadTime(*): 1s056ms - TotalReadThroughput: 8.51 MB/sec Instance aa4a715d244baecb:2bb62d6f0000000e (host=vb0206.halxg.cloudera.com:22000):(Total: 3m1s, non-child: 2m25s, % non-child: 80.21%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 9:3/760.18 MB 6:2/506.81 MB 7:1/253.39 MB 5:2/506.80 MB 4:3/760.17 MB 1:2/506.77 MB 0:3/760.20 MB MemoryUsage(4s000ms): 995.80 MB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.06 GB, 1.03 GB, 995.20 MB, 944.53 MB, 918.41 MB, 903.59 MB, 889.93 MB, 874.11 MB, 841.19 MB, 795.81 MB, 755.47 MB, 712.85 MB, 670.42 MB, 649.79 MB, 604.43 MB, 663.72 MB, 657.42 MB, 698.49 MB, 692.04 MB, 752.95 MB, 707.17 MB, 663.22 MB, 646.99 MB, 626.91 MB, 565.68 MB, 667.55 MB, 661.75 MB, 648.88 MB, 616.91 MB, 546.07 MB, 484.53 MB, 436.60 MB, 408.93 MB, 383.97 MB, 357.41 MB, 305.43 MB, 271.94 MB, 221.87 MB, 163.51 MB, 85.75 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 12, 12, 9, 7, 7, 7, 7, 7, 7, 7, 6, 4, 2 - AverageThreadTokens: 11.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1189423103) - PerHostPeakMemUsage: 1.11 GB (1189423103) - RowsProduced: 24.21M (24210513) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 598.484ms - TotalThreadsInvoluntaryContextSwitches: 23.97K (23968) - TotalThreadsTotalWallClockTime: 34m4s - TotalThreadsSysTime: 2s114ms - TotalThreadsUserTime: 53s910ms - TotalThreadsVoluntaryContextSwitches: 39.67K (39671) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 337.847ms - OpenTime: 32.906ms - ExecTreeOpenTime: 44.626us - PrepareTime: 23.564ms - ExecTreePrepareTime: 299.041us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s496ms, non-child: 35s496ms, % non-child: 100.00%) - BytesSent: 494.84 MB (518880607) - NetworkThroughput(*): 286.76 MB/sec - OverallThroughput: 13.94 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.21M (24210513) - SerializeBatchTime: 33s762ms - TransmitDataRPCTime: 1s725ms - UncompressedRowBatchSize: 854.38 MB (895883569) CodeGen:(Total: 54.016ms, non-child: 54.016ms, % non-child: 100.00%) - CodegenTime: 1.403ms - CompileTime: 9.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.431ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.294ms HDFS_SCAN_NODE (id=1):(Total: 283.663ms, non-child: 283.663ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/506.78 MB 9:3/760.18 MB 6:2/506.81 MB 7:1/253.39 MB 5:2/506.80 MB 4:3/760.17 MB 1:2/506.77 MB 0:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:99.45% 1:0.2762% 2:0% 3:0% 4:0.2762% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(4s000ms): 881.21 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1002.36 MB, 1.06 GB, 1.09 GB, 1.19 GB, 1.22 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.31 GB, 1.45 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 5.433ms ; Min: 2.809ms ; Max: 7.554ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.31 - BytesRead: 1.47 GB (1576537765) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1576537765) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1576537765) - DecompressionTime: 9s010ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1189252753) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.292ms - RowBatchQueuePutWaitTime: 30m41s - RowsRead: 124.58M (124580613) - RowsReturned: 24.21M (24210513) - RowsReturnedRate: 85.35 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 10.55K (10552) - ScannerThreadsTotalWallClockTime: 31m3s - MaterializeTupleTime(*): 10s769ms - ScannerThreadsSysTime: 1s328ms - ScannerThreadsUserTime: 19s741ms - ScannerThreadsVoluntaryContextSwitches: 23.77K (23765) - TotalRawHdfsReadTime(*): 977.989ms - TotalReadThroughput: 8.31 MB/sec Instance aa4a715d244baecb:2bb62d6f0000000d (host=vb0208.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m25s, % non-child: 80.17%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 7:1/234.34 MB 5:2/506.78 MB 4:3/760.21 MB 8:3/760.15 MB 1:2/506.82 MB 3:1/253.41 MB 2:4/1013.57 MB 0:2/506.80 MB MemoryUsage(4s000ms): 1.07 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.06 GB, 1.01 GB, 977.29 MB, 942.19 MB, 916.02 MB, 907.03 MB, 889.67 MB, 859.49 MB, 835.22 MB, 787.13 MB, 764.99 MB, 726.16 MB, 684.33 MB, 643.83 MB, 628.50 MB, 590.93 MB, 559.35 MB, 642.00 MB, 617.80 MB, 579.46 MB, 613.96 MB, 580.80 MB, 592.16 MB, 694.56 MB, 783.23 MB, 767.84 MB, 728.41 MB, 704.80 MB, 650.92 MB, 596.74 MB, 539.27 MB, 486.06 MB, 453.11 MB, 424.50 MB, 372.48 MB, 303.69 MB, 263.68 MB, 213.12 MB, 152.02 MB, 110.00 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 12, 11, 9, 8, 8, 8, 8, 7, 6, 5, 5, 4, 3 - AverageThreadTokens: 11.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.10 GB (1180803981) - PerHostPeakMemUsage: 1.10 GB (1180803981) - RowsProduced: 24.00M (24004509) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m25s - TotalStorageWaitTime: 624.433ms - TotalThreadsInvoluntaryContextSwitches: 24.27K (24275) - TotalThreadsTotalWallClockTime: 34m9s - TotalThreadsSysTime: 2s064ms - TotalThreadsUserTime: 55s075ms - TotalThreadsVoluntaryContextSwitches: 39.56K (39563) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 355.353ms - OpenTime: 34.093ms - ExecTreeOpenTime: 49.998us - PrepareTime: 25.241ms - ExecTreePrepareTime: 325.236us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35s517ms, non-child: 35s517ms, % non-child: 100.00%) - BytesSent: 490.64 MB (514476323) - NetworkThroughput(*): 263.30 MB/sec - OverallThroughput: 13.81 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.00M (24004509) - SerializeBatchTime: 33s645ms - TransmitDataRPCTime: 1s863ms - UncompressedRowBatchSize: 847.11 MB (888260613) CodeGen:(Total: 56.737ms, non-child: 56.737ms, % non-child: 100.00%) - CodegenTime: 1.463ms - CompileTime: 10.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 23.118ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 22.833ms HDFS_SCAN_NODE (id=1):(Total: 298.471ms, non-child: 298.471ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 7:1/234.34 MB 5:2/506.78 MB 4:3/760.21 MB 8:3/760.15 MB 1:2/506.82 MB 3:1/253.41 MB 2:4/1013.57 MB 0:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0% 2:0% 3:0.2762% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 976.57 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 996.05 MB, 1.00 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.21 GB, 1.22 GB, 1.28 GB, 1.42 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB - FooterProcessingTime: (Avg: 5.627ms ; Min: 2.742ms ; Max: 8.252ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.33 - BytesRead: 1.54 GB (1657536250) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.54 GB (1657536250) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.54 GB (1657536250) - DecompressionTime: 9s556ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.10 GB (1180691850) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.491ms - RowBatchQueuePutWaitTime: 30m46s - RowsRead: 130.98M (130980854) - RowsReturned: 24.00M (24004509) - RowsReturnedRate: 80.42 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 10.63K (10634) - ScannerThreadsTotalWallClockTime: 31m8s - MaterializeTupleTime(*): 11s495ms - ScannerThreadsSysTime: 1s272ms - ScannerThreadsUserTime: 21s062ms - ScannerThreadsVoluntaryContextSwitches: 23.64K (23635) - TotalRawHdfsReadTime(*): 1s104ms - TotalReadThroughput: 8.73 MB/sec Instance aa4a715d244baecb:2bb62d6f00000008 (host=vb0232.halxg.cloudera.com:22000):(Total: 3m, non-child: 2m23s, % non-child: 79.48%) Hdfs split stats (:<# splits>/): 6:2/506.80 MB 9:3/760.17 MB 7:1/253.39 MB 8:5/1.24 GB 1:2/260.77 MB 5:3/760.18 MB 4:1/253.40 MB 2:1/253.40 MB 0:1/253.38 MB MemoryUsage(4s000ms): 1.06 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.05 GB, 1.01 GB, 981.32 MB, 941.85 MB, 918.27 MB, 895.48 MB, 876.73 MB, 858.49 MB, 826.73 MB, 799.87 MB, 753.24 MB, 711.58 MB, 669.34 MB, 626.35 MB, 610.47 MB, 589.07 MB, 644.96 MB, 643.91 MB, 667.59 MB, 692.46 MB, 699.56 MB, 661.30 MB, 697.30 MB, 753.90 MB, 726.83 MB, 697.55 MB, 665.14 MB, 645.18 MB, 594.74 MB, 536.75 MB, 469.51 MB, 433.82 MB, 401.34 MB, 371.43 MB, 329.29 MB, 291.35 MB, 246.53 MB, 191.89 MB, 139.63 MB, 71.08 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 12, 10, 9, 8, 7, 7, 7, 7, 6, 6, 5, 4, 2 - AverageThreadTokens: 11.28 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188888731) - PerHostPeakMemUsage: 1.11 GB (1188888731) - RowsProduced: 24.90M (24904227) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m24s - TotalStorageWaitTime: 573.750ms - TotalThreadsInvoluntaryContextSwitches: 24.55K (24548) - TotalThreadsTotalWallClockTime: 33m51s - TotalThreadsSysTime: 1s898ms - TotalThreadsUserTime: 55s737ms - TotalThreadsVoluntaryContextSwitches: 40.92K (40923) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 356.015ms - OpenTime: 33.637ms - ExecTreeOpenTime: 46.693us - PrepareTime: 23.325ms - ExecTreePrepareTime: 313.436us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 36s650ms, non-child: 36s650ms, % non-child: 100.00%) - BytesSent: 509.00 MB (533725492) - NetworkThroughput(*): 280.34 MB/sec - OverallThroughput: 13.89 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 24.90M (24904227) - SerializeBatchTime: 34s825ms - TransmitDataRPCTime: 1s815ms - UncompressedRowBatchSize: 878.86 MB (921553699) CodeGen:(Total: 54.455ms, non-child: 54.455ms, % non-child: 100.00%) - CodegenTime: 1.453ms - CompileTime: 10.141ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.750ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 21.003ms HDFS_SCAN_NODE (id=1):(Total: 299.955ms, non-child: 299.955ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/506.80 MB 9:3/760.17 MB 7:1/253.39 MB 8:5/1.24 GB 1:2/260.77 MB 5:3/760.18 MB 4:1/253.40 MB 2:1/253.40 MB 0:1/253.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.44% 1:0.5556% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 963.21 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1004.97 MB, 1.00 GB, 1.11 GB, 1.14 GB, 1.21 GB, 1.27 GB, 1.31 GB, 1.31 GB, 1.39 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 4.883ms ; Min: 2.614ms ; Max: 8.245ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.28 - BytesRead: 1.47 GB (1579317980) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1579317980) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1579317980) - DecompressionTime: 9s135ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188575888) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.642ms - RowBatchQueuePutWaitTime: 30m30s - RowsRead: 124.77M (124770123) - RowsReturned: 24.90M (24904227) - RowsReturnedRate: 83.03 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 11.16K (11158) - ScannerThreadsTotalWallClockTime: 30m51s - MaterializeTupleTime(*): 10s934ms - ScannerThreadsSysTime: 1s199ms - ScannerThreadsUserTime: 20s295ms - ScannerThreadsVoluntaryContextSwitches: 24.47K (24466) - TotalRawHdfsReadTime(*): 994.718ms - TotalReadThroughput: 8.37 MB/sec Instance aa4a715d244baecb:2bb62d6f00000007 (host=vb0234.halxg.cloudera.com:22000):(Total: 2m58s, non-child: 2m24s, % non-child: 80.74%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:2/506.77 MB 1:1/253.39 MB 7:3/760.20 MB 6:3/760.17 MB 3:3/760.18 MB 2:2/258.65 MB 0:2/506.79 MB MemoryUsage(4s000ms): 1.10 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.09 GB, 1.06 GB, 1.03 GB, 999.79 MB, 959.47 MB, 916.18 MB, 893.00 MB, 891.46 MB, 871.02 MB, 841.24 MB, 807.10 MB, 758.40 MB, 719.63 MB, 676.92 MB, 649.73 MB, 621.22 MB, 637.53 MB, 723.51 MB, 743.71 MB, 729.33 MB, 700.21 MB, 646.20 MB, 682.98 MB, 673.41 MB, 637.26 MB, 670.64 MB, 660.70 MB, 691.73 MB, 665.34 MB, 629.43 MB, 594.76 MB, 531.53 MB, 473.11 MB, 414.51 MB, 359.32 MB, 318.96 MB, 281.31 MB, 237.92 MB, 185.12 MB, 124.54 MB ThreadUsage(4s000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 12, 12, 12, 10, 9, 7, 6, 6, 6, 6, 5, 3 - AverageThreadTokens: 11.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.11 GB (1188388151) - PerHostPeakMemUsage: 1.11 GB (1188388151) - RowsProduced: 23.36M (23361849) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m24s - TotalStorageWaitTime: 697.451ms - TotalThreadsInvoluntaryContextSwitches: 22.99K (22991) - TotalThreadsTotalWallClockTime: 34m16s - TotalThreadsSysTime: 1s979ms - TotalThreadsUserTime: 51s949ms - TotalThreadsVoluntaryContextSwitches: 38.79K (38789) Fragment Instance Lifecycle Timings: - ExecTime: 2m58s - ExecTreeExecTime: 335.756ms - OpenTime: 33.577ms - ExecTreeOpenTime: 49.667us - PrepareTime: 27.244ms - ExecTreePrepareTime: 325.704us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 34s048ms, non-child: 34s048ms, % non-child: 100.00%) - BytesSent: 477.51 MB (500701167) - NetworkThroughput(*): 273.03 MB/sec - OverallThroughput: 14.02 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 23.36M (23361849) - SerializeBatchTime: 32s290ms - TransmitDataRPCTime: 1s748ms - UncompressedRowBatchSize: 824.43 MB (864479689) CodeGen:(Total: 58.242ms, non-child: 58.242ms, % non-child: 100.00%) - CodegenTime: 1.461ms - CompileTime: 10.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.91 MB (2003016) - NumFunctions: 22 (22) - NumInstructions: 390 (390) - OptimizationTime: 22.695ms - PeakMemoryUsage: 195.00 KB (199680) - PrepareTime: 24.839ms HDFS_SCAN_NODE (id=1):(Total: 281.667ms, non-child: 281.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:2/506.77 MB 1:1/253.39 MB 7:3/760.20 MB 6:3/760.17 MB 3:3/760.18 MB 2:2/258.65 MB 0:2/506.79 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0.2801% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:76 BytesRead(4s000ms): 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1002.33 MB, 1.03 GB, 1.16 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.22 GB, 1.29 GB, 1.31 GB, 1.31 GB, 1.39 GB, 1.43 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.47 GB - FooterProcessingTime: (Avg: 6.088ms ; Min: 2.898ms ; Max: 8.613ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.52 - BytesRead: 1.47 GB (1578597766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.47 GB (1578597766) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.47 GB (1578597766) - DecompressionTime: 8s835ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 12 (12) - NumScannersWithNoReads: 0 (0) - PeakMemoryUsage: 1.11 GB (1188176684) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.045ms - RowBatchQueuePutWaitTime: 30m57s - RowsRead: 124.71M (124712354) - RowsReturned: 23.36M (23361849) - RowsReturnedRate: 82.94 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9.77K (9771) - ScannerThreadsTotalWallClockTime: 31m18s - MaterializeTupleTime(*): 10s441ms - ScannerThreadsSysTime: 1s264ms - ScannerThreadsUserTime: 19s232ms - ScannerThreadsVoluntaryContextSwitches: 22.93K (22933) - TotalRawHdfsReadTime(*): 1s143ms - TotalReadThroughput: 8.43 MB/sec ================================================================================