Query (id=5c4ea905ef3e8e81:c65a0b777b980983): Summary: Session ID: ea466445b6d47dda:4f8bea6d851fc18b Session Type: BEESWAX Start Time: 2015-03-09 15:54:34.217055000 End Time: 2015-03-09 16:24:10.457405000 Query Type: QUERY Query State: EXCEPTION Query Status: Session closed Impala Version: impalad version 2.2.0-cdh5-INTERNAL DEBUG (build d5b55fcd8c8999b6eb5fa3fbbc6c06cd914600c7) User: dhecht Connected User: dhecht Delegated User: Network Address: 127.0.0.1:55677 Default Db: tpch_parquet Sql Statement: select s_name, count(*) as numwait from supplier, lineitem l1, orders, nation where s_suppkey = l1.l_suppkey and o_orderkey = l1.l_orderkey and o_orderstatus = 'F' and l1.l_receiptdate > l1.l_commitdate and exists ( select * from lineitem l2 where l2.l_orderkey = l1.l_orderkey and l2.l_suppkey <> l1.l_suppkey ) and not exists ( select * from lineitem l3 where l3.l_orderkey = l1.l_orderkey and l3.l_suppkey <> l1.l_suppkey and l3.l_receiptdate > l3.l_commitdate ) and s_nationkey = n_nationkey and n_name = 'SAUDI ARABIA' group by s_name order by numwait desc, s_name limit 100 Coordinator: dhecht-impala-s3.vpc.cloudera.com:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.03GB VCores=6 F07:PLAN FRAGMENT [UNPARTITIONED] 20:MERGING-EXCHANGE [UNPARTITIONED] order by: count(*) DESC, s_name ASC limit: 100 hosts=1 per-host-mem=unavailable tuple-ids=9 row-size=42B cardinality=100 F06:PLAN FRAGMENT [HASH(s_name)] DATASTREAM SINK [FRAGMENT=F07, EXCHANGE=20, UNPARTITIONED] 12:TOP-N [LIMIT=100] | order by: count(*) DESC, s_name ASC | hosts=1 per-host-mem=4.10KB | tuple-ids=9 row-size=42B cardinality=100 | 19:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: s_name | hosts=1 per-host-mem=10.00MB | tuple-ids=8 row-size=42B cardinality=10388 | 18:EXCHANGE [HASH(s_name)] hosts=1 per-host-mem=0B tuple-ids=8 row-size=42B cardinality=10388 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F06, EXCHANGE=18, HASH(s_name)] 11:AGGREGATE | output: count(*) | group by: s_name | hosts=1 per-host-mem=10.00MB | tuple-ids=8 row-size=42B cardinality=10388 | 10:HASH JOIN [LEFT ANTI JOIN, BROADCAST] | hash predicates: l1.l_orderkey = l3.l_orderkey | other join predicates: l3.l_suppkey != l1.l_suppkey | hosts=1 per-host-mem=42.81MB | tuple-ids=1,0,2,3 row-size=162B cardinality=600122 | |--17:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=6 row-size=68B cardinality=600122 | 09:HASH JOIN [LEFT SEMI JOIN, BROADCAST] | hash predicates: l1.l_orderkey = l2.l_orderkey | other join predicates: l2.l_suppkey != l1.l_suppkey | hosts=1 per-host-mem=100.73MB | tuple-ids=1,0,2,3 row-size=162B cardinality=600122 | |--16:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=4 row-size=16B cardinality=6001215 | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: s_nationkey = n_nationkey | hosts=1 per-host-mem=28B | tuple-ids=1,0,2,3 row-size=162B cardinality=600122 | |--15:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=3 row-size=25B cardinality=1 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l1.l_orderkey = o_orderkey | hosts=1 per-host-mem=13.11MB | tuple-ids=1,0,2 row-size=137B cardinality=600122 | |--14:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=2 row-size=25B cardinality=500000 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l1.l_suppkey = s_suppkey | hosts=1 per-host-mem=472.66KB | tuple-ids=1,0 row-size=112B cardinality=600122 | |--13:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=0 row-size=44B cardinality=10000 | 01:SCAN HDFS [tpch_parquet.lineitem l1, RANDOM] partitions=1/1 files=3 size=195.85MB predicates: l1.l_receiptdate > l1.l_commitdate table stats: 6001215 rows total column stats: all hosts=1 per-host-mem=320.00MB tuple-ids=1 row-size=68B cardinality=600122 F05:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=17, BROADCAST] 05:SCAN HDFS [tpch_parquet.lineitem l3, RANDOM] partitions=1/1 files=3 size=195.85MB predicates: l3.l_receiptdate > l3.l_commitdate table stats: 6001215 rows total column stats: all hosts=1 per-host-mem=1.25GB tuple-ids=6 row-size=68B cardinality=600122 F04:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=16, BROADCAST] 04:SCAN HDFS [tpch_parquet.lineitem l2, RANDOM] partitions=1/1 files=3 size=195.85MB table stats: 6001215 rows total column stats: all hosts=1 per-host-mem=1.25GB tuple-ids=4 row-size=16B cardinality=6001215 F03:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=15, BROADCAST] 03:SCAN HDFS [tpch_parquet.nation, RANDOM] partitions=1/1 files=1 size=2.17KB predicates: n_name = 'SAUDI ARABIA' table stats: 25 rows total column stats: all hosts=1 per-host-mem=32.00MB tuple-ids=3 row-size=25B cardinality=1 F02:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=14, BROADCAST] 02:SCAN HDFS [tpch_parquet.orders, RANDOM] partitions=1/1 files=2 size=54.93MB predicates: o_orderstatus = 'F' table stats: 1500000 rows total column stats: all hosts=1 per-host-mem=80.00MB tuple-ids=2 row-size=25B cardinality=500000 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=13, BROADCAST] 00:SCAN HDFS [tpch_parquet.supplier, RANDOM] partitions=1/1 files=1 size=888.89KB table stats: 10000 rows total column stats: all hosts=1 per-host-mem=48.00MB tuple-ids=0 row-size=44B cardinality=10000 ---------------- Estimated Per-Host Mem: 2178010461 Estimated Per-Host VCores: 6 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------------- 20:MERGING-EXCHANGE 1 57.837us 57.837us 0 100 0 -1.00 B UNPARTITIONED 12:TOP-N 3 46.221us 50.652us 0 100 4.00 KB 4.10 KB 19:AGGREGATE 3 288.856ms 309.500ms 0 10.39K 3.12 MB 10.00 MB FINALIZE 18:EXCHANGE 3 0ns 0ns 0 10.39K 0 0 HASH(s_name) 11:AGGREGATE 3 388.125ms 400.343ms 0 10.39K 3.12 MB 10.00 MB 10:HASH JOIN 3 1s980ms 3s647ms 0 600.12K 282.12 MB 42.81 MB LEFT ANTI JOIN, BROADCAST |--17:EXCHANGE 3 1s479ms 1s860ms 2.15M 600.12K 0 0 BROADCAST | 05:SCAN HDFS 3 9s674ms 9s855ms 2.15M 600.12K 20.60 MB 1.25 GB tpch_parquet.lineitem l3 09:HASH JOIN 3 228.646ms 685.939ms 0 600.12K 266.07 MB 100.73 MB LEFT SEMI JOIN, BROADCAST |--16:EXCHANGE 3 1s392ms 1s792ms 1.26M 6.00M 0 0 BROADCAST | 04:SCAN HDFS 3 986.398ms 1s546ms 1.26M 6.00M 10.82 MB 1.25 GB tpch_parquet.lineitem l2 08:HASH JOIN 3 22.387ms 24.573ms 0 600.12K 2.04 MB 28.00 B INNER JOIN, BROADCAST |--15:EXCHANGE 3 21.502us 35.57us 1 1 0 0 BROADCAST | 03:SCAN HDFS 1 303.905ms 303.905ms 1 1 50.00 KB 32.00 MB tpch_parquet.nation 07:HASH JOIN 3 194.735ms 556.25ms 0 600.12K 266.09 MB 13.11 MB INNER JOIN, BROADCAST |--14:EXCHANGE 3 201.969ms 438.85ms 702.00K 500.00K 0 0 BROADCAST | 02:SCAN HDFS 2 4s837ms 6s364ms 702.00K 500.00K 10.96 MB 80.00 MB tpch_parquet.orders 06:HASH JOIN 3 38.973ms 93.309ms 0 600.12K 3.27 MB 472.66 KB INNER JOIN, BROADCAST |--13:EXCHANGE 3 723.639us 2.170ms 10.00K 10.00K 0 0 BROADCAST | 00:SCAN HDFS 1 516.116ms 516.116ms 10.00K 10.00K 1.14 MB 48.00 MB tpch_parquet.supplier 01:SCAN HDFS 3 295.208ms 883.293ms 1.02K 600.12K 19.98 MB 320.00 MB tpch_parquet.lineitem l1 Planner Timeline: 50.93ms - Analysis finished: 20.298ms (20.298ms) - Equivalence classes computed: 22.160ms (1.861ms) - Single node plan created: 34.812ms (12.652ms) - Distributed plan created: 39.886ms (5.73ms) - Planning finished: 50.93ms (10.207ms) Query Timeline: 29m36s - Start execution: 96.53us (96.53us) - Planning finished: 87.79ms (86.983ms) - Ready to start remote fragments: 89.785ms (2.705ms) - Remote fragments started: 1s217ms (1s128ms) - Cancelled: 29m36s (29m35s) - Rows available: 29m36s (12.717ms) - Unregister query: 29m36s (5.480ms) ImpalaServer: - ClientFetchWaitTimer: 0ns - RowMaterializationTimer: 0ns Execution Profile 5c4ea905ef3e8e81:c65a0b777b980983:(Total: 29m36s, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 16, last: 0.007938ns, min: 0.007234ns, max: 0.510393ns, mean: 0.169528ns, stddev: 0.191379ns Per Node Peak Memory Usage: dhecht-impala-s3.vpc.cloudera.com:22002(732.50 MB) dhecht-impala-s3.vpc.cloudera.com:22001(747.08 MB) dhecht-impala-s3.vpc.cloudera.com:22000(708.31 MB) - FinalizationTimer: 0ns Coordinator Fragment F07:(Total: 29m35s, non-child: 1.38ms, % non-child: 0.00%) MemoryUsage(32s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB ThreadUsage(500.0ms): 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - PrepareTime: 104.302us - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 14 (14) - BufferedPins: 0 (0) - BytesWritten: 40.00 MB (41942880) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 624.00 MB (654311424) - PeakMemoryUsage: 616.25 MB (646184960) - TotalBufferWaitTime: 297.116ms - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns EXCHANGE_NODE (id=20):(Total: 29m35s, non-child: 57.837us, % non-child: 0.00%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 29m35s - MergeGetNext: 0ns - MergeGetNextBatch: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F06:(Total: 289.993ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:29m35s max:29m35s mean: 29m35s stddev:10.267656.267.656340ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 3.14 MB (3293184) - PerHostPeakMemUsage: 729.30 MB (764723989) - PrepareTime: 288.907ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 703.883ms, non-child: 703.883ms, % non-child: 100.00%) - CodegenTime: 7.211ms - CompileTime: 25.744ms - LoadTime: 67.597us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 397.602ms - PrepareTime: 278.320ms DataStreamSender (dst_id=20):(Total: 53.858us, non-child: 53.858us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 SORT_NODE (id=12):(Total: 288.903ms, non-child: 46.221us, % non-child: 0.02%) - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 288.856ms, non-child: 288.856ms, % non-child: 100.00%) - BuildTime: 0ns - GetNewBlockTime: 383.290us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.79us EXCHANGE_NODE (id=18): - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 344 (344) - BlocksRecycled: 31 (31) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 624.00 MB (654311424) - PeakMemoryUsage: 616.38 MB (646316048) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns Averaged Fragment F00:(Total: 497.179ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 56.34 MB, max: 69.89 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:29m35s max:29m35s mean: 29m35s stddev:10.127090.127.089907ms execution rates: min:32.50 KB/sec max:40.31 KB/sec mean:37.66 KB/sec stddev:3.65 KB/sec num instances: 3 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 663.76 MB (696002994) - PerHostPeakMemUsage: 729.30 MB (764723989) - PrepareTime: 486.162ms - RowsProduced: 0 (0) - TotalCpuTime: 5s555ms - TotalNetworkReceiveTime: 5s850ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 141.233ms CodeGen:(Total: 2s578ms, non-child: 2s578ms, % non-child: 100.00%) - CodegenTime: 6.841ms - CompileTime: 434.487ms - LoadTime: 70.694us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 1s720ms - PrepareTime: 422.1ms DataStreamSender (dst_id=18):(Total: 62.655us, non-child: 62.655us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=11):(Total: 486.157ms, non-child: 388.125ms, % non-child: 79.84%) - BuildTime: 0ns - GetNewBlockTime: 356.444us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 27.493us HASH_JOIN_NODE (id=10):(Total: 98.32ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 3s025ms - BuildRows: 1.97M (1968128) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 221.718ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 271.45 MB (284640597) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 4 (4) - UnpinTime: 2.888ms EXCHANGE_NODE (id=17):(Total: 4s609ms, non-child: 4s609ms, % non-child: 100.00%) - BytesReceived: 80.59 MB (84505675) - ConvertRowBatchTime: 775.874ms - DeserializeRowBatchTimer: 1s199ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.97M (1968128) - RowsReturnedRate: 451.95 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 76.78ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 1s181ms - BuildRows: 967.00K (966997) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 102.522ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 215.39 MB (225856170) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.418us EXCHANGE_NODE (id=16):(Total: 1s392ms, non-child: 1s392ms, % non-child: 100.00%) - BytesReceived: 15.08 MB (15811671) - ConvertRowBatchTime: 792.850ms - DeserializeRowBatchTimer: 147.526ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 967.00K (966997) - RowsReturnedRate: 705.05 K/sec - SendersBlockedTimer: 533.714ms - SendersBlockedTotalTimer(*): 1s414ms HASH_JOIN_NODE (id=8):(Total: 1s208ms, non-child: 22.387ms, % non-child: 1.85%) - BuildPartitionTime: 5.618us - BuildRows: 0 (0) - BuildRowsPartitioned: 0 (0) - BuildTime: 8.160us - GetNewBlockTime: 10.964ms - HashBuckets: 1 (1) - LargestPartitionPercent: 66 (66) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 10 (10) - PeakMemoryUsage: 1.36 MB (1430869) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.847us EXCHANGE_NODE (id=15):(Total: 21.502us, non-child: 21.502us, % non-child: 100.00%) - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 2.193us - DeserializeRowBatchTimer: 16.975us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 20.83 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 1s186ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 565.492ms - BuildRows: 328.89K (328891) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 168.335ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 10 (10) - PeakMemoryUsage: 126.72 MB (132877157) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.582us EXCHANGE_NODE (id=14):(Total: 1s741ms, non-child: 1s741ms, % non-child: 100.00%) - BytesReceived: 10.01 MB (10497535) - ConvertRowBatchTime: 165.617ms - DeserializeRowBatchTimer: 312.533ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 328.89K (328891) - RowsReturnedRate: 120.14 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 334.905ms, non-child: 38.973ms, % non-child: 11.64%) - BuildPartitionTime: 6.483ms - BuildRows: 3.33K (3333) - BuildRowsPartitioned: 3.33K (3333) - BuildTime: 4.805ms - GetNewBlockTime: 311.177us - HashBuckets: 10.92K (10922) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 5 (5) - PeakMemoryUsage: 1.10 MB (1149610) - PinTime: 0ns - ProbeRows: 341 (341) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.731us EXCHANGE_NODE (id=13):(Total: 723.639us, non-child: 723.639us, % non-child: 100.00%) - BytesReceived: 191.83 KB (196433) - ConvertRowBatchTime: 652.450us - DeserializeRowBatchTimer: 4.264ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 3.33K (3333) - RowsReturnedRate: 1.54 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 295.208ms, non-child: 295.208ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.56 MB (3737672) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 669.118us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 6.66 MB (6982770) - PerReadThreadRawHdfsThroughput: 10.46 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 22.75K (22745) - RowsReturned: 341 (341) - RowsReturnedRate: 386.00 /sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s022ms - TotalReadThroughput: 2.06 KB/sec Averaged Fragment F05:(Total: 10s663ms, non-child: 24.581ms, % non-child: 0.23%) split sizes: min: 56.34 MB, max: 69.89 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:29m35s max:29m35s mean: 29m35s stddev:13.688129.688.129230ms execution rates: min:32.50 KB/sec max:40.31 KB/sec mean:37.66 KB/sec stddev:3.65 KB/sec num instances: 3 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 20.68 MB (21689690) - PerHostPeakMemUsage: 729.30 MB (764723989) - PrepareTime: 221.262us - RowsProduced: 717.48K (717482) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 169.696ms - TotalStorageWaitTime: 861.788ms DataStreamSender (dst_id=17):(Total: 963.642ms, non-child: 963.642ms, % non-child: 100.00%) - BytesSent: 80.70 MB (84621062) - NetworkThroughput(*): 22.69 MB/sec - OverallThroughput: 84.81 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 750.449ms - ThriftTransmitTime(*): 3s566ms - UncompressedRowBatchSize: 164.23 MB (172204248) HDFS_SCAN_NODE (id=5):(Total: 9s674ms, non-child: 9s674ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 12.36 MB (12957479) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 19.894ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.58 MB (21581826) - PerReadThreadRawHdfsThroughput: 7.62 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.20M (1201087) - RowsReturned: 717.48K (717482) - RowsReturnedRate: 74.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s651ms - TotalReadThroughput: 7.14 KB/sec Averaged Fragment F04:(Total: 4s174ms, non-child: 17.355ms, % non-child: 0.42%) split sizes: min: 56.34 MB, max: 69.89 MB, avg: 65.28 MB, stddev: 6.32 MB completion times: min:29m35s max:29m35s mean: 29m35s stddev:5.836832.836.832431ms execution rates: min:32.50 KB/sec max:40.32 KB/sec mean:37.66 KB/sec stddev:3.65 KB/sec num instances: 3 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 10.88 MB (11404840) - PerHostPeakMemUsage: 729.30 MB (764723989) - PrepareTime: 177.902us - RowsProduced: 418.82K (418816) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 2s085ms - TotalStorageWaitTime: 884.24ms DataStreamSender (dst_id=16):(Total: 3s170ms, non-child: 3s170ms, % non-child: 100.00%) - BytesSent: 15.10 MB (15834924) - NetworkThroughput(*): 6.04 MB/sec - OverallThroughput: 4.71 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 354.305ms - ThriftTransmitTime(*): 2s478ms - UncompressedRowBatchSize: 33.56 MB (35185452) HDFS_SCAN_NODE (id=4):(Total: 986.398ms, non-child: 986.398ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 6.60 MB (6922418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 21.31ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.82 MB (11347512) - PerReadThreadRawHdfsThroughput: 6.77 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 460.80K (460800) - RowsReturned: 418.82K (418816) - RowsReturnedRate: 516.25 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s152ms - TotalReadThroughput: 3.81 KB/sec Averaged Fragment F03:(Total: 334.804ms, non-child: 30.729ms, % non-child: 9.18%) split sizes: min: 2.17 KB, max: 2.17 KB, avg: 2.17 KB, stddev: 0 completion times: min:309.717ms max:309.717ms mean: 309.717772.717.772000ms stddev:0.000000ns execution rates: min:7.02 KB/sec max:7.02 KB/sec mean:7.02 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 73.98 KB (75760) - PerHostPeakMemUsage: 31.22 MB (32741184) - PrepareTime: 231.683us - RowsProduced: 1 (1) - TotalCpuTime: 344.890ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 156.439us - TotalStorageWaitTime: 292.950ms DataStreamSender (dst_id=15):(Total: 170.585us, non-child: 170.585us, % non-child: 100.00%) - BytesSent: 123.00 B (123) - NetworkThroughput(*): 214.64 KB/sec - OverallThroughput: 704.15 KB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 47.149us - ThriftTransmitTime(*): 559.609us - UncompressedRowBatchSize: 132.00 B (132) HDFS_SCAN_NODE (id=3):(Total: 303.905ms, non-child: 303.905ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.64 KB (2701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.31us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 50.00 KB (51200) - PerReadThreadRawHdfsThroughput: 92.06 KB/sec - RemoteScanRanges: 0 (0) - RowsRead: 25 (25) - RowsReturned: 1 (1) - RowsReturnedRate: 3.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 294.835ms - MaterializeTupleTime(*): 60.914us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 28.651ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 5s204ms, non-child: 49.531ms, % non-child: 0.95%) split sizes: min: 11.82 MB, max: 43.11 MB, avg: 27.46 MB, stddev: 15.64 MB completion times: min:3s551ms max:29m35s mean: 14m49s stddev:14m45s execution rates: min:24.87 KB/sec max:3.33 MB/sec mean:1.68 MB/sec stddev:1.65 MB/sec num instances: 2 - AverageThreadTokens: 1.44 - PeakMemoryUsage: 7.21 MB (7555092) - PerHostPeakMemUsage: 679.14 MB (712125588) - PrepareTime: 226.951us - RowsProduced: 351.00K (351001) - TotalCpuTime: 6s803ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 62.530ms - TotalStorageWaitTime: 900.334ms DataStreamSender (dst_id=14):(Total: 318.39ms, non-child: 318.39ms, % non-child: 100.00%) - BytesSent: 15.02 MB (15754743) - NetworkThroughput(*): 10.59 MB/sec - OverallThroughput: 44.83 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 229.780ms - ThriftTransmitTime(*): 1s361ms - UncompressedRowBatchSize: 37.16 MB (38965282) HDFS_SCAN_NODE (id=2):(Total: 4s837ms, non-child: 4s837ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 3.21 MB (3366778) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 53.195ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.17 MB (7514132) - PerReadThreadRawHdfsThroughput: 3.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 750.00K (750000) - RowsReturned: 351.00K (351001) - RowsReturnedRate: 66.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1660) - ScannerThreadsTotalWallClockTime: 5s324ms - MaterializeTupleTime(*): 4s345ms - ScannerThreadsSysTime: 16.497ms - ScannerThreadsUserTime: 1s112ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 769.847ms - TotalReadThroughput: 188.71 KB/sec Averaged Fragment F01:(Total: 544.513ms, non-child: 6.403ms, % non-child: 1.18%) split sizes: min: 888.89 KB, max: 888.89 KB, avg: 888.89 KB, stddev: 0 completion times: min:545.637ms max:545.637ms mean: 545.637187.637.187000ms stddev:0.000000ns execution rates: min:1.59 MB/sec max:1.59 MB/sec mean:1.59 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 1.19 MB (1252392) - PerHostPeakMemUsage: 37.96 MB (39804872) - PrepareTime: 186.568us - RowsProduced: 10.00K (10000) - TotalCpuTime: 556.798ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 10.733ms - TotalStorageWaitTime: 508.464ms DataStreamSender (dst_id=13):(Total: 21.994ms, non-child: 21.994ms, % non-child: 100.00%) - BytesSent: 575.49 KB (589299) - NetworkThroughput(*): 13.59 MB/sec - OverallThroughput: 25.55 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 6.965ms - ThriftTransmitTime(*): 41.363ms - UncompressedRowBatchSize: 1.55 MB (1620120) HDFS_SCAN_NODE (id=0):(Total: 516.116ms, non-child: 516.116ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 229.21 KB (234710) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.988us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.14 MB (1199144) - PerReadThreadRawHdfsThroughput: 1015.84 KB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.00K (10000) - RowsReturned: 10.00K (10000) - RowsReturnedRate: 19.38 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 527.474ms - MaterializeTupleTime(*): 15.355ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 225.634ms - TotalReadThroughput: 445.88 KB/sec Fragment F06: Instance 5c4ea905ef3e8e81:c65a0b777b980986 (host=dhecht-impala-s3.vpc.cloudera.com:22000):(Total: 310.566ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(32s000ms): 3.09 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 3.14 MB (3293184) - PerHostPeakMemUsage: 708.31 MB (742718384) - PrepareTime: 309.555ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 728.881ms, non-child: 728.881ms, % non-child: 100.00%) - CodegenTime: 7.498ms - CompileTime: 32.624ms - LoadTime: 120.500us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 395.402ms - PrepareTime: 297.310ms DataStreamSender (dst_id=20):(Total: 59.931us, non-child: 59.931us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 SORT_NODE (id=12):(Total: 309.550ms, non-child: 50.652us, % non-child: 0.02%) - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 309.500ms, non-child: 309.500ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 347.442us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 30.138us EXCHANGE_NODE (id=18): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 5c4ea905ef3e8e81:c65a0b777b980985 (host=dhecht-impala-s3.vpc.cloudera.com:22002):(Total: 300.209ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(32s000ms): 3.09 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 3.14 MB (3293184) - PerHostPeakMemUsage: 732.50 MB (768084264) - PrepareTime: 299.126ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 321 (321) - BlocksRecycled: 31 (31) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 624.00 MB (654311424) - PeakMemoryUsage: 616.25 MB (646184976) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 736.944ms, non-child: 736.944ms, % non-child: 100.00%) - CodegenTime: 6.913ms - CompileTime: 13.321ms - LoadTime: 41.42us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 432.453ms - PrepareTime: 289.654ms DataStreamSender (dst_id=20):(Total: 56.305us, non-child: 56.305us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 SORT_NODE (id=12):(Total: 299.121ms, non-child: 45.128us, % non-child: 0.02%) - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 299.76ms, non-child: 299.76ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 351.882us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 24.783us EXCHANGE_NODE (id=18): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 5c4ea905ef3e8e81:c65a0b777b980987 (host=dhecht-impala-s3.vpc.cloudera.com:22001):(Total: 259.205ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(32s000ms): 3.09 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB, 3.14 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 3.14 MB (3293184) - PerHostPeakMemUsage: 747.08 MB (783369320) - PrepareTime: 258.40ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 368 (368) - BlocksRecycled: 32 (32) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 624.00 MB (654311424) - PeakMemoryUsage: 616.50 MB (646447120) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 645.823ms, non-child: 645.823ms, % non-child: 100.00%) - CodegenTime: 7.222ms - CompileTime: 31.287ms - LoadTime: 41.250us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 364.953ms - PrepareTime: 247.994ms DataStreamSender (dst_id=20):(Total: 45.340us, non-child: 45.340us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 SORT_NODE (id=12):(Total: 258.36ms, non-child: 42.884us, % non-child: 0.02%) - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 257.993ms, non-child: 257.993ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 450.548us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.318us EXCHANGE_NODE (id=18): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F00: Instance 5c4ea905ef3e8e81:c65a0b777b980989 (host=dhecht-impala-s3.vpc.cloudera.com:22000):(Total: 501.349ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:1/69.89 MB MemoryUsage(32s000ms): 511.23 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB, 579.32 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 583.50 MB (611844048) - PerHostPeakMemUsage: 708.31 MB (742718384) - PrepareTime: 499.399ms - RowsProduced: 0 (0) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 4s300ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 2s823ms, non-child: 2s823ms, % non-child: 100.00%) - CodegenTime: 6.887ms - CompileTime: 351.147ms - LoadTime: 125.599us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 2s042ms - PrepareTime: 428.140ms DataStreamSender (dst_id=18):(Total: 61.120us, non-child: 61.120us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=11):(Total: 499.394ms, non-child: 388.23ms, % non-child: 77.70%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 379.292us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 27.230us HASH_JOIN_NODE (id=10):(Total: 111.371ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Spilled - BuildPartitionTime: 3s228ms - BuildRows: 2.15M (2150400) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 299.1ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 282.12 MB (295825408) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 14 (14) - UnpinTime: 8.556ms EXCHANGE_NODE (id=17):(Total: 4s972ms, non-child: 1s452ms, % non-child: 29.21%) BytesReceived(32s000ms): 65.08 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB, 80.62 MB - BytesReceived: 80.62 MB (84534671) - ConvertRowBatchTime: 781.42ms - DeserializeRowBatchTimer: 1s182ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 2.15M (2150400) - RowsReturnedRate: 432.46 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 89.46ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 1s382ms - BuildRows: 1.25M (1254400) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 1.513ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 266.07 MB (278994944) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 30.538us EXCHANGE_NODE (id=16):(Total: 1s139ms, non-child: 1s139ms, % non-child: 100.00%) BytesReceived(32s000ms): 14.01 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB, 15.07 MB - BytesReceived: 15.07 MB (15807144) - ConvertRowBatchTime: 927.468ms - DeserializeRowBatchTimer: 151.410ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.25M (1254400) - RowsReturnedRate: 1.10 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=8):(Total: 68.46ms, non-child: 24.573ms, % non-child: 36.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 0ns - BuildRows: 0 (0) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=15): BytesReceived(32s000ms): 40.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 17.50us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 43.473ms, non-child: 28.182ms, % non-child: 64.83%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 0ns - BuildRows: 0 (0) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=14): BytesReceived(32s000ms): 8.64 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB - BytesReceived: 10.00 MB (10486281) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 350.999ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 15.291ms, non-child: 14.151ms, % non-child: 92.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 0ns - BuildRows: 0 (0) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 8.00 KB (8192) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=13): BytesReceived(32s000ms): 185.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB - BytesReceived: 191.83 KB (196433) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 3.867ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 1.139ms, non-child: 1.139ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/69.89 MB BytesRead(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - PeakMemoryUsage: 0 - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 5c4ea905ef3e8e81:c65a0b777b98098a (host=dhecht-impala-s3.vpc.cloudera.com:22001):(Total: 500.327ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:1/56.34 MB MemoryUsage(32s000ms): 634.79 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB, 709.86 MB ThreadUsage(32s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - PeakMemoryUsage: 709.86 MB (744337304) - PerHostPeakMemUsage: 747.08 MB (783369320) - PrepareTime: 492.597ms - RowsProduced: 0 (0) - TotalCpuTime: 7s969ms - TotalNetworkReceiveTime: 7s302ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 423.700ms CodeGen:(Total: 1s881ms, non-child: 1s881ms, % non-child: 100.00%) - CodegenTime: 6.699ms - CompileTime: 568.459ms - LoadTime: 27.775us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 880.16ms - PrepareTime: 431.878ms DataStreamSender (dst_id=18):(Total: 54.404us, non-child: 54.404us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=11):(Total: 492.592ms, non-child: 400.343ms, % non-child: 81.27%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 326.387us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 25.872us HASH_JOIN_NODE (id=10):(Total: 92.248ms, non-child: 2s293ms, % non-child: 100.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s247ms - BuildRows: 1.88M (1876992) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 193.1ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 266.12 MB (279048192) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 79.651us EXCHANGE_NODE (id=17):(Total: 5s696ms, non-child: 1s124ms, % non-child: 19.75%) BytesReceived(32s000ms): 65.15 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB - BytesReceived: 80.58 MB (84491177) - ConvertRowBatchTime: 622.870ms - DeserializeRowBatchTimer: 1s151ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.88M (1876992) - RowsReturnedRate: 329.48 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 70.555ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 1s515ms - BuildRows: 1.26M (1256448) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 1.103ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 266.07 MB (278994944) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.184us EXCHANGE_NODE (id=16):(Total: 1s792ms, non-child: 1s792ms, % non-child: 100.00%) BytesReceived(32s000ms): 14.05 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB, 15.10 MB - BytesReceived: 15.10 MB (15834924) - ConvertRowBatchTime: 1s165ms - DeserializeRowBatchTimer: 142.934ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.26M (1256448) - RowsReturnedRate: 700.80 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=8):(Total: 3s510ms, non-child: 23.539ms, % non-child: 0.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Filter Pushed Down - BuildPartitionTime: 8.981us - BuildRows: 1 (1) - BuildRowsPartitioned: 1 (1) - BuildTime: 12.504us - GetNewBlockTime: 3.498ms - HashBuckets: 2 (2) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.04 MB (2134016) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.754us EXCHANGE_NODE (id=15):(Total: 35.57us, non-child: 35.57us, % non-child: 100.00%) BytesReceived(32s000ms): 40.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 3.506us - DeserializeRowBatchTimer: 16.937us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 28.52 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 3s487ms, non-child: 556.25ms, % non-child: 15.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 534.132ms - BuildRows: 284.67K (284672) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 327.861ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 114.06 MB (119604224) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.108us EXCHANGE_NODE (id=14):(Total: 1s952ms, non-child: 167.824ms, % non-child: 8.60%) BytesReceived(32s000ms): 8.66 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB - BytesReceived: 10.02 MB (10503162) - ConvertRowBatchTime: 139.725ms - DeserializeRowBatchTimer: 286.457ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 284.67K (284672) - RowsReturnedRate: 145.82 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 978.774ms, non-child: 93.309ms, % non-child: 9.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Filter Pushed Down - BuildPartitionTime: 19.450ms - BuildRows: 10.00K (10000) - BuildRowsPartitioned: 10.00K (10000) - BuildTime: 14.417ms - GetNewBlockTime: 311.177us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.27 MB (3432448) - PinTime: 0ns - ProbeRows: 1.02K (1024) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.731us EXCHANGE_NODE (id=13):(Total: 2.170ms, non-child: 2.170ms, % non-child: 100.00%) BytesReceived(32s000ms): 185.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB - BytesReceived: 191.83 KB (196433) - ConvertRowBatchTime: 1.957ms - DeserializeRowBatchTimer: 4.463ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 10.00K (10000) - RowsReturnedRate: 4.61 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 883.293ms, non-child: 883.293ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/56.34 MB BytesRead(32s000ms): 9.02 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 10.69 MB (11213018) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 669.118us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.98 MB (20948312) - PerReadThreadRawHdfsThroughput: 10.46 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 68.24K (68236) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 1.16 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s022ms - TotalReadThroughput: 6.18 KB/sec Instance 5c4ea905ef3e8e81:c65a0b777b980988 (host=dhecht-impala-s3.vpc.cloudera.com:22002):(Total: 489.862ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:1/69.62 MB MemoryUsage(32s000ms): 607.61 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB, 697.93 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.01 - PeakMemoryUsage: 697.93 MB (731827632) - PerHostPeakMemUsage: 732.50 MB (768084264) - PrepareTime: 466.492ms - RowsProduced: 0 (0) - TotalCpuTime: 8s698ms - TotalNetworkReceiveTime: 5s948ms - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 3s030ms, non-child: 3s030ms, % non-child: 100.00%) - CodegenTime: 6.937ms - CompileTime: 383.855ms - LoadTime: 58.710us - ModuleFileSize: 1.90 MB (1994464) - OptimizationTime: 2s239ms - PrepareTime: 405.984ms DataStreamSender (dst_id=18):(Total: 72.441us, non-child: 72.441us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=11):(Total: 466.487ms, non-child: 376.9ms, % non-child: 80.60%) ExecOption: Codegen Enabled - BuildTime: 0ns - GetNewBlockTime: 363.655us - GetResultsTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 3.12 MB (3276800) - PinTime: 0ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.377us HASH_JOIN_NODE (id=10):(Total: 90.477ms, non-child: 3s647ms, % non-child: 100.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 3s599ms - BuildRows: 1.88M (1876992) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 173.151ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 266.12 MB (279048192) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.399us EXCHANGE_NODE (id=17):(Total: 3s160ms, non-child: 1s860ms, % non-child: 58.89%) BytesReceived(32s000ms): 65.24 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB, 80.58 MB - BytesReceived: 80.58 MB (84491177) - ConvertRowBatchTime: 923.709ms - DeserializeRowBatchTimer: 1s263ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.88M (1876992) - RowsReturnedRate: 593.92 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=9):(Total: 68.633ms, non-child: 685.939ms, % non-child: 100.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 646.138ms - BuildRows: 390.14K (390144) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 304.951ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 114.04 MB (119578624) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.534us EXCHANGE_NODE (id=16):(Total: 1s245ms, non-child: 1s245ms, % non-child: 100.00%) BytesReceived(32s000ms): 14.04 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB, 15.06 MB - BytesReceived: 15.06 MB (15792946) - ConvertRowBatchTime: 285.796ms - DeserializeRowBatchTimer: 148.235ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 390.14K (390144) - RowsReturnedRate: 313.22 K/sec - SendersBlockedTimer: 1s601ms - SendersBlockedTotalTimer(*): 4s244ms HASH_JOIN_NODE (id=8):(Total: 48.283ms, non-child: 19.49ms, % non-child: 39.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Build-Side Filter Pushed Down - BuildPartitionTime: 7.875us - BuildRows: 1 (1) - BuildRowsPartitioned: 1 (1) - BuildTime: 11.978us - GetNewBlockTime: 18.431ms - HashBuckets: 2 (2) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.04 MB (2134016) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 28.941us EXCHANGE_NODE (id=15):(Total: 29.450us, non-child: 29.450us, % non-child: 100.00%) BytesReceived(32s000ms): 40.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B, 41.00 B - BytesReceived: 41.00 B (41) - ConvertRowBatchTime: 3.73us - DeserializeRowBatchTimer: 16.938us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 33.95 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 29.204ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 1s162ms - BuildRows: 702.00K (702003) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - GetNewBlockTime: 8.809ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 266.09 MB (279010864) - PinTime: 0ns - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 29.56us EXCHANGE_NODE (id=14):(Total: 3s271ms, non-child: 438.85ms, % non-child: 13.39%) BytesReceived(32s000ms): 8.67 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB, 10.02 MB - BytesReceived: 10.02 MB (10503162) - ConvertRowBatchTime: 357.128ms - DeserializeRowBatchTimer: 300.141ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 702.00K (702003) - RowsReturnedRate: 214.59 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 10.650ms, non-child: 9.459ms, % non-child: 88.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled - BuildPartitionTime: 0ns - BuildRows: 0 (0) - BuildRowsPartitioned: 0 (0) - BuildTime: 0ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 8.00 KB (8192) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=13): BytesReceived(32s000ms): 185.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB, 191.83 KB - BytesReceived: 191.83 KB (196433) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 4.462ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=1):(Total: 1.191ms, non-child: 1.191ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/69.62 MB BytesRead(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - PeakMemoryUsage: 0 - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F05: Instance 5c4ea905ef3e8e81:c65a0b777b98098c (host=dhecht-impala-s3.vpc.cloudera.com:22000):(Total: 10s682ms, non-child: 13.799ms, % non-child: 0.13%) Hdfs split stats (:<# splits>/): -1:1/69.89 MB MemoryUsage(32s000ms): 19.42 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB, 20.62 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 20.62 MB (21624152) - PerHostPeakMemUsage: 708.31 MB (742718384) - PrepareTime: 214.436us - RowsProduced: 735.23K (735232) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 276.776ms - TotalStorageWaitTime: 1s229ms DataStreamSender (dst_id=17):(Total: 1s075ms, non-child: 1s075ms, % non-child: 100.00%) - BytesSent: 84.31 MB (88410672) - NetworkThroughput(*): 22.58 MB/sec - OverallThroughput: 78.43 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 768.664ms - ThriftTransmitTime(*): 3s734ms - UncompressedRowBatchSize: 168.29 MB (176464296) HDFS_SCAN_NODE (id=5):(Total: 9s594ms, non-child: 9s594ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/69.89 MB BytesRead(32s000ms): 12.85 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB, 13.21 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 13.21 MB (13855307) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 16.797ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.54 MB (21538136) - PerReadThreadRawHdfsThroughput: 6.41 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.23M (1229471) - RowsReturned: 735.23K (735232) - RowsReturnedRate: 76.63 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s060ms - TotalReadThroughput: 7.63 KB/sec Instance 5c4ea905ef3e8e81:c65a0b777b98098b (host=dhecht-impala-s3.vpc.cloudera.com:22002):(Total: 10s675ms, non-child: 24.694ms, % non-child: 0.23%) Hdfs split stats (:<# splits>/): -1:1/69.62 MB MemoryUsage(32s000ms): 19.49 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB, 20.68 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 20.68 MB (21689688) - PerHostPeakMemUsage: 732.50 MB (768084264) - PrepareTime: 228.337us - RowsProduced: 648.19K (648192) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 77.860ms - TotalStorageWaitTime: 744.62ms DataStreamSender (dst_id=17):(Total: 795.844ms, non-child: 795.844ms, % non-child: 100.00%) - BytesSent: 77.14 MB (80886114) - NetworkThroughput(*): 23.97 MB/sec - OverallThroughput: 96.93 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 699.576ms - ThriftTransmitTime(*): 3s218ms - UncompressedRowBatchSize: 148.37 MB (155573676) HDFS_SCAN_NODE (id=5):(Total: 9s855ms, non-child: 9s855ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/69.62 MB BytesRead(32s000ms): 12.96 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB, 13.16 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 13.16 MB (13804112) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.485ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.60 MB (21603672) - PerReadThreadRawHdfsThroughput: 8.49 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.09M (1090755) - RowsReturned: 648.19K (648192) - RowsReturnedRate: 65.77 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s551ms - TotalReadThroughput: 7.61 KB/sec Instance 5c4ea905ef3e8e81:c65a0b777b98098d (host=dhecht-impala-s3.vpc.cloudera.com:22001):(Total: 10s630ms, non-child: 35.250ms, % non-child: 0.33%) Hdfs split stats (:<# splits>/): -1:1/56.34 MB MemoryUsage(32s000ms): 19.54 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB, 20.75 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 20.75 MB (21755232) - PerHostPeakMemUsage: 747.08 MB (783369320) - PrepareTime: 221.13us - RowsProduced: 769.02K (769024) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 154.452ms - TotalStorageWaitTime: 612.290ms DataStreamSender (dst_id=17):(Total: 1s020ms, non-child: 1s020ms, % non-child: 100.00%) - BytesSent: 80.65 MB (84566400) - NetworkThroughput(*): 21.53 MB/sec - OverallThroughput: 79.06 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 783.105ms - ThriftTransmitTime(*): 3s746ms - UncompressedRowBatchSize: 176.02 MB (184574772) HDFS_SCAN_NODE (id=5):(Total: 9s575ms, non-child: 9s575ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/56.34 MB BytesRead(32s000ms): 10.53 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB, 10.69 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 10.69 MB (11213018) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 28.400ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.60 MB (21603672) - PerReadThreadRawHdfsThroughput: 7.97 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.28M (1283036) - RowsReturned: 769.02K (769024) - RowsReturnedRate: 80.31 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s341ms - TotalReadThroughput: 6.18 KB/sec Fragment F04: Instance 5c4ea905ef3e8e81:c65a0b777b98098f (host=dhecht-impala-s3.vpc.cloudera.com:22000):(Total: 4s181ms, non-child: 21.387ms, % non-child: 0.51%) Hdfs split stats (:<# splits>/): -1:1/69.89 MB MemoryUsage(32s000ms): 10.59 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB, 10.88 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 10.88 MB (11404840) - PerHostPeakMemUsage: 708.31 MB (742718384) - PrepareTime: 175.299us - RowsProduced: 300.03K (300032) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 2s071ms - TotalStorageWaitTime: 1s450ms DataStreamSender (dst_id=16):(Total: 2s613ms, non-child: 2s613ms, % non-child: 100.00%) - BytesSent: 10.91 MB (11436030) - NetworkThroughput(*): 4.79 MB/sec - OverallThroughput: 4.17 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 184.264ms - ThriftTransmitTime(*): 2s276ms - UncompressedRowBatchSize: 24.04 MB (25206204) HDFS_SCAN_NODE (id=4):(Total: 1s546ms, non-child: 1s546ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/69.89 MB BytesRead(32s000ms): 6.72 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB, 7.05 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.05 MB (7392971) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 50.164ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.82 MB (11347512) - PerReadThreadRawHdfsThroughput: 3.72 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 342.02K (342016) - RowsReturned: 300.03K (300032) - RowsReturnedRate: 194.05 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s896ms - TotalReadThroughput: 4.07 KB/sec Instance 5c4ea905ef3e8e81:c65a0b777b980990 (host=dhecht-impala-s3.vpc.cloudera.com:22001):(Total: 4s180ms, non-child: 7.869ms, % non-child: 0.19%) Hdfs split stats (:<# splits>/): -1:1/56.34 MB MemoryUsage(32s000ms): 10.76 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB, 10.81 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 10.88 MB (11404840) - PerHostPeakMemUsage: 747.08 MB (783369320) - PrepareTime: 185.171us - RowsProduced: 495.62K (495616) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 2s018ms - TotalStorageWaitTime: 543.640ms DataStreamSender (dst_id=16):(Total: 3s476ms, non-child: 3s476ms, % non-child: 100.00%) - BytesSent: 17.84 MB (18711531) - NetworkThroughput(*): 6.86 MB/sec - OverallThroughput: 5.13 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 441.952ms - ThriftTransmitTime(*): 2s600ms - UncompressedRowBatchSize: 39.71 MB (41637552) HDFS_SCAN_NODE (id=4):(Total: 696.322ms, non-child: 696.322ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/56.34 MB BytesRead(32s000ms): 5.64 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB, 5.73 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 5.73 MB (6006725) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 7.613ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.82 MB (11347512) - PerReadThreadRawHdfsThroughput: 9.00 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 537.60K (537600) - RowsReturned: 495.62K (495616) - RowsReturnedRate: 711.76 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 636.181ms - TotalReadThroughput: 3.31 KB/sec Instance 5c4ea905ef3e8e81:c65a0b777b98098e (host=dhecht-impala-s3.vpc.cloudera.com:22002):(Total: 4s162ms, non-child: 22.811ms, % non-child: 0.55%) Hdfs split stats (:<# splits>/): -1:1/69.62 MB MemoryUsage(32s000ms): 10.54 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB, 10.75 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 10.88 MB (11404840) - PerHostPeakMemUsage: 732.50 MB (768084264) - PrepareTime: 173.237us - RowsProduced: 460.80K (460800) - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 2s165ms - TotalStorageWaitTime: 657.731ms DataStreamSender (dst_id=16):(Total: 3s422ms, non-child: 3s422ms, % non-child: 100.00%) - BytesSent: 16.55 MB (17357211) - NetworkThroughput(*): 6.47 MB/sec - OverallThroughput: 4.84 MB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 436.700ms - ThriftTransmitTime(*): 2s557ms - UncompressedRowBatchSize: 36.92 MB (38712600) HDFS_SCAN_NODE (id=4):(Total: 716.709ms, non-child: 716.709ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/69.62 MB BytesRead(32s000ms): 6.81 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB, 7.03 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.03 MB (7367560) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5.314ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.82 MB (11347512) - PerReadThreadRawHdfsThroughput: 7.58 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 502.78K (502784) - RowsReturned: 460.80K (460800) - RowsReturnedRate: 642.94 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 926.363ms - TotalReadThroughput: 4.06 KB/sec Fragment F03: Instance 5c4ea905ef3e8e81:c65a0b777b980991 (host=dhecht-impala-s3.vpc.cloudera.com:22002):(Total: 334.804ms, non-child: 30.729ms, % non-child: 9.18%) Hdfs split stats (:<# splits>/): -1:1/2.17 KB MemoryUsage(500.0ms): 59.98 KB ThreadUsage(500.0ms): 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 73.98 KB (75760) - PerHostPeakMemUsage: 31.22 MB (32741184) - PrepareTime: 231.683us - RowsProduced: 1 (1) - TotalCpuTime: 344.890ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 156.439us - TotalStorageWaitTime: 292.950ms DataStreamSender (dst_id=15):(Total: 170.585us, non-child: 170.585us, % non-child: 100.00%) - BytesSent: 123.00 B (123) - NetworkThroughput(*): 214.64 KB/sec - OverallThroughput: 704.15 KB/sec - PeakMemoryUsage: 15.98 KB (16368) - SerializeBatchTime: 47.149us - ThriftTransmitTime(*): 559.609us - UncompressedRowBatchSize: 132.00 B (132) HDFS_SCAN_NODE (id=3):(Total: 303.905ms, non-child: 303.905ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/2.17 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0 - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.64 KB (2701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14.31us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 50.00 KB (51200) - PerReadThreadRawHdfsThroughput: 92.06 KB/sec - RemoteScanRanges: 0 (0) - RowsRead: 25 (25) - RowsReturned: 1 (1) - RowsReturnedRate: 3.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 294.835ms - MaterializeTupleTime(*): 60.914us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 28.651ms - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 5c4ea905ef3e8e81:c65a0b777b980993 (host=dhecht-impala-s3.vpc.cloudera.com:22001):(Total: 6s908ms, non-child: 70.72ms, % non-child: 1.01%) Hdfs split stats (:<# splits>/): -1:1/43.11 MB MemoryUsage(32s000ms): 4.01 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 11.02 MB (11557192) - PerHostPeakMemUsage: 747.08 MB (783369320) - PrepareTime: 215.147us - RowsProduced: 546.82K (546816) - TotalCpuTime: 7s119ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 96.569ms - TotalStorageWaitTime: 1s202ms DataStreamSender (dst_id=14):(Total: 473.833ms, non-child: 473.833ms, % non-child: 100.00%) - BytesSent: 23.57 MB (24718329) - NetworkThroughput(*): 11.47 MB/sec - OverallThroughput: 49.75 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 358.523ms - ThriftTransmitTime(*): 2s054ms - UncompressedRowBatchSize: 57.89 MB (60702984) HDFS_SCAN_NODE (id=2):(Total: 6s364ms, non-child: 6s364ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/43.11 MB BytesRead(32s000ms): 4.73 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB, 4.96 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.96 MB (5198987) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 55.66ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.96 MB (11495752) - PerReadThreadRawHdfsThroughput: 4.98 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.18M (1181503) - RowsReturned: 546.82K (546816) - RowsReturnedRate: 85.92 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2.53K (2527) - ScannerThreadsTotalWallClockTime: 7s119ms - MaterializeTupleTime(*): 5s820ms - ScannerThreadsSysTime: 25.996ms - ScannerThreadsUserTime: 1s747ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 995.100ms - TotalReadThroughput: 2.87 KB/sec Instance 5c4ea905ef3e8e81:c65a0b777b980992 (host=dhecht-impala-s3.vpc.cloudera.com:22000):(Total: 3s501ms, non-child: 28.990ms, % non-child: 0.83%) Hdfs split stats (:<# splits>/): -1:1/11.82 MB MemoryUsage(500.0ms): 0, 2.31 MB, 3.22 MB, 3.22 MB, 3.22 MB, 3.22 MB, 3.22 MB, 3.24 MB ThreadUsage(500.0ms): 1, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.88 - PeakMemoryUsage: 3.39 MB (3552992) - PerHostPeakMemUsage: 611.19 MB (640881856) - PrepareTime: 238.755us - RowsProduced: 155.19K (155187) - TotalCpuTime: 6s487ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 28.490ms - TotalStorageWaitTime: 598.333ms DataStreamSender (dst_id=14):(Total: 162.246ms, non-child: 162.246ms, % non-child: 100.00%) - BytesSent: 6.48 MB (6791157) - NetworkThroughput(*): 9.70 MB/sec - OverallThroughput: 39.92 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 101.38ms - ThriftTransmitTime(*): 667.810ms - UncompressedRowBatchSize: 16.43 MB (17227581) HDFS_SCAN_NODE (id=2):(Total: 3s310ms, non-child: 3s310ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/11.82 MB Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:0% 2:14.29% 3:0% 4:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 100.00 KB, 1.46 MB, 1.46 MB, 1.46 MB, 1.46 MB, 1.46 MB, 1.46 MB - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.46 MB (1534569) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.325ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.37 MB (3532512) - PerReadThreadRawHdfsThroughput: 2.69 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 318.50K (318497) - RowsReturned: 155.19K (155187) - RowsReturnedRate: 46.88 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 793 (793) - ScannerThreadsTotalWallClockTime: 3s529ms - MaterializeTupleTime(*): 2s871ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 476.927ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 544.593ms - TotalReadThroughput: 374.56 KB/sec Fragment F01: Instance 5c4ea905ef3e8e81:c65a0b777b980994 (host=dhecht-impala-s3.vpc.cloudera.com:22002):(Total: 544.513ms, non-child: 6.403ms, % non-child: 1.18%) Hdfs split stats (:<# splits>/): -1:1/888.89 KB MemoryUsage(500.0ms): 715.22 KB ThreadUsage(500.0ms): 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 1.19 MB (1252392) - PerHostPeakMemUsage: 37.96 MB (39804872) - PrepareTime: 186.568us - RowsProduced: 10.00K (10000) - TotalCpuTime: 556.798ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 10.733ms - TotalStorageWaitTime: 508.464ms DataStreamSender (dst_id=13):(Total: 21.994ms, non-child: 21.994ms, % non-child: 100.00%) - BytesSent: 575.49 KB (589299) - NetworkThroughput(*): 13.59 MB/sec - OverallThroughput: 25.55 MB/sec - PeakMemoryUsage: 12.00 KB (12288) - SerializeBatchTime: 6.965ms - ThriftTransmitTime(*): 41.363ms - UncompressedRowBatchSize: 1.55 MB (1620120) HDFS_SCAN_NODE (id=0):(Total: 516.116ms, non-child: 516.116ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:1/888.89 KB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:3 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 222.94 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 229.21 KB (234710) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.988us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.14 MB (1199144) - PerReadThreadRawHdfsThroughput: 1015.84 KB/sec - RemoteScanRanges: 0 (0) - RowsRead: 10.00K (10000) - RowsReturned: 10.00K (10000) - RowsReturnedRate: 19.38 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 527.474ms - MaterializeTupleTime(*): 15.355ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 10.998ms - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 225.634ms - TotalReadThroughput: 445.88 KB/sec