Query (id=b64a3852190d9ac2:412186998b9ee4a1): Summary: Session ID: 8d43f9002c6cc53e:b93b424d18a15bb1 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2016-09-13 09:05:50.993210000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.6.0-cdh5.8.0 RELEASE (build 8d8652f69461f0dd8d5f474573fb5de7ceb0ee6b) User: BI Connected User: BI Delegated User: Network Address: ::ffff:10.1.17.0:55026 Default Db: trivago_analytic Sql Statement: SELECT FROM_UNIXTIME( UNIX_TIMESTAMP( CONCAT(CAST( ssm.ymd as STRING ),CAST( pl.time AS string )), 'yyyyMMddHH:mm:ss' ) ) AS datetime_click, FROM_UNIXTIME( LEAD( UNIX_TIMESTAMP( CONCAT( CAST( ssm.ymd as STRING ), CAST( pl.time AS string ) ), 'yyyyMMddHH:mm:ss' ), 1 ) OVER (PARTITION BY ssm.tracking_int_id ORDER BY cl.date_id) ) AS datetime_next_click_v1, LEAD( FROM_UNIXTIME( UNIX_TIMESTAMP( CONCAT( CAST( ssm.ymd as STRING ), CAST( pl.time AS string ) ), 'yyyyMMddHH:mm:ss' ) ), 1 ) OVER (PARTITION BY ssm.tracking_int_id ORDER BY cl.date_id) AS datetime_next_click_v2, LEAD( ssm.ymd, 1 ) OVER (PARTITION BY ssm.tracking_int_id ORDER BY cl.date_id) AS ymd_next_click, LEAD( pl.time, 1 ) OVER (PARTITION BY ssm.tracking_int_id ORDER BY cl.date_id) AS time_next_click FROM trivago_analytic.session_stats_master ssm JOIN ssm.co_log_entries AS cl JOIN ssm.page_log_entries AS pl ON pl.date_id = cl.date_id WHERE ssm.ymd BETWEEN 20160501 AND 20160503 AND ssm.crawler_id = 0 AND cl.page_id = 8001 ORDER BY ssm.ymd, cl.date_id Coordinator: dn12.hadoop.trivago.com:22000 Query Options (non default): QUERY_TIMEOUT_S=600 Plan: ---------------- Estimated Per-Host Requirements: Memory=464.00MB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. trivago_analytic.session_stats_master 11:MERGING-EXCHANGE [UNPARTITIONED] | order by: ymd ASC, date_id ASC | hosts=51 per-host-mem=unavailable | tuple-ids=4 row-size=80B cardinality=8183490 | 09:SORT | order by: ymd ASC, date_id ASC | hosts=51 per-host-mem=112.00MB | tuple-ids=4 row-size=80B cardinality=8183490 | 08:ANALYTIC | functions: lead(unix_timestamp(concat(CAST(ymd AS STRING), CAST(time AS STRING)), 'yyyyMMddHH:mm:ss'), 1, NULL), lead(from_unixtime(unix_timestamp(concat(CAST(ymd AS STRING), CAST(time AS STRING)), 'yyyyMMddHH:mm:ss')), 1, NULL), lead(ymd, 1, NULL), lead(time, 1, NULL) | partition by: ssm.tracking_int_id | order by: date_id ASC | window: ROWS BETWEEN UNBOUNDED PRECEDING AND 1 FOLLOWING | hosts=51 per-host-mem=0B | tuple-ids=6,5 row-size=136B cardinality=8183490 | 07:SORT | order by: tracking_int_id ASC NULLS FIRST, date_id ASC | hosts=51 per-host-mem=112.00MB | tuple-ids=6 row-size=92B cardinality=8183490 | 10:EXCHANGE [HASH(ssm.tracking_int_id)] | hosts=51 per-host-mem=0B | tuple-ids=1,0,2 row-size=92B cardinality=8183490 | 01:SUBPLAN | hosts=51 per-host-mem=0B | tuple-ids=1,0,2 row-size=92B cardinality=8183490 | |--06:HASH JOIN [INNER JOIN] | | hash predicates: cl.date_id = pl.date_id | | hosts=51 per-host-mem=0B | | tuple-ids=1,0,2 row-size=92B cardinality=10 | | | |--04:UNNEST [ssm.page_log_entries pl] | | parent-subplan=01 | | hosts=51 per-host-mem=0B | | tuple-ids=2 row-size=0B cardinality=10 | | | 05:NESTED LOOP JOIN [CROSS JOIN] | | hosts=51 per-host-mem=48B | | tuple-ids=1,0 row-size=60B cardinality=10 | | | |--02:SINGULAR ROW SRC | | parent-subplan=01 | | hosts=51 per-host-mem=0B | | tuple-ids=0 row-size=48B cardinality=1 | | | 03:UNNEST [ssm.co_log_entries cl] | parent-subplan=01 | hosts=51 per-host-mem=0B | tuple-ids=1 row-size=0B cardinality=10 | 00:SCAN HDFS [trivago_analytic.session_stats_master ssm, RANDOM] partitions=3/3178 files=384 size=59.97GB predicates: ssm.crawler_id = 0, !empty(ssm.co_log_entries), !empty(ssm.page_log_entries) predicates on cl: cl.page_id = 8001 table stats: 9479908430 rows total columns missing stats: co_log_entries, page_log_entries hosts=51 per-host-mem=352.00MB tuple-ids=0 row-size=48B cardinality=818349 ---------------- Estimated Per-Host Mem: 486539312 Estimated Per-Host VCores: 2 Tables Missing Stats: trivago_analytic.session_stats_master Request Pool: default-pool Admission result: Admitted immediately Planner Timeline: 21.466ms - Analysis finished: 6.790ms (6.790ms) - Equivalence classes computed: 7.003ms (213.002us) - Single node plan created: 15.231ms (8.228ms) - Runtime filters computed: 15.329ms (97.722us) - Distributed plan created: 16.415ms (1.086ms) - Lineage info computed: 17.285ms (869.692us) - Planning finished: 21.466ms (4.181ms) Query Timeline: 46s801ms - Start execution: 358.648us (358.648us) - Planning finished: 28.525ms (28.166ms) - Submit for admission: 31.660ms (3.135ms) - Completed admission: 32.183ms (522.272us) - Ready to start 102 remote fragments: 36.263ms (4.080ms) - All 102 remote fragments started: 539.504ms (503.241ms) - Rows available: 43s187ms (42s648ms) - First row fetched: 45s062ms (1s874ms) ImpalaServer: - ClientFetchWaitTimer: 1s874ms - RowMaterializationTimer: 2.381ms Execution Profile b64a3852190d9ac2:412186998b9ee4a1:(Total: 43s156ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 102, 25th %-ile: 3ms, 50th %-ile: 4ms, 75th %-ile: 8ms, 90th %-ile: 12ms, 95th %-ile: 40ms, 99.9th %-ile: 452ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F02:(Total: 42s651ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 7.79 MB, 29.51 MB, 34.43 MB, 35.10 MB, 35.66 MB, 35.67 MB, 35.67 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 35.67 MB (37406680) - PerHostPeakMemUsage: 0 - PrepareTime: 514.000us - RowsProduced: 1.02K (1024) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.63M (2625668) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=11):(Total: 42s648ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.02 MB, 12.77 MB, 15.51 MB, 15.83 MB, 16.07 MB, 16.07 MB, 16.07 MB - BytesReceived: 16.07 MB (16854722) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 102.552ms - FirstBatchArrivalWaitTime: 42s645ms - MergeGetNext: 1.944ms - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.02K (1024) - RowsReturnedRate: 24.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 24s347ms Averaged Fragment F01:(Total: 41s055ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 903.06 MB (946925535) - PrepareTime: 245.949ms - RowsProduced: 8.40K (8400) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s766ms - TotalNetworkSendTime: 433.019ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.82M (2815823) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.77 GB (24445521877) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 774.350ms, non-child: 774.350ms, % non-child: 100.00%) - CodegenTime: 358.081us - CompileTime: 153.070ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 411.460ms - PrepareTime: 209.061ms DataStreamSender (dst_id=11):(Total: 6.398ms, non-child: 6.398ms, % non-child: 100.00%) - BytesSent: 365.39 KB (374156) - NetworkThroughput(*): 590.89 MB/sec - OverallThroughput: 66.28 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 7.38K (7376) - SerializeBatchTime: 5.598ms - TransmitDataRPCTime: 901.750us - UncompressedRowBatchSize: 907.35 KB (929125) SORT_NODE (id=9):(Total: 40s612ms, non-child: 147.014ms, % non-child: 0.36%) - InMemorySortTime: 101.045ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 8.40K (8400) - RowsReturnedRate: 208.00 /sec - SortDataSize: 20.57 MB (21572639) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s465ms, non-child: 1s264ms, % non-child: 3.13%) - EvaluationTime: 1s201ms - GetNewBlockTime: 135.195us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.23K (203232) - RowsReturnedRate: 5.02 K/sec - UnpinTime: 4.382us SORT_NODE (id=7):(Total: 39s200ms, non-child: 419.502ms, % non-child: 1.07%) - InMemorySortTime: 124.375ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096253) - RowsReturned: 203.23K (203232) - RowsReturnedRate: 5.18 K/sec - SortDataSize: 18.61 MB (19510332) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s781ms, non-child: 38s781ms, % non-child: 100.00%) - BytesReceived: 8.87 MB (9297601) - ConvertRowBatchTime: 10.579ms - DeserializeRowBatchTimer: 76.526ms - FirstBatchArrivalWaitTime: 450.954ms - PeakMemoryUsage: 0 - RowsReturned: 203.23K (203232) - RowsReturnedRate: 5.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 27s846ms, non-child: 556.635ms, % non-child: 2.00%) split sizes: min: 1.03 GB, max: 1.28 GB, avg: 1.18 GB, stddev: 55.99 MB - AverageThreadTokens: 1.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 854.96 MB (896493670) - PerHostPeakMemUsage: 903.06 MB (946925535) - PrepareTime: 223.602ms - RowsProduced: 203.23K (203232) - TotalCpuTime: 32s029ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 511.942ms - TotalStorageWaitTime: 16s792ms CodeGen:(Total: 475.329ms, non-child: 475.329ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 74.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 181.712ms - PrepareTime: 209.867ms DataStreamSender (dst_id=10):(Total: 170.336ms, non-child: 170.336ms, % non-child: 100.00%) - BytesSent: 8.87 MB (9297601) - NetworkThroughput(*): 137.31 MB/sec - OverallThroughput: 52.26 MB/sec - PeakMemoryUsage: 1.26 MB (1319371) - RowsReturned: 203.23K (203232) - SerializeBatchTime: 105.021ms - TransmitDataRPCTime: 65.006ms - UncompressedRowBatchSize: 24.05 MB (25216683) SUBPLAN_NODE (id=1):(Total: 26s644ms, non-child: 13.536ms, % non-child: 0.05%) - PeakMemoryUsage: 14.26 MB (14954944) - RowsReturned: 203.23K (203232) - RowsReturnedRate: 7.70 K/sec HASH_JOIN_NODE (id=6):(Total: 25s988ms, non-child: 25s844ms, % non-child: 99.45%) - BuildPartitionTime: 261.786ms - BuildRows: 2.26M (2259228) - BuildRowsPartitioned: 2.26M (2259228) - BuildTime: 180.267ms - GetNewBlockTime: 2s896ms - HashBuckets: 4.00M (4000218) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1408393) - PeakMemoryUsage: 2.12 MB (2222348) - PinTime: 0.000ns - ProbeRows: 235.34K (235345) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.513ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 49.008ms UNNEST_NODE (id=4):(Total: 34.845ms, non-child: 34.845ms, % non-child: 100.00%) - AvgCollectionSize: 25.67 - MaxCollectionSize: 2.33K (2327) - MinCollectionSize: 1 (1) - NumCollections: 88.02K (88024) - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 725.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 190.988ms, non-child: 150.480ms, % non-child: 78.79%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.34K (235345) - ProbeTime: 0.000ns - RowsReturned: 899.15K (899153) - RowsReturnedRate: 4.84 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 40.507ms, non-child: 40.507ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 122 (122) - MinCollectionSize: 1 (1) - NumCollections: 88.02K (88024) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 95.00 /sec HDFS_SCAN_NODE (id=0):(Total: 642.748ms, non-child: 642.748ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.65 - BytesRead: 57.15 MB (59920987) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.31 MB (59048361) - BytesReadRemoteUnexpected: 355.24 KB (363766) - BytesReadShortCircuit: 56.31 MB (59048361) - DecompressionTime: 179.244ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 842.40 MB (883317540) - PerReadThreadRawHdfsThroughput: 13.70 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.38M (7383502) - RowsReturned: 88.02K (88024) - RowsReturnedRate: 141.13 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 222 (222) - ScannerThreadsTotalWallClockTime: 19s058ms - MaterializeTupleTime(*): 1s417ms - ScannerThreadsSysTime: 442.532ms - ScannerThreadsUserTime: 1s265ms - ScannerThreadsVoluntaryContextSwitches: 672 (672) - TotalRawHdfsReadTime(*): 4s785ms - TotalReadThroughput: 1.98 MB/sec BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.93M (2934768) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 60.06 MB (62980096) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F01: Instance b64a3852190d9ac2:412186998b9ee4b8 (host=dn44.hadoop.trivago.com:22000):(Total: 41s098ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.10 MB, 48.13 MB, 48.06 MB, 48.10 MB, 48.10 MB, 48.08 MB, 48.07 MB, 48.07 MB, 48.08 MB, 48.10 MB, 48.11 MB, 48.10 MB, 48.11 MB, 48.10 MB, 52.07 MB, 56.10 MB, 56.09 MB, 56.14 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.07 MB, 56.11 MB, 56.10 MB, 56.11 MB, 56.10 MB, 56.08 MB, 56.13 MB, 64.09 MB, 64.07 MB, 64.06 MB, 64.09 MB, 64.12 MB, 64.13 MB, 64.07 MB, 64.12 MB, 64.10 MB, 64.05 MB, 69.14 MB, 82.23 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 942.32 MB (988090856) - PrepareTime: 178.462ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s784ms - TotalNetworkSendTime: 348.697ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.87M (2874149) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 661.136ms, non-child: 661.136ms, % non-child: 100.00%) - CodegenTime: 200.671us - CompileTime: 113.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 370.991ms - PrepareTime: 175.941ms DataStreamSender (dst_id=11):(Total: 2.446ms, non-child: 2.446ms, % non-child: 100.00%) - BytesSent: 177.35 KB (181605) - NetworkThroughput(*): 655.74 MB/sec - OverallThroughput: 70.79 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.233ms - TransmitDataRPCTime: 264.117us - UncompressedRowBatchSize: 440.24 KB (450801) SORT_NODE (id=9):(Total: 40s747ms, non-child: 154.358ms, % non-child: 0.38%) ExecOption: Codegen Enabled - InMemorySortTime: 94.716ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.66 MB (21658819) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s593ms, non-child: 1s410ms, % non-child: 3.48%) - EvaluationTime: 1s385ms - GetNewBlockTime: 100.803us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.98K (203983) - RowsReturnedRate: 5.03 K/sec - UnpinTime: 3.866us SORT_NODE (id=7):(Total: 39s182ms, non-child: 383.424ms, % non-child: 0.98%) ExecOption: Codegen Enabled - InMemorySortTime: 120.861ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096704) - RowsReturned: 203.98K (203983) - RowsReturnedRate: 5.21 K/sec - SortDataSize: 18.68 MB (19582368) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s799ms, non-child: 27.181ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 94.51 KB, 404.74 KB, 717.75 KB, 1011.27 KB, 1.25 MB, 1.51 MB, 1.82 MB, 2.09 MB, 2.40 MB, 2.68 MB, 2.95 MB, 3.24 MB, 3.53 MB, 3.84 MB, 4.14 MB, 4.46 MB, 4.77 MB, 5.10 MB, 5.40 MB, 5.73 MB, 6.05 MB, 6.42 MB, 6.77 MB, 7.09 MB, 7.41 MB, 7.74 MB, 8.05 MB, 8.27 MB, 8.45 MB, 8.60 MB, 8.68 MB, 8.74 MB, 8.77 MB, 8.82 MB, 8.84 MB, 8.86 MB, 8.88 MB, 8.88 MB - BytesReceived: 8.89 MB (9318413) - ConvertRowBatchTime: 10.521ms - DeserializeRowBatchTimer: 67.551ms - FirstBatchArrivalWaitTime: 644.448ms - PeakMemoryUsage: 0 - RowsReturned: 203.98K (203983) - RowsReturnedRate: 5.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4d2 (host=dn19.hadoop.trivago.com:22000):(Total: 42s597ms, non-child: 729.259ms, % non-child: 1.71%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.11 MB, 48.13 MB, 48.11 MB, 48.13 MB, 48.09 MB, 48.09 MB, 48.11 MB, 48.09 MB, 48.08 MB, 48.10 MB, 48.11 MB, 48.10 MB, 48.10 MB, 48.13 MB, 52.12 MB, 56.11 MB, 56.11 MB, 56.13 MB, 56.10 MB, 56.11 MB, 56.12 MB, 56.15 MB, 56.11 MB, 56.08 MB, 56.11 MB, 56.09 MB, 56.11 MB, 64.11 MB, 64.10 MB, 64.13 MB, 64.08 MB, 64.13 MB, 64.11 MB, 64.08 MB, 64.13 MB, 64.06 MB, 64.07 MB, 64.09 MB, 69.16 MB, 84.23 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 939.54 MB (985175656) - PrepareTime: 179.208ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s379ms - TotalNetworkSendTime: 1s443ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.95M (2950373) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 714.082ms, non-child: 714.082ms, % non-child: 100.00%) - CodegenTime: 244.099us - CompileTime: 106.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 430.314ms - PrepareTime: 176.470ms DataStreamSender (dst_id=11):(Total: 2.820ms, non-child: 2.820ms, % non-child: 100.00%) - BytesSent: 181.10 KB (185443) - NetworkThroughput(*): 444.66 MB/sec - OverallThroughput: 62.70 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.558ms - TransmitDataRPCTime: 397.723us - UncompressedRowBatchSize: 444.40 KB (455067) SORT_NODE (id=9):(Total: 41s151ms, non-child: 144.435ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 98.215ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.57 MB (21573586) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s007ms, non-child: 1s216ms, % non-child: 2.97%) - EvaluationTime: 1s116ms - GetNewBlockTime: 94.369us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.22K (203224) - RowsReturnedRate: 4.96 K/sec - UnpinTime: 4.514us SORT_NODE (id=7):(Total: 39s790ms, non-child: 396.245ms, % non-child: 1.00%) ExecOption: Codegen Enabled - InMemorySortTime: 129.517ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42092608) - RowsReturned: 203.22K (203224) - RowsReturnedRate: 5.11 K/sec - SortDataSize: 18.61 MB (19509504) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s394ms, non-child: 27.661ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 37.79 KB, 303.44 KB, 607.00 KB, 920.70 KB, 1.13 MB, 1.41 MB, 1.70 MB, 2.00 MB, 2.28 MB, 2.56 MB, 2.83 MB, 3.11 MB, 3.40 MB, 3.67 MB, 3.99 MB, 4.28 MB, 4.59 MB, 4.90 MB, 5.24 MB, 5.59 MB, 5.94 MB, 6.28 MB, 6.63 MB, 6.99 MB, 7.31 MB, 7.66 MB, 7.94 MB, 8.19 MB, 8.40 MB, 8.53 MB, 8.63 MB, 8.70 MB, 8.73 MB, 8.78 MB, 8.81 MB, 8.83 MB, 8.85 MB, 8.85 MB, 8.86 MB - BytesReceived: 8.86 MB (9291786) - ConvertRowBatchTime: 10.657ms - DeserializeRowBatchTimer: 65.997ms - FirstBatchArrivalWaitTime: 496.121ms - PeakMemoryUsage: 0 - RowsReturned: 203.22K (203224) - RowsReturnedRate: 5.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c2 (host=dn28.hadoop.trivago.com:22000):(Total: 41s295ms, non-child: 101.567ms, % non-child: 0.25%) MemoryUsage(1s000ms): 48.01 MB, 48.10 MB, 48.09 MB, 48.09 MB, 48.11 MB, 48.09 MB, 48.08 MB, 48.11 MB, 48.11 MB, 48.07 MB, 48.15 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 56.09 MB, 56.10 MB, 56.11 MB, 56.08 MB, 56.09 MB, 56.10 MB, 56.13 MB, 56.12 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.10 MB, 56.15 MB, 64.08 MB, 64.12 MB, 64.07 MB, 64.09 MB, 64.11 MB, 64.10 MB, 64.07 MB, 64.06 MB, 64.10 MB, 64.12 MB, 64.12 MB, 82.23 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 986.72 MB (1034655632) - PrepareTime: 186.301ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s093ms - TotalNetworkSendTime: 675.401ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 3.10M (3096709) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 573.460ms, non-child: 573.460ms, % non-child: 100.00%) - CodegenTime: 239.408us - CompileTime: 89.110ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 300.255ms - PrepareTime: 183.134ms DataStreamSender (dst_id=11):(Total: 2.520ms, non-child: 2.520ms, % non-child: 100.00%) - BytesSent: 178.82 KB (183116) - NetworkThroughput(*): 408.85 MB/sec - OverallThroughput: 69.27 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.201ms - TransmitDataRPCTime: 427.128us - UncompressedRowBatchSize: 441.90 KB (452502) SORT_NODE (id=9):(Total: 40s618ms, non-child: 133.943ms, % non-child: 0.33%) ExecOption: Codegen Enabled - InMemorySortTime: 94.307ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.49 MB (21487817) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s484ms, non-child: 980.527ms, % non-child: 2.42%) - EvaluationTime: 974.377ms - GetNewBlockTime: 145.440us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.51K (202508) - RowsReturnedRate: 5.00 K/sec - UnpinTime: 5.296us SORT_NODE (id=7):(Total: 39s503ms, non-child: 395.041ms, % non-child: 1.00%) ExecOption: Codegen Enabled - InMemorySortTime: 127.267ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42099840) - RowsReturned: 202.51K (202508) - RowsReturnedRate: 5.13 K/sec - SortDataSize: 18.54 MB (19440768) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s108ms, non-child: 29.144ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 68.75 KB, 385.95 KB, 681.43 KB, 965.30 KB, 1.22 MB, 1.49 MB, 1.77 MB, 2.06 MB, 2.36 MB, 2.65 MB, 2.91 MB, 3.20 MB, 3.45 MB, 3.74 MB, 4.05 MB, 4.35 MB, 4.67 MB, 4.99 MB, 5.33 MB, 5.63 MB, 5.97 MB, 6.32 MB, 6.67 MB, 7.02 MB, 7.35 MB, 7.66 MB, 7.98 MB, 8.22 MB, 8.40 MB, 8.53 MB, 8.61 MB, 8.67 MB, 8.72 MB, 8.76 MB, 8.80 MB, 8.81 MB, 8.83 MB, 8.84 MB, 8.84 MB - BytesReceived: 8.84 MB (9271028) - ConvertRowBatchTime: 10.848ms - DeserializeRowBatchTimer: 185.275ms - FirstBatchArrivalWaitTime: 472.876ms - PeakMemoryUsage: 0 - RowsReturned: 202.51K (202508) - RowsReturnedRate: 5.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4cd (host=dn13.hadoop.trivago.com:22000):(Total: 42s711ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.05 MB, 48.08 MB, 48.14 MB, 48.09 MB, 48.12 MB, 48.10 MB, 48.10 MB, 48.09 MB, 48.14 MB, 48.13 MB, 48.13 MB, 48.06 MB, 48.10 MB, 48.14 MB, 52.08 MB, 56.10 MB, 56.13 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.14 MB, 56.14 MB, 56.11 MB, 56.12 MB, 56.08 MB, 56.12 MB, 56.13 MB, 56.14 MB, 64.10 MB, 64.06 MB, 64.09 MB, 64.11 MB, 64.13 MB, 64.12 MB, 64.08 MB, 64.13 MB, 64.09 MB, 64.07 MB, 64.07 MB, 79.73 MB, 87.23 MB, 85.23 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 951.69 MB (997915912) - PrepareTime: 193.937ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s477ms - TotalNetworkSendTime: 2.455ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.83M (2831940) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 617.477ms, non-child: 617.477ms, % non-child: 100.00%) - CodegenTime: 258.076us - CompileTime: 99.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 326.096ms - PrepareTime: 191.047ms DataStreamSender (dst_id=11):(Total: 2.186ms, non-child: 2.186ms, % non-child: 100.00%) - BytesSent: 178.33 KB (182615) - NetworkThroughput(*): 725.41 MB/sec - OverallThroughput: 79.63 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 1.971ms - TransmitDataRPCTime: 240.080us - UncompressedRowBatchSize: 441.32 KB (451908) SORT_NODE (id=9):(Total: 42s706ms, non-child: 199.480ms, % non-child: 0.47%) ExecOption: Codegen Enabled - InMemorySortTime: 140.040ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 95.00 /sec - SortDataSize: 20.66 MB (21665859) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 42s507ms, non-child: 2s621ms, % non-child: 6.17%) - EvaluationTime: 2s614ms - GetNewBlockTime: 114.048us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.01K (204009) - RowsReturnedRate: 4.80 K/sec - UnpinTime: 5.700us SORT_NODE (id=7):(Total: 39s885ms, non-child: 392.308ms, % non-child: 0.98%) ExecOption: Codegen Enabled - InMemorySortTime: 116.244ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42095856) - RowsReturned: 204.01K (204009) - RowsReturnedRate: 5.11 K/sec - SortDataSize: 18.68 MB (19584864) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s492ms, non-child: 29.229ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 99.27 KB, 428.18 KB, 746.37 KB, 1.02 MB, 1.26 MB, 1.56 MB, 1.85 MB, 2.16 MB, 2.42 MB, 2.74 MB, 2.96 MB, 3.27 MB, 3.53 MB, 3.81 MB, 4.13 MB, 4.44 MB, 4.75 MB, 5.07 MB, 5.40 MB, 5.73 MB, 6.06 MB, 6.42 MB, 6.74 MB, 7.12 MB, 7.44 MB, 7.77 MB, 8.05 MB, 8.29 MB, 8.47 MB, 8.59 MB, 8.67 MB, 8.72 MB, 8.78 MB, 8.82 MB, 8.85 MB, 8.87 MB, 8.87 MB, 8.89 MB, 8.89 MB - BytesReceived: 8.89 MB (9320738) - ConvertRowBatchTime: 10.661ms - DeserializeRowBatchTimer: 80.048ms - FirstBatchArrivalWaitTime: 767.191ms - PeakMemoryUsage: 0 - RowsReturned: 204.01K (204009) - RowsReturnedRate: 5.17 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4af (host=dn31.hadoop.trivago.com:22000):(Total: 40s062ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.10 MB, 48.10 MB, 48.09 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.14 MB, 48.10 MB, 48.16 MB, 48.09 MB, 48.11 MB, 48.07 MB, 48.13 MB, 48.09 MB, 56.10 MB, 56.08 MB, 56.11 MB, 56.13 MB, 56.10 MB, 56.15 MB, 56.12 MB, 56.09 MB, 56.06 MB, 56.10 MB, 56.11 MB, 56.08 MB, 60.09 MB, 64.10 MB, 64.09 MB, 64.10 MB, 64.12 MB, 64.12 MB, 64.07 MB, 64.09 MB, 64.08 MB, 64.11 MB, 64.13 MB, 70.18 MB, 57.12 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 902.00 MB (945815016) - PrepareTime: 212.613ms - RowsProduced: 20.48K (20480) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s470ms - TotalNetworkSendTime: 35.276ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.82M (2817060) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 733.304ms, non-child: 733.304ms, % non-child: 100.00%) - CodegenTime: 350.682us - CompileTime: 129.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 412.101ms - PrepareTime: 190.682ms DataStreamSender (dst_id=11):(Total: 15.437ms, non-child: 15.437ms, % non-child: 100.00%) - BytesSent: 896.81 KB (918334) - NetworkThroughput(*): 862.86 MB/sec - OverallThroughput: 56.73 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 19.46K (19456) - SerializeBatchTime: 14.422ms - TransmitDataRPCTime: 1.014ms - UncompressedRowBatchSize: 2.16 MB (2269989) SORT_NODE (id=9):(Total: 40s012ms, non-child: 125.688ms, % non-child: 0.31%) ExecOption: Codegen Enabled - InMemorySortTime: 88.834ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 20.48K (20480) - RowsReturnedRate: 511.00 /sec - SortDataSize: 20.85 MB (21859981) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s886ms, non-child: 1s024ms, % non-child: 2.57%) - EvaluationTime: 979.843ms - GetNewBlockTime: 178.360us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 205.68K (205678) - RowsReturnedRate: 5.16 K/sec - UnpinTime: 3.660us SORT_NODE (id=7):(Total: 38s862ms, non-child: 376.250ms, % non-child: 0.97%) ExecOption: Codegen Enabled - InMemorySortTime: 98.742ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094800) - RowsReturned: 205.68K (205678) - RowsReturnedRate: 5.29 K/sec - SortDataSize: 18.83 MB (19745088) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s485ms, non-child: 28.079ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 91.16 KB, 431.49 KB, 747.49 KB, 1.00 MB, 1.27 MB, 1.56 MB, 1.83 MB, 2.11 MB, 2.43 MB, 2.70 MB, 2.96 MB, 3.24 MB, 3.51 MB, 3.82 MB, 4.10 MB, 4.44 MB, 4.76 MB, 5.07 MB, 5.41 MB, 5.75 MB, 6.10 MB, 6.42 MB, 6.81 MB, 7.13 MB, 7.47 MB, 7.80 MB, 8.08 MB, 8.33 MB, 8.51 MB, 8.64 MB, 8.73 MB, 8.78 MB, 8.83 MB, 8.88 MB, 8.91 MB, 8.92 MB, 8.94 MB, 8.95 MB - BytesReceived: 8.95 MB (9384415) - ConvertRowBatchTime: 10.628ms - DeserializeRowBatchTimer: 75.100ms - FirstBatchArrivalWaitTime: 564.214ms - PeakMemoryUsage: 0 - RowsReturned: 205.68K (205678) - RowsReturnedRate: 5.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ce (host=dn38.hadoop.trivago.com:22000):(Total: 42s596ms, non-child: 888.825ms, % non-child: 2.09%) MemoryUsage(1s000ms): 24.00 MB, 48.05 MB, 48.06 MB, 48.14 MB, 48.13 MB, 48.11 MB, 48.11 MB, 48.10 MB, 48.11 MB, 48.13 MB, 48.13 MB, 48.08 MB, 48.12 MB, 48.08 MB, 48.07 MB, 48.07 MB, 56.10 MB, 56.14 MB, 56.14 MB, 56.15 MB, 56.14 MB, 56.08 MB, 56.10 MB, 56.09 MB, 56.09 MB, 56.07 MB, 56.10 MB, 56.13 MB, 56.11 MB, 64.12 MB, 64.10 MB, 64.10 MB, 64.06 MB, 64.11 MB, 64.12 MB, 64.08 MB, 64.13 MB, 64.15 MB, 64.06 MB, 64.07 MB, 69.65 MB, 59.62 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 892.68 MB (936042088) - PrepareTime: 220.040ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s333ms - TotalNetworkSendTime: 1s634ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.76M (2761636) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 745.450ms, non-child: 745.450ms, % non-child: 100.00%) - CodegenTime: 323.479us - CompileTime: 159.035ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 382.537ms - PrepareTime: 203.088ms DataStreamSender (dst_id=11):(Total: 2.410ms, non-child: 2.410ms, % non-child: 100.00%) - BytesSent: 178.24 KB (182517) - NetworkThroughput(*): 722.44 MB/sec - OverallThroughput: 72.22 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.240ms - TransmitDataRPCTime: 240.937us - UncompressedRowBatchSize: 441.29 KB (451881) SORT_NODE (id=9):(Total: 40s959ms, non-child: 133.086ms, % non-child: 0.32%) ExecOption: Codegen Enabled - InMemorySortTime: 94.008ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.56 MB (21561330) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s826ms, non-child: 1s069ms, % non-child: 2.62%) - EvaluationTime: 1s039ms - GetNewBlockTime: 145.173us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.07K (203070) - RowsReturnedRate: 4.97 K/sec - UnpinTime: 3.274us SORT_NODE (id=7):(Total: 39s757ms, non-child: 408.314ms, % non-child: 1.03%) ExecOption: Codegen Enabled - InMemorySortTime: 120.322ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42101136) - RowsReturned: 203.07K (203070) - RowsReturnedRate: 5.11 K/sec - SortDataSize: 18.59 MB (19494720) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s349ms, non-child: 29.516ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 51.85 KB, 326.68 KB, 658.26 KB, 927.83 KB, 1.19 MB, 1.46 MB, 1.72 MB, 2.02 MB, 2.29 MB, 2.58 MB, 2.85 MB, 3.14 MB, 3.41 MB, 3.69 MB, 4.01 MB, 4.27 MB, 4.59 MB, 4.91 MB, 5.23 MB, 5.54 MB, 5.89 MB, 6.26 MB, 6.59 MB, 6.94 MB, 7.27 MB, 7.62 MB, 7.92 MB, 8.18 MB, 8.40 MB, 8.54 MB, 8.63 MB, 8.69 MB, 8.73 MB, 8.77 MB, 8.81 MB, 8.82 MB, 8.83 MB, 8.84 MB, 8.85 MB - BytesReceived: 8.85 MB (9282072) - ConvertRowBatchTime: 10.744ms - DeserializeRowBatchTimer: 78.637ms - FirstBatchArrivalWaitTime: 329.772ms - PeakMemoryUsage: 0 - RowsReturned: 203.07K (203070) - RowsReturnedRate: 5.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ae (host=dn8.hadoop.trivago.com:22000):(Total: 40s137ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.10 MB, 48.09 MB, 48.10 MB, 48.12 MB, 48.12 MB, 48.06 MB, 48.08 MB, 48.08 MB, 48.07 MB, 48.12 MB, 48.10 MB, 48.13 MB, 48.10 MB, 48.13 MB, 56.10 MB, 56.07 MB, 56.11 MB, 56.10 MB, 56.13 MB, 56.12 MB, 56.10 MB, 56.05 MB, 56.10 MB, 56.11 MB, 56.06 MB, 56.14 MB, 56.13 MB, 60.10 MB, 64.11 MB, 64.07 MB, 64.08 MB, 64.08 MB, 64.11 MB, 64.11 MB, 64.09 MB, 64.12 MB, 64.14 MB, 69.18 MB, 59.62 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 960.53 MB (1007187808) - PrepareTime: 234.431ms - RowsProduced: 9.22K (9216) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s511ms - TotalNetworkSendTime: 11.995ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.92M (2920517) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 678.123ms, non-child: 678.123ms, % non-child: 100.00%) - CodegenTime: 365.829us - CompileTime: 142.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 340.741ms - PrepareTime: 193.723ms DataStreamSender (dst_id=11):(Total: 5.007ms, non-child: 5.007ms, % non-child: 100.00%) - BytesSent: 401.80 KB (411442) - NetworkThroughput(*): 509.55 MB/sec - OverallThroughput: 78.36 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 8.19K (8192) - SerializeBatchTime: 4.254ms - TransmitDataRPCTime: 770.051us - UncompressedRowBatchSize: 993.49 KB (1017333) SORT_NODE (id=9):(Total: 40s120ms, non-child: 132.771ms, % non-child: 0.33%) ExecOption: Codegen Enabled - InMemorySortTime: 92.858ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 9.22K (9216) - RowsReturnedRate: 229.00 /sec - SortDataSize: 20.53 MB (21522112) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s987ms, non-child: 1s061ms, % non-child: 2.65%) - EvaluationTime: 1s006ms - GetNewBlockTime: 129.071us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.80K (202798) - RowsReturnedRate: 5.07 K/sec - UnpinTime: 3.564us SORT_NODE (id=7):(Total: 38s926ms, non-child: 399.420ms, % non-child: 1.03%) ExecOption: Codegen Enabled - InMemorySortTime: 123.683ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42102480) - RowsReturned: 202.80K (202798) - RowsReturnedRate: 5.21 K/sec - SortDataSize: 18.57 MB (19468608) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s526ms, non-child: 28.242ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 38.00 KB, 324.59 KB, 658.56 KB, 940.23 KB, 1.18 MB, 1.44 MB, 1.73 MB, 2.01 MB, 2.30 MB, 2.58 MB, 2.85 MB, 3.12 MB, 3.40 MB, 3.72 MB, 4.00 MB, 4.33 MB, 4.62 MB, 4.93 MB, 5.26 MB, 5.58 MB, 5.93 MB, 6.28 MB, 6.66 MB, 6.99 MB, 7.33 MB, 7.67 MB, 7.97 MB, 8.21 MB, 8.40 MB, 8.54 MB, 8.62 MB, 8.69 MB, 8.73 MB, 8.78 MB, 8.81 MB, 8.83 MB, 8.84 MB, 8.85 MB - BytesReceived: 8.85 MB (9283403) - ConvertRowBatchTime: 11.053ms - DeserializeRowBatchTimer: 71.518ms - FirstBatchArrivalWaitTime: 618.606ms - PeakMemoryUsage: 0 - RowsReturned: 202.80K (202798) - RowsReturnedRate: 5.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a8 (host=dn50.hadoop.trivago.com:22000):(Total: 40s080ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.08 MB, 48.11 MB, 48.08 MB, 48.11 MB, 48.14 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.06 MB, 48.12 MB, 48.12 MB, 48.13 MB, 48.07 MB, 48.10 MB, 48.12 MB, 56.10 MB, 56.12 MB, 56.13 MB, 56.10 MB, 56.08 MB, 56.13 MB, 56.13 MB, 56.06 MB, 56.10 MB, 56.11 MB, 56.09 MB, 56.10 MB, 56.08 MB, 64.10 MB, 64.12 MB, 64.07 MB, 64.09 MB, 64.10 MB, 64.08 MB, 64.10 MB, 64.10 MB, 64.07 MB, 64.08 MB, 80.73 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 914.41 MB (958826008) - PrepareTime: 233.642ms - RowsProduced: 25.60K (25600) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s265ms - TotalNetworkSendTime: 292.892ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.92M (2918308) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 709.864ms, non-child: 709.864ms, % non-child: 100.00%) - CodegenTime: 373.589us - CompileTime: 126.216ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 378.524ms - PrepareTime: 204.332ms DataStreamSender (dst_id=11):(Total: 18.336ms, non-child: 18.336ms, % non-child: 100.00%) - BytesSent: 1.09 MB (1141657) - NetworkThroughput(*): 627.02 MB/sec - OverallThroughput: 59.38 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 24.58K (24576) - SerializeBatchTime: 16.637ms - TransmitDataRPCTime: 1.736ms - UncompressedRowBatchSize: 2.70 MB (2832714) SORT_NODE (id=9):(Total: 39s754ms, non-child: 111.637ms, % non-child: 0.28%) ExecOption: Codegen Enabled - InMemorySortTime: 79.028ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 25.60K (25600) - RowsReturnedRate: 643.00 /sec - SortDataSize: 20.47 MB (21462107) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s642ms, non-child: 956.397ms, % non-child: 2.41%) - EvaluationTime: 842.215ms - GetNewBlockTime: 155.016us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.27K (202268) - RowsReturnedRate: 5.10 K/sec - UnpinTime: 3.897us SORT_NODE (id=7):(Total: 38s686ms, non-child: 407.398ms, % non-child: 1.05%) ExecOption: Codegen Enabled - InMemorySortTime: 119.662ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42092512) - RowsReturned: 202.27K (202268) - RowsReturnedRate: 5.23 K/sec - SortDataSize: 18.52 MB (19417728) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s278ms, non-child: 25.775ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 107.76 KB, 399.16 KB, 727.25 KB, 995.91 KB, 1.23 MB, 1.51 MB, 1.80 MB, 2.08 MB, 2.36 MB, 2.63 MB, 2.92 MB, 3.17 MB, 3.46 MB, 3.76 MB, 4.06 MB, 4.37 MB, 4.67 MB, 5.00 MB, 5.33 MB, 5.63 MB, 5.96 MB, 6.34 MB, 6.69 MB, 7.04 MB, 7.38 MB, 7.70 MB, 8.02 MB, 8.23 MB, 8.40 MB, 8.54 MB, 8.61 MB, 8.66 MB, 8.72 MB, 8.75 MB, 8.78 MB, 8.80 MB, 8.82 MB, 8.82 MB - BytesReceived: 8.83 MB (9254241) - ConvertRowBatchTime: 9.637ms - DeserializeRowBatchTimer: 68.419ms - FirstBatchArrivalWaitTime: 432.128ms - PeakMemoryUsage: 0 - RowsReturned: 202.27K (202268) - RowsReturnedRate: 5.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c5 (host=dn2.hadoop.trivago.com:22000):(Total: 41s345ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.09 MB, 48.10 MB, 48.13 MB, 48.13 MB, 48.12 MB, 48.09 MB, 48.10 MB, 48.12 MB, 48.09 MB, 48.09 MB, 48.05 MB, 48.10 MB, 48.06 MB, 48.09 MB, 52.11 MB, 56.10 MB, 56.11 MB, 56.12 MB, 56.10 MB, 56.13 MB, 56.09 MB, 56.08 MB, 56.10 MB, 56.10 MB, 56.12 MB, 56.15 MB, 56.08 MB, 60.09 MB, 64.12 MB, 64.10 MB, 64.06 MB, 64.10 MB, 64.15 MB, 64.10 MB, 64.10 MB, 64.15 MB, 64.11 MB, 64.07 MB, 64.07 MB, 76.23 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 933.78 MB (979138528) - PrepareTime: 256.598ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s940ms - TotalNetworkSendTime: 1.741ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 3.01M (3005316) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 883.875ms, non-child: 883.875ms, % non-child: 100.00%) - CodegenTime: 362.728us - CompileTime: 175.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 495.119ms - PrepareTime: 212.478ms DataStreamSender (dst_id=11):(Total: 2.803ms, non-child: 2.803ms, % non-child: 100.00%) - BytesSent: 178.11 KB (182382) - NetworkThroughput(*): 223.69 MB/sec - OverallThroughput: 62.05 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.082ms - TransmitDataRPCTime: 777.580us - UncompressedRowBatchSize: 441.66 KB (452259) SORT_NODE (id=9):(Total: 41s340ms, non-child: 174.511ms, % non-child: 0.42%) ExecOption: Codegen Enabled - InMemorySortTime: 117.631ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.67 MB (21673112) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s166ms, non-child: 1s765ms, % non-child: 4.29%) - EvaluationTime: 1s717ms - GetNewBlockTime: 165.924us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.10K (204104) - RowsReturnedRate: 4.96 K/sec - UnpinTime: 4.948us SORT_NODE (id=7):(Total: 39s400ms, non-child: 445.360ms, % non-child: 1.13%) ExecOption: Codegen Enabled - InMemorySortTime: 139.626ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42097168) - RowsReturned: 204.10K (204104) - RowsReturnedRate: 5.18 K/sec - SortDataSize: 18.69 MB (19593984) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s955ms, non-child: 28.022ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 112.30 KB, 432.80 KB, 745.91 KB, 1022.23 KB, 1.26 MB, 1.58 MB, 1.83 MB, 2.13 MB, 2.43 MB, 2.72 MB, 2.97 MB, 3.27 MB, 3.56 MB, 3.86 MB, 4.14 MB, 4.46 MB, 4.76 MB, 5.08 MB, 5.41 MB, 5.73 MB, 6.07 MB, 6.40 MB, 6.78 MB, 7.12 MB, 7.44 MB, 7.79 MB, 8.08 MB, 8.30 MB, 8.47 MB, 8.62 MB, 8.69 MB, 8.75 MB, 8.79 MB, 8.84 MB, 8.86 MB, 8.88 MB, 8.89 MB, 8.89 MB, 8.90 MB - BytesReceived: 8.90 MB (9329739) - ConvertRowBatchTime: 10.069ms - DeserializeRowBatchTimer: 64.241ms - FirstBatchArrivalWaitTime: 478.636ms - PeakMemoryUsage: 0 - RowsReturned: 204.10K (204104) - RowsReturnedRate: 5.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a9 (host=dn24.hadoop.trivago.com:22000):(Total: 40s257ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.12 MB, 48.12 MB, 48.08 MB, 48.05 MB, 48.11 MB, 48.15 MB, 48.14 MB, 48.10 MB, 48.10 MB, 48.11 MB, 48.11 MB, 48.07 MB, 48.09 MB, 48.06 MB, 52.07 MB, 56.15 MB, 56.09 MB, 56.07 MB, 56.07 MB, 56.11 MB, 56.10 MB, 56.10 MB, 56.09 MB, 56.12 MB, 56.07 MB, 56.10 MB, 56.11 MB, 60.11 MB, 64.09 MB, 64.07 MB, 64.14 MB, 64.10 MB, 64.10 MB, 64.10 MB, 64.10 MB, 64.08 MB, 64.13 MB, 64.10 MB, 70.14 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 878.60 MB (921281936) - PrepareTime: 236.933ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s353ms - TotalNetworkSendTime: 228.744ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.72M (2721156) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 855.549ms, non-child: 855.549ms, % non-child: 100.00%) - CodegenTime: 380.272us - CompileTime: 146.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 474.491ms - PrepareTime: 233.264ms DataStreamSender (dst_id=11):(Total: 3.234ms, non-child: 3.234ms, % non-child: 100.00%) - BytesSent: 178.08 KB (182356) - NetworkThroughput(*): 471.86 MB/sec - OverallThroughput: 53.77 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.915ms - TransmitDataRPCTime: 368.560us - UncompressedRowBatchSize: 441.13 KB (451719) SORT_NODE (id=9):(Total: 40s015ms, non-child: 143.253ms, % non-child: 0.36%) ExecOption: Codegen Enabled - InMemorySortTime: 100.186ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 102.00 /sec - SortDataSize: 20.75 MB (21756611) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s872ms, non-child: 1s063ms, % non-child: 2.67%) - EvaluationTime: 1s056ms - GetNewBlockTime: 148.160us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.81K (204812) - RowsReturnedRate: 5.14 K/sec - UnpinTime: 3.792us SORT_NODE (id=7):(Total: 38s809ms, non-child: 440.978ms, % non-child: 1.14%) ExecOption: Codegen Enabled - InMemorySortTime: 120.911ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42099120) - RowsReturned: 204.81K (204812) - RowsReturnedRate: 5.28 K/sec - SortDataSize: 18.75 MB (19661952) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s368ms, non-child: 28.538ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 100.60 KB, 419.60 KB, 720.54 KB, 1.00 MB, 1.26 MB, 1.54 MB, 1.80 MB, 2.12 MB, 2.41 MB, 2.68 MB, 2.95 MB, 3.22 MB, 3.52 MB, 3.82 MB, 4.12 MB, 4.44 MB, 4.77 MB, 5.05 MB, 5.41 MB, 5.72 MB, 6.07 MB, 6.40 MB, 6.73 MB, 7.09 MB, 7.42 MB, 7.79 MB, 8.08 MB, 8.32 MB, 8.52 MB, 8.64 MB, 8.72 MB, 8.77 MB, 8.82 MB, 8.86 MB, 8.88 MB, 8.90 MB, 8.92 MB, 8.92 MB - BytesReceived: 8.93 MB (9360065) - ConvertRowBatchTime: 10.719ms - DeserializeRowBatchTimer: 79.886ms - FirstBatchArrivalWaitTime: 307.419ms - PeakMemoryUsage: 0 - RowsReturned: 204.81K (204812) - RowsReturnedRate: 5.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4cb (host=dn33.hadoop.trivago.com:22000):(Total: 41s538ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.08 MB, 48.09 MB, 48.05 MB, 48.09 MB, 48.10 MB, 48.09 MB, 48.16 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.06 MB, 48.09 MB, 48.15 MB, 48.09 MB, 48.10 MB, 56.10 MB, 56.10 MB, 56.08 MB, 56.09 MB, 56.11 MB, 56.10 MB, 56.10 MB, 56.13 MB, 56.06 MB, 56.13 MB, 56.10 MB, 56.05 MB, 56.10 MB, 64.09 MB, 64.12 MB, 64.13 MB, 64.08 MB, 64.11 MB, 64.13 MB, 64.10 MB, 64.16 MB, 64.06 MB, 64.09 MB, 64.09 MB, 69.16 MB, 84.73 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 853.27 MB (894718320) - PrepareTime: 270.339ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s349ms - TotalNetworkSendTime: 296.074ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.75M (2749636) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 661.001ms, non-child: 661.001ms, % non-child: 100.00%) - CodegenTime: 288.804us - CompileTime: 127.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 344.991ms - PrepareTime: 187.585ms DataStreamSender (dst_id=11):(Total: 2.631ms, non-child: 2.631ms, % non-child: 100.00%) - BytesSent: 177.03 KB (181283) - NetworkThroughput(*): 774.30 MB/sec - OverallThroughput: 65.71 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.441ms - TransmitDataRPCTime: 223.280us - UncompressedRowBatchSize: 440.21 KB (450774) SORT_NODE (id=9):(Total: 41s239ms, non-child: 156.132ms, % non-child: 0.38%) ExecOption: Codegen Enabled - InMemorySortTime: 108.715ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.79 MB (21804646) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s083ms, non-child: 1s317ms, % non-child: 3.21%) - EvaluationTime: 1s157ms - GetNewBlockTime: 119.239us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 205.33K (205333) - RowsReturnedRate: 5.00 K/sec - UnpinTime: 3.991us SORT_NODE (id=7):(Total: 39s766ms, non-child: 400.969ms, % non-child: 1.01%) ExecOption: Codegen Enabled - InMemorySortTime: 126.890ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096256) - RowsReturned: 205.33K (205333) - RowsReturnedRate: 5.16 K/sec - SortDataSize: 18.80 MB (19711968) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s365ms, non-child: 29.367ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 44.39 KB, 337.64 KB, 623.13 KB, 913.32 KB, 1.17 MB, 1.43 MB, 1.73 MB, 1.99 MB, 2.29 MB, 2.60 MB, 2.87 MB, 3.15 MB, 3.42 MB, 3.75 MB, 4.02 MB, 4.35 MB, 4.67 MB, 4.99 MB, 5.35 MB, 5.65 MB, 6.00 MB, 6.34 MB, 6.71 MB, 7.06 MB, 7.40 MB, 7.72 MB, 8.02 MB, 8.28 MB, 8.48 MB, 8.62 MB, 8.72 MB, 8.79 MB, 8.83 MB, 8.87 MB, 8.91 MB, 8.93 MB, 8.94 MB, 8.95 MB, 8.95 MB - BytesReceived: 8.95 MB (9388925) - ConvertRowBatchTime: 10.903ms - DeserializeRowBatchTimer: 74.473ms - FirstBatchArrivalWaitTime: 563.602ms - PeakMemoryUsage: 0 - RowsReturned: 205.33K (205333) - RowsReturnedRate: 5.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b0 (host=dn47.hadoop.trivago.com:22000):(Total: 40s544ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.08 MB, 48.11 MB, 48.08 MB, 48.12 MB, 48.12 MB, 48.07 MB, 48.10 MB, 48.07 MB, 48.15 MB, 48.11 MB, 48.12 MB, 48.09 MB, 48.09 MB, 48.12 MB, 48.10 MB, 56.14 MB, 56.10 MB, 56.11 MB, 56.10 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.10 MB, 56.12 MB, 56.11 MB, 56.10 MB, 56.08 MB, 56.08 MB, 64.10 MB, 64.07 MB, 64.08 MB, 64.11 MB, 64.10 MB, 64.07 MB, 64.09 MB, 64.08 MB, 64.11 MB, 64.11 MB, 74.48 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 891.27 MB (934562864) - PrepareTime: 232.736ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s209ms - TotalNetworkSendTime: 445.554ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 980.759ms, non-child: 980.759ms, % non-child: 100.00%) - CodegenTime: 338.948us - CompileTime: 154.549ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 595.979ms - PrepareTime: 229.524ms DataStreamSender (dst_id=11):(Total: 3.354ms, non-child: 3.354ms, % non-child: 100.00%) - BytesSent: 179.12 KB (183424) - NetworkThroughput(*): 913.94 MB/sec - OverallThroughput: 52.14 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 3.206ms - TransmitDataRPCTime: 191.399us - UncompressedRowBatchSize: 442.69 KB (453312) SORT_NODE (id=9):(Total: 40s095ms, non-child: 155.443ms, % non-child: 0.39%) ExecOption: Codegen Enabled - InMemorySortTime: 104.548ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 102.00 /sec - SortDataSize: 20.51 MB (21504204) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s940ms, non-child: 1s279ms, % non-child: 3.20%) - EvaluationTime: 1s254ms - GetNewBlockTime: 82.891us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.58K (202581) - RowsReturnedRate: 5.07 K/sec - UnpinTime: 4.812us SORT_NODE (id=7):(Total: 38s660ms, non-child: 437.138ms, % non-child: 1.13%) ExecOption: Codegen Enabled - InMemorySortTime: 123.022ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096192) - RowsReturned: 202.58K (202581) - RowsReturnedRate: 5.24 K/sec - SortDataSize: 18.55 MB (19447776) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s223ms, non-child: 26.839ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 149.32 KB, 440.04 KB, 770.82 KB, 1.04 MB, 1.29 MB, 1.56 MB, 1.84 MB, 2.12 MB, 2.39 MB, 2.67 MB, 2.94 MB, 3.20 MB, 3.49 MB, 3.77 MB, 4.10 MB, 4.40 MB, 4.72 MB, 5.04 MB, 5.35 MB, 5.70 MB, 6.05 MB, 6.41 MB, 6.76 MB, 7.10 MB, 7.44 MB, 7.77 MB, 8.05 MB, 8.27 MB, 8.44 MB, 8.56 MB, 8.63 MB, 8.69 MB, 8.73 MB, 8.77 MB, 8.80 MB, 8.81 MB, 8.83 MB, 8.83 MB - BytesReceived: 8.84 MB (9264349) - ConvertRowBatchTime: 10.341ms - DeserializeRowBatchTimer: 71.478ms - FirstBatchArrivalWaitTime: 246.903ms - PeakMemoryUsage: 0 - RowsReturned: 202.58K (202581) - RowsReturnedRate: 5.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4cc (host=dn26.hadoop.trivago.com:22000):(Total: 41s614ms, non-child: 62.298ms, % non-child: 0.15%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.11 MB, 48.09 MB, 48.08 MB, 48.09 MB, 48.14 MB, 48.12 MB, 48.11 MB, 48.10 MB, 48.07 MB, 48.10 MB, 48.07 MB, 48.07 MB, 48.09 MB, 48.12 MB, 56.10 MB, 56.10 MB, 56.10 MB, 56.08 MB, 56.10 MB, 56.06 MB, 56.10 MB, 56.08 MB, 56.07 MB, 56.09 MB, 56.11 MB, 56.10 MB, 56.12 MB, 60.13 MB, 64.10 MB, 64.08 MB, 64.11 MB, 64.14 MB, 64.11 MB, 64.07 MB, 64.13 MB, 64.14 MB, 64.06 MB, 64.07 MB, 69.65 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 983.11 MB (1030868328) - PrepareTime: 191.852ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s503ms - TotalNetworkSendTime: 649.628ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.88M (2884741) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 587.074ms, non-child: 587.074ms, % non-child: 100.00%) - CodegenTime: 298.520us - CompileTime: 87.947ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 309.597ms - PrepareTime: 188.819ms DataStreamSender (dst_id=11):(Total: 2.508ms, non-child: 2.508ms, % non-child: 100.00%) - BytesSent: 176.82 KB (181063) - NetworkThroughput(*): 126.52 MB/sec - OverallThroughput: 68.82 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.304ms - TransmitDataRPCTime: 1.364ms - UncompressedRowBatchSize: 440.76 KB (451341) SORT_NODE (id=9):(Total: 40s962ms, non-child: 134.325ms, % non-child: 0.33%) ExecOption: Codegen Enabled - InMemorySortTime: 96.715ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.56 MB (21558998) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s828ms, non-child: 918.442ms, % non-child: 2.25%) - EvaluationTime: 912.702ms - GetNewBlockTime: 140.448us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.06K (203057) - RowsReturnedRate: 4.97 K/sec - UnpinTime: 3.960us SORT_NODE (id=7):(Total: 39s909ms, non-child: 389.545ms, % non-child: 0.98%) ExecOption: Codegen Enabled - InMemorySortTime: 115.352ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42093008) - RowsReturned: 203.06K (203057) - RowsReturnedRate: 5.09 K/sec - SortDataSize: 18.59 MB (19493472) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s520ms, non-child: 30.527ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 37.57 KB, 325.76 KB, 635.15 KB, 906.05 KB, 1.16 MB, 1.46 MB, 1.73 MB, 2.02 MB, 2.30 MB, 2.58 MB, 2.86 MB, 3.12 MB, 3.41 MB, 3.68 MB, 3.99 MB, 4.31 MB, 4.60 MB, 4.94 MB, 5.27 MB, 5.59 MB, 5.90 MB, 6.24 MB, 6.60 MB, 6.95 MB, 7.30 MB, 7.62 MB, 7.90 MB, 8.16 MB, 8.39 MB, 8.51 MB, 8.63 MB, 8.69 MB, 8.74 MB, 8.78 MB, 8.81 MB, 8.83 MB, 8.84 MB, 8.85 MB, 8.85 MB - BytesReceived: 8.86 MB (9286722) - ConvertRowBatchTime: 11.727ms - DeserializeRowBatchTimer: 76.417ms - FirstBatchArrivalWaitTime: 684.291ms - PeakMemoryUsage: 0 - RowsReturned: 203.06K (203057) - RowsReturnedRate: 5.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a7 (host=dn7.hadoop.trivago.com:22000):(Total: 40s095ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.14 MB, 48.08 MB, 48.09 MB, 48.10 MB, 48.06 MB, 48.10 MB, 48.11 MB, 48.09 MB, 48.09 MB, 48.11 MB, 48.07 MB, 48.09 MB, 48.12 MB, 48.07 MB, 52.13 MB, 56.14 MB, 56.07 MB, 56.09 MB, 56.14 MB, 56.10 MB, 56.08 MB, 56.11 MB, 56.13 MB, 56.07 MB, 56.09 MB, 56.08 MB, 56.11 MB, 60.08 MB, 64.07 MB, 64.14 MB, 64.11 MB, 64.13 MB, 64.08 MB, 64.08 MB, 64.09 MB, 64.07 MB, 64.11 MB, 64.11 MB, 80.23 MB, 37.61 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 907.87 MB (951975232) - PrepareTime: 216.615ms - RowsProduced: 114.07K (114073) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s269ms - TotalNetworkSendTime: 57.280ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.86M (2860741) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 714.643ms, non-child: 714.643ms, % non-child: 100.00%) - CodegenTime: 437.590us - CompileTime: 152.440ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 373.524ms - PrepareTime: 187.923ms DataStreamSender (dst_id=11):(Total: 114.708ms, non-child: 114.708ms, % non-child: 100.00%) - BytesSent: 4.81 MB (5038882) - NetworkThroughput(*): 259.88 MB/sec - OverallThroughput: 41.89 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 113.05K (113049) - SerializeBatchTime: 96.290ms - TransmitDataRPCTime: 18.490ms - UncompressedRowBatchSize: 12.04 MB (12627813) SORT_NODE (id=9):(Total: 39s932ms, non-child: 143.977ms, % non-child: 0.36%) ExecOption: Codegen Enabled - InMemorySortTime: 98.411ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 114.07K (114073) - RowsReturnedRate: 2.86 K/sec - SortDataSize: 20.71 MB (21713634) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s788ms, non-child: 1s112ms, % non-child: 2.80%) - EvaluationTime: 1s081ms - GetNewBlockTime: 99.626us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.49K (204489) - RowsReturnedRate: 5.14 K/sec - UnpinTime: 4.320us SORT_NODE (id=7):(Total: 38s675ms, non-child: 391.774ms, % non-child: 1.01%) ExecOption: Codegen Enabled - InMemorySortTime: 120.787ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42097424) - RowsReturned: 204.49K (204489) - RowsReturnedRate: 5.29 K/sec - SortDataSize: 18.72 MB (19630944) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s284ms, non-child: 27.734ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 107.39 KB, 423.96 KB, 751.95 KB, 1.02 MB, 1.28 MB, 1.56 MB, 1.83 MB, 2.14 MB, 2.43 MB, 2.71 MB, 2.98 MB, 3.26 MB, 3.56 MB, 3.85 MB, 4.14 MB, 4.43 MB, 4.76 MB, 5.08 MB, 5.39 MB, 5.73 MB, 6.08 MB, 6.41 MB, 6.77 MB, 7.11 MB, 7.45 MB, 7.78 MB, 8.06 MB, 8.31 MB, 8.49 MB, 8.62 MB, 8.70 MB, 8.76 MB, 8.80 MB, 8.85 MB, 8.87 MB, 8.89 MB, 8.90 MB, 8.91 MB - BytesReceived: 8.91 MB (9342062) - ConvertRowBatchTime: 10.603ms - DeserializeRowBatchTimer: 78.223ms - FirstBatchArrivalWaitTime: 526.536ms - PeakMemoryUsage: 0 - RowsReturned: 204.49K (204489) - RowsReturnedRate: 5.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ab (host=dn6.hadoop.trivago.com:22000):(Total: 40s121ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.12 MB, 48.10 MB, 48.11 MB, 48.13 MB, 48.07 MB, 48.15 MB, 48.10 MB, 48.11 MB, 48.11 MB, 48.11 MB, 48.08 MB, 48.14 MB, 48.14 MB, 48.10 MB, 52.09 MB, 56.10 MB, 56.12 MB, 56.15 MB, 56.14 MB, 56.08 MB, 56.12 MB, 56.11 MB, 56.09 MB, 56.11 MB, 56.15 MB, 56.10 MB, 56.10 MB, 56.12 MB, 64.12 MB, 64.11 MB, 64.10 MB, 64.11 MB, 64.10 MB, 64.10 MB, 64.06 MB, 64.11 MB, 64.14 MB, 64.15 MB, 70.64 MB, 57.12 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 939.40 MB (985035312) - PrepareTime: 231.127ms - RowsProduced: 12.29K (12288) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s495ms - TotalNetworkSendTime: 18.330ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.85M (2851813) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 692.425ms, non-child: 692.425ms, % non-child: 100.00%) - CodegenTime: 361.656us - CompileTime: 133.112ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 367.358ms - PrepareTime: 191.312ms DataStreamSender (dst_id=11):(Total: 8.628ms, non-child: 8.628ms, % non-child: 100.00%) - BytesSent: 541.48 KB (554477) - NetworkThroughput(*): 215.84 MB/sec - OverallThroughput: 61.28 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 11.26K (11264) - SerializeBatchTime: 6.218ms - TransmitDataRPCTime: 2.449ms - UncompressedRowBatchSize: 1.30 MB (1362231) SORT_NODE (id=9):(Total: 40s097ms, non-child: 138.753ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 99.249ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 12.29K (12288) - RowsReturnedRate: 306.00 /sec - SortDataSize: 20.63 MB (21635038) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s958ms, non-child: 1s058ms, % non-child: 2.65%) - EvaluationTime: 1s015ms - GetNewBlockTime: 116.344us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.82K (203818) - RowsReturnedRate: 5.10 K/sec - UnpinTime: 4.260us SORT_NODE (id=7):(Total: 38s900ms, non-child: 389.793ms, % non-child: 1.00%) ExecOption: Codegen Enabled - InMemorySortTime: 114.774ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094800) - RowsReturned: 203.82K (203818) - RowsReturnedRate: 5.24 K/sec - SortDataSize: 18.66 MB (19566528) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s510ms, non-child: 27.513ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 102.04 KB, 432.96 KB, 738.82 KB, 1022.88 KB, 1.27 MB, 1.56 MB, 1.85 MB, 2.13 MB, 2.42 MB, 2.73 MB, 2.98 MB, 3.27 MB, 3.54 MB, 3.84 MB, 4.15 MB, 4.44 MB, 4.76 MB, 5.09 MB, 5.40 MB, 5.75 MB, 6.11 MB, 6.41 MB, 6.76 MB, 7.13 MB, 7.46 MB, 7.78 MB, 8.06 MB, 8.30 MB, 8.48 MB, 8.60 MB, 8.69 MB, 8.73 MB, 8.78 MB, 8.82 MB, 8.85 MB, 8.87 MB, 8.88 MB, 8.88 MB - BytesReceived: 8.89 MB (9322127) - ConvertRowBatchTime: 10.116ms - DeserializeRowBatchTimer: 77.263ms - FirstBatchArrivalWaitTime: 364.463ms - PeakMemoryUsage: 0 - RowsReturned: 203.82K (203818) - RowsReturnedRate: 5.29 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c7 (host=dn10.hadoop.trivago.com:22000):(Total: 41s431ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.12 MB, 48.11 MB, 48.10 MB, 48.12 MB, 48.14 MB, 48.08 MB, 48.07 MB, 48.13 MB, 48.10 MB, 48.08 MB, 48.10 MB, 48.13 MB, 48.10 MB, 48.11 MB, 48.16 MB, 56.10 MB, 56.07 MB, 56.10 MB, 56.11 MB, 56.09 MB, 56.08 MB, 56.09 MB, 56.07 MB, 56.11 MB, 56.08 MB, 56.10 MB, 56.09 MB, 56.09 MB, 64.13 MB, 64.08 MB, 64.07 MB, 64.11 MB, 64.07 MB, 64.10 MB, 64.11 MB, 64.11 MB, 64.09 MB, 64.11 MB, 64.11 MB, 81.23 MB, 37.61 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 908.69 MB (952827456) - PrepareTime: 242.347ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s055ms - TotalNetworkSendTime: 596.598ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.83M (2834276) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 799.568ms, non-child: 799.568ms, % non-child: 100.00%) - CodegenTime: 464.192us - CompileTime: 205.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 377.224ms - PrepareTime: 216.181ms DataStreamSender (dst_id=11):(Total: 2.865ms, non-child: 2.865ms, % non-child: 100.00%) - BytesSent: 177.38 KB (181635) - NetworkThroughput(*): 468.60 MB/sec - OverallThroughput: 60.46 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.621ms - TransmitDataRPCTime: 369.656us - UncompressedRowBatchSize: 440.18 KB (450747) SORT_NODE (id=9):(Total: 40s832ms, non-child: 144.751ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 98.014ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.58 MB (21584340) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s687ms, non-child: 1s204ms, % non-child: 2.96%) - EvaluationTime: 1s175ms - GetNewBlockTime: 167.328us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.39K (203391) - RowsReturnedRate: 5.00 K/sec - UnpinTime: 5.352us SORT_NODE (id=7):(Total: 39s482ms, non-child: 411.955ms, % non-child: 1.04%) ExecOption: Codegen Enabled - InMemorySortTime: 112.789ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094800) - RowsReturned: 203.39K (203391) - RowsReturnedRate: 5.15 K/sec - SortDataSize: 18.62 MB (19525536) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s070ms, non-child: 27.593ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 101.28 KB, 398.84 KB, 715.93 KB, 972.30 KB, 1.23 MB, 1.52 MB, 1.78 MB, 2.07 MB, 2.36 MB, 2.64 MB, 2.91 MB, 3.20 MB, 3.47 MB, 3.77 MB, 4.06 MB, 4.37 MB, 4.67 MB, 5.00 MB, 5.34 MB, 5.66 MB, 6.01 MB, 6.37 MB, 6.74 MB, 7.09 MB, 7.41 MB, 7.75 MB, 8.04 MB, 8.28 MB, 8.46 MB, 8.57 MB, 8.66 MB, 8.71 MB, 8.77 MB, 8.80 MB, 8.83 MB, 8.85 MB, 8.86 MB, 8.87 MB, 8.87 MB - BytesReceived: 8.88 MB (9306823) - ConvertRowBatchTime: 10.789ms - DeserializeRowBatchTimer: 84.616ms - FirstBatchArrivalWaitTime: 128.987ms - PeakMemoryUsage: 0 - RowsReturned: 203.39K (203391) - RowsReturnedRate: 5.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a4 (host=dn40.hadoop.trivago.com:22000):(Total: 40s002ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.06 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.08 MB, 48.08 MB, 48.10 MB, 48.05 MB, 48.12 MB, 48.12 MB, 48.09 MB, 48.15 MB, 56.15 MB, 56.09 MB, 56.05 MB, 56.10 MB, 56.09 MB, 56.13 MB, 56.09 MB, 56.13 MB, 56.11 MB, 56.08 MB, 56.09 MB, 56.08 MB, 56.13 MB, 64.10 MB, 64.14 MB, 64.11 MB, 64.12 MB, 64.13 MB, 64.07 MB, 64.06 MB, 64.10 MB, 64.14 MB, 64.14 MB, 74.29 MB, 57.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 859.99 MB (901769648) - PrepareTime: 299.819ms - RowsProduced: 12.29K (12288) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s173ms - TotalNetworkSendTime: 50.162ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 3.05M (3052196) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 751.568ms, non-child: 751.568ms, % non-child: 100.00%) - CodegenTime: 378.147us - CompileTime: 141.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 397.456ms - PrepareTime: 211.680ms DataStreamSender (dst_id=11):(Total: 8.451ms, non-child: 8.451ms, % non-child: 100.00%) - BytesSent: 537.86 KB (550770) - NetworkThroughput(*): 598.13 MB/sec - OverallThroughput: 62.15 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 11.26K (11264) - SerializeBatchTime: 7.610ms - TransmitDataRPCTime: 878.155us - UncompressedRowBatchSize: 1.30 MB (1360449) SORT_NODE (id=9):(Total: 39s944ms, non-child: 116.198ms, % non-child: 0.29%) ExecOption: Codegen Enabled - InMemorySortTime: 77.653ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 12.29K (12288) - RowsReturnedRate: 307.00 /sec - SortDataSize: 20.52 MB (21513283) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s828ms, non-child: 1s193ms, % non-child: 3.00%) - EvaluationTime: 1s007ms - GetNewBlockTime: 146.869us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.74K (202744) - RowsReturnedRate: 5.09 K/sec - UnpinTime: 4.169us SORT_NODE (id=7):(Total: 38s634ms, non-child: 445.484ms, % non-child: 1.15%) ExecOption: Codegen Enabled - InMemorySortTime: 147.092ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42102720) - RowsReturned: 202.74K (202744) - RowsReturnedRate: 5.25 K/sec - SortDataSize: 18.56 MB (19463424) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s188ms, non-child: 32.132ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 80.50 KB, 407.39 KB, 727.10 KB, 1005.12 KB, 1.25 MB, 1.52 MB, 1.79 MB, 2.08 MB, 2.37 MB, 2.62 MB, 2.89 MB, 3.19 MB, 3.46 MB, 3.76 MB, 4.05 MB, 4.36 MB, 4.65 MB, 4.97 MB, 5.33 MB, 5.65 MB, 5.98 MB, 6.35 MB, 6.70 MB, 7.05 MB, 7.37 MB, 7.71 MB, 8.00 MB, 8.22 MB, 8.43 MB, 8.56 MB, 8.63 MB, 8.69 MB, 8.74 MB, 8.78 MB, 8.81 MB, 8.83 MB, 8.85 MB, 8.85 MB - BytesReceived: 8.85 MB (9283414) - ConvertRowBatchTime: 10.965ms - DeserializeRowBatchTimer: 74.936ms - FirstBatchArrivalWaitTime: 562.616ms - PeakMemoryUsage: 0 - RowsReturned: 202.74K (202744) - RowsReturnedRate: 5.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ad (host=dn46.hadoop.trivago.com:22000):(Total: 40s381ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.10 MB, 48.05 MB, 48.11 MB, 48.07 MB, 48.05 MB, 48.15 MB, 48.10 MB, 48.10 MB, 48.08 MB, 48.10 MB, 48.07 MB, 48.11 MB, 48.10 MB, 48.10 MB, 48.14 MB, 56.10 MB, 56.10 MB, 56.10 MB, 56.09 MB, 56.09 MB, 56.06 MB, 56.08 MB, 56.13 MB, 56.11 MB, 56.13 MB, 56.12 MB, 56.06 MB, 56.09 MB, 60.13 MB, 64.06 MB, 64.11 MB, 64.13 MB, 64.12 MB, 64.07 MB, 64.09 MB, 64.09 MB, 64.07 MB, 64.09 MB, 70.16 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 851.65 MB (893017352) - PrepareTime: 303.796ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s374ms - TotalNetworkSendTime: 219.905ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.69M (2686372) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 751.184ms, non-child: 751.184ms, % non-child: 100.00%) - CodegenTime: 402.869us - CompileTime: 144.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 399.787ms - PrepareTime: 206.582ms DataStreamSender (dst_id=11):(Total: 2.610ms, non-child: 2.610ms, % non-child: 100.00%) - BytesSent: 177.56 KB (181821) - NetworkThroughput(*): 720.50 MB/sec - OverallThroughput: 66.43 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.394ms - TransmitDataRPCTime: 240.663us - UncompressedRowBatchSize: 441.05 KB (451638) SORT_NODE (id=9):(Total: 40s159ms, non-child: 150.741ms, % non-child: 0.38%) ExecOption: Codegen Enabled - InMemorySortTime: 104.023ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.46 MB (21457210) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s008ms, non-child: 1s209ms, % non-child: 3.02%) - EvaluationTime: 1s099ms - GetNewBlockTime: 132.175us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.17K (202174) - RowsReturnedRate: 5.05 K/sec - UnpinTime: 4.130us SORT_NODE (id=7):(Total: 38s798ms, non-child: 409.133ms, % non-child: 1.05%) ExecOption: Codegen Enabled - InMemorySortTime: 113.634ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42092832) - RowsReturned: 202.17K (202174) - RowsReturnedRate: 5.21 K/sec - SortDataSize: 18.51 MB (19408704) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s389ms, non-child: 31.728ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 72.88 KB, 394.51 KB, 713.92 KB, 995.85 KB, 1.23 MB, 1.50 MB, 1.79 MB, 2.06 MB, 2.34 MB, 2.64 MB, 2.87 MB, 3.16 MB, 3.45 MB, 3.74 MB, 4.04 MB, 4.37 MB, 4.68 MB, 4.99 MB, 5.32 MB, 5.65 MB, 6.00 MB, 6.34 MB, 6.69 MB, 7.04 MB, 7.38 MB, 7.70 MB, 7.99 MB, 8.22 MB, 8.39 MB, 8.52 MB, 8.61 MB, 8.66 MB, 8.70 MB, 8.75 MB, 8.78 MB, 8.80 MB, 8.81 MB, 8.82 MB - BytesReceived: 8.82 MB (9252392) - ConvertRowBatchTime: 10.950ms - DeserializeRowBatchTimer: 69.905ms - FirstBatchArrivalWaitTime: 252.538ms - PeakMemoryUsage: 0 - RowsReturned: 202.17K (202174) - RowsReturnedRate: 5.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4d5 (host=dn1.hadoop.trivago.com:22000):(Total: 42s386ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.08 MB, 48.12 MB, 48.08 MB, 48.12 MB, 48.11 MB, 48.07 MB, 48.13 MB, 48.07 MB, 48.09 MB, 48.09 MB, 48.10 MB, 48.06 MB, 48.09 MB, 48.11 MB, 48.10 MB, 56.10 MB, 56.07 MB, 56.10 MB, 56.07 MB, 56.13 MB, 56.06 MB, 56.09 MB, 56.08 MB, 56.14 MB, 56.10 MB, 56.13 MB, 56.12 MB, 56.11 MB, 64.12 MB, 64.09 MB, 64.13 MB, 64.11 MB, 64.11 MB, 64.12 MB, 64.08 MB, 64.11 MB, 64.10 MB, 64.07 MB, 64.07 MB, 64.08 MB, 76.23 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 889.79 MB (933013424) - PrepareTime: 324.116ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s457ms - TotalNetworkSendTime: 443.519ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.71M (2706500) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 1s022ms, non-child: 1s022ms, % non-child: 100.00%) - CodegenTime: 381.760us - CompileTime: 261.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 485.533ms - PrepareTime: 274.569ms DataStreamSender (dst_id=11):(Total: 1.980ms, non-child: 1.980ms, % non-child: 100.00%) - BytesSent: 179.86 KB (184173) - NetworkThroughput(*): 757.43 MB/sec - OverallThroughput: 88.68 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 1.791ms - TransmitDataRPCTime: 231.892us - UncompressedRowBatchSize: 443.53 KB (454176) SORT_NODE (id=9):(Total: 41s940ms, non-child: 153.595ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 99.375ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 97.00 /sec - SortDataSize: 20.56 MB (21554206) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s787ms, non-child: 1s822ms, % non-child: 4.36%) - EvaluationTime: 1s768ms - GetNewBlockTime: 141.400us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.09K (203086) - RowsReturnedRate: 4.86 K/sec - UnpinTime: 4.440us SORT_NODE (id=7):(Total: 39s964ms, non-child: 492.674ms, % non-child: 1.23%) ExecOption: Codegen Enabled - InMemorySortTime: 126.587ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42098000) - RowsReturned: 203.09K (203086) - RowsReturnedRate: 5.08 K/sec - SortDataSize: 18.59 MB (19496256) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s471ms, non-child: 27.707ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 45.80 KB, 354.67 KB, 681.17 KB, 948.50 KB, 1.18 MB, 1.47 MB, 1.76 MB, 2.03 MB, 2.32 MB, 2.61 MB, 2.86 MB, 3.14 MB, 3.44 MB, 3.72 MB, 4.05 MB, 4.34 MB, 4.66 MB, 5.00 MB, 5.30 MB, 5.62 MB, 5.95 MB, 6.30 MB, 6.67 MB, 7.01 MB, 7.35 MB, 7.67 MB, 7.96 MB, 8.20 MB, 8.40 MB, 8.53 MB, 8.63 MB, 8.69 MB, 8.74 MB, 8.78 MB, 8.81 MB, 8.83 MB, 8.84 MB, 8.85 MB, 8.85 MB, 8.86 MB - BytesReceived: 8.86 MB (9289008) - ConvertRowBatchTime: 10.169ms - DeserializeRowBatchTimer: 66.249ms - FirstBatchArrivalWaitTime: 385.565ms - PeakMemoryUsage: 0 - RowsReturned: 203.09K (203086) - RowsReturnedRate: 5.14 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4be (host=dn4.hadoop.trivago.com:22000):(Total: 40s897ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 12.00 MB, 48.04 MB, 48.06 MB, 48.11 MB, 48.10 MB, 48.08 MB, 48.12 MB, 48.12 MB, 48.07 MB, 48.10 MB, 48.14 MB, 48.09 MB, 48.14 MB, 48.10 MB, 48.10 MB, 48.07 MB, 56.12 MB, 56.15 MB, 56.13 MB, 56.10 MB, 56.13 MB, 56.05 MB, 56.10 MB, 56.10 MB, 56.10 MB, 56.10 MB, 56.11 MB, 56.13 MB, 60.06 MB, 64.06 MB, 64.13 MB, 64.09 MB, 64.07 MB, 64.13 MB, 64.09 MB, 64.13 MB, 64.07 MB, 64.10 MB, 64.12 MB, 64.13 MB, 75.73 MB, 60.12 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 892.74 MB (936103544) - PrepareTime: 543.627ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s092ms - TotalNetworkSendTime: 154.534ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.63M (2632324) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 1s074ms, non-child: 1s074ms, % non-child: 100.00%) - CodegenTime: 383.720us - CompileTime: 218.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 571.502ms - PrepareTime: 283.149ms DataStreamSender (dst_id=11):(Total: 2.239ms, non-child: 2.239ms, % non-child: 100.00%) - BytesSent: 179.93 KB (184245) - NetworkThroughput(*): 465.38 MB/sec - OverallThroughput: 78.47 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 1.904ms - TransmitDataRPCTime: 377.564us - UncompressedRowBatchSize: 443.56 KB (454203) SORT_NODE (id=9):(Total: 40s727ms, non-child: 157.938ms, % non-child: 0.39%) ExecOption: Codegen Enabled - InMemorySortTime: 105.164ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.83 MB (21844050) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s569ms, non-child: 1s964ms, % non-child: 4.84%) - EvaluationTime: 1s673ms - GetNewBlockTime: 153.520us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 205.70K (205701) - RowsReturnedRate: 5.07 K/sec - UnpinTime: 4.396us SORT_NODE (id=7):(Total: 38s605ms, non-child: 497.583ms, % non-child: 1.29%) ExecOption: Codegen Enabled - InMemorySortTime: 116.866ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42093504) - RowsReturned: 205.70K (205701) - RowsReturnedRate: 5.33 K/sec - SortDataSize: 18.83 MB (19747296) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s107ms, non-child: 31.933ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 27.50 KB, 305.89 KB, 622.74 KB, 913.86 KB, 1.16 MB, 1.44 MB, 1.71 MB, 2.02 MB, 2.30 MB, 2.59 MB, 2.88 MB, 3.17 MB, 3.44 MB, 3.75 MB, 4.05 MB, 4.36 MB, 4.66 MB, 4.99 MB, 5.32 MB, 5.66 MB, 5.98 MB, 6.34 MB, 6.71 MB, 7.09 MB, 7.40 MB, 7.75 MB, 8.05 MB, 8.31 MB, 8.49 MB, 8.62 MB, 8.73 MB, 8.78 MB, 8.83 MB, 8.88 MB, 8.92 MB, 8.94 MB, 8.95 MB, 8.96 MB, 8.96 MB - BytesReceived: 8.97 MB (9402230) - ConvertRowBatchTime: 10.890ms - DeserializeRowBatchTimer: 74.266ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 205.70K (205701) - RowsReturnedRate: 5.40 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c1 (host=dn15.hadoop.trivago.com:22000):(Total: 41s266ms, non-child: 120.734ms, % non-child: 0.29%) MemoryUsage(1s000ms): 48.01 MB, 48.07 MB, 48.06 MB, 48.10 MB, 48.10 MB, 48.12 MB, 48.13 MB, 48.12 MB, 48.10 MB, 48.08 MB, 48.11 MB, 48.11 MB, 48.11 MB, 48.08 MB, 48.12 MB, 48.12 MB, 56.12 MB, 56.10 MB, 56.14 MB, 56.10 MB, 56.11 MB, 56.06 MB, 56.08 MB, 56.10 MB, 56.11 MB, 56.14 MB, 56.10 MB, 56.09 MB, 56.08 MB, 64.07 MB, 64.08 MB, 64.12 MB, 64.11 MB, 64.10 MB, 64.11 MB, 64.12 MB, 64.08 MB, 64.12 MB, 64.09 MB, 64.05 MB, 60.22 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 900.07 MB (943794640) - PrepareTime: 187.401ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s062ms - TotalNetworkSendTime: 723.651ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.81M (2812229) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 602.830ms, non-child: 602.830ms, % non-child: 100.00%) - CodegenTime: 255.314us - CompileTime: 95.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 322.703ms - PrepareTime: 184.459ms DataStreamSender (dst_id=11):(Total: 2.566ms, non-child: 2.566ms, % non-child: 100.00%) - BytesSent: 177.19 KB (181443) - NetworkThroughput(*): 682.64 MB/sec - OverallThroughput: 67.43 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.389ms - TransmitDataRPCTime: 253.482us - UncompressedRowBatchSize: 440.26 KB (450828) SORT_NODE (id=9):(Total: 40s540ms, non-child: 140.027ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 100.837ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.64 MB (21645207) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s400ms, non-child: 936.624ms, % non-child: 2.32%) - EvaluationTime: 930.826ms - GetNewBlockTime: 100.766us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.83K (203832) - RowsReturnedRate: 5.04 K/sec - UnpinTime: 5.090us SORT_NODE (id=7):(Total: 39s464ms, non-child: 385.679ms, % non-child: 0.98%) ExecOption: Codegen Enabled - InMemorySortTime: 117.047ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42102032) - RowsReturned: 203.83K (203832) - RowsReturnedRate: 5.16 K/sec - SortDataSize: 18.66 MB (19567872) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s078ms, non-child: 29.374ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 103.99 KB, 398.73 KB, 731.37 KB, 1.00 MB, 1.26 MB, 1.53 MB, 1.84 MB, 2.12 MB, 2.43 MB, 2.70 MB, 2.97 MB, 3.24 MB, 3.52 MB, 3.80 MB, 4.12 MB, 4.43 MB, 4.73 MB, 5.06 MB, 5.37 MB, 5.70 MB, 6.03 MB, 6.37 MB, 6.74 MB, 7.06 MB, 7.40 MB, 7.72 MB, 8.03 MB, 8.27 MB, 8.44 MB, 8.58 MB, 8.66 MB, 8.72 MB, 8.76 MB, 8.81 MB, 8.84 MB, 8.85 MB, 8.86 MB, 8.87 MB, 8.88 MB - BytesReceived: 8.88 MB (9309613) - ConvertRowBatchTime: 11.040ms - DeserializeRowBatchTimer: 77.478ms - FirstBatchArrivalWaitTime: 381.094ms - PeakMemoryUsage: 0 - RowsReturned: 203.83K (203832) - RowsReturnedRate: 5.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ba (host=dn12.hadoop.trivago.com:22000):(Total: 41s146ms, non-child: 132.791ms, % non-child: 0.32%) MemoryUsage(1s000ms): 24.00 MB, 48.05 MB, 48.10 MB, 48.09 MB, 48.13 MB, 48.10 MB, 48.09 MB, 48.08 MB, 48.13 MB, 48.09 MB, 48.13 MB, 48.09 MB, 48.11 MB, 48.14 MB, 48.06 MB, 48.06 MB, 56.12 MB, 56.14 MB, 56.11 MB, 56.09 MB, 56.10 MB, 56.08 MB, 56.10 MB, 56.10 MB, 56.09 MB, 56.15 MB, 56.09 MB, 56.07 MB, 56.08 MB, 64.09 MB, 64.07 MB, 64.10 MB, 64.13 MB, 64.09 MB, 64.10 MB, 64.06 MB, 64.13 MB, 64.09 MB, 64.06 MB, 64.07 MB, 82.23 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 806.88 MB (846076064) - PrepareTime: 193.784ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s816ms - TotalNetworkSendTime: 762.178ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 629.034ms, non-child: 629.034ms, % non-child: 100.00%) - CodegenTime: 262.948us - CompileTime: 96.868ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 340.555ms - PrepareTime: 190.889ms DataStreamSender (dst_id=11):(Total: 2.348ms, non-child: 2.348ms, % non-child: 100.00%) - BytesSent: 178.65 KB (182938) - NetworkThroughput(*): 635.83 MB/sec - OverallThroughput: 74.28 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.144ms - TransmitDataRPCTime: 274.388us - UncompressedRowBatchSize: 442.69 KB (453312) SORT_NODE (id=9):(Total: 40s381ms, non-child: 138.235ms, % non-child: 0.34%) ExecOption: Codegen Enabled - InMemorySortTime: 98.428ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.67 MB (21671170) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s243ms, non-child: 997.394ms, % non-child: 2.48%) - EvaluationTime: 991.287ms - GetNewBlockTime: 85.860us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.09K (204085) - RowsReturnedRate: 5.07 K/sec - UnpinTime: 3.944us SORT_NODE (id=7):(Total: 39s246ms, non-child: 414.900ms, % non-child: 1.06%) ExecOption: Codegen Enabled - InMemorySortTime: 136.000ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42095744) - RowsReturned: 204.09K (204085) - RowsReturnedRate: 5.20 K/sec - SortDataSize: 18.68 MB (19592160) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s831ms, non-child: 28.847ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 10.38 KB, 278.48 KB, 616.18 KB, 887.72 KB, 1.15 MB, 1.43 MB, 1.69 MB, 1.98 MB, 2.28 MB, 2.59 MB, 2.86 MB, 3.16 MB, 3.43 MB, 3.69 MB, 4.01 MB, 4.30 MB, 4.64 MB, 4.96 MB, 5.28 MB, 5.60 MB, 5.95 MB, 6.32 MB, 6.65 MB, 6.98 MB, 7.32 MB, 7.67 MB, 7.97 MB, 8.22 MB, 8.41 MB, 8.55 MB, 8.66 MB, 8.71 MB, 8.76 MB, 8.81 MB, 8.84 MB, 8.87 MB, 8.87 MB, 8.89 MB, 8.89 MB - BytesReceived: 8.89 MB (9323993) - ConvertRowBatchTime: 11.009ms - DeserializeRowBatchTimer: 92.064ms - FirstBatchArrivalWaitTime: 771.619ms - PeakMemoryUsage: 0 - RowsReturned: 204.09K (204085) - RowsReturnedRate: 5.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c6 (host=dn27.hadoop.trivago.com:22000):(Total: 41s596ms, non-child: 111.604ms, % non-child: 0.27%) MemoryUsage(1s000ms): 48.01 MB, 48.05 MB, 48.12 MB, 48.08 MB, 48.10 MB, 48.14 MB, 48.12 MB, 48.09 MB, 48.11 MB, 48.06 MB, 48.09 MB, 48.11 MB, 48.14 MB, 48.12 MB, 48.10 MB, 48.10 MB, 56.12 MB, 56.09 MB, 56.10 MB, 56.14 MB, 56.08 MB, 56.06 MB, 56.11 MB, 56.10 MB, 56.11 MB, 56.08 MB, 56.08 MB, 56.11 MB, 56.11 MB, 60.11 MB, 64.14 MB, 64.13 MB, 64.07 MB, 64.11 MB, 64.13 MB, 64.11 MB, 64.14 MB, 64.07 MB, 64.08 MB, 64.08 MB, 80.23 MB, 37.61 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 920.31 MB (965018216) - PrepareTime: 188.416ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s277ms - TotalNetworkSendTime: 715.490ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.74M (2743269) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 603.099ms, non-child: 603.099ms, % non-child: 100.00%) - CodegenTime: 264.152us - CompileTime: 88.713ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 328.364ms - PrepareTime: 185.303ms DataStreamSender (dst_id=11):(Total: 3.751ms, non-child: 3.751ms, % non-child: 100.00%) - BytesSent: 178.02 KB (182291) - NetworkThroughput(*): 321.29 MB/sec - OverallThroughput: 46.34 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 3.345ms - TransmitDataRPCTime: 541.096us - UncompressedRowBatchSize: 441.71 KB (452313) SORT_NODE (id=9):(Total: 40s878ms, non-child: 141.645ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 98.035ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.35 MB (21334697) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s736ms, non-child: 1s065ms, % non-child: 2.62%) - EvaluationTime: 1s059ms - GetNewBlockTime: 145.512us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 201.15K (201146) - RowsReturnedRate: 4.94 K/sec - UnpinTime: 4.576us SORT_NODE (id=7):(Total: 39s671ms, non-child: 379.164ms, % non-child: 0.96%) ExecOption: Codegen Enabled - InMemorySortTime: 114.106ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42095632) - RowsReturned: 201.15K (201146) - RowsReturnedRate: 5.07 K/sec - SortDataSize: 18.42 MB (19310016) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s291ms, non-child: 29.267ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 77.03 KB, 376.19 KB, 722.18 KB, 1009.72 KB, 1.22 MB, 1.53 MB, 1.81 MB, 2.11 MB, 2.38 MB, 2.68 MB, 2.96 MB, 3.24 MB, 3.50 MB, 3.78 MB, 4.07 MB, 4.37 MB, 4.67 MB, 4.97 MB, 5.30 MB, 5.63 MB, 5.96 MB, 6.30 MB, 6.65 MB, 6.99 MB, 7.31 MB, 7.63 MB, 7.95 MB, 8.17 MB, 8.36 MB, 8.47 MB, 8.56 MB, 8.63 MB, 8.68 MB, 8.72 MB, 8.75 MB, 8.77 MB, 8.78 MB, 8.79 MB, 8.79 MB - BytesReceived: 8.79 MB (9220132) - ConvertRowBatchTime: 10.776ms - DeserializeRowBatchTimer: 72.248ms - FirstBatchArrivalWaitTime: 722.639ms - PeakMemoryUsage: 0 - RowsReturned: 201.15K (201146) - RowsReturnedRate: 5.12 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b1 (host=dn30.hadoop.trivago.com:22000):(Total: 40s851ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.04 MB, 48.14 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.09 MB, 48.13 MB, 48.08 MB, 48.08 MB, 48.09 MB, 48.08 MB, 48.06 MB, 48.10 MB, 48.10 MB, 48.10 MB, 56.11 MB, 56.16 MB, 56.10 MB, 56.11 MB, 56.08 MB, 56.10 MB, 56.13 MB, 56.13 MB, 56.13 MB, 56.11 MB, 56.07 MB, 56.14 MB, 56.11 MB, 60.10 MB, 64.08 MB, 64.10 MB, 64.07 MB, 64.12 MB, 64.13 MB, 64.08 MB, 64.07 MB, 64.10 MB, 64.13 MB, 69.18 MB, 59.12 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 800.53 MB (839416368) - PrepareTime: 205.147ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s552ms - TotalNetworkSendTime: 594.931ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.53M (2525765) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 676.574ms, non-child: 676.574ms, % non-child: 100.00%) - CodegenTime: 239.188us - CompileTime: 116.910ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 356.600ms - PrepareTime: 202.368ms DataStreamSender (dst_id=11):(Total: 2.696ms, non-child: 2.696ms, % non-child: 100.00%) - BytesSent: 179.96 KB (184280) - NetworkThroughput(*): 633.99 MB/sec - OverallThroughput: 65.17 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.475ms - TransmitDataRPCTime: 277.201us - UncompressedRowBatchSize: 443.29 KB (453933) SORT_NODE (id=9):(Total: 40s254ms, non-child: 120.663ms, % non-child: 0.30%) ExecOption: Codegen Enabled - InMemorySortTime: 81.953ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.51 MB (21510082) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s133ms, non-child: 1s144ms, % non-child: 2.85%) - EvaluationTime: 1s041ms - GetNewBlockTime: 94.806us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.71K (202711) - RowsReturnedRate: 5.05 K/sec - UnpinTime: 4.251us SORT_NODE (id=7):(Total: 38s988ms, non-child: 420.920ms, % non-child: 1.08%) ExecOption: Codegen Enabled - InMemorySortTime: 135.125ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42095696) - RowsReturned: 202.71K (202711) - RowsReturnedRate: 5.20 K/sec - SortDataSize: 18.56 MB (19460256) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s567ms, non-child: 26.698ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 73.27 KB, 359.87 KB, 681.92 KB, 964.47 KB, 1.23 MB, 1.50 MB, 1.80 MB, 2.09 MB, 2.36 MB, 2.65 MB, 2.91 MB, 3.20 MB, 3.47 MB, 3.77 MB, 4.07 MB, 4.38 MB, 4.67 MB, 5.03 MB, 5.35 MB, 5.64 MB, 5.99 MB, 6.31 MB, 6.69 MB, 7.01 MB, 7.36 MB, 7.68 MB, 7.97 MB, 8.23 MB, 8.41 MB, 8.55 MB, 8.63 MB, 8.69 MB, 8.73 MB, 8.78 MB, 8.81 MB, 8.82 MB, 8.84 MB, 8.85 MB - BytesReceived: 8.85 MB (9282627) - ConvertRowBatchTime: 10.639ms - DeserializeRowBatchTimer: 66.170ms - FirstBatchArrivalWaitTime: 744.130ms - PeakMemoryUsage: 0 - RowsReturned: 202.71K (202711) - RowsReturnedRate: 5.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b7 (host=dn22.hadoop.trivago.com:22000):(Total: 41s099ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.03 MB, 48.10 MB, 48.14 MB, 48.12 MB, 48.12 MB, 48.07 MB, 48.15 MB, 48.12 MB, 48.10 MB, 48.13 MB, 48.11 MB, 48.15 MB, 48.10 MB, 48.10 MB, 48.09 MB, 56.11 MB, 56.12 MB, 56.12 MB, 56.10 MB, 56.08 MB, 56.12 MB, 56.14 MB, 56.11 MB, 56.13 MB, 56.07 MB, 56.11 MB, 56.14 MB, 56.13 MB, 64.07 MB, 64.08 MB, 64.10 MB, 64.08 MB, 64.09 MB, 64.07 MB, 64.11 MB, 64.09 MB, 64.07 MB, 64.09 MB, 64.10 MB, 81.23 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 877.97 MB (920616488) - PrepareTime: 240.252ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s722ms - TotalNetworkSendTime: 593.267ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.82M (2822596) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 687.463ms, non-child: 687.463ms, % non-child: 100.00%) - CodegenTime: 424.026us - CompileTime: 129.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 355.323ms - PrepareTime: 201.668ms DataStreamSender (dst_id=11):(Total: 2.831ms, non-child: 2.831ms, % non-child: 100.00%) - BytesSent: 179.97 KB (184291) - NetworkThroughput(*): 658.00 MB/sec - OverallThroughput: 62.07 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.630ms - TransmitDataRPCTime: 267.101us - UncompressedRowBatchSize: 443.06 KB (453690) SORT_NODE (id=9):(Total: 40s503ms, non-child: 149.333ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 107.955ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.56 MB (21563227) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s354ms, non-child: 1s212ms, % non-child: 3.00%) - EvaluationTime: 1s170ms - GetNewBlockTime: 176.857us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.23K (203233) - RowsReturnedRate: 5.04 K/sec - UnpinTime: 3.266us SORT_NODE (id=7):(Total: 39s142ms, non-child: 404.692ms, % non-child: 1.03%) ExecOption: Codegen Enabled - InMemorySortTime: 117.453ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42090704) - RowsReturned: 203.23K (203233) - RowsReturnedRate: 5.19 K/sec - SortDataSize: 18.61 MB (19510368) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s737ms, non-child: 29.835ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 25.06 KB, 301.89 KB, 636.98 KB, 947.14 KB, 1.18 MB, 1.47 MB, 1.76 MB, 2.02 MB, 2.33 MB, 2.60 MB, 2.89 MB, 3.17 MB, 3.42 MB, 3.74 MB, 4.02 MB, 4.35 MB, 4.64 MB, 4.93 MB, 5.26 MB, 5.56 MB, 5.92 MB, 6.26 MB, 6.63 MB, 6.99 MB, 7.32 MB, 7.65 MB, 7.94 MB, 8.22 MB, 8.42 MB, 8.56 MB, 8.65 MB, 8.71 MB, 8.76 MB, 8.80 MB, 8.84 MB, 8.85 MB, 8.86 MB, 8.87 MB, 8.88 MB - BytesReceived: 8.88 MB (9310568) - ConvertRowBatchTime: 10.610ms - DeserializeRowBatchTimer: 73.371ms - FirstBatchArrivalWaitTime: 767.812ms - PeakMemoryUsage: 0 - RowsReturned: 203.23K (203233) - RowsReturnedRate: 5.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c8 (host=dn43.hadoop.trivago.com:22000):(Total: 41s430ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.06 MB, 48.08 MB, 48.10 MB, 48.13 MB, 48.08 MB, 48.07 MB, 48.09 MB, 48.13 MB, 48.10 MB, 48.08 MB, 48.14 MB, 48.07 MB, 48.11 MB, 48.13 MB, 48.11 MB, 56.11 MB, 56.08 MB, 56.09 MB, 56.09 MB, 56.08 MB, 56.08 MB, 56.09 MB, 56.10 MB, 56.07 MB, 56.14 MB, 56.10 MB, 56.07 MB, 56.09 MB, 64.08 MB, 64.07 MB, 64.08 MB, 64.12 MB, 64.10 MB, 64.09 MB, 64.09 MB, 64.09 MB, 64.12 MB, 64.13 MB, 64.13 MB, 82.23 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 909.43 MB (953603728) - PrepareTime: 220.591ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s058ms - TotalNetworkSendTime: 705.458ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.75M (2752804) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 799.743ms, non-child: 799.743ms, % non-child: 100.00%) - CodegenTime: 499.943us - CompileTime: 152.252ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 430.981ms - PrepareTime: 215.733ms DataStreamSender (dst_id=11):(Total: 2.464ms, non-child: 2.464ms, % non-child: 100.00%) - BytesSent: 178.16 KB (182439) - NetworkThroughput(*): 643.63 MB/sec - OverallThroughput: 70.60 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.264ms - TransmitDataRPCTime: 270.323us - UncompressedRowBatchSize: 441.87 KB (452475) SORT_NODE (id=9):(Total: 40s704ms, non-child: 135.642ms, % non-child: 0.33%) ExecOption: Codegen Enabled - InMemorySortTime: 95.707ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.40 MB (21393456) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s569ms, non-child: 1s052ms, % non-child: 2.59%) - EvaluationTime: 1s023ms - GetNewBlockTime: 104.464us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 201.61K (201606) - RowsReturnedRate: 4.97 K/sec - UnpinTime: 3.608us SORT_NODE (id=7):(Total: 39s516ms, non-child: 443.656ms, % non-child: 1.12%) ExecOption: Codegen Enabled - InMemorySortTime: 143.768ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42098768) - RowsReturned: 201.61K (201606) - RowsReturnedRate: 5.10 K/sec - SortDataSize: 18.46 MB (19354176) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s072ms, non-child: 25.474ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 102.74 KB, 431.30 KB, 717.63 KB, 1006.63 KB, 1.25 MB, 1.56 MB, 1.83 MB, 2.12 MB, 2.40 MB, 2.68 MB, 2.95 MB, 3.19 MB, 3.50 MB, 3.80 MB, 4.08 MB, 4.40 MB, 4.69 MB, 5.03 MB, 5.36 MB, 5.70 MB, 6.05 MB, 6.41 MB, 6.77 MB, 7.11 MB, 7.41 MB, 7.71 MB, 8.02 MB, 8.25 MB, 8.42 MB, 8.53 MB, 8.60 MB, 8.66 MB, 8.70 MB, 8.74 MB, 8.76 MB, 8.79 MB, 8.80 MB, 8.80 MB, 8.80 MB - BytesReceived: 8.81 MB (9234171) - ConvertRowBatchTime: 10.414ms - DeserializeRowBatchTimer: 61.337ms - FirstBatchArrivalWaitTime: 619.069ms - PeakMemoryUsage: 0 - RowsReturned: 201.61K (201606) - RowsReturnedRate: 5.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4cf (host=dn25.hadoop.trivago.com:22000):(Total: 40s926ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.10 MB, 48.10 MB, 48.13 MB, 48.12 MB, 48.12 MB, 48.10 MB, 48.12 MB, 48.14 MB, 48.08 MB, 48.09 MB, 48.11 MB, 48.10 MB, 48.11 MB, 48.12 MB, 56.12 MB, 56.12 MB, 56.10 MB, 56.11 MB, 56.10 MB, 56.10 MB, 56.11 MB, 56.11 MB, 56.10 MB, 56.13 MB, 56.07 MB, 56.09 MB, 56.13 MB, 64.12 MB, 64.09 MB, 64.05 MB, 64.07 MB, 64.12 MB, 64.08 MB, 64.12 MB, 64.06 MB, 64.07 MB, 64.11 MB, 64.11 MB, 69.67 MB, 60.12 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 902.72 MB (946566064) - PrepareTime: 266.436ms - RowsProduced: 3.07K (3072) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s196ms - TotalNetworkSendTime: 7.137ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.90M (2899365) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 903.574ms, non-child: 903.574ms, % non-child: 100.00%) - CodegenTime: 448.974us - CompileTime: 175.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 465.166ms - PrepareTime: 262.172ms DataStreamSender (dst_id=11):(Total: 2.105ms, non-child: 2.105ms, % non-child: 100.00%) - BytesSent: 131.42 KB (134572) - NetworkThroughput(*): 125.53 MB/sec - OverallThroughput: 60.97 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 2.05K (2048) - SerializeBatchTime: 1.440ms - TransmitDataRPCTime: 1.022ms - UncompressedRowBatchSize: 329.48 KB (337392) SORT_NODE (id=9):(Total: 40s917ms, non-child: 136.464ms, % non-child: 0.33%) ExecOption: Codegen Enabled - InMemorySortTime: 93.804ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 3.07K (3072) - RowsReturnedRate: 75.00 /sec - SortDataSize: 20.59 MB (21594329) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s781ms, non-child: 1s112ms, % non-child: 2.73%) - EvaluationTime: 1s104ms - GetNewBlockTime: 116.031us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.47K (203468) - RowsReturnedRate: 4.99 K/sec - UnpinTime: 4.381us SORT_NODE (id=7):(Total: 39s668ms, non-child: 458.056ms, % non-child: 1.15%) ExecOption: Codegen Enabled - InMemorySortTime: 115.503ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094800) - RowsReturned: 203.47K (203468) - RowsReturnedRate: 5.13 K/sec - SortDataSize: 18.63 MB (19532928) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s210ms, non-child: 27.426ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 35.27 KB, 301.17 KB, 643.98 KB, 931.34 KB, 1.18 MB, 1.46 MB, 1.73 MB, 2.03 MB, 2.32 MB, 2.59 MB, 2.86 MB, 3.14 MB, 3.42 MB, 3.72 MB, 4.01 MB, 4.32 MB, 4.64 MB, 4.94 MB, 5.26 MB, 5.59 MB, 5.94 MB, 6.31 MB, 6.66 MB, 6.99 MB, 7.32 MB, 7.65 MB, 7.94 MB, 8.21 MB, 8.43 MB, 8.55 MB, 8.65 MB, 8.70 MB, 8.76 MB, 8.79 MB, 8.83 MB, 8.85 MB, 8.86 MB, 8.87 MB, 8.87 MB - BytesReceived: 8.88 MB (9307720) - ConvertRowBatchTime: 9.561ms - DeserializeRowBatchTimer: 71.062ms - FirstBatchArrivalWaitTime: 502.716ms - PeakMemoryUsage: 0 - RowsReturned: 203.47K (203468) - RowsReturnedRate: 5.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4d1 (host=dn21.hadoop.trivago.com:22000):(Total: 41s188ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.04 MB, 48.08 MB, 48.14 MB, 48.09 MB, 48.05 MB, 48.12 MB, 48.10 MB, 48.09 MB, 48.14 MB, 48.10 MB, 48.09 MB, 48.09 MB, 48.11 MB, 48.12 MB, 48.10 MB, 56.12 MB, 56.10 MB, 56.08 MB, 56.15 MB, 56.08 MB, 56.11 MB, 56.07 MB, 56.10 MB, 56.12 MB, 56.13 MB, 56.10 MB, 56.10 MB, 56.08 MB, 64.07 MB, 64.11 MB, 64.07 MB, 64.08 MB, 64.14 MB, 64.15 MB, 64.10 MB, 64.07 MB, 64.10 MB, 64.12 MB, 64.14 MB, 69.18 MB, 83.73 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 880.06 MB (922805752) - PrepareTime: 309.850ms - RowsProduced: 3.07K (3072) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s176ms - TotalNetworkSendTime: 4.050ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.82M (2819428) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 828.126ms, non-child: 828.126ms, % non-child: 100.00%) - CodegenTime: 291.261us - CompileTime: 181.420ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 431.212ms - PrepareTime: 214.708ms DataStreamSender (dst_id=11):(Total: 1.525ms, non-child: 1.525ms, % non-child: 100.00%) - BytesSent: 132.96 KB (136149) - NetworkThroughput(*): 963.82 MB/sec - OverallThroughput: 85.09 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 2.05K (2048) - SerializeBatchTime: 1.422ms - TransmitDataRPCTime: 134.716us - UncompressedRowBatchSize: 329.91 KB (337824) SORT_NODE (id=9):(Total: 41s181ms, non-child: 153.672ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 105.627ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 3.07K (3072) - RowsReturnedRate: 74.00 /sec - SortDataSize: 20.83 MB (21840002) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s028ms, non-child: 1s400ms, % non-child: 3.41%) - EvaluationTime: 1s224ms - GetNewBlockTime: 135.618us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 205.60K (205601) - RowsReturnedRate: 5.01 K/sec - UnpinTime: 4.926us SORT_NODE (id=7):(Total: 39s628ms, non-child: 436.389ms, % non-child: 1.10%) ExecOption: Codegen Enabled - InMemorySortTime: 135.579ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42092448) - RowsReturned: 205.60K (205601) - RowsReturnedRate: 5.19 K/sec - SortDataSize: 18.82 MB (19737696) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s191ms, non-child: 27.427ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 28.02 KB, 315.90 KB, 636.83 KB, 939.54 KB, 1.15 MB, 1.47 MB, 1.75 MB, 2.03 MB, 2.32 MB, 2.60 MB, 2.88 MB, 3.18 MB, 3.47 MB, 3.77 MB, 4.05 MB, 4.35 MB, 4.67 MB, 5.00 MB, 5.34 MB, 5.69 MB, 6.01 MB, 6.35 MB, 6.70 MB, 7.06 MB, 7.40 MB, 7.75 MB, 8.03 MB, 8.27 MB, 8.49 MB, 8.61 MB, 8.71 MB, 8.78 MB, 8.82 MB, 8.87 MB, 8.90 MB, 8.93 MB, 8.94 MB, 8.95 MB, 8.96 MB - BytesReceived: 8.96 MB (9391461) - ConvertRowBatchTime: 10.586ms - DeserializeRowBatchTimer: 73.068ms - FirstBatchArrivalWaitTime: 483.733ms - PeakMemoryUsage: 0 - RowsReturned: 205.60K (205601) - RowsReturnedRate: 5.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4bf (host=dn37.hadoop.trivago.com:22000):(Total: 41s165ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 36.00 MB, 48.06 MB, 48.08 MB, 48.09 MB, 48.12 MB, 48.11 MB, 48.15 MB, 48.07 MB, 48.06 MB, 48.11 MB, 48.09 MB, 48.06 MB, 48.11 MB, 48.13 MB, 48.14 MB, 48.10 MB, 56.11 MB, 56.12 MB, 56.10 MB, 56.11 MB, 56.12 MB, 56.14 MB, 56.10 MB, 56.13 MB, 56.08 MB, 56.08 MB, 56.11 MB, 56.08 MB, 56.05 MB, 64.06 MB, 64.12 MB, 64.11 MB, 64.15 MB, 64.10 MB, 64.10 MB, 64.10 MB, 64.12 MB, 64.14 MB, 64.05 MB, 64.06 MB, 81.23 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 874.63 MB (917114272) - PrepareTime: 317.681ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s827ms - TotalNetworkSendTime: 593.740ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.75M (2747396) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 742.609ms, non-child: 742.609ms, % non-child: 100.00%) - CodegenTime: 423.823us - CompileTime: 134.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 386.279ms - PrepareTime: 220.842ms DataStreamSender (dst_id=11):(Total: 2.295ms, non-child: 2.295ms, % non-child: 100.00%) - BytesSent: 178.80 KB (183093) - NetworkThroughput(*): 864.18 MB/sec - OverallThroughput: 76.07 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.120ms - TransmitDataRPCTime: 202.053us - UncompressedRowBatchSize: 442.56 KB (453177) SORT_NODE (id=9):(Total: 40s569ms, non-child: 122.906ms, % non-child: 0.30%) ExecOption: Codegen Enabled - InMemorySortTime: 84.288ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.53 MB (21528688) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s446ms, non-child: 1s176ms, % non-child: 2.91%) - EvaluationTime: 991.269ms - GetNewBlockTime: 155.544us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.94K (202939) - RowsReturnedRate: 5.02 K/sec - UnpinTime: 3.410us SORT_NODE (id=7):(Total: 39s269ms, non-child: 426.633ms, % non-child: 1.09%) ExecOption: Codegen Enabled - InMemorySortTime: 120.042ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42091264) - RowsReturned: 202.94K (202939) - RowsReturnedRate: 5.17 K/sec - SortDataSize: 18.58 MB (19482144) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s842ms, non-child: 28.218ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 62.52 KB, 383.49 KB, 683.46 KB, 972.90 KB, 1.20 MB, 1.50 MB, 1.76 MB, 2.05 MB, 2.34 MB, 2.62 MB, 2.90 MB, 3.16 MB, 3.46 MB, 3.73 MB, 4.03 MB, 4.35 MB, 4.62 MB, 4.97 MB, 5.27 MB, 5.61 MB, 5.95 MB, 6.31 MB, 6.66 MB, 7.02 MB, 7.36 MB, 7.70 MB, 7.98 MB, 8.24 MB, 8.42 MB, 8.55 MB, 8.64 MB, 8.70 MB, 8.75 MB, 8.79 MB, 8.81 MB, 8.84 MB, 8.85 MB, 8.86 MB, 8.86 MB - BytesReceived: 8.86 MB (9295597) - ConvertRowBatchTime: 10.741ms - DeserializeRowBatchTimer: 76.932ms - FirstBatchArrivalWaitTime: 555.014ms - PeakMemoryUsage: 0 - RowsReturned: 202.94K (202939) - RowsReturnedRate: 5.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ca (host=dn23.hadoop.trivago.com:22000):(Total: 41s409ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.03 MB, 48.06 MB, 48.07 MB, 48.14 MB, 48.15 MB, 48.10 MB, 48.11 MB, 48.10 MB, 48.10 MB, 48.08 MB, 48.13 MB, 48.06 MB, 48.13 MB, 48.10 MB, 48.08 MB, 56.13 MB, 56.10 MB, 56.12 MB, 56.15 MB, 56.09 MB, 56.09 MB, 56.10 MB, 56.11 MB, 56.10 MB, 56.10 MB, 56.08 MB, 56.12 MB, 56.10 MB, 60.08 MB, 64.08 MB, 64.09 MB, 64.11 MB, 64.12 MB, 64.07 MB, 64.11 MB, 64.10 MB, 64.12 MB, 64.14 MB, 64.15 MB, 79.73 MB, 37.61 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 906.90 MB (950955168) - PrepareTime: 347.488ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s931ms - TotalNetworkSendTime: 717.154ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.96M (2962469) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 821.804ms, non-child: 821.804ms, % non-child: 100.00%) - CodegenTime: 413.280us - CompileTime: 161.670ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 440.009ms - PrepareTime: 219.346ms DataStreamSender (dst_id=11):(Total: 2.711ms, non-child: 2.711ms, % non-child: 100.00%) - BytesSent: 179.04 KB (183334) - NetworkThroughput(*): 966.52 MB/sec - OverallThroughput: 64.47 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.550ms - TransmitDataRPCTime: 180.897us - UncompressedRowBatchSize: 442.08 KB (452691) SORT_NODE (id=9):(Total: 40s690ms, non-child: 121.809ms, % non-child: 0.30%) ExecOption: Codegen Enabled - InMemorySortTime: 81.022ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.41 MB (21405348) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s568ms, non-child: 1s204ms, % non-child: 2.97%) - EvaluationTime: 1s050ms - GetNewBlockTime: 146.220us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 201.74K (201735) - RowsReturnedRate: 4.97 K/sec - UnpinTime: 4.517us SORT_NODE (id=7):(Total: 39s364ms, non-child: 418.242ms, % non-child: 1.06%) ExecOption: Codegen Enabled - InMemorySortTime: 115.270ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096720) - RowsReturned: 201.74K (201735) - RowsReturnedRate: 5.12 K/sec - SortDataSize: 18.47 MB (19366560) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s945ms, non-child: 26.599ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 49.09 KB, 354.75 KB, 679.01 KB, 934.34 KB, 1.19 MB, 1.46 MB, 1.75 MB, 2.02 MB, 2.31 MB, 2.57 MB, 2.85 MB, 3.12 MB, 3.42 MB, 3.72 MB, 4.02 MB, 4.33 MB, 4.63 MB, 4.95 MB, 5.30 MB, 5.61 MB, 5.94 MB, 6.30 MB, 6.65 MB, 7.00 MB, 7.33 MB, 7.66 MB, 7.94 MB, 8.18 MB, 8.36 MB, 8.49 MB, 8.58 MB, 8.64 MB, 8.68 MB, 8.73 MB, 8.77 MB, 8.79 MB, 8.80 MB, 8.81 MB, 8.81 MB - BytesReceived: 8.81 MB (9241035) - ConvertRowBatchTime: 10.459ms - DeserializeRowBatchTimer: 74.226ms - FirstBatchArrivalWaitTime: 399.903ms - PeakMemoryUsage: 0 - RowsReturned: 201.74K (201735) - RowsReturnedRate: 5.18 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c4 (host=dn51.hadoop.trivago.com:22000):(Total: 41s347ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.09 MB, 48.11 MB, 48.08 MB, 48.08 MB, 48.12 MB, 48.10 MB, 48.06 MB, 48.12 MB, 48.10 MB, 48.09 MB, 48.15 MB, 48.13 MB, 48.11 MB, 48.10 MB, 48.11 MB, 56.10 MB, 56.15 MB, 56.13 MB, 56.11 MB, 56.10 MB, 56.05 MB, 56.10 MB, 56.10 MB, 56.12 MB, 56.12 MB, 56.12 MB, 56.10 MB, 60.07 MB, 64.08 MB, 64.11 MB, 64.11 MB, 64.14 MB, 64.07 MB, 64.13 MB, 64.13 MB, 64.08 MB, 64.10 MB, 64.13 MB, 64.13 MB, 79.73 MB, 57.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 859.28 MB (901018048) - PrepareTime: 229.035ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s155ms - TotalNetworkSendTime: 357.409ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.71M (2706565) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 691.345ms, non-child: 691.345ms, % non-child: 100.00%) - CodegenTime: 358.198us - CompileTime: 109.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 385.247ms - PrepareTime: 195.914ms DataStreamSender (dst_id=11):(Total: 2.813ms, non-child: 2.813ms, % non-child: 100.00%) - BytesSent: 177.30 KB (181551) - NetworkThroughput(*): 536.80 MB/sec - OverallThroughput: 61.54 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.536ms - TransmitDataRPCTime: 322.543us - UncompressedRowBatchSize: 440.45 KB (451017) SORT_NODE (id=9):(Total: 40s987ms, non-child: 147.438ms, % non-child: 0.36%) ExecOption: Codegen Enabled - InMemorySortTime: 96.441ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.72 MB (21727540) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s839ms, non-child: 1s267ms, % non-child: 3.10%) - EvaluationTime: 1s142ms - GetNewBlockTime: 121.187us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.63K (204628) - RowsReturnedRate: 5.01 K/sec - UnpinTime: 4.400us SORT_NODE (id=7):(Total: 39s572ms, non-child: 404.536ms, % non-child: 1.02%) ExecOption: Codegen Enabled - InMemorySortTime: 127.617ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42093616) - RowsReturned: 204.63K (204628) - RowsReturnedRate: 5.17 K/sec - SortDataSize: 18.73 MB (19644288) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s168ms, non-child: 23.156ms, % non-child: 0.06%) BytesReceived(1s000ms): 0, 87.57 KB, 418.88 KB, 724.61 KB, 1002.98 KB, 1.24 MB, 1.54 MB, 1.84 MB, 2.11 MB, 2.42 MB, 2.70 MB, 2.97 MB, 3.23 MB, 3.54 MB, 3.82 MB, 4.12 MB, 4.40 MB, 4.74 MB, 5.04 MB, 5.39 MB, 5.71 MB, 6.07 MB, 6.43 MB, 6.76 MB, 7.13 MB, 7.44 MB, 7.77 MB, 8.05 MB, 8.31 MB, 8.49 MB, 8.62 MB, 8.70 MB, 8.76 MB, 8.80 MB, 8.85 MB, 8.87 MB, 8.89 MB, 8.90 MB, 8.91 MB, 8.91 MB - BytesReceived: 8.92 MB (9351204) - ConvertRowBatchTime: 8.909ms - DeserializeRowBatchTimer: 72.265ms - FirstBatchArrivalWaitTime: 539.138ms - PeakMemoryUsage: 0 - RowsReturned: 204.63K (204628) - RowsReturnedRate: 5.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4bc (host=dn41.hadoop.trivago.com:22000):(Total: 41s070ms, non-child: 118.254ms, % non-child: 0.29%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.10 MB, 48.11 MB, 48.07 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.11 MB, 48.10 MB, 48.08 MB, 48.12 MB, 48.11 MB, 48.10 MB, 48.07 MB, 48.11 MB, 52.10 MB, 56.14 MB, 56.07 MB, 56.12 MB, 56.11 MB, 56.10 MB, 56.08 MB, 56.10 MB, 56.07 MB, 56.10 MB, 56.10 MB, 56.07 MB, 56.09 MB, 60.09 MB, 64.10 MB, 64.08 MB, 64.09 MB, 64.14 MB, 64.10 MB, 64.10 MB, 64.09 MB, 64.12 MB, 64.14 MB, 64.14 MB, 83.73 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 828.94 MB (869203064) - PrepareTime: 175.487ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s744ms - TotalNetworkSendTime: 822.413ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.63M (2627173) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 704.506ms, non-child: 704.506ms, % non-child: 100.00%) - CodegenTime: 272.122us - CompileTime: 99.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 431.538ms - PrepareTime: 172.397ms DataStreamSender (dst_id=11):(Total: 2.082ms, non-child: 2.082ms, % non-child: 100.00%) - BytesSent: 177.67 KB (181933) - NetworkThroughput(*): 909.74 MB/sec - OverallThroughput: 83.32 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 1.925ms - TransmitDataRPCTime: 190.720us - UncompressedRowBatchSize: 441.16 KB (451746) SORT_NODE (id=9):(Total: 40s245ms, non-child: 118.463ms, % non-child: 0.29%) ExecOption: Codegen Enabled - InMemorySortTime: 81.489ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.52 MB (21515753) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s126ms, non-child: 999.052ms, % non-child: 2.49%) - EvaluationTime: 993.215ms - GetNewBlockTime: 65.587us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.69K (202688) - RowsReturnedRate: 5.05 K/sec - UnpinTime: 4.024us SORT_NODE (id=7):(Total: 39s127ms, non-child: 368.070ms, % non-child: 0.94%) ExecOption: Codegen Enabled - InMemorySortTime: 111.356ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42099120) - RowsReturned: 202.69K (202688) - RowsReturnedRate: 5.18 K/sec - SortDataSize: 18.56 MB (19458048) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s759ms, non-child: 26.962ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 37.66 KB, 322.36 KB, 645.63 KB, 924.24 KB, 1.17 MB, 1.45 MB, 1.74 MB, 2.02 MB, 2.30 MB, 2.60 MB, 2.82 MB, 3.14 MB, 3.40 MB, 3.70 MB, 4.01 MB, 4.29 MB, 4.60 MB, 4.93 MB, 5.27 MB, 5.57 MB, 5.92 MB, 6.27 MB, 6.64 MB, 6.98 MB, 7.30 MB, 7.64 MB, 7.94 MB, 8.20 MB, 8.38 MB, 8.53 MB, 8.62 MB, 8.69 MB, 8.73 MB, 8.76 MB, 8.80 MB, 8.82 MB, 8.84 MB, 8.84 MB, 8.84 MB - BytesReceived: 8.85 MB (9275968) - ConvertRowBatchTime: 10.600ms - DeserializeRowBatchTimer: 67.219ms - FirstBatchArrivalWaitTime: 530.573ms - PeakMemoryUsage: 0 - RowsReturned: 202.69K (202688) - RowsReturnedRate: 5.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4d3 (host=dn29.hadoop.trivago.com:22000):(Total: 42s464ms, non-child: 365.347ms, % non-child: 0.86%) MemoryUsage(1s000ms): 48.01 MB, 48.09 MB, 48.15 MB, 48.09 MB, 48.10 MB, 48.12 MB, 48.05 MB, 48.08 MB, 48.09 MB, 48.12 MB, 48.07 MB, 48.13 MB, 48.12 MB, 48.15 MB, 48.11 MB, 48.07 MB, 56.12 MB, 56.06 MB, 56.09 MB, 56.06 MB, 56.09 MB, 56.12 MB, 56.09 MB, 56.10 MB, 56.07 MB, 56.14 MB, 56.14 MB, 56.14 MB, 56.08 MB, 56.10 MB, 64.12 MB, 64.08 MB, 64.12 MB, 64.12 MB, 64.11 MB, 64.10 MB, 64.10 MB, 64.07 MB, 64.07 MB, 64.07 MB, 69.16 MB, 59.12 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 942.59 MB (988374128) - PrepareTime: 193.768ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s662ms - TotalNetworkSendTime: 1s225ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.90M (2898148) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 860.477ms, non-child: 860.477ms, % non-child: 100.00%) - CodegenTime: 303.656us - CompileTime: 173.581ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 495.519ms - PrepareTime: 190.607ms DataStreamSender (dst_id=11):(Total: 2.407ms, non-child: 2.407ms, % non-child: 100.00%) - BytesSent: 177.61 KB (181868) - NetworkThroughput(*): 579.95 MB/sec - OverallThroughput: 72.05 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.231ms - TransmitDataRPCTime: 299.064us - UncompressedRowBatchSize: 441.42 KB (452016) SORT_NODE (id=9):(Total: 41s235ms, non-child: 143.853ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 100.391ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.23 MB (21215258) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s092ms, non-child: 997.887ms, % non-child: 2.43%) - EvaluationTime: 990.825ms - GetNewBlockTime: 289.320us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 200.10K (200102) - RowsReturnedRate: 4.87 K/sec - UnpinTime: 5.136us SORT_NODE (id=7):(Total: 40s094ms, non-child: 415.790ms, % non-child: 1.04%) ExecOption: Codegen Enabled - InMemorySortTime: 135.216ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42097200) - RowsReturned: 200.10K (200102) - RowsReturnedRate: 4.99 K/sec - SortDataSize: 18.32 MB (19209792) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s678ms, non-child: 30.191ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 108.70 KB, 435.58 KB, 753.76 KB, 1.01 MB, 1.27 MB, 1.53 MB, 1.83 MB, 2.10 MB, 2.41 MB, 2.68 MB, 2.97 MB, 3.24 MB, 3.51 MB, 3.79 MB, 4.07 MB, 4.40 MB, 4.69 MB, 5.00 MB, 5.32 MB, 5.67 MB, 5.99 MB, 6.31 MB, 6.67 MB, 7.02 MB, 7.34 MB, 7.68 MB, 7.94 MB, 8.17 MB, 8.33 MB, 8.47 MB, 8.54 MB, 8.60 MB, 8.65 MB, 8.69 MB, 8.71 MB, 8.73 MB, 8.74 MB, 8.75 MB, 8.75 MB - BytesReceived: 8.75 MB (9177580) - ConvertRowBatchTime: 11.500ms - DeserializeRowBatchTimer: 108.477ms - FirstBatchArrivalWaitTime: 309.297ms - PeakMemoryUsage: 0 - RowsReturned: 200.10K (200102) - RowsReturnedRate: 5.04 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a5 (host=dn45.hadoop.trivago.com:22000):(Total: 40s231ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.05 MB, 48.11 MB, 48.12 MB, 48.11 MB, 48.09 MB, 48.08 MB, 48.12 MB, 48.08 MB, 48.05 MB, 48.13 MB, 48.08 MB, 48.10 MB, 48.07 MB, 48.10 MB, 48.13 MB, 56.07 MB, 56.12 MB, 56.06 MB, 56.10 MB, 56.10 MB, 56.11 MB, 56.14 MB, 56.10 MB, 56.09 MB, 56.11 MB, 56.10 MB, 56.06 MB, 56.15 MB, 64.07 MB, 64.11 MB, 64.06 MB, 64.07 MB, 64.09 MB, 64.07 MB, 64.10 MB, 64.10 MB, 64.08 MB, 64.09 MB, 69.67 MB, 59.62 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 967.39 MB (1014382232) - PrepareTime: 235.410ms - RowsProduced: 29.70K (29696) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s220ms - TotalNetworkSendTime: 238.798ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.84M (2837796) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 771.508ms, non-child: 771.508ms, % non-child: 100.00%) - CodegenTime: 387.732us - CompileTime: 174.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 386.199ms - PrepareTime: 209.609ms DataStreamSender (dst_id=11):(Total: 22.776ms, non-child: 22.776ms, % non-child: 100.00%) - BytesSent: 1.27 MB (1329941) - NetworkThroughput(*): 702.11 MB/sec - OverallThroughput: 55.69 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 28.67K (28672) - SerializeBatchTime: 21.016ms - TransmitDataRPCTime: 1.806ms - UncompressedRowBatchSize: 3.14 MB (3292884) SORT_NODE (id=9):(Total: 39s971ms, non-child: 153.749ms, % non-child: 0.38%) ExecOption: Codegen Enabled - InMemorySortTime: 109.657ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 29.70K (29696) - RowsReturnedRate: 742.00 /sec - SortDataSize: 20.70 MB (21704035) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s817ms, non-child: 1s162ms, % non-child: 2.92%) - EvaluationTime: 1s119ms - GetNewBlockTime: 134.558us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.38K (204379) - RowsReturnedRate: 5.13 K/sec - UnpinTime: 4.275us SORT_NODE (id=7):(Total: 38s655ms, non-child: 420.626ms, % non-child: 1.09%) ExecOption: Codegen Enabled - InMemorySortTime: 126.497ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42098384) - RowsReturned: 204.38K (204379) - RowsReturnedRate: 5.29 K/sec - SortDataSize: 18.71 MB (19620384) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s234ms, non-child: 26.904ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 31.84 KB, 304.11 KB, 627.13 KB, 920.75 KB, 1.18 MB, 1.44 MB, 1.73 MB, 2.00 MB, 2.33 MB, 2.60 MB, 2.89 MB, 3.17 MB, 3.47 MB, 3.75 MB, 4.05 MB, 4.36 MB, 4.69 MB, 5.00 MB, 5.33 MB, 5.67 MB, 6.00 MB, 6.35 MB, 6.69 MB, 7.02 MB, 7.37 MB, 7.68 MB, 8.00 MB, 8.26 MB, 8.45 MB, 8.59 MB, 8.69 MB, 8.74 MB, 8.79 MB, 8.83 MB, 8.86 MB, 8.88 MB, 8.90 MB, 8.90 MB - BytesReceived: 8.91 MB (9341542) - ConvertRowBatchTime: 9.914ms - DeserializeRowBatchTimer: 79.900ms - FirstBatchArrivalWaitTime: 674.261ms - PeakMemoryUsage: 0 - RowsReturned: 204.38K (204379) - RowsReturnedRate: 5.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4d4 (host=dn20.hadoop.trivago.com:22000):(Total: 42s579ms, non-child: 327.907ms, % non-child: 0.77%) MemoryUsage(1s000ms): 48.01 MB, 48.06 MB, 48.10 MB, 48.12 MB, 48.10 MB, 48.12 MB, 48.10 MB, 48.15 MB, 48.15 MB, 48.10 MB, 48.09 MB, 48.08 MB, 48.09 MB, 48.13 MB, 48.10 MB, 52.11 MB, 56.11 MB, 56.10 MB, 56.07 MB, 56.12 MB, 56.11 MB, 56.12 MB, 56.10 MB, 56.10 MB, 56.10 MB, 56.09 MB, 56.12 MB, 56.08 MB, 56.10 MB, 64.11 MB, 64.07 MB, 64.13 MB, 64.09 MB, 64.09 MB, 64.10 MB, 64.07 MB, 64.11 MB, 64.14 MB, 64.16 MB, 64.16 MB, 68.69 MB, 84.73 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 818.95 MB (858728936) - PrepareTime: 235.542ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s743ms - TotalNetworkSendTime: 1s094ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.46M (2456741) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 766.041ms, non-child: 766.041ms, % non-child: 100.00%) - CodegenTime: 574.442us - CompileTime: 131.771ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 421.303ms - PrepareTime: 212.208ms DataStreamSender (dst_id=11):(Total: 2.689ms, non-child: 2.689ms, % non-child: 100.00%) - BytesSent: 179.34 KB (183649) - NetworkThroughput(*): 837.79 MB/sec - OverallThroughput: 65.12 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.541ms - TransmitDataRPCTime: 209.052us - UncompressedRowBatchSize: 442.77 KB (453393) SORT_NODE (id=9):(Total: 41s482ms, non-child: 149.328ms, % non-child: 0.36%) ExecOption: Codegen Enabled - InMemorySortTime: 104.407ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 98.00 /sec - SortDataSize: 20.64 MB (21638537) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s333ms, non-child: 1s163ms, % non-child: 2.81%) - EvaluationTime: 1s057ms - GetNewBlockTime: 121.707us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.83K (203828) - RowsReturnedRate: 4.93 K/sec - UnpinTime: 2.955us SORT_NODE (id=7):(Total: 40s170ms, non-child: 412.790ms, % non-child: 1.03%) ExecOption: Codegen Enabled - InMemorySortTime: 115.933ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42097552) - RowsReturned: 203.83K (203828) - RowsReturnedRate: 5.07 K/sec - SortDataSize: 18.66 MB (19567488) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s757ms, non-child: 26.970ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 102.03 KB, 434.76 KB, 767.86 KB, 1.01 MB, 1.30 MB, 1.58 MB, 1.85 MB, 2.14 MB, 2.43 MB, 2.72 MB, 2.98 MB, 3.26 MB, 3.54 MB, 3.82 MB, 4.14 MB, 4.45 MB, 4.76 MB, 5.06 MB, 5.39 MB, 5.70 MB, 6.06 MB, 6.39 MB, 6.75 MB, 7.10 MB, 7.43 MB, 7.78 MB, 8.06 MB, 8.29 MB, 8.47 MB, 8.59 MB, 8.68 MB, 8.74 MB, 8.77 MB, 8.83 MB, 8.85 MB, 8.87 MB, 8.88 MB, 8.89 MB, 8.89 MB - BytesReceived: 8.89 MB (9326565) - ConvertRowBatchTime: 10.068ms - DeserializeRowBatchTimer: 73.037ms - FirstBatchArrivalWaitTime: 430.533ms - PeakMemoryUsage: 0 - RowsReturned: 203.83K (203828) - RowsReturnedRate: 5.13 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a3 (host=dn35.hadoop.trivago.com:22000):(Total: 40s154ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.12 MB, 48.09 MB, 48.07 MB, 48.08 MB, 48.07 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.11 MB, 48.08 MB, 48.11 MB, 48.09 MB, 48.10 MB, 48.14 MB, 52.14 MB, 56.06 MB, 56.10 MB, 56.10 MB, 56.13 MB, 56.12 MB, 56.08 MB, 56.10 MB, 56.08 MB, 56.09 MB, 56.13 MB, 56.10 MB, 56.10 MB, 60.12 MB, 64.07 MB, 64.08 MB, 64.07 MB, 64.12 MB, 64.06 MB, 64.09 MB, 64.10 MB, 64.10 MB, 64.10 MB, 69.17 MB, 59.62 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 843.33 MB (884296192) - PrepareTime: 273.385ms - RowsProduced: 15.36K (15360) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s278ms - TotalNetworkSendTime: 229.257ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.86M (2856037) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 658.592ms, non-child: 658.592ms, % non-child: 100.00%) - CodegenTime: 247.197us - CompileTime: 149.678ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 315.415ms - PrepareTime: 192.760ms DataStreamSender (dst_id=11):(Total: 11.582ms, non-child: 11.582ms, % non-child: 100.00%) - BytesSent: 667.98 KB (684015) - NetworkThroughput(*): 766.41 MB/sec - OverallThroughput: 56.32 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 14.34K (14336) - SerializeBatchTime: 10.741ms - TransmitDataRPCTime: 851.144us - UncompressedRowBatchSize: 1.62 MB (1696491) SORT_NODE (id=9):(Total: 39s914ms, non-child: 120.839ms, % non-child: 0.30%) ExecOption: Codegen Enabled - InMemorySortTime: 83.784ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 15.36K (15360) - RowsReturnedRate: 384.00 /sec - SortDataSize: 20.48 MB (21470531) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s793ms, non-child: 1s107ms, % non-child: 2.78%) - EvaluationTime: 1s024ms - GetNewBlockTime: 148.968us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.40K (202403) - RowsReturnedRate: 5.09 K/sec - UnpinTime: 4.222us SORT_NODE (id=7):(Total: 38s685ms, non-child: 393.389ms, % non-child: 1.02%) ExecOption: Codegen Enabled - InMemorySortTime: 118.782ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094800) - RowsReturned: 202.40K (202403) - RowsReturnedRate: 5.23 K/sec - SortDataSize: 18.53 MB (19430688) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s292ms, non-child: 27.070ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 17.22 KB, 285.28 KB, 592.29 KB, 906.98 KB, 1.14 MB, 1.41 MB, 1.68 MB, 1.95 MB, 2.25 MB, 2.54 MB, 2.81 MB, 3.09 MB, 3.38 MB, 3.65 MB, 3.96 MB, 4.27 MB, 4.58 MB, 4.88 MB, 5.22 MB, 5.54 MB, 5.89 MB, 6.22 MB, 6.58 MB, 6.93 MB, 7.27 MB, 7.60 MB, 7.92 MB, 8.19 MB, 8.38 MB, 8.52 MB, 8.61 MB, 8.67 MB, 8.71 MB, 8.76 MB, 8.80 MB, 8.82 MB, 8.84 MB, 8.84 MB - BytesReceived: 8.85 MB (9279439) - ConvertRowBatchTime: 10.251ms - DeserializeRowBatchTimer: 71.454ms - FirstBatchArrivalWaitTime: 639.818ms - PeakMemoryUsage: 0 - RowsReturned: 202.40K (202403) - RowsReturnedRate: 5.29 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c9 (host=dn39.hadoop.trivago.com:22000):(Total: 41s270ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.04 MB, 48.10 MB, 48.06 MB, 48.11 MB, 48.09 MB, 48.05 MB, 48.08 MB, 48.15 MB, 48.08 MB, 48.09 MB, 48.09 MB, 48.08 MB, 48.07 MB, 48.10 MB, 48.10 MB, 56.12 MB, 56.11 MB, 56.13 MB, 56.08 MB, 56.16 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.10 MB, 56.12 MB, 56.10 MB, 56.12 MB, 56.08 MB, 64.08 MB, 64.10 MB, 64.12 MB, 64.13 MB, 64.09 MB, 64.11 MB, 64.10 MB, 64.09 MB, 64.06 MB, 64.08 MB, 64.08 MB, 80.23 MB, 37.61 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 903.53 MB (947417528) - PrepareTime: 265.209ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s857ms - TotalNetworkSendTime: 629.673ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.69M (2686853) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 995.637ms, non-child: 995.637ms, % non-child: 100.00%) - CodegenTime: 417.468us - CompileTime: 161.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 572.134ms - PrepareTime: 260.957ms DataStreamSender (dst_id=11):(Total: 2.604ms, non-child: 2.604ms, % non-child: 100.00%) - BytesSent: 178.30 KB (182582) - NetworkThroughput(*): 823.41 MB/sec - OverallThroughput: 66.87 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.419ms - TransmitDataRPCTime: 211.466us - UncompressedRowBatchSize: 442.08 KB (452691) SORT_NODE (id=9):(Total: 40s633ms, non-child: 150.984ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 100.736ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.68 MB (21681562) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s482ms, non-child: 1s119ms, % non-child: 2.77%) - EvaluationTime: 1s111ms - GetNewBlockTime: 90.415us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.21K (204208) - RowsReturnedRate: 5.04 K/sec - UnpinTime: 4.905us SORT_NODE (id=7):(Total: 39s363ms, non-child: 490.848ms, % non-child: 1.25%) ExecOption: Codegen Enabled - InMemorySortTime: 135.571ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096752) - RowsReturned: 204.21K (204208) - RowsReturnedRate: 5.19 K/sec - SortDataSize: 18.70 MB (19603968) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s872ms, non-child: 27.269ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 51.16 KB, 370.85 KB, 676.96 KB, 949.02 KB, 1.21 MB, 1.49 MB, 1.80 MB, 2.08 MB, 2.37 MB, 2.66 MB, 2.92 MB, 3.19 MB, 3.48 MB, 3.78 MB, 4.07 MB, 4.39 MB, 4.72 MB, 5.04 MB, 5.37 MB, 5.69 MB, 6.03 MB, 6.40 MB, 6.74 MB, 7.08 MB, 7.42 MB, 7.72 MB, 8.02 MB, 8.28 MB, 8.46 MB, 8.60 MB, 8.67 MB, 8.74 MB, 8.79 MB, 8.83 MB, 8.86 MB, 8.89 MB, 8.90 MB, 8.90 MB, 8.90 MB - BytesReceived: 8.91 MB (9341116) - ConvertRowBatchTime: 10.868ms - DeserializeRowBatchTimer: 69.549ms - FirstBatchArrivalWaitTime: 322.085ms - PeakMemoryUsage: 0 - RowsReturned: 204.21K (204208) - RowsReturnedRate: 5.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c0 (host=dn9.hadoop.trivago.com:22000):(Total: 41s182ms, non-child: 13.480ms, % non-child: 0.03%) MemoryUsage(1s000ms): 24.00 MB, 48.05 MB, 48.13 MB, 48.11 MB, 48.13 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.12 MB, 48.10 MB, 48.10 MB, 48.11 MB, 48.14 MB, 48.15 MB, 48.11 MB, 48.06 MB, 52.10 MB, 56.12 MB, 56.11 MB, 56.13 MB, 56.10 MB, 56.07 MB, 56.12 MB, 56.10 MB, 56.05 MB, 56.06 MB, 56.13 MB, 56.10 MB, 56.13 MB, 56.06 MB, 64.07 MB, 64.10 MB, 64.09 MB, 64.11 MB, 64.09 MB, 64.13 MB, 64.07 MB, 64.12 MB, 64.14 MB, 64.15 MB, 81.23 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 871.81 MB (914159488) - PrepareTime: 233.862ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s886ms - TotalNetworkSendTime: 662.953ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.83M (2827717) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 697.936ms, non-child: 697.936ms, % non-child: 100.00%) - CodegenTime: 261.570us - CompileTime: 147.805ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 355.050ms - PrepareTime: 194.403ms DataStreamSender (dst_id=11):(Total: 2.142ms, non-child: 2.142ms, % non-child: 100.00%) - BytesSent: 178.70 KB (182985) - NetworkThroughput(*): 707.15 MB/sec - OverallThroughput: 81.43 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 1.950ms - TransmitDataRPCTime: 246.778us - UncompressedRowBatchSize: 441.95 KB (452556) SORT_NODE (id=9):(Total: 40s469ms, non-child: 116.337ms, % non-child: 0.29%) ExecOption: Codegen Enabled - InMemorySortTime: 77.100ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.30 MB (21282086) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s352ms, non-child: 1s062ms, % non-child: 2.63%) - EvaluationTime: 1s020ms - GetNewBlockTime: 164.292us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 200.60K (200600) - RowsReturnedRate: 4.97 K/sec - UnpinTime: 3.634us SORT_NODE (id=7):(Total: 39s290ms, non-child: 387.328ms, % non-child: 0.99%) ExecOption: Codegen Enabled - InMemorySortTime: 112.819ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094800) - RowsReturned: 200.60K (200600) - RowsReturnedRate: 5.11 K/sec - SortDataSize: 18.37 MB (19257600) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s902ms, non-child: 28.953ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 31.99 KB, 316.11 KB, 627.86 KB, 932.40 KB, 1.17 MB, 1.44 MB, 1.73 MB, 2.00 MB, 2.30 MB, 2.57 MB, 2.85 MB, 3.10 MB, 3.42 MB, 3.70 MB, 3.99 MB, 4.27 MB, 4.58 MB, 4.87 MB, 5.19 MB, 5.51 MB, 5.86 MB, 6.21 MB, 6.56 MB, 6.90 MB, 7.22 MB, 7.54 MB, 7.83 MB, 8.11 MB, 8.28 MB, 8.42 MB, 8.52 MB, 8.58 MB, 8.63 MB, 8.67 MB, 8.71 MB, 8.73 MB, 8.75 MB, 8.76 MB, 8.76 MB - BytesReceived: 8.76 MB (9189256) - ConvertRowBatchTime: 10.880ms - DeserializeRowBatchTimer: 69.488ms - FirstBatchArrivalWaitTime: 624.389ms - PeakMemoryUsage: 0 - RowsReturned: 200.60K (200600) - RowsReturnedRate: 5.16 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4bd (host=dn0.hadoop.trivago.com:22000):(Total: 40s964ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.08 MB, 48.07 MB, 48.11 MB, 48.11 MB, 48.12 MB, 48.09 MB, 48.10 MB, 48.07 MB, 48.12 MB, 48.09 MB, 48.13 MB, 48.12 MB, 48.13 MB, 48.06 MB, 48.10 MB, 56.12 MB, 56.08 MB, 56.07 MB, 56.15 MB, 56.08 MB, 56.10 MB, 56.09 MB, 56.08 MB, 56.08 MB, 56.09 MB, 56.07 MB, 56.14 MB, 56.15 MB, 60.13 MB, 64.12 MB, 64.10 MB, 64.10 MB, 64.09 MB, 64.09 MB, 64.10 MB, 64.14 MB, 64.06 MB, 64.06 MB, 69.15 MB, 81.73 MB, 57.12 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 871.18 MB (913500304) - PrepareTime: 270.988ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s431ms - TotalNetworkSendTime: 3.361ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.78M (2776868) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 950.639ms, non-child: 950.639ms, % non-child: 100.00%) - CodegenTime: 384.536us - CompileTime: 225.756ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 498.894ms - PrepareTime: 225.173ms DataStreamSender (dst_id=11):(Total: 3.028ms, non-child: 3.028ms, % non-child: 100.00%) - BytesSent: 179.21 KB (183508) - NetworkThroughput(*): 182.69 MB/sec - OverallThroughput: 57.79 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.102ms - TransmitDataRPCTime: 957.944us - UncompressedRowBatchSize: 442.50 KB (453123) SORT_NODE (id=9):(Total: 40s943ms, non-child: 183.028ms, % non-child: 0.45%) ExecOption: Codegen Enabled - InMemorySortTime: 116.337ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.34 MB (21323978) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s760ms, non-child: 1s846ms, % non-child: 4.53%) - EvaluationTime: 1s784ms - GetNewBlockTime: 107.200us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 200.98K (200984) - RowsReturnedRate: 4.93 K/sec - UnpinTime: 5.376us SORT_NODE (id=7):(Total: 38s914ms, non-child: 468.196ms, % non-child: 1.20%) ExecOption: Codegen Enabled - InMemorySortTime: 147.199ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42102528) - RowsReturned: 200.98K (200984) - RowsReturnedRate: 5.16 K/sec - SortDataSize: 18.40 MB (19294464) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s446ms, non-child: 28.733ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 108.98 KB, 425.35 KB, 739.49 KB, 1017.96 KB, 1.27 MB, 1.56 MB, 1.82 MB, 2.10 MB, 2.41 MB, 2.68 MB, 2.94 MB, 3.21 MB, 3.48 MB, 3.76 MB, 4.07 MB, 4.37 MB, 4.69 MB, 4.98 MB, 5.32 MB, 5.63 MB, 5.97 MB, 6.31 MB, 6.68 MB, 7.03 MB, 7.35 MB, 7.66 MB, 7.93 MB, 8.18 MB, 8.35 MB, 8.50 MB, 8.56 MB, 8.63 MB, 8.67 MB, 8.71 MB, 8.74 MB, 8.75 MB, 8.77 MB, 8.77 MB - BytesReceived: 8.77 MB (9200474) - ConvertRowBatchTime: 10.886ms - DeserializeRowBatchTimer: 74.144ms - FirstBatchArrivalWaitTime: 94.108ms - PeakMemoryUsage: 0 - RowsReturned: 200.98K (200984) - RowsReturnedRate: 5.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b5 (host=dn3.hadoop.trivago.com:22000):(Total: 40s873ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.07 MB, 48.14 MB, 48.13 MB, 48.11 MB, 48.12 MB, 48.06 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.12 MB, 48.14 MB, 48.09 MB, 48.06 MB, 56.10 MB, 56.10 MB, 56.14 MB, 56.11 MB, 56.07 MB, 56.12 MB, 56.05 MB, 56.11 MB, 56.08 MB, 56.11 MB, 56.05 MB, 56.09 MB, 56.10 MB, 64.12 MB, 64.05 MB, 64.09 MB, 64.11 MB, 64.11 MB, 64.12 MB, 64.12 MB, 64.09 MB, 64.13 MB, 64.15 MB, 69.19 MB, 81.73 MB, 57.12 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 954.41 MB (1000770736) - PrepareTime: 285.638ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s218ms - TotalNetworkSendTime: 1.771ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.89M (2891908) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 928.362ms, non-child: 928.362ms, % non-child: 100.00%) - CodegenTime: 412.780us - CompileTime: 233.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 477.923ms - PrepareTime: 216.203ms DataStreamSender (dst_id=11):(Total: 2.952ms, non-child: 2.952ms, % non-child: 100.00%) - BytesSent: 178.56 KB (182848) - NetworkThroughput(*): 263.08 MB/sec - OverallThroughput: 59.05 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.333ms - TransmitDataRPCTime: 662.820us - UncompressedRowBatchSize: 441.84 KB (452448) SORT_NODE (id=9):(Total: 40s859ms, non-child: 181.404ms, % non-child: 0.44%) ExecOption: Codegen Enabled - InMemorySortTime: 119.180ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.54 MB (21533515) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s678ms, non-child: 2s004ms, % non-child: 4.93%) - EvaluationTime: 1s929ms - GetNewBlockTime: 159.276us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.86K (202861) - RowsReturnedRate: 4.99 K/sec - UnpinTime: 6.260us SORT_NODE (id=7):(Total: 38s674ms, non-child: 441.215ms, % non-child: 1.14%) ExecOption: Codegen Enabled - InMemorySortTime: 132.427ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42097264) - RowsReturned: 202.86K (202861) - RowsReturnedRate: 5.25 K/sec - SortDataSize: 18.57 MB (19474656) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s233ms, non-child: 29.934ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 60.16 KB, 384.62 KB, 701.30 KB, 992.82 KB, 1.22 MB, 1.51 MB, 1.78 MB, 2.06 MB, 2.35 MB, 2.62 MB, 2.91 MB, 3.17 MB, 3.46 MB, 3.77 MB, 4.07 MB, 4.36 MB, 4.69 MB, 5.00 MB, 5.32 MB, 5.66 MB, 5.99 MB, 6.32 MB, 6.68 MB, 7.03 MB, 7.37 MB, 7.71 MB, 8.01 MB, 8.24 MB, 8.42 MB, 8.55 MB, 8.63 MB, 8.69 MB, 8.73 MB, 8.78 MB, 8.80 MB, 8.82 MB, 8.83 MB, 8.84 MB - BytesReceived: 8.84 MB (9274406) - ConvertRowBatchTime: 10.248ms - DeserializeRowBatchTimer: 81.182ms - FirstBatchArrivalWaitTime: 294.321ms - PeakMemoryUsage: 0 - RowsReturned: 202.86K (202861) - RowsReturnedRate: 5.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4a6 (host=dn42.hadoop.trivago.com:22000):(Total: 39s991ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.10 MB, 48.09 MB, 48.13 MB, 48.10 MB, 48.09 MB, 48.11 MB, 48.11 MB, 48.14 MB, 48.10 MB, 48.10 MB, 48.13 MB, 48.13 MB, 48.10 MB, 48.10 MB, 48.10 MB, 56.10 MB, 56.09 MB, 56.11 MB, 56.10 MB, 56.14 MB, 56.10 MB, 56.06 MB, 56.05 MB, 56.13 MB, 56.06 MB, 56.11 MB, 56.09 MB, 56.15 MB, 64.11 MB, 64.08 MB, 64.12 MB, 64.09 MB, 64.12 MB, 64.14 MB, 64.08 MB, 64.12 MB, 64.05 MB, 64.06 MB, 80.23 MB, 37.61 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 940.00 MB (985659440) - PrepareTime: 213.157ms - RowsProduced: 8.19K (8192) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s074ms - TotalNetworkSendTime: 211.098ms - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 714.240ms, non-child: 714.240ms, % non-child: 100.00%) - CodegenTime: 360.463us - CompileTime: 151.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 364.086ms - PrepareTime: 198.546ms DataStreamSender (dst_id=11):(Total: 5.805ms, non-child: 5.805ms, % non-child: 100.00%) - BytesSent: 358.64 KB (367252) - NetworkThroughput(*): 748.13 MB/sec - OverallThroughput: 60.33 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 7.17K (7168) - SerializeBatchTime: 5.420ms - TransmitDataRPCTime: 468.153us - UncompressedRowBatchSize: 885.11 KB (906354) SORT_NODE (id=9):(Total: 39s774ms, non-child: 147.238ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 107.761ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 8.19K (8192) - RowsReturnedRate: 205.00 /sec - SortDataSize: 20.45 MB (21440948) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 39s627ms, non-child: 1s108ms, % non-child: 2.80%) - EvaluationTime: 1s090ms - GetNewBlockTime: 267.269us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.03K (202034) - RowsReturnedRate: 5.10 K/sec - UnpinTime: 3.820us SORT_NODE (id=7):(Total: 38s519ms, non-child: 429.763ms, % non-child: 1.12%) ExecOption: Codegen Enabled - InMemorySortTime: 147.000ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42096864) - RowsReturned: 202.03K (202034) - RowsReturnedRate: 5.25 K/sec - SortDataSize: 18.50 MB (19395264) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s089ms, non-child: 27.368ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 95.21 KB, 409.13 KB, 765.98 KB, 1.01 MB, 1.25 MB, 1.53 MB, 1.81 MB, 2.07 MB, 2.37 MB, 2.64 MB, 2.92 MB, 3.19 MB, 3.49 MB, 3.78 MB, 4.09 MB, 4.41 MB, 4.71 MB, 5.01 MB, 5.35 MB, 5.69 MB, 6.01 MB, 6.36 MB, 6.71 MB, 7.05 MB, 7.37 MB, 7.71 MB, 7.99 MB, 8.22 MB, 8.40 MB, 8.53 MB, 8.61 MB, 8.64 MB, 8.70 MB, 8.75 MB, 8.77 MB, 8.79 MB, 8.81 MB, 8.81 MB - BytesReceived: 8.81 MB (9242634) - ConvertRowBatchTime: 10.311ms - DeserializeRowBatchTimer: 70.282ms - FirstBatchArrivalWaitTime: 295.591ms - PeakMemoryUsage: 0 - RowsReturned: 202.03K (202034) - RowsReturnedRate: 5.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b3 (host=dn14.hadoop.trivago.com:22000):(Total: 40s868ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.12 MB, 48.09 MB, 48.10 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.12 MB, 48.09 MB, 48.15 MB, 48.09 MB, 48.07 MB, 48.10 MB, 56.11 MB, 56.12 MB, 56.08 MB, 56.09 MB, 56.11 MB, 56.08 MB, 56.16 MB, 56.15 MB, 56.13 MB, 56.10 MB, 56.13 MB, 56.07 MB, 56.10 MB, 64.11 MB, 64.10 MB, 64.09 MB, 64.10 MB, 64.11 MB, 64.11 MB, 64.14 MB, 64.07 MB, 64.11 MB, 64.12 MB, 69.18 MB, 64.72 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 928.85 MB (973974400) - PrepareTime: 193.501ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s581ms - TotalNetworkSendTime: 607.041ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.98M (2984005) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 647.913ms, non-child: 647.913ms, % non-child: 100.00%) - CodegenTime: 269.823us - CompileTime: 101.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 355.187ms - PrepareTime: 190.435ms DataStreamSender (dst_id=11):(Total: 2.612ms, non-child: 2.612ms, % non-child: 100.00%) - BytesSent: 177.30 KB (181554) - NetworkThroughput(*): 369.85 MB/sec - OverallThroughput: 66.27 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.388ms - TransmitDataRPCTime: 468.145us - UncompressedRowBatchSize: 441.40 KB (451989) SORT_NODE (id=9):(Total: 40s258ms, non-child: 142.724ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 100.581ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.72 MB (21725809) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s115ms, non-child: 1s132ms, % non-child: 2.82%) - EvaluationTime: 1s126ms - GetNewBlockTime: 89.737us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.67K (204670) - RowsReturnedRate: 5.10 K/sec - UnpinTime: 2.438us SORT_NODE (id=7):(Total: 38s983ms, non-child: 385.821ms, % non-child: 0.99%) ExecOption: Codegen Enabled - InMemorySortTime: 112.101ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42092272) - RowsReturned: 204.67K (204670) - RowsReturnedRate: 5.25 K/sec - SortDataSize: 18.74 MB (19648320) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s597ms, non-child: 29.204ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 38.20 KB, 334.53 KB, 641.62 KB, 923.22 KB, 1.18 MB, 1.46 MB, 1.75 MB, 2.02 MB, 2.29 MB, 2.59 MB, 2.86 MB, 3.13 MB, 3.42 MB, 3.71 MB, 4.01 MB, 4.33 MB, 4.64 MB, 4.95 MB, 5.30 MB, 5.62 MB, 5.96 MB, 6.32 MB, 6.69 MB, 7.06 MB, 7.39 MB, 7.71 MB, 8.02 MB, 8.29 MB, 8.47 MB, 8.62 MB, 8.71 MB, 8.75 MB, 8.80 MB, 8.85 MB, 8.88 MB, 8.90 MB, 8.91 MB, 8.92 MB - BytesReceived: 8.93 MB (9361652) - ConvertRowBatchTime: 11.756ms - DeserializeRowBatchTimer: 73.397ms - FirstBatchArrivalWaitTime: 602.923ms - PeakMemoryUsage: 0 - RowsReturned: 204.67K (204670) - RowsReturnedRate: 5.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b6 (host=dn16.hadoop.trivago.com:22000):(Total: 40s237ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.05 MB, 48.13 MB, 48.10 MB, 48.09 MB, 48.14 MB, 48.10 MB, 48.13 MB, 48.14 MB, 48.10 MB, 48.14 MB, 48.10 MB, 48.08 MB, 48.09 MB, 48.15 MB, 48.12 MB, 56.06 MB, 56.07 MB, 56.09 MB, 56.13 MB, 56.07 MB, 56.15 MB, 56.09 MB, 56.13 MB, 56.07 MB, 56.10 MB, 56.10 MB, 56.06 MB, 56.09 MB, 64.08 MB, 64.12 MB, 64.09 MB, 64.12 MB, 64.06 MB, 64.10 MB, 64.10 MB, 64.06 MB, 64.09 MB, 64.11 MB, 69.68 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 956.42 MB (1002873840) - PrepareTime: 191.967ms - RowsProduced: 15.36K (15360) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s659ms - TotalNetworkSendTime: 12.906ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.82M (2823749) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 570.068ms, non-child: 570.068ms, % non-child: 100.00%) - CodegenTime: 266.632us - CompileTime: 85.258ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 295.094ms - PrepareTime: 188.990ms DataStreamSender (dst_id=11):(Total: 9.475ms, non-child: 9.475ms, % non-child: 100.00%) - BytesSent: 671.21 KB (687321) - NetworkThroughput(*): 435.75 MB/sec - OverallThroughput: 69.18 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 14.34K (14336) - SerializeBatchTime: 8.121ms - TransmitDataRPCTime: 1.504ms - UncompressedRowBatchSize: 1.62 MB (1699488) SORT_NODE (id=9):(Total: 40s215ms, non-child: 134.457ms, % non-child: 0.33%) ExecOption: Codegen Enabled - InMemorySortTime: 93.695ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 15.36K (15360) - RowsReturnedRate: 381.00 /sec - SortDataSize: 20.61 MB (21608877) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s081ms, non-child: 1s010ms, % non-child: 2.52%) - EvaluationTime: 1s004ms - GetNewBlockTime: 131.940us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 203.53K (203529) - RowsReturnedRate: 5.08 K/sec - UnpinTime: 3.996us SORT_NODE (id=7):(Total: 39s070ms, non-child: 395.462ms, % non-child: 1.01%) ExecOption: Codegen Enabled - InMemorySortTime: 121.436ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42094464) - RowsReturned: 203.53K (203529) - RowsReturnedRate: 5.21 K/sec - SortDataSize: 18.63 MB (19538784) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s674ms, non-child: 29.868ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 77.81 KB, 356.90 KB, 689.09 KB, 977.74 KB, 1.22 MB, 1.50 MB, 1.78 MB, 2.07 MB, 2.32 MB, 2.63 MB, 2.89 MB, 3.15 MB, 3.44 MB, 3.71 MB, 4.03 MB, 4.37 MB, 4.66 MB, 4.96 MB, 5.29 MB, 5.60 MB, 5.94 MB, 6.30 MB, 6.65 MB, 7.02 MB, 7.35 MB, 7.68 MB, 8.00 MB, 8.25 MB, 8.42 MB, 8.58 MB, 8.65 MB, 8.71 MB, 8.75 MB, 8.79 MB, 8.82 MB, 8.85 MB, 8.86 MB, 8.87 MB - BytesReceived: 8.87 MB (9303542) - ConvertRowBatchTime: 11.069ms - DeserializeRowBatchTimer: 82.436ms - FirstBatchArrivalWaitTime: 786.332ms - PeakMemoryUsage: 0 - RowsReturned: 203.53K (203529) - RowsReturnedRate: 5.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b2 (host=dn32.hadoop.trivago.com:22000):(Total: 40s748ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.07 MB, 48.13 MB, 48.11 MB, 48.07 MB, 48.08 MB, 48.14 MB, 48.05 MB, 48.10 MB, 48.07 MB, 48.10 MB, 48.12 MB, 48.10 MB, 48.13 MB, 48.12 MB, 48.09 MB, 56.07 MB, 56.10 MB, 56.08 MB, 56.10 MB, 56.11 MB, 56.07 MB, 56.06 MB, 56.13 MB, 56.15 MB, 56.07 MB, 56.09 MB, 56.11 MB, 56.10 MB, 60.10 MB, 64.12 MB, 64.10 MB, 64.07 MB, 64.09 MB, 64.12 MB, 64.11 MB, 64.10 MB, 64.14 MB, 64.16 MB, 74.12 MB, 60.12 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 924.23 MB (969130160) - PrepareTime: 210.462ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s441ms - TotalNetworkSendTime: 578.418ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.79M (2787268) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 779.650ms, non-child: 779.650ms, % non-child: 100.00%) - CodegenTime: 379.405us - CompileTime: 146.919ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 429.567ms - PrepareTime: 202.428ms DataStreamSender (dst_id=11):(Total: 2.346ms, non-child: 2.346ms, % non-child: 100.00%) - BytesSent: 179.04 KB (183342) - NetworkThroughput(*): 701.95 MB/sec - OverallThroughput: 74.50 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.193ms - TransmitDataRPCTime: 249.090us - UncompressedRowBatchSize: 441.71 KB (452313) SORT_NODE (id=9):(Total: 40s167ms, non-child: 149.893ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 107.602ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.30 MB (21286869) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s017ms, non-child: 1s152ms, % non-child: 2.88%) - EvaluationTime: 1s048ms - GetNewBlockTime: 137.785us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 200.70K (200697) - RowsReturnedRate: 5.01 K/sec - UnpinTime: 3.940us SORT_NODE (id=7):(Total: 38s865ms, non-child: 408.562ms, % non-child: 1.05%) ExecOption: Codegen Enabled - InMemorySortTime: 119.988ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.16 MB (42106592) - RowsReturned: 200.70K (200697) - RowsReturnedRate: 5.16 K/sec - SortDataSize: 18.37 MB (19266912) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s456ms, non-child: 26.906ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 105.78 KB, 448.89 KB, 760.11 KB, 1.02 MB, 1.27 MB, 1.54 MB, 1.82 MB, 2.08 MB, 2.37 MB, 2.64 MB, 2.90 MB, 3.19 MB, 3.46 MB, 3.75 MB, 4.05 MB, 4.36 MB, 4.66 MB, 4.99 MB, 5.31 MB, 5.63 MB, 5.97 MB, 6.32 MB, 6.64 MB, 7.02 MB, 7.35 MB, 7.67 MB, 7.97 MB, 8.19 MB, 8.37 MB, 8.49 MB, 8.57 MB, 8.62 MB, 8.65 MB, 8.71 MB, 8.73 MB, 8.75 MB, 8.76 MB, 8.77 MB - BytesReceived: 8.77 MB (9195044) - ConvertRowBatchTime: 10.691ms - DeserializeRowBatchTimer: 78.463ms - FirstBatchArrivalWaitTime: 300.297ms - PeakMemoryUsage: 0 - RowsReturned: 200.70K (200697) - RowsReturnedRate: 5.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b9 (host=dn11.hadoop.trivago.com:22000):(Total: 41s029ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 48.01 MB, 48.10 MB, 48.08 MB, 48.11 MB, 48.12 MB, 48.12 MB, 48.11 MB, 48.14 MB, 48.11 MB, 48.11 MB, 48.09 MB, 48.10 MB, 48.11 MB, 48.10 MB, 48.09 MB, 48.11 MB, 56.07 MB, 56.08 MB, 56.15 MB, 56.07 MB, 56.14 MB, 56.11 MB, 56.10 MB, 56.10 MB, 56.06 MB, 56.11 MB, 56.11 MB, 56.12 MB, 56.13 MB, 64.08 MB, 64.11 MB, 64.09 MB, 64.07 MB, 64.13 MB, 64.08 MB, 64.09 MB, 64.12 MB, 64.09 MB, 64.06 MB, 69.14 MB, 64.72 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 930.84 MB (976057848) - PrepareTime: 214.222ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s679ms - TotalNetworkSendTime: 582.261ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.81M (2811557) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 721.806ms, non-child: 721.806ms, % non-child: 100.00%) - CodegenTime: 380.152us - CompileTime: 178.574ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 375.187ms - PrepareTime: 167.435ms DataStreamSender (dst_id=11):(Total: 2.629ms, non-child: 2.629ms, % non-child: 100.00%) - BytesSent: 178.23 KB (182503) - NetworkThroughput(*): 375.51 MB/sec - OverallThroughput: 66.19 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.453ms - TransmitDataRPCTime: 463.496us - UncompressedRowBatchSize: 441.53 KB (452124) SORT_NODE (id=9):(Total: 40s443ms, non-child: 141.639ms, % non-child: 0.35%) ExecOption: Codegen Enabled - InMemorySortTime: 97.535ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.66 MB (21663669) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s302ms, non-child: 1s235ms, % non-child: 3.07%) - EvaluationTime: 1s184ms - GetNewBlockTime: 125.352us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.00K (203997) - RowsReturnedRate: 5.06 K/sec - UnpinTime: 5.224us SORT_NODE (id=7):(Total: 39s066ms, non-child: 371.039ms, % non-child: 0.95%) ExecOption: Codegen Enabled - InMemorySortTime: 118.353ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42095184) - RowsReturned: 204.00K (203997) - RowsReturnedRate: 5.22 K/sec - SortDataSize: 18.68 MB (19583712) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s695ms, non-child: 29.722ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 114.72 KB, 425.50 KB, 758.86 KB, 1022.23 KB, 1.24 MB, 1.55 MB, 1.81 MB, 2.09 MB, 2.40 MB, 2.66 MB, 2.96 MB, 3.24 MB, 3.52 MB, 3.83 MB, 4.13 MB, 4.42 MB, 4.78 MB, 5.10 MB, 5.42 MB, 5.76 MB, 6.10 MB, 6.46 MB, 6.79 MB, 7.13 MB, 7.47 MB, 7.78 MB, 8.08 MB, 8.31 MB, 8.49 MB, 8.63 MB, 8.71 MB, 8.75 MB, 8.80 MB, 8.84 MB, 8.87 MB, 8.89 MB, 8.89 MB, 8.90 MB - BytesReceived: 8.91 MB (9339899) - ConvertRowBatchTime: 10.974ms - DeserializeRowBatchTimer: 83.982ms - FirstBatchArrivalWaitTime: 445.194ms - PeakMemoryUsage: 0 - RowsReturned: 204.00K (203997) - RowsReturnedRate: 5.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4aa (host=dn49.hadoop.trivago.com:22000):(Total: 40s325ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.10 MB, 48.11 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.11 MB, 48.09 MB, 48.09 MB, 48.10 MB, 48.12 MB, 48.11 MB, 48.07 MB, 48.08 MB, 48.10 MB, 48.11 MB, 52.13 MB, 56.08 MB, 56.11 MB, 56.11 MB, 56.08 MB, 56.09 MB, 56.09 MB, 56.11 MB, 56.10 MB, 56.13 MB, 56.08 MB, 56.13 MB, 56.09 MB, 60.11 MB, 64.11 MB, 64.09 MB, 64.14 MB, 64.13 MB, 64.08 MB, 64.09 MB, 64.14 MB, 64.06 MB, 64.09 MB, 69.16 MB, 64.72 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 842.09 MB (882991360) - PrepareTime: 222.328ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s453ms - TotalNetworkSendTime: 162.882ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.55M (2547429) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 734.184ms, non-child: 734.184ms, % non-child: 100.00%) - CodegenTime: 372.288us - CompileTime: 137.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 407.086ms - PrepareTime: 189.136ms DataStreamSender (dst_id=11):(Total: 2.622ms, non-child: 2.622ms, % non-child: 100.00%) - BytesSent: 177.89 KB (182159) - NetworkThroughput(*): 945.46 MB/sec - OverallThroughput: 66.24 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.461ms - TransmitDataRPCTime: 183.741us - UncompressedRowBatchSize: 441.45 KB (452043) SORT_NODE (id=9):(Total: 40s160ms, non-child: 149.824ms, % non-child: 0.37%) ExecOption: Codegen Enabled - InMemorySortTime: 104.835ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.46 MB (21456531) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s010ms, non-child: 1s149ms, % non-child: 2.87%) - EvaluationTime: 1s112ms - GetNewBlockTime: 125.929us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.21K (202212) - RowsReturnedRate: 5.05 K/sec - UnpinTime: 4.508us SORT_NODE (id=7):(Total: 38s861ms, non-child: 392.602ms, % non-child: 1.01%) ExecOption: Codegen Enabled - InMemorySortTime: 115.270ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42091392) - RowsReturned: 202.21K (202212) - RowsReturnedRate: 5.20 K/sec - SortDataSize: 18.51 MB (19412352) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s468ms, non-child: 28.152ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 44.27 KB, 329.47 KB, 660.42 KB, 964.79 KB, 1.21 MB, 1.48 MB, 1.76 MB, 2.03 MB, 2.33 MB, 2.61 MB, 2.85 MB, 3.13 MB, 3.40 MB, 3.69 MB, 3.97 MB, 4.29 MB, 4.60 MB, 4.95 MB, 5.27 MB, 5.59 MB, 5.92 MB, 6.26 MB, 6.60 MB, 6.96 MB, 7.31 MB, 7.62 MB, 7.93 MB, 8.18 MB, 8.39 MB, 8.53 MB, 8.60 MB, 8.67 MB, 8.71 MB, 8.76 MB, 8.78 MB, 8.81 MB, 8.82 MB, 8.83 MB - BytesReceived: 8.83 MB (9261318) - ConvertRowBatchTime: 10.709ms - DeserializeRowBatchTimer: 68.588ms - FirstBatchArrivalWaitTime: 106.596ms - PeakMemoryUsage: 0 - RowsReturned: 202.21K (202212) - RowsReturnedRate: 5.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4c3 (host=dn36.hadoop.trivago.com:22000):(Total: 41s238ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.06 MB, 48.05 MB, 48.07 MB, 48.12 MB, 48.11 MB, 48.11 MB, 48.13 MB, 48.12 MB, 48.10 MB, 48.10 MB, 48.08 MB, 48.08 MB, 48.11 MB, 48.15 MB, 48.12 MB, 56.12 MB, 56.08 MB, 56.10 MB, 56.10 MB, 56.08 MB, 56.10 MB, 56.11 MB, 56.10 MB, 56.14 MB, 56.06 MB, 56.07 MB, 56.09 MB, 56.10 MB, 64.10 MB, 64.11 MB, 64.10 MB, 64.11 MB, 64.14 MB, 64.08 MB, 64.12 MB, 64.06 MB, 64.10 MB, 64.12 MB, 64.12 MB, 73.76 MB, 84.73 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 1009.99 MB (1059046752) - PrepareTime: 251.388ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 39s017ms - TotalNetworkSendTime: 3.072ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 3.04M (3043589) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 827.520ms, non-child: 827.520ms, % non-child: 100.00%) - CodegenTime: 437.764us - CompileTime: 172.028ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 434.169ms - PrepareTime: 220.537ms DataStreamSender (dst_id=11):(Total: 2.161ms, non-child: 2.161ms, % non-child: 100.00%) - BytesSent: 178.19 KB (182467) - NetworkThroughput(*): 759.65 MB/sec - OverallThroughput: 80.50 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 1.960ms - TransmitDataRPCTime: 229.070us - UncompressedRowBatchSize: 441.40 KB (451989) SORT_NODE (id=9):(Total: 41s233ms, non-child: 196.904ms, % non-child: 0.48%) ExecOption: Codegen Enabled - InMemorySortTime: 122.164ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 99.00 /sec - SortDataSize: 20.71 MB (21715364) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 41s036ms, non-child: 1s563ms, % non-child: 3.81%) - EvaluationTime: 1s513ms - GetNewBlockTime: 177.762us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.55K (204551) - RowsReturnedRate: 4.98 K/sec - UnpinTime: 6.489us SORT_NODE (id=7):(Total: 39s473ms, non-child: 440.894ms, % non-child: 1.12%) ExecOption: Codegen Enabled - InMemorySortTime: 135.299ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42090256) - RowsReturned: 204.55K (204551) - RowsReturnedRate: 5.18 K/sec - SortDataSize: 18.73 MB (19636896) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 39s032ms, non-child: 27.444ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 54.79 KB, 372.41 KB, 671.17 KB, 990.29 KB, 1.21 MB, 1.50 MB, 1.75 MB, 2.04 MB, 2.33 MB, 2.64 MB, 2.90 MB, 3.19 MB, 3.47 MB, 3.73 MB, 4.06 MB, 4.37 MB, 4.66 MB, 4.99 MB, 5.32 MB, 5.62 MB, 5.94 MB, 6.29 MB, 6.64 MB, 7.01 MB, 7.33 MB, 7.67 MB, 8.00 MB, 8.24 MB, 8.42 MB, 8.58 MB, 8.69 MB, 8.74 MB, 8.79 MB, 8.83 MB, 8.87 MB, 8.89 MB, 8.91 MB, 8.92 MB, 8.92 MB - BytesReceived: 8.92 MB (9355002) - ConvertRowBatchTime: 11.011ms - DeserializeRowBatchTimer: 68.828ms - FirstBatchArrivalWaitTime: 253.201ms - PeakMemoryUsage: 0 - RowsReturned: 204.55K (204551) - RowsReturnedRate: 5.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4ac (host=dn17.hadoop.trivago.com:22000):(Total: 40s300ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.07 MB, 48.15 MB, 48.07 MB, 48.09 MB, 48.07 MB, 48.10 MB, 48.11 MB, 48.06 MB, 48.13 MB, 48.07 MB, 48.10 MB, 48.10 MB, 48.09 MB, 48.09 MB, 48.10 MB, 56.10 MB, 56.13 MB, 56.14 MB, 56.11 MB, 56.09 MB, 56.08 MB, 56.08 MB, 56.08 MB, 56.14 MB, 56.09 MB, 56.08 MB, 56.08 MB, 60.07 MB, 64.13 MB, 64.10 MB, 64.11 MB, 64.07 MB, 64.09 MB, 64.13 MB, 64.09 MB, 64.14 MB, 64.11 MB, 64.08 MB, 69.65 MB, 84.23 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 839.65 MB (880436968) - PrepareTime: 260.133ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s366ms - TotalNetworkSendTime: 4.190ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.70M (2701093) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 24.00 GB (25769803776) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 858.795ms, non-child: 858.795ms, % non-child: 100.00%) - CodegenTime: 461.856us - CompileTime: 154.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 447.783ms - PrepareTime: 255.997ms DataStreamSender (dst_id=11):(Total: 3.057ms, non-child: 3.057ms, % non-child: 100.00%) - BytesSent: 179.34 KB (183643) - NetworkThroughput(*): 211.84 MB/sec - OverallThroughput: 57.28 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.805ms - TransmitDataRPCTime: 826.720us - UncompressedRowBatchSize: 442.37 KB (452988) SORT_NODE (id=9):(Total: 40s293ms, non-child: 154.201ms, % non-child: 0.38%) ExecOption: Codegen Enabled - InMemorySortTime: 97.816ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.69 MB (21699831) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s139ms, non-child: 1s263ms, % non-child: 3.15%) - EvaluationTime: 1s253ms - GetNewBlockTime: 94.808us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 204.25K (204249) - RowsReturnedRate: 5.09 K/sec - UnpinTime: 4.080us SORT_NODE (id=7):(Total: 38s876ms, non-child: 496.121ms, % non-child: 1.28%) ExecOption: Codegen Enabled - InMemorySortTime: 156.538ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42093680) - RowsReturned: 204.25K (204249) - RowsReturnedRate: 5.25 K/sec - SortDataSize: 18.70 MB (19607904) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s380ms, non-child: 26.129ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 66.00 KB, 366.67 KB, 674.19 KB, 976.82 KB, 1.23 MB, 1.51 MB, 1.80 MB, 2.07 MB, 2.37 MB, 2.65 MB, 2.96 MB, 3.22 MB, 3.51 MB, 3.78 MB, 4.08 MB, 4.37 MB, 4.69 MB, 5.01 MB, 5.34 MB, 5.66 MB, 6.01 MB, 6.35 MB, 6.71 MB, 7.08 MB, 7.37 MB, 7.73 MB, 8.02 MB, 8.28 MB, 8.46 MB, 8.60 MB, 8.68 MB, 8.73 MB, 8.79 MB, 8.82 MB, 8.85 MB, 8.87 MB, 8.88 MB, 8.89 MB - BytesReceived: 8.90 MB (9329939) - ConvertRowBatchTime: 9.510ms - DeserializeRowBatchTimer: 67.772ms - FirstBatchArrivalWaitTime: 509.385ms - PeakMemoryUsage: 0 - RowsReturned: 204.25K (204249) - RowsReturnedRate: 5.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4bb (host=dn5.hadoop.trivago.com:22000):(Total: 40s851ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 36.00 MB, 48.06 MB, 48.10 MB, 48.07 MB, 48.12 MB, 48.12 MB, 48.14 MB, 48.05 MB, 48.08 MB, 48.11 MB, 48.11 MB, 48.12 MB, 48.15 MB, 48.11 MB, 48.10 MB, 48.07 MB, 56.10 MB, 56.07 MB, 56.10 MB, 56.08 MB, 56.10 MB, 56.10 MB, 56.13 MB, 56.10 MB, 56.12 MB, 56.10 MB, 56.08 MB, 56.11 MB, 56.13 MB, 56.10 MB, 64.10 MB, 64.08 MB, 64.09 MB, 64.13 MB, 64.12 MB, 64.09 MB, 64.07 MB, 64.11 MB, 64.13 MB, 68.43 MB, 81.23 MB, 56.75 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 921.15 MB (965890912) - PrepareTime: 270.976ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s422ms - TotalNetworkSendTime: 4.471ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.92M (2916356) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 969.018ms, non-child: 969.018ms, % non-child: 100.00%) - CodegenTime: 358.598us - CompileTime: 275.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 477.496ms - PrepareTime: 215.309ms DataStreamSender (dst_id=11):(Total: 3.019ms, non-child: 3.019ms, % non-child: 100.00%) - BytesSent: 178.17 KB (182443) - NetworkThroughput(*): 190.31 MB/sec - OverallThroughput: 57.62 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.157ms - TransmitDataRPCTime: 914.252us - UncompressedRowBatchSize: 441.63 KB (452232) SORT_NODE (id=9):(Total: 40s844ms, non-child: 179.285ms, % non-child: 0.44%) ExecOption: Codegen Enabled - InMemorySortTime: 123.287ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.28 MB (21266659) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s665ms, non-child: 1s795ms, % non-child: 4.42%) - EvaluationTime: 1s716ms - GetNewBlockTime: 131.678us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 200.51K (200506) - RowsReturnedRate: 4.93 K/sec - UnpinTime: 5.822us SORT_NODE (id=7):(Total: 38s869ms, non-child: 434.760ms, % non-child: 1.12%) ExecOption: Codegen Enabled - InMemorySortTime: 127.169ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.14 MB (42093168) - RowsReturned: 200.51K (200506) - RowsReturnedRate: 5.16 K/sec - SortDataSize: 18.36 MB (19248576) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s434ms, non-child: 25.611ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 61.01 KB, 373.36 KB, 655.12 KB, 953.24 KB, 1.18 MB, 1.46 MB, 1.73 MB, 2.02 MB, 2.27 MB, 2.59 MB, 2.84 MB, 3.12 MB, 3.40 MB, 3.68 MB, 3.98 MB, 4.31 MB, 4.61 MB, 4.93 MB, 5.26 MB, 5.57 MB, 5.91 MB, 6.26 MB, 6.58 MB, 6.94 MB, 7.27 MB, 7.60 MB, 7.91 MB, 8.15 MB, 8.33 MB, 8.46 MB, 8.55 MB, 8.61 MB, 8.65 MB, 8.69 MB, 8.73 MB, 8.74 MB, 8.76 MB, 8.76 MB - BytesReceived: 8.77 MB (9192432) - ConvertRowBatchTime: 9.024ms - DeserializeRowBatchTimer: 67.246ms - FirstBatchArrivalWaitTime: 413.995ms - PeakMemoryUsage: 0 - RowsReturned: 200.51K (200506) - RowsReturnedRate: 5.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4d0 (host=dn48.hadoop.trivago.com:22000):(Total: 42s310ms, non-child: 325.774ms, % non-child: 0.77%) MemoryUsage(1s000ms): 48.01 MB, 48.09 MB, 48.10 MB, 48.10 MB, 48.14 MB, 48.08 MB, 48.07 MB, 48.12 MB, 48.11 MB, 48.11 MB, 48.12 MB, 48.11 MB, 48.14 MB, 48.10 MB, 48.11 MB, 52.12 MB, 56.10 MB, 56.06 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.11 MB, 56.07 MB, 56.10 MB, 56.11 MB, 56.06 MB, 56.13 MB, 56.11 MB, 60.08 MB, 64.12 MB, 64.10 MB, 64.10 MB, 64.11 MB, 64.11 MB, 64.11 MB, 64.08 MB, 64.14 MB, 64.15 MB, 64.05 MB, 64.05 MB, 74.35 MB, 60.12 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 869.27 MB (911490736) - PrepareTime: 319.103ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s956ms - TotalNetworkSendTime: 1s386ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.70M (2700645) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 1s060ms, non-child: 1s060ms, % non-child: 100.00%) - CodegenTime: 492.364us - CompileTime: 288.567ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 531.467ms - PrepareTime: 239.942ms DataStreamSender (dst_id=11):(Total: 2.361ms, non-child: 2.361ms, % non-child: 100.00%) - BytesSent: 178.20 KB (182478) - NetworkThroughput(*): 987.09 MB/sec - OverallThroughput: 73.70 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.216ms - TransmitDataRPCTime: 176.300us - UncompressedRowBatchSize: 440.89 KB (451476) SORT_NODE (id=9):(Total: 40s921ms, non-child: 186.750ms, % non-child: 0.46%) ExecOption: Codegen Enabled - InMemorySortTime: 144.335ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 100.00 /sec - SortDataSize: 20.87 MB (21879484) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s734ms, non-child: 1s315ms, % non-child: 3.23%) - EvaluationTime: 1s154ms - GetNewBlockTime: 149.425us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 206.04K (206038) - RowsReturnedRate: 5.06 K/sec - UnpinTime: 4.159us SORT_NODE (id=7):(Total: 39s419ms, non-child: 448.403ms, % non-child: 1.14%) ExecOption: Codegen Enabled - InMemorySortTime: 123.908ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42098720) - RowsReturned: 206.04K (206038) - RowsReturnedRate: 5.23 K/sec - SortDataSize: 18.86 MB (19779648) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s970ms, non-child: 27.509ms, % non-child: 0.07%) BytesReceived(1s000ms): 0, 112.83 KB, 414.86 KB, 762.49 KB, 1.00 MB, 1.29 MB, 1.58 MB, 1.84 MB, 2.13 MB, 2.44 MB, 2.73 MB, 2.99 MB, 3.28 MB, 3.55 MB, 3.86 MB, 4.16 MB, 4.48 MB, 4.81 MB, 5.11 MB, 5.44 MB, 5.79 MB, 6.12 MB, 6.48 MB, 6.85 MB, 7.19 MB, 7.53 MB, 7.84 MB, 8.12 MB, 8.36 MB, 8.55 MB, 8.68 MB, 8.77 MB, 8.82 MB, 8.86 MB, 8.90 MB, 8.94 MB, 8.96 MB, 8.96 MB, 8.97 MB, 8.97 MB - BytesReceived: 8.98 MB (9413800) - ConvertRowBatchTime: 10.339ms - DeserializeRowBatchTimer: 74.161ms - FirstBatchArrivalWaitTime: 40.057ms - PeakMemoryUsage: 0 - RowsReturned: 206.04K (206038) - RowsReturnedRate: 5.29 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b64a3852190d9ac2:412186998b9ee4b4 (host=dn34.hadoop.trivago.com:22000):(Total: 40s527ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 24.00 MB, 48.07 MB, 48.07 MB, 48.12 MB, 48.05 MB, 48.08 MB, 48.11 MB, 48.08 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.12 MB, 48.12 MB, 48.07 MB, 48.10 MB, 48.05 MB, 56.09 MB, 56.09 MB, 56.13 MB, 56.12 MB, 56.10 MB, 56.10 MB, 56.07 MB, 56.10 MB, 56.09 MB, 56.10 MB, 56.09 MB, 56.09 MB, 56.13 MB, 64.07 MB, 64.11 MB, 64.11 MB, 64.08 MB, 64.12 MB, 64.11 MB, 64.14 MB, 64.08 MB, 64.11 MB, 64.12 MB, 69.18 MB, 83.79 MB, 32.02 MB, 32.02 MB, 32.02 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 97.29 MB (102020704) - PerHostPeakMemUsage: 972.57 MB (1019811576) - PrepareTime: 332.259ms - RowsProduced: 4.10K (4096) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 38s022ms - TotalNetworkSendTime: 241.635ms - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 3.04M (3036964) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 96.00 MB (100663296) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 1s080ms, non-child: 1s080ms, % non-child: 100.00%) - CodegenTime: 505.147us - CompileTime: 258.864ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 302 (302) - NumInstructions: 4.97K (4973) - OptimizationTime: 536.829ms - PrepareTime: 284.141ms DataStreamSender (dst_id=11):(Total: 2.663ms, non-child: 2.663ms, % non-child: 100.00%) - BytesSent: 179.54 KB (183854) - NetworkThroughput(*): 652.62 MB/sec - OverallThroughput: 65.82 MB/sec - PeakMemoryUsage: 1.59 KB (1632) - RowsReturned: 3.07K (3072) - SerializeBatchTime: 2.470ms - TransmitDataRPCTime: 268.664us - UncompressedRowBatchSize: 442.90 KB (453528) SORT_NODE (id=9):(Total: 40s205ms, non-child: 183.987ms, % non-child: 0.46%) ExecOption: Codegen Enabled - InMemorySortTime: 124.819ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.01 MB (41955328) - RowsReturned: 4.10K (4096) - RowsReturnedRate: 101.00 /sec - SortDataSize: 20.50 MB (21490627) - TotalMergesPerformed: 0 (0) ANALYTIC_EVAL_NODE (id=8):(Total: 40s021ms, non-child: 1s493ms, % non-child: 3.73%) - EvaluationTime: 1s440ms - GetNewBlockTime: 122.907us - PeakMemoryUsage: 25.26 MB (26488832) - PinTime: 0.000ns - RowsReturned: 202.52K (202516) - RowsReturnedRate: 5.06 K/sec - UnpinTime: 5.546us SORT_NODE (id=7):(Total: 38s527ms, non-child: 489.283ms, % non-child: 1.27%) ExecOption: Codegen Enabled - InMemorySortTime: 118.114ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 40.15 MB (42098768) - RowsReturned: 202.52K (202516) - RowsReturnedRate: 5.26 K/sec - SortDataSize: 18.54 MB (19441536) - TotalMergesPerformed: 0 (0) EXCHANGE_NODE (id=10):(Total: 38s038ms, non-child: 28.763ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 59.82 KB, 358.02 KB, 720.96 KB, 989.46 KB, 1.22 MB, 1.48 MB, 1.76 MB, 2.04 MB, 2.33 MB, 2.62 MB, 2.88 MB, 3.17 MB, 3.44 MB, 3.70 MB, 4.00 MB, 4.30 MB, 4.61 MB, 4.94 MB, 5.26 MB, 5.60 MB, 5.93 MB, 6.28 MB, 6.63 MB, 7.00 MB, 7.32 MB, 7.67 MB, 7.98 MB, 8.22 MB, 8.42 MB, 8.55 MB, 8.63 MB, 8.69 MB, 8.73 MB, 8.77 MB, 8.80 MB, 8.82 MB, 8.83 MB, 8.84 MB - BytesReceived: 8.84 MB (9273976) - ConvertRowBatchTime: 11.172ms - DeserializeRowBatchTimer: 78.495ms - FirstBatchArrivalWaitTime: 11.911ms - PeakMemoryUsage: 0 - RowsReturned: 202.52K (202516) - RowsReturnedRate: 5.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F00: Instance b64a3852190d9ac2:412186998b9ee4d7 (host=dn40.hadoop.trivago.com:22000):(Total: 30s229ms, non-child: 1s552ms, % non-child: 5.14%) Hdfs split stats (:<# splits>/): 2:1/36.31 MB 5:1/32.79 MB 0:2/256.00 MB 6:1/128.00 MB 8:2/157.92 MB 7:3/190.88 MB 4:3/191.24 MB 1:3/288.34 MB MemoryUsage(1s000ms): 114.99 MB, 549.65 MB, 653.38 MB, 793.33 MB, 777.31 MB, 743.16 MB, 716.55 MB, 672.23 MB, 638.32 MB, 609.48 MB, 608.45 MB, 649.38 MB, 627.60 MB, 604.92 MB, 579.08 MB, 550.75 MB, 526.77 MB, 491.51 MB, 463.48 MB, 432.41 MB, 405.47 MB, 370.85 MB, 334.75 MB, 299.32 MB, 260.33 MB, 232.20 MB, 194.44 MB, 159.14 MB, 115.06 MB, 73.80 MB, 39.74 MB, 11.77 MB ThreadUsage(1s000ms): 8, 11, 5, 3, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 811.94 MB (851382248) - PerHostPeakMemUsage: 859.99 MB (901769648) - PrepareTime: 211.548ms - RowsProduced: 224.73K (224734) - TotalCpuTime: 33s022ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s416ms - TotalStorageWaitTime: 31s125ms CodeGen:(Total: 456.296ms, non-child: 456.296ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 70.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 179.124ms - PrepareTime: 206.167ms DataStreamSender (dst_id=10):(Total: 181.289ms, non-child: 181.289ms, % non-child: 100.00%) - BytesSent: 9.79 MB (10268111) - NetworkThroughput(*): 141.83 MB/sec - OverallThroughput: 54.02 MB/sec - PeakMemoryUsage: 1.20 MB (1261224) - RowsReturned: 224.73K (224734) - SerializeBatchTime: 111.937ms - TransmitDataRPCTime: 69.042ms - UncompressedRowBatchSize: 26.59 MB (27884488) SUBPLAN_NODE (id=1):(Total: 28s039ms, non-child: 15.124ms, % non-child: 0.05%) - PeakMemoryUsage: 13.84 MB (14508816) - RowsReturned: 224.73K (224734) - RowsReturnedRate: 8.01 K/sec HASH_JOIN_NODE (id=6):(Total: 27s451ms, non-child: 27s333ms, % non-child: 99.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 243.126ms - BuildRows: 2.48M (2475483) - BuildRowsPartitioned: 2.48M (2475483) - BuildTime: 190.812ms - GetNewBlockTime: 2s957ms - HashBuckets: 4.38M (4380433) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.53M (1526112) - PeakMemoryUsage: 2.09 MB (2190464) - PinTime: 0.000ns - ProbeRows: 255.48K (255481) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.663ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 51.365ms UNNEST_NODE (id=4):(Total: 36.112ms, non-child: 36.112ms, % non-child: 100.00%) - AvgCollectionSize: 25.95 - MaxCollectionSize: 1.32K (1322) - MinCollectionSize: 1 (1) - NumCollections: 95.38K (95382) - PeakMemoryUsage: 0 - RowsReturned: 5 (5) - RowsReturnedRate: 138.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 168.674ms, non-child: 129.311ms, % non-child: 76.66%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 255.48K (255481) - ProbeTime: 0.000ns - RowsReturned: 978.84K (978841) - RowsReturnedRate: 5.80 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.363ms, non-child: 39.363ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 139 (139) - MinCollectionSize: 1 (1) - NumCollections: 95.38K (95382) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 25.00 /sec HDFS_SCAN_NODE (id=0):(Total: 572.800ms, non-child: 572.800ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 2:1/36.31 MB 5:1/32.79 MB 0:2/256.00 MB 6:1/128.00 MB 8:2/157.92 MB 7:3/190.88 MB 4:3/191.24 MB 1:3/288.34 MB Hdfs Read Thread Concurrency Bucket: 0:66.13% 1:27.42% 2:3.226% 3:1.613% 4:0% 5:0% 6:1.613% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:96 BytesRead(500.000ms): 0, 16.75 MB, 36.63 MB, 37.43 MB, 44.25 MB, 46.73 MB, 53.67 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 54.62 MB, 58.96 MB, 60.33 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB, 60.50 MB - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 1.02 - BytesRead: 60.50 MB (63436507) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.72 MB (62617307) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.72 MB (62617307) - DecompressionTime: 198.074ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 16 (16) - PeakMemoryUsage: 798.69 MB (837482688) - PerReadThreadRawHdfsThroughput: 3.97 MB/sec - RemoteScanRanges: 8 (8) - RowsRead: 7.82M (7817414) - RowsReturned: 95.38K (95382) - RowsReturnedRate: 166.52 K/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 195 (195) - ScannerThreadsTotalWallClockTime: 32s910ms - MaterializeTupleTime(*): 1s330ms - ScannerThreadsSysTime: 476.024ms - ScannerThreadsUserTime: 1s220ms - ScannerThreadsVoluntaryContextSwitches: 609 (609) - TotalRawHdfsReadTime(*): 15s223ms - TotalReadThroughput: 1.92 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f4 (host=dn15.hadoop.trivago.com:22000):(Total: 25s559ms, non-child: 864.552ms, % non-child: 3.38%) Hdfs split stats (:<# splits>/): 0:3/195.58 MB 3:1/128.00 MB 2:2/256.00 MB 9:3/191.63 MB 10:1/32.63 MB 8:3/288.09 MB 6:1/128.00 MB MemoryUsage(500.000ms): 260.79 KB, 292.30 MB, 832.62 MB, 846.88 MB, 829.05 MB, 803.05 MB, 808.61 MB, 789.87 MB, 791.88 MB, 771.71 MB, 753.28 MB, 731.14 MB, 712.18 MB, 688.82 MB, 671.51 MB, 657.89 MB, 639.00 MB, 619.30 MB, 606.10 MB, 589.35 MB, 577.81 MB, 559.95 MB, 552.07 MB, 531.38 MB, 522.35 MB, 513.01 MB, 489.54 MB, 480.37 MB, 453.78 MB, 445.92 MB, 426.54 MB, 411.41 MB, 393.98 MB, 378.05 MB, 367.14 MB, 359.27 MB, 340.04 MB, 329.85 MB, 313.29 MB, 294.84 MB, 279.44 MB, 254.57 MB, 217.04 MB, 199.52 MB, 179.53 MB, 153.63 MB, 137.81 MB, 121.72 MB, 97.99 MB, 73.27 MB, 57.42 MB, 34.08 MB, 13.58 MB, 4.55 MB, 4.33 MB ThreadUsage(500.000ms): 1, 13, 5, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 851.97 MB (893354488) - PerHostPeakMemUsage: 900.07 MB (943794640) - PrepareTime: 187.672ms - RowsProduced: 197.15K (197148) - TotalCpuTime: 28s911ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 682.550ms - TotalStorageWaitTime: 13s244ms CodeGen:(Total: 410.533ms, non-child: 410.533ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 160.382ms - PrepareTime: 182.616ms DataStreamSender (dst_id=10):(Total: 166.123ms, non-child: 166.123ms, % non-child: 100.00%) - BytesSent: 8.62 MB (9034842) - NetworkThroughput(*): 123.88 MB/sec - OverallThroughput: 51.87 MB/sec - PeakMemoryUsage: 1.16 MB (1212072) - RowsReturned: 197.15K (197148) - SerializeBatchTime: 96.302ms - TransmitDataRPCTime: 69.553ms - UncompressedRowBatchSize: 23.33 MB (24461736) SUBPLAN_NODE (id=1):(Total: 24s118ms, non-child: 30.747ms, % non-child: 0.13%) - PeakMemoryUsage: 17.05 MB (17878544) - RowsReturned: 197.15K (197148) - RowsReturnedRate: 8.17 K/sec HASH_JOIN_NODE (id=6):(Total: 23s616ms, non-child: 23s479ms, % non-child: 99.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 250.834ms - BuildRows: 2.21M (2209999) - BuildRowsPartitioned: 2.21M (2209999) - BuildTime: 164.876ms - GetNewBlockTime: 2s609ms - HashBuckets: 3.91M (3914146) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1406128) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 234.87K (234866) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.658ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 45.258ms UNNEST_NODE (id=4):(Total: 32.351ms, non-child: 32.351ms, % non-child: 100.00%) - AvgCollectionSize: 25.15 - MaxCollectionSize: 1.92K (1921) - MinCollectionSize: 1 (1) - NumCollections: 87.88K (87883) - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 463.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 175.859ms, non-child: 141.206ms, % non-child: 80.30%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 234.87K (234866) - ProbeTime: 0.000ns - RowsReturned: 870.14K (870139) - RowsReturnedRate: 4.95 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 34.652ms, non-child: 34.652ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 88 (88) - MinCollectionSize: 1 (1) - NumCollections: 87.88K (87883) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 28.00 /sec HDFS_SCAN_NODE (id=0):(Total: 471.277ms, non-child: 471.277ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 0:3/195.58 MB 3:1/128.00 MB 2:2/256.00 MB 9:3/191.63 MB 10:1/32.63 MB 8:3/288.09 MB 6:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:96.15% 1:3.846% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 25.39 MB, 53.64 MB, 55.30 MB, 55.50 MB, 55.50 MB, 55.55 MB, 56.36 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB, 56.82 MB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 0.46 - BytesRead: 56.82 MB (59583398) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.53 MB (59276198) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.53 MB (59276198) - DecompressionTime: 170.726ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 842.24 MB (883148688) - PerReadThreadRawHdfsThroughput: 23.56 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.40M (7400684) - RowsReturned: 87.88K (87883) - RowsReturnedRate: 186.48 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 191 (191) - ScannerThreadsTotalWallClockTime: 15s128ms - MaterializeTupleTime(*): 1s283ms - ScannerThreadsSysTime: 372.018ms - ScannerThreadsUserTime: 1s232ms - ScannerThreadsVoluntaryContextSwitches: 655 (655) - TotalRawHdfsReadTime(*): 2s411ms - TotalReadThroughput: 2.14 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f9 (host=dn27.hadoop.trivago.com:22000):(Total: 25s374ms, non-child: 2s078ms, % non-child: 8.19%) Hdfs split stats (:<# splits>/): 1:1/128.00 MB 4:1/128.00 MB 2:3/288.39 MB 5:3/286.21 MB 7:1/128.00 MB 10:1/29.63 MB 8:1/128.00 MB 9:2/62.66 MB MemoryUsage(500.000ms): 260.79 KB, 302.26 MB, 827.28 MB, 860.67 MB, 848.60 MB, 832.03 MB, 820.71 MB, 801.73 MB, 783.01 MB, 773.47 MB, 758.21 MB, 736.71 MB, 720.22 MB, 702.33 MB, 688.79 MB, 668.72 MB, 646.50 MB, 628.23 MB, 620.34 MB, 613.11 MB, 588.91 MB, 571.43 MB, 559.59 MB, 551.62 MB, 532.62 MB, 511.18 MB, 501.03 MB, 476.82 MB, 457.40 MB, 431.08 MB, 409.08 MB, 399.68 MB, 365.91 MB, 359.02 MB, 327.98 MB, 319.56 MB, 298.20 MB, 279.48 MB, 268.95 MB, 252.39 MB, 231.56 MB, 204.19 MB, 182.20 MB, 160.17 MB, 141.51 MB, 114.88 MB, 96.13 MB, 73.82 MB, 58.37 MB, 29.53 MB, 8.88 MB, 8.86 MB, 8.62 MB, 8.44 MB, 8.31 MB ThreadUsage(500.000ms): 1, 13, 6, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 872.23 MB (914595648) - PerHostPeakMemUsage: 920.31 MB (965018216) - PrepareTime: 188.204ms - RowsProduced: 188.62K (188621) - TotalCpuTime: 28s176ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s503ms - TotalStorageWaitTime: 7s500ms CodeGen:(Total: 414.428ms, non-child: 414.428ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 64.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 166.648ms - PrepareTime: 183.014ms DataStreamSender (dst_id=10):(Total: 157.168ms, non-child: 157.168ms, % non-child: 100.00%) - BytesSent: 8.24 MB (8635576) - NetworkThroughput(*): 125.82 MB/sec - OverallThroughput: 52.40 MB/sec - PeakMemoryUsage: 1.24 MB (1302184) - RowsReturned: 188.62K (188621) - SerializeBatchTime: 91.449ms - TransmitDataRPCTime: 65.457ms - UncompressedRowBatchSize: 22.32 MB (23403728) SUBPLAN_NODE (id=1):(Total: 22s724ms, non-child: 22.949ms, % non-child: 0.10%) - PeakMemoryUsage: 14.12 MB (14809752) - RowsReturned: 188.62K (188621) - RowsReturnedRate: 8.30 K/sec HASH_JOIN_NODE (id=6):(Total: 22s186ms, non-child: 22s053ms, % non-child: 99.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 230.294ms - BuildRows: 2.15M (2152512) - BuildRowsPartitioned: 2.15M (2152512) - BuildTime: 155.399ms - GetNewBlockTime: 2s487ms - HashBuckets: 3.81M (3813952) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.37M (1371648) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 231.23K (231232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.707ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 43.021ms UNNEST_NODE (id=4):(Total: 30.666ms, non-child: 30.666ms, % non-child: 100.00%) - AvgCollectionSize: 25.11 - MaxCollectionSize: 1.83K (1826) - MinCollectionSize: 1 (1) - NumCollections: 85.73K (85728) - PeakMemoryUsage: 0 - RowsReturned: 24 (24) - RowsReturnedRate: 782.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 172.086ms, non-child: 133.235ms, % non-child: 77.42%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 231.23K (231232) - ProbeTime: 0.000ns - RowsReturned: 909.99K (909990) - RowsReturnedRate: 5.29 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 38.851ms, non-child: 38.851ms, % non-child: 100.00%) - AvgCollectionSize: 2.70 - MaxCollectionSize: 114 (114) - MinCollectionSize: 1 (1) - NumCollections: 85.73K (85728) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 51.00 /sec HDFS_SCAN_NODE (id=0):(Total: 515.424ms, non-child: 515.424ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 1:1/128.00 MB 4:1/128.00 MB 2:3/288.39 MB 5:3/286.21 MB 7:1/128.00 MB 10:1/29.63 MB 8:1/128.00 MB 9:2/62.66 MB Hdfs Read Thread Concurrency Bucket: 0:97.96% 1:0% 2:0% 3:0% 4:0% 5:2.041% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 0, 27.36 MB, 52.95 MB, 55.62 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB, 55.87 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 0.41 - BytesRead: 55.87 MB (58586923) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.58 MB (58279723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.58 MB (58279723) - DecompressionTime: 157.638ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 857.87 MB (899542072) - PerReadThreadRawHdfsThroughput: 23.23 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.23M (7225285) - RowsReturned: 85.73K (85728) - RowsReturnedRate: 166.32 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 182 (182) - ScannerThreadsTotalWallClockTime: 9s733ms - MaterializeTupleTime(*): 1s211ms - ScannerThreadsSysTime: 368.017ms - ScannerThreadsUserTime: 1s132ms - ScannerThreadsVoluntaryContextSwitches: 591 (591) - TotalRawHdfsReadTime(*): 2s405ms - TotalReadThroughput: 2.23 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f5 (host=dn28.hadoop.trivago.com:22000):(Total: 26s868ms, non-child: 837.441ms, % non-child: 3.12%) Hdfs split stats (:<# splits>/): 5:1/32.92 MB 7:1/33.71 MB 6:1/128.00 MB 1:2/63.81 MB 2:2/160.81 MB 0:2/158.19 MB 8:5/541.70 MB 4:2/161.13 MB 3:1/29.28 MB MemoryUsage(500.000ms): 0, 320.41 MB, 797.67 MB, 894.14 MB, 930.06 MB, 922.81 MB, 918.89 MB, 910.52 MB, 890.98 MB, 882.74 MB, 858.45 MB, 852.54 MB, 834.46 MB, 818.13 MB, 794.96 MB, 778.20 MB, 768.09 MB, 758.72 MB, 739.89 MB, 730.50 MB, 715.70 MB, 696.05 MB, 675.94 MB, 655.61 MB, 648.31 MB, 629.64 MB, 621.48 MB, 602.43 MB, 593.31 MB, 559.68 MB, 550.34 MB, 529.70 MB, 507.58 MB, 498.22 MB, 476.23 MB, 458.28 MB, 432.70 MB, 416.97 MB, 393.58 MB, 373.91 MB, 355.74 MB, 332.29 MB, 312.52 MB, 292.25 MB, 277.34 MB, 253.67 MB, 227.39 MB, 207.54 MB, 186.10 MB, 165.78 MB, 144.63 MB, 105.72 MB, 95.15 MB, 62.80 MB, 36.81 MB, 22.10 MB, 8.81 MB, 8.65 MB ThreadUsage(500.000ms): 1, 15, 10, 5, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 938.60 MB (984197896) - PerHostPeakMemUsage: 986.72 MB (1034655632) - PrepareTime: 199.968ms - RowsProduced: 209.30K (209303) - TotalCpuTime: 30s140ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 696.416ms - TotalStorageWaitTime: 13s293ms CodeGen:(Total: 412.777ms, non-child: 412.777ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 62.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 154.527ms - PrepareTime: 194.938ms DataStreamSender (dst_id=10):(Total: 166.077ms, non-child: 166.077ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9610265) - NetworkThroughput(*): 127.58 MB/sec - OverallThroughput: 55.19 MB/sec - PeakMemoryUsage: 1.43 MB (1498792) - RowsReturned: 209.30K (209303) - SerializeBatchTime: 93.932ms - TransmitDataRPCTime: 71.838ms - UncompressedRowBatchSize: 24.77 MB (25969880) SUBPLAN_NODE (id=1):(Total: 25s452ms, non-child: 30.231ms, % non-child: 0.12%) - PeakMemoryUsage: 13.23 MB (13874840) - RowsReturned: 209.30K (209303) - RowsReturnedRate: 8.22 K/sec HASH_JOIN_NODE (id=6):(Total: 24s924ms, non-child: 24s790ms, % non-child: 99.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 231.043ms - BuildRows: 2.39M (2393916) - BuildRowsPartitioned: 2.39M (2393916) - BuildTime: 167.884ms - GetNewBlockTime: 2s786ms - HashBuckets: 4.23M (4228479) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.55M (1548368) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 257.75K (257755) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.246ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 45.054ms UNNEST_NODE (id=4):(Total: 30.550ms, non-child: 30.550ms, % non-child: 100.00%) - AvgCollectionSize: 24.74 - MaxCollectionSize: 2.10K (2104) - MinCollectionSize: 1 (1) - NumCollections: 96.77K (96773) - PeakMemoryUsage: 0 - RowsReturned: 9 (9) - RowsReturnedRate: 294.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 179.460ms, non-child: 144.839ms, % non-child: 80.71%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 257.75K (257755) - ProbeTime: 0.000ns - RowsReturned: 964.37K (964365) - RowsReturnedRate: 5.37 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 34.620ms, non-child: 34.620ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 73 (73) - MinCollectionSize: 1 (1) - NumCollections: 96.77K (96773) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 57.00 /sec HDFS_SCAN_NODE (id=0):(Total: 497.283ms, non-child: 497.283ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 5:1/32.92 MB 7:1/33.71 MB 6:1/128.00 MB 1:2/63.81 MB 2:2/160.81 MB 0:2/158.19 MB 8:5/541.70 MB 4:2/161.13 MB 3:1/29.28 MB Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:5.455% 2:1.818% 3:1.818% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(500.000ms): 30.64 MB, 52.55 MB, 58.35 MB, 61.31 MB, 61.50 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB, 61.52 MB - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 0.53 - BytesRead: 61.52 MB (64504042) - BytesReadDataNodeCache: 0 - BytesReadLocal: 61.13 MB (64094442) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 61.13 MB (64094442) - DecompressionTime: 187.465ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 40 (40) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 927.38 MB (972428256) - PerReadThreadRawHdfsThroughput: 14.90 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.95M (7948760) - RowsReturned: 96.77K (96773) - RowsReturnedRate: 194.60 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 212 (212) - ScannerThreadsTotalWallClockTime: 15s053ms - MaterializeTupleTime(*): 1s336ms - ScannerThreadsSysTime: 448.022ms - ScannerThreadsUserTime: 1s224ms - ScannerThreadsVoluntaryContextSwitches: 698 (698) - TotalRawHdfsReadTime(*): 4s128ms - TotalReadThroughput: 2.24 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e5 (host=dn32.hadoop.trivago.com:22000):(Total: 28s313ms, non-child: 64.319ms, % non-child: 0.23%) Hdfs split stats (:<# splits>/): 7:2/161.26 MB 9:1/128.00 MB 3:1/128.00 MB 0:2/256.00 MB 6:2/157.83 MB 4:3/189.71 MB 8:1/128.00 MB 10:1/31.05 MB MemoryUsage(500.000ms): 260.79 KB, 566.69 MB, 861.76 MB, 867.52 MB, 847.68 MB, 830.55 MB, 821.92 MB, 801.72 MB, 794.04 MB, 783.97 MB, 766.85 MB, 752.46 MB, 745.84 MB, 731.41 MB, 718.88 MB, 708.46 MB, 692.81 MB, 682.20 MB, 673.25 MB, 664.82 MB, 656.37 MB, 647.19 MB, 636.59 MB, 623.83 MB, 616.82 MB, 604.16 MB, 584.43 MB, 574.24 MB, 563.86 MB, 540.73 MB, 529.46 MB, 518.73 MB, 509.27 MB, 490.40 MB, 484.11 MB, 462.83 MB, 454.30 MB, 426.41 MB, 415.56 MB, 396.05 MB, 378.04 MB, 370.06 MB, 348.25 MB, 330.91 MB, 309.41 MB, 292.72 MB, 275.34 MB, 254.17 MB, 231.71 MB, 214.33 MB, 204.44 MB, 186.94 MB, 160.72 MB, 146.55 MB, 128.06 MB, 110.76 MB, 91.45 MB, 63.28 MB, 43.92 MB, 25.97 MB, 3.21 MB ThreadUsage(500.000ms): 1, 10, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 876.11 MB (918672504) - PerHostPeakMemUsage: 924.23 MB (969130160) - PrepareTime: 219.068ms - RowsProduced: 207.32K (207317) - TotalCpuTime: 32s379ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 154.304ms - TotalStorageWaitTime: 6s414ms CodeGen:(Total: 462.489ms, non-child: 462.489ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 71.530ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 176.727ms - PrepareTime: 213.389ms DataStreamSender (dst_id=10):(Total: 162.172ms, non-child: 162.172ms, % non-child: 100.00%) - BytesSent: 9.04 MB (9474274) - NetworkThroughput(*): 156.85 MB/sec - OverallThroughput: 55.71 MB/sec - PeakMemoryUsage: 1.18 MB (1236648) - RowsReturned: 207.32K (207317) - SerializeBatchTime: 104.230ms - TransmitDataRPCTime: 57.605ms - UncompressedRowBatchSize: 24.53 MB (25723448) SUBPLAN_NODE (id=1):(Total: 27s624ms, non-child: 16.518ms, % non-child: 0.06%) - PeakMemoryUsage: 14.04 MB (14720096) - RowsReturned: 207.32K (207317) - RowsReturnedRate: 7.50 K/sec HASH_JOIN_NODE (id=6):(Total: 26s957ms, non-child: 26s836ms, % non-child: 99.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 268.002ms - BuildRows: 2.27M (2274392) - BuildRowsPartitioned: 2.27M (2274392) - BuildTime: 172.008ms - GetNewBlockTime: 2s885ms - HashBuckets: 4.03M (4031416) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.39M (1393648) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 233.85K (233849) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.048ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 48.220ms UNNEST_NODE (id=4):(Total: 32.668ms, non-child: 32.668ms, % non-child: 100.00%) - AvgCollectionSize: 26.11 - MaxCollectionSize: 2.30K (2304) - MinCollectionSize: 1 (1) - NumCollections: 87.10K (87103) - PeakMemoryUsage: 0 - RowsReturned: 29 (29) - RowsReturnedRate: 887.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 165.750ms, non-child: 130.786ms, % non-child: 78.91%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 233.85K (233849) - ProbeTime: 0.000ns - RowsReturned: 909.10K (909095) - RowsReturnedRate: 5.48 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 34.963ms, non-child: 34.963ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 187 (187) - MinCollectionSize: 1 (1) - NumCollections: 87.10K (87103) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 85.00 /sec HDFS_SCAN_NODE (id=0):(Total: 650.671ms, non-child: 650.671ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 7:2/161.26 MB 9:1/128.00 MB 3:1/128.00 MB 0:2/256.00 MB 6:2/157.83 MB 4:3/189.71 MB 8:1/128.00 MB 10:1/31.05 MB Hdfs Read Thread Concurrency Bucket: 0:96.61% 1:1.695% 2:0% 3:0% 4:0% 5:1.695% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 0, 39.11 MB, 53.82 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB, 55.35 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 0.17 - BytesRead: 55.35 MB (58041447) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.86 MB (57529447) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.86 MB (57529447) - DecompressionTime: 177.703ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 863.73 MB (905683120) - PerReadThreadRawHdfsThroughput: 13.22 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.18M (7184623) - RowsReturned: 87.10K (87103) - RowsReturnedRate: 133.87 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 192 (192) - ScannerThreadsTotalWallClockTime: 8s233ms - MaterializeTupleTime(*): 1s428ms - ScannerThreadsSysTime: 468.024ms - ScannerThreadsUserTime: 1s276ms - ScannerThreadsVoluntaryContextSwitches: 617 (617) - TotalRawHdfsReadTime(*): 4s185ms - TotalReadThroughput: 1.84 MB/sec Instance b64a3852190d9ac2:412186998b9ee4ff (host=dn26.hadoop.trivago.com:22000):(Total: 26s960ms, non-child: 265.526ms, % non-child: 0.98%) Hdfs split stats (:<# splits>/): 9:2/256.00 MB 0:1/34.45 MB 5:2/256.00 MB 4:3/288.55 MB 10:1/128.00 MB 2:3/290.22 MB MemoryUsage(500.000ms): 3.04 MB, 700.11 MB, 749.93 MB, 933.37 MB, 916.08 MB, 909.12 MB, 888.20 MB, 868.36 MB, 858.15 MB, 844.40 MB, 834.71 MB, 826.82 MB, 809.52 MB, 799.05 MB, 791.34 MB, 774.44 MB, 764.59 MB, 743.24 MB, 731.75 MB, 721.81 MB, 705.21 MB, 695.68 MB, 687.38 MB, 678.18 MB, 669.75 MB, 657.96 MB, 635.61 MB, 615.67 MB, 605.94 MB, 585.80 MB, 560.39 MB, 541.91 MB, 520.32 MB, 508.89 MB, 479.58 MB, 470.44 MB, 451.71 MB, 433.16 MB, 408.29 MB, 394.20 MB, 373.75 MB, 352.09 MB, 326.82 MB, 304.93 MB, 282.98 MB, 254.49 MB, 226.31 MB, 208.88 MB, 186.64 MB, 165.96 MB, 140.56 MB, 115.87 MB, 96.21 MB, 78.05 MB, 57.78 MB, 35.24 MB, 17.82 MB, 7.68 MB ThreadUsage(500.000ms): 13, 7, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 934.96 MB (980375424) - PerHostPeakMemUsage: 983.11 MB (1030868328) - PrepareTime: 195.108ms - RowsProduced: 210.57K (210567) - TotalCpuTime: 30s669ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 522.393ms - TotalStorageWaitTime: 5s962ms CodeGen:(Total: 427.845ms, non-child: 427.845ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.739ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 171.836ms - PrepareTime: 189.462ms DataStreamSender (dst_id=10):(Total: 179.971ms, non-child: 179.971ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9618477) - NetworkThroughput(*): 123.47 MB/sec - OverallThroughput: 50.97 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 210.57K (210567) - SerializeBatchTime: 105.337ms - TransmitDataRPCTime: 74.294ms - UncompressedRowBatchSize: 24.92 MB (26126688) SUBPLAN_NODE (id=1):(Total: 26s087ms, non-child: 41.696ms, % non-child: 0.16%) - PeakMemoryUsage: 14.89 MB (15615056) - RowsReturned: 210.57K (210567) - RowsReturnedRate: 8.07 K/sec HASH_JOIN_NODE (id=6):(Total: 25s519ms, non-child: 25s368ms, % non-child: 99.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 282.202ms - BuildRows: 2.33M (2331553) - BuildRowsPartitioned: 2.33M (2331553) - BuildTime: 183.180ms - GetNewBlockTime: 2s818ms - HashBuckets: 4.14M (4137277) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.44M (1442384) - PeakMemoryUsage: 2.16 MB (2266240) - PinTime: 0.000ns - ProbeRows: 243.57K (243570) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.698ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 48.320ms UNNEST_NODE (id=4):(Total: 33.390ms, non-child: 33.390ms, % non-child: 100.00%) - AvgCollectionSize: 25.86 - MaxCollectionSize: 3.27K (3274) - MinCollectionSize: 1 (1) - NumCollections: 90.15K (90149) - PeakMemoryUsage: 0 - RowsReturned: 22 (22) - RowsReturnedRate: 658.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 196.395ms, non-child: 156.040ms, % non-child: 79.45%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 243.57K (243570) - ProbeTime: 0.000ns - RowsReturned: 974.22K (974222) - RowsReturnedRate: 4.96 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 40.355ms, non-child: 40.355ms, % non-child: 100.00%) - AvgCollectionSize: 2.70 - MaxCollectionSize: 134 (134) - MinCollectionSize: 1 (1) - NumCollections: 90.15K (90149) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 74.00 /sec HDFS_SCAN_NODE (id=0):(Total: 526.102ms, non-child: 526.102ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 12 Hdfs split stats (:<# splits>/): 9:2/256.00 MB 0:1/34.45 MB 5:2/256.00 MB 4:3/288.55 MB 10:1/128.00 MB 2:3/290.22 MB Hdfs Read Thread Concurrency Bucket: 0:94.74% 1:0% 2:1.754% 3:0% 4:3.509% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 400.00 KB, 43.95 MB, 47.30 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB, 59.41 MB - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 0.35 - BytesRead: 59.41 MB (62300193) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.83 MB (61683656) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.83 MB (61683656) - DecompressionTime: 185.852ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 7 (7) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 921.19 MB (965937048) - PerReadThreadRawHdfsThroughput: 13.65 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.78M (7784918) - RowsReturned: 90.15K (90149) - RowsReturnedRate: 171.35 K/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 207 (207) - ScannerThreadsTotalWallClockTime: 7s784ms - MaterializeTupleTime(*): 1s418ms - ScannerThreadsSysTime: 432.022ms - ScannerThreadsUserTime: 1s288ms - ScannerThreadsVoluntaryContextSwitches: 678 (678) - TotalRawHdfsReadTime(*): 4s353ms - TotalReadThroughput: 2.08 MB/sec Instance b64a3852190d9ac2:412186998b9ee4ed (host=dn12.hadoop.trivago.com:22000):(Total: 31s694ms, non-child: 382.973ms, % non-child: 1.21%) Hdfs split stats (:<# splits>/): 2:1/33.02 MB 7:1/128.00 MB 5:3/288.75 MB 3:2/160.80 MB 10:4/221.81 MB 4:1/128.00 MB 1:1/28.85 MB 0:2/62.97 MB 6:2/61.49 MB MemoryUsage(1s000ms): 726.39 KB, 203.37 MB, 474.55 MB, 667.72 MB, 736.87 MB, 728.43 MB, 705.89 MB, 690.31 MB, 671.18 MB, 641.11 MB, 625.39 MB, 604.54 MB, 574.91 MB, 549.21 MB, 536.22 MB, 519.16 MB, 490.83 MB, 471.12 MB, 443.63 MB, 414.08 MB, 386.46 MB, 356.01 MB, 329.54 MB, 295.43 MB, 266.10 MB, 239.11 MB, 208.09 MB, 182.45 MB, 155.19 MB, 125.43 MB, 103.36 MB, 72.28 MB, 47.38 MB, 25.09 MB, 4.68 MB ThreadUsage(1s000ms): 3, 6, 5, 5, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 758.77 MB (795627720) - PerHostPeakMemUsage: 806.88 MB (846076064) - PrepareTime: 221.503ms - RowsProduced: 194.90K (194899) - TotalCpuTime: 35s948ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 237.942ms - TotalStorageWaitTime: 13s622ms CodeGen:(Total: 462.215ms, non-child: 462.215ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 74.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 170.737ms - PrepareTime: 216.078ms DataStreamSender (dst_id=10):(Total: 174.450ms, non-child: 174.450ms, % non-child: 100.00%) - BytesSent: 8.49 MB (8906263) - NetworkThroughput(*): 120.41 MB/sec - OverallThroughput: 48.69 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 194.90K (194899) - SerializeBatchTime: 103.591ms - TransmitDataRPCTime: 70.537ms - UncompressedRowBatchSize: 23.06 MB (24182680) SUBPLAN_NODE (id=1):(Total: 30s675ms, non-child: 39.530ms, % non-child: 0.13%) - PeakMemoryUsage: 14.10 MB (14789288) - RowsReturned: 194.90K (194899) - RowsReturnedRate: 6.35 K/sec HASH_JOIN_NODE (id=6):(Total: 30s054ms, non-child: 29s914ms, % non-child: 99.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 270.652ms - BuildRows: 2.14M (2138356) - BuildRowsPartitioned: 2.14M (2138356) - BuildTime: 179.898ms - GetNewBlockTime: 3s045ms - HashBuckets: 3.78M (3783545) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.31M (1312848) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 218.32K (218320) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 58.635ms - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 44.899ms UNNEST_NODE (id=4):(Total: 35.819ms, non-child: 35.819ms, % non-child: 100.00%) - AvgCollectionSize: 26.06 - MaxCollectionSize: 3.72K (3717) - MinCollectionSize: 1 (1) - NumCollections: 82.05K (82053) - PeakMemoryUsage: 0 - RowsReturned: 27 (27) - RowsReturnedRate: 753.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 198.467ms, non-child: 154.503ms, % non-child: 77.85%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 218.32K (218320) - ProbeTime: 0.000ns - RowsReturned: 819.27K (819267) - RowsReturnedRate: 4.13 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 43.963ms, non-child: 43.963ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 106 (106) - MinCollectionSize: 1 (1) - NumCollections: 82.05K (82053) - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 159.00 /sec HDFS_SCAN_NODE (id=0):(Total: 581.424ms, non-child: 581.424ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 2:1/33.02 MB 7:1/128.00 MB 5:3/288.75 MB 3:2/160.80 MB 10:4/221.81 MB 4:1/128.00 MB 1:1/28.85 MB 0:2/62.97 MB 6:2/61.49 MB Hdfs Read Thread Concurrency Bucket: 0:94.03% 1:4.478% 2:1.493% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(1s000ms): 6.27 MB, 24.76 MB, 38.89 MB, 50.60 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB, 53.07 MB - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 0.49 - BytesRead: 53.07 MB (55647429) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.57 MB (55125655) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 52.57 MB (55125655) - DecompressionTime: 168.716ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 5 (5) - PeakMemoryUsage: 745.76 MB (781982248) - PerReadThreadRawHdfsThroughput: 16.23 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 6.80M (6801737) - RowsReturned: 82.05K (82053) - RowsReturnedRate: 141.12 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 179 (179) - ScannerThreadsTotalWallClockTime: 15s257ms - MaterializeTupleTime(*): 1s224ms - ScannerThreadsSysTime: 348.019ms - ScannerThreadsUserTime: 1s212ms - ScannerThreadsVoluntaryContextSwitches: 645 (645) - TotalRawHdfsReadTime(*): 3s269ms - TotalReadThroughput: 1.58 MB/sec Instance b64a3852190d9ac2:412186998b9ee4ee (host=dn5.hadoop.trivago.com:22000):(Total: 34s448ms, non-child: 164.969ms, % non-child: 0.48%) Hdfs split stats (:<# splits>/): 3:1/128.00 MB 5:1/33.79 MB 2:1/32.96 MB 6:2/256.00 MB 0:4/413.43 MB 9:2/161.74 MB 7:2/156.67 MB 10:2/65.14 MB MemoryUsage(1s000ms): 32.66 MB, 644.52 MB, 772.74 MB, 766.04 MB, 827.04 MB, 859.37 MB, 834.12 MB, 807.48 MB, 779.16 MB, 756.07 MB, 733.39 MB, 705.49 MB, 679.85 MB, 656.30 MB, 634.19 MB, 615.59 MB, 589.07 MB, 565.58 MB, 531.78 MB, 503.45 MB, 476.62 MB, 446.44 MB, 415.83 MB, 392.76 MB, 365.38 MB, 340.73 MB, 305.52 MB, 278.06 MB, 257.31 MB, 227.56 MB, 194.94 MB, 175.03 MB, 137.34 MB, 105.35 MB, 76.96 MB, 43.23 MB, 24.20 MB ThreadUsage(1s000ms): 8, 9, 6, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 873.02 MB (915426920) - PerHostPeakMemUsage: 921.15 MB (965890912) - PrepareTime: 258.002ms - RowsProduced: 210.58K (210578) - TotalCpuTime: 42s171ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.694ms - TotalStorageWaitTime: 17s417ms CodeGen:(Total: 558.102ms, non-child: 558.102ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 88.557ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 217.112ms - PrepareTime: 239.919ms DataStreamSender (dst_id=10):(Total: 198.708ms, non-child: 198.708ms, % non-child: 100.00%) - BytesSent: 9.19 MB (9632576) - NetworkThroughput(*): 136.20 MB/sec - OverallThroughput: 46.23 MB/sec - PeakMemoryUsage: 1.35 MB (1416872) - RowsReturned: 210.58K (210578) - SerializeBatchTime: 130.892ms - TransmitDataRPCTime: 67.445ms - UncompressedRowBatchSize: 24.92 MB (26128088) SUBPLAN_NODE (id=1):(Total: 33s526ms, non-child: 71.673ms, % non-child: 0.21%) - PeakMemoryUsage: 15.14 MB (15880296) - RowsReturned: 210.58K (210578) - RowsReturnedRate: 6.28 K/sec HASH_JOIN_NODE (id=6):(Total: 32s807ms, non-child: 32s568ms, % non-child: 99.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 349.874ms - BuildRows: 2.34M (2336690) - BuildRowsPartitioned: 2.34M (2336690) - BuildTime: 243.179ms - GetNewBlockTime: 3s523ms - HashBuckets: 4.14M (4140136) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.46M (1458192) - PeakMemoryUsage: 2.13 MB (2229376) - PinTime: 0.000ns - ProbeRows: 244.09K (244086) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 70.354ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 61.178ms UNNEST_NODE (id=4):(Total: 50.842ms, non-child: 50.842ms, % non-child: 100.00%) - AvgCollectionSize: 25.64 - MaxCollectionSize: 2.59K (2593) - MinCollectionSize: 1 (1) - NumCollections: 91.14K (91137) - PeakMemoryUsage: 0 - RowsReturned: 16 (16) - RowsReturnedRate: 314.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 294.466ms, non-child: 244.122ms, % non-child: 82.90%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 244.09K (244086) - ProbeTime: 0.000ns - RowsReturned: 928.91K (928912) - RowsReturnedRate: 3.15 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 50.343ms, non-child: 50.343ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 97 (97) - MinCollectionSize: 1 (1) - NumCollections: 91.14K (91137) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 19.00 /sec HDFS_SCAN_NODE (id=0):(Total: 647.546ms, non-child: 647.546ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 3:1/128.00 MB 5:1/33.79 MB 2:1/32.96 MB 6:2/256.00 MB 0:4/413.43 MB 9:2/161.74 MB 7:2/156.67 MB 10:2/65.14 MB Hdfs Read Thread Concurrency Bucket: 0:89.04% 1:6.849% 2:1.37% 3:1.37% 4:0% 5:0% 6:1.37% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(1s000ms): 25.65 MB, 46.72 MB, 50.83 MB, 54.92 MB, 58.96 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB, 59.23 MB - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 0.66 - BytesRead: 59.23 MB (62103610) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.63 MB (61479254) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.63 MB (61479254) - DecompressionTime: 173.551ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 861.67 MB (903530304) - PerReadThreadRawHdfsThroughput: 8.72 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.63M (7628407) - RowsReturned: 91.14K (91137) - RowsReturnedRate: 140.74 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 192 (192) - ScannerThreadsTotalWallClockTime: 22s415ms - MaterializeTupleTime(*): 1s480ms - ScannerThreadsSysTime: 456.021ms - ScannerThreadsUserTime: 1s316ms - ScannerThreadsVoluntaryContextSwitches: 844 (844) - TotalRawHdfsReadTime(*): 6s792ms - TotalReadThroughput: 1.62 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e3 (host=dn47.hadoop.trivago.com:22000):(Total: 26s411ms, non-child: 934.796ms, % non-child: 3.54%) Hdfs split stats (:<# splits>/): 8:1/128.00 MB 9:2/256.00 MB 0:2/63.00 MB 7:1/32.66 MB 2:2/163.92 MB 1:1/128.00 MB 5:1/29.29 MB 3:1/128.00 MB 4:4/314.29 MB MemoryUsage(500.000ms): 260.79 KB, 40.24 MB, 434.95 MB, 669.34 MB, 755.38 MB, 763.88 MB, 829.20 MB, 821.34 MB, 807.05 MB, 807.15 MB, 815.34 MB, 831.46 MB, 820.70 MB, 811.92 MB, 789.72 MB, 780.41 MB, 767.07 MB, 748.33 MB, 730.08 MB, 711.81 MB, 689.87 MB, 679.67 MB, 659.88 MB, 645.78 MB, 628.36 MB, 596.80 MB, 578.48 MB, 562.98 MB, 537.94 MB, 521.80 MB, 503.84 MB, 473.24 MB, 454.43 MB, 434.63 MB, 394.14 MB, 377.04 MB, 367.86 MB, 345.90 MB, 322.45 MB, 301.63 MB, 274.49 MB, 262.30 MB, 248.10 MB, 229.96 MB, 219.64 MB, 195.79 MB, 177.55 MB, 152.41 MB, 135.66 MB, 103.38 MB, 82.78 MB, 61.90 MB, 43.88 MB, 23.68 MB, 4.52 MB, 4.34 MB, 4.10 MB ThreadUsage(500.000ms): 1, 16, 12, 8, 6, 5, 4, 4, 4, 4, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.02 - BloomFilterBytes: 0 - PeakMemoryUsage: 843.20 MB (884157880) - PerHostPeakMemUsage: 891.27 MB (934562864) - PrepareTime: 279.159ms - RowsProduced: 212.35K (212352) - TotalCpuTime: 30s603ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 594.051ms - TotalStorageWaitTime: 26s977ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 39 (39) - BlocksRecycled: 2.93M (2931840) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 56.06 MB (58785792) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 636.516ms, non-child: 636.516ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 92.769ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 271.616ms - PrepareTime: 271.216ms DataStreamSender (dst_id=10):(Total: 160.179ms, non-child: 160.179ms, % non-child: 100.00%) - BytesSent: 9.22 MB (9672806) - NetworkThroughput(*): 148.34 MB/sec - OverallThroughput: 57.59 MB/sec - PeakMemoryUsage: 1.30 MB (1367720) - RowsReturned: 212.35K (212352) - SerializeBatchTime: 97.711ms - TransmitDataRPCTime: 62.187ms - UncompressedRowBatchSize: 25.13 MB (26348172) SUBPLAN_NODE (id=1):(Total: 24s679ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.66 MB (14318440) - RowsReturned: 212.35K (212352) - RowsReturnedRate: 8.60 K/sec HASH_JOIN_NODE (id=6):(Total: 23s851ms, non-child: 23s733ms, % non-child: 99.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 231.212ms - BuildRows: 2.35M (2352677) - BuildRowsPartitioned: 2.35M (2352677) - BuildTime: 155.214ms - GetNewBlockTime: 2s686ms - HashBuckets: 4.17M (4166126) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.47M (1465936) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 245.42K (245419) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.306ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.665ms UNNEST_NODE (id=4):(Total: 30.737ms, non-child: 30.737ms, % non-child: 100.00%) - AvgCollectionSize: 25.68 - MaxCollectionSize: 2.17K (2167) - MinCollectionSize: 1 (1) - NumCollections: 91.62K (91621) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 32.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 161.335ms, non-child: 122.732ms, % non-child: 76.07%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 245.42K (245419) - ProbeTime: 0.000ns - RowsReturned: 930.48K (930480) - RowsReturnedRate: 5.77 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 38.602ms, non-child: 38.602ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 85 (85) - MinCollectionSize: 1 (1) - NumCollections: 91.62K (91621) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 25.00 /sec HDFS_SCAN_NODE (id=0):(Total: 896.003ms, non-child: 896.003ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 8:1/128.00 MB 9:2/256.00 MB 0:2/63.00 MB 7:1/32.66 MB 2:2/163.92 MB 1:1/128.00 MB 5:1/29.29 MB 3:1/128.00 MB 4:4/314.29 MB Hdfs Read Thread Concurrency Bucket: 0:92.45% 1:1.887% 2:1.887% 3:1.887% 4:0% 5:1.887% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 15.05 MB, 35.73 MB, 45.68 MB, 48.72 MB, 50.66 MB, 54.83 MB, 54.83 MB, 56.11 MB, 56.11 MB, 56.91 MB, 58.35 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB, 59.02 MB - AverageHdfsReadThreadConcurrency: 0.21 - AverageScannerThreadConcurrency: 1.09 - BytesRead: 59.02 MB (61888813) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.33 MB (61162830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.33 MB (61162830) - DecompressionTime: 186.177ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 831.74 MB (872137760) - PerReadThreadRawHdfsThroughput: 13.22 MB/sec - RemoteScanRanges: 7 (7) - RowsRead: 7.66M (7663406) - RowsReturned: 91.62K (91621) - RowsReturnedRate: 102.25 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 301 (301) - ScannerThreadsTotalWallClockTime: 29s512ms - MaterializeTupleTime(*): 1s671ms - ScannerThreadsSysTime: 500.026ms - ScannerThreadsUserTime: 1s436ms - ScannerThreadsVoluntaryContextSwitches: 611 (611) - TotalRawHdfsReadTime(*): 4s463ms - TotalReadThroughput: 2.19 MB/sec Instance b64a3852190d9ac2:412186998b9ee4de (host=dn6.hadoop.trivago.com:22000):(Total: 25s952ms, non-child: 222.234ms, % non-child: 0.86%) Hdfs split stats (:<# splits>/): 5:1/128.00 MB 3:2/68.22 MB 0:1/128.00 MB 10:1/128.00 MB 7:2/65.43 MB 4:2/60.39 MB 8:5/346.03 MB 9:3/285.35 MB MemoryUsage(500.000ms): 260.79 KB, 299.80 MB, 739.80 MB, 853.13 MB, 889.07 MB, 873.46 MB, 855.51 MB, 835.25 MB, 822.74 MB, 799.07 MB, 790.95 MB, 775.19 MB, 754.54 MB, 731.45 MB, 720.54 MB, 702.37 MB, 665.88 MB, 659.80 MB, 649.31 MB, 631.40 MB, 621.40 MB, 604.89 MB, 595.35 MB, 574.55 MB, 566.37 MB, 546.30 MB, 527.10 MB, 513.65 MB, 498.18 MB, 489.54 MB, 463.08 MB, 446.43 MB, 436.04 MB, 415.23 MB, 388.50 MB, 366.22 MB, 354.77 MB, 334.60 MB, 312.79 MB, 295.79 MB, 272.95 MB, 263.34 MB, 246.46 MB, 229.52 MB, 210.37 MB, 187.40 MB, 170.72 MB, 150.97 MB, 140.46 MB, 120.83 MB, 100.52 MB, 78.44 MB, 55.35 MB, 37.62 MB, 16.13 MB, 6.66 MB ThreadUsage(500.000ms): 1, 16, 9, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 891.32 MB (934612744) - PerHostPeakMemUsage: 939.40 MB (985035312) - PrepareTime: 186.362ms - RowsProduced: 210.06K (210055) - TotalCpuTime: 30s032ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 253.652ms - TotalStorageWaitTime: 15s043ms CodeGen:(Total: 412.840ms, non-child: 412.840ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 67.522ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 163.220ms - PrepareTime: 181.434ms DataStreamSender (dst_id=10):(Total: 179.960ms, non-child: 179.960ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9611118) - NetworkThroughput(*): 123.59 MB/sec - OverallThroughput: 50.93 MB/sec - PeakMemoryUsage: 1.30 MB (1359528) - RowsReturned: 210.06K (210055) - SerializeBatchTime: 105.436ms - TransmitDataRPCTime: 74.160ms - UncompressedRowBatchSize: 24.86 MB (26063140) SUBPLAN_NODE (id=1):(Total: 25s137ms, non-child: 52.180ms, % non-child: 0.21%) - PeakMemoryUsage: 14.77 MB (15482248) - RowsReturned: 210.06K (210055) - RowsReturnedRate: 8.36 K/sec HASH_JOIN_NODE (id=6):(Total: 24s375ms, non-child: 24s238ms, % non-child: 99.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 262.359ms - BuildRows: 2.31M (2313739) - BuildRowsPartitioned: 2.31M (2313739) - BuildTime: 173.110ms - GetNewBlockTime: 2s698ms - HashBuckets: 4.10M (4097347) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.43M (1425920) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 238.35K (238354) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.726ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.231ms UNNEST_NODE (id=4):(Total: 33.330ms, non-child: 33.330ms, % non-child: 100.00%) - AvgCollectionSize: 25.96 - MaxCollectionSize: 1.90K (1901) - MinCollectionSize: 1 (1) - NumCollections: 89.12K (89120) - PeakMemoryUsage: 0 - RowsReturned: 19 (19) - RowsReturnedRate: 570.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 185.508ms, non-child: 144.720ms, % non-child: 78.01%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 238.35K (238354) - ProbeTime: 0.000ns - RowsReturned: 908.81K (908806) - RowsReturnedRate: 4.90 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 40.788ms, non-child: 40.788ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 139 (139) - MinCollectionSize: 1 (1) - NumCollections: 89.12K (89120) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 24.00 /sec HDFS_SCAN_NODE (id=0):(Total: 709.625ms, non-child: 709.625ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 5:1/128.00 MB 3:2/68.22 MB 0:1/128.00 MB 10:1/128.00 MB 7:2/65.43 MB 4:2/60.39 MB 8:5/346.03 MB 9:3/285.35 MB Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:0% 2:3.704% 3:1.852% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(500.000ms): 0, 25.70 MB, 46.30 MB, 55.92 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB, 57.87 MB - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 0.52 - BytesRead: 57.87 MB (60680713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.51 MB (54016403) - BytesReadRemoteUnexpected: 5.87 MB (6152310) - BytesReadShortCircuit: 51.51 MB (54016403) - DecompressionTime: 177.797ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 880.73 MB (923511280) - PerReadThreadRawHdfsThroughput: 12.76 MB/sec - RemoteScanRanges: 29 (29) - RowsRead: 7.43M (7426713) - RowsReturned: 89.12K (89120) - RowsReturnedRate: 125.59 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 201 (201) - ScannerThreadsTotalWallClockTime: 17s106ms - MaterializeTupleTime(*): 1s353ms - ScannerThreadsSysTime: 376.016ms - ScannerThreadsUserTime: 1s268ms - ScannerThreadsVoluntaryContextSwitches: 683 (683) - TotalRawHdfsReadTime(*): 4s535ms - TotalReadThroughput: 2.10 MB/sec Instance b64a3852190d9ac2:412186998b9ee4eb (host=dn44.hadoop.trivago.com:22000):(Total: 25s889ms, non-child: 414.989ms, % non-child: 1.60%) Hdfs split stats (:<# splits>/): 2:1/33.05 MB 0:2/160.63 MB 6:1/128.00 MB 8:2/163.06 MB 4:1/128.00 MB 3:3/189.30 MB 5:4/413.71 MB MemoryUsage(500.000ms): 260.79 KB, 109.64 MB, 481.93 MB, 603.12 MB, 836.54 MB, 888.70 MB, 875.82 MB, 860.76 MB, 847.63 MB, 837.04 MB, 828.57 MB, 821.63 MB, 809.64 MB, 792.91 MB, 773.94 MB, 762.83 MB, 755.55 MB, 738.50 MB, 727.31 MB, 707.86 MB, 686.91 MB, 667.18 MB, 655.53 MB, 647.16 MB, 628.09 MB, 601.90 MB, 575.26 MB, 568.01 MB, 551.73 MB, 527.35 MB, 509.11 MB, 484.44 MB, 463.81 MB, 441.15 MB, 424.99 MB, 398.56 MB, 376.07 MB, 354.01 MB, 332.11 MB, 315.80 MB, 297.53 MB, 276.64 MB, 254.12 MB, 233.63 MB, 212.52 MB, 193.68 MB, 169.30 MB, 148.38 MB, 139.16 MB, 115.74 MB, 81.33 MB, 62.34 MB, 34.12 MB, 23.78 MB, 10.83 MB, 8.30 MB ThreadUsage(500.000ms): 1, 15, 15, 8, 7, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - PeakMemoryUsage: 894.25 MB (937685872) - PerHostPeakMemUsage: 942.32 MB (988090856) - PrepareTime: 195.206ms - RowsProduced: 211.67K (211667) - TotalCpuTime: 35s045ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 454.192ms - TotalStorageWaitTime: 16s441ms CodeGen:(Total: 404.263ms, non-child: 404.263ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 146.970ms - PrepareTime: 190.598ms DataStreamSender (dst_id=10):(Total: 166.506ms, non-child: 166.506ms, % non-child: 100.00%) - BytesSent: 9.19 MB (9641321) - NetworkThroughput(*): 146.15 MB/sec - OverallThroughput: 55.22 MB/sec - PeakMemoryUsage: 1.28 MB (1343144) - RowsReturned: 211.67K (211667) - SerializeBatchTime: 103.296ms - TransmitDataRPCTime: 62.913ms - UncompressedRowBatchSize: 25.05 MB (26263172) SUBPLAN_NODE (id=1):(Total: 24s903ms, non-child: 14.006ms, % non-child: 0.06%) - PeakMemoryUsage: 14.58 MB (15283080) - RowsReturned: 211.67K (211667) - RowsReturnedRate: 8.50 K/sec HASH_JOIN_NODE (id=6):(Total: 24s335ms, non-child: 24s214ms, % non-child: 99.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 247.109ms - BuildRows: 2.32M (2315348) - BuildRowsPartitioned: 2.32M (2315348) - BuildTime: 167.862ms - GetNewBlockTime: 2s810ms - HashBuckets: 4.10M (4097350) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.44M (1437088) - PeakMemoryUsage: 2.09 MB (2190464) - PinTime: 0.000ns - ProbeRows: 238.95K (238946) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.092ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 48.616ms UNNEST_NODE (id=4):(Total: 34.682ms, non-child: 34.682ms, % non-child: 100.00%) - AvgCollectionSize: 25.78 - MaxCollectionSize: 1.47K (1470) - MinCollectionSize: 1 (1) - NumCollections: 89.82K (89818) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 28.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 169.647ms, non-child: 128.718ms, % non-child: 75.87%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 238.95K (238946) - ProbeTime: 0.000ns - RowsReturned: 894.80K (894800) - RowsReturnedRate: 5.27 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 40.929ms, non-child: 40.929ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 109 (109) - MinCollectionSize: 1 (1) - NumCollections: 89.82K (89818) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 24.00 /sec HDFS_SCAN_NODE (id=0):(Total: 554.179ms, non-child: 554.179ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 2:1/33.05 MB 0:2/160.63 MB 6:1/128.00 MB 8:2/163.06 MB 4:1/128.00 MB 3:3/189.30 MB 5:4/413.71 MB Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:1.852% 2:1.852% 3:1.852% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 7.33 MB, 33.34 MB, 39.53 MB, 53.54 MB, 57.31 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB, 57.49 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 0.78 - BytesRead: 57.49 MB (60277842) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.19 MB (59970642) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.19 MB (59970642) - DecompressionTime: 185.460ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 881.13 MB (923934752) - PerReadThreadRawHdfsThroughput: 15.35 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.49M (7493996) - RowsReturned: 89.82K (89818) - RowsReturnedRate: 162.07 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 242 (242) - ScannerThreadsTotalWallClockTime: 23s914ms - MaterializeTupleTime(*): 1s584ms - ScannerThreadsSysTime: 404.018ms - ScannerThreadsUserTime: 1s464ms - ScannerThreadsVoluntaryContextSwitches: 687 (687) - TotalRawHdfsReadTime(*): 3s745ms - TotalReadThroughput: 2.09 MB/sec Instance b64a3852190d9ac2:412186998b9ee4ec (host=dn11.hadoop.trivago.com:22000):(Total: 24s100ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/128.00 MB 7:1/36.35 MB 2:3/192.38 MB 10:1/32.03 MB 9:2/159.82 MB 4:2/160.85 MB 3:2/158.55 MB 5:2/160.08 MB 0:1/28.77 MB 1:1/128.00 MB MemoryUsage(500.000ms): 260.79 KB, 502.66 MB, 815.38 MB, 857.67 MB, 851.43 MB, 843.83 MB, 829.29 MB, 820.44 MB, 802.92 MB, 789.24 MB, 770.02 MB, 760.77 MB, 753.34 MB, 726.98 MB, 718.48 MB, 698.50 MB, 676.36 MB, 658.89 MB, 640.11 MB, 633.04 MB, 620.75 MB, 599.45 MB, 583.52 MB, 561.75 MB, 530.31 MB, 519.19 MB, 497.68 MB, 473.00 MB, 466.60 MB, 439.77 MB, 425.31 MB, 416.37 MB, 396.94 MB, 381.16 MB, 353.74 MB, 330.27 MB, 307.78 MB, 290.13 MB, 269.73 MB, 246.43 MB, 225.87 MB, 205.96 MB, 185.01 MB, 164.62 MB, 144.72 MB, 128.00 MB, 99.48 MB, 85.67 MB, 66.67 MB, 49.40 MB, 27.75 MB, 7.67 MB ThreadUsage(500.000ms): 1, 13, 4, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 882.77 MB (925652864) - PerHostPeakMemUsage: 930.84 MB (976057848) - PrepareTime: 201.952ms - RowsProduced: 202.89K (202890) - TotalCpuTime: 27s991ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 42.716ms - TotalStorageWaitTime: 11s274ms CodeGen:(Total: 416.456ms, non-child: 416.456ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 153.083ms - PrepareTime: 180.733ms DataStreamSender (dst_id=10):(Total: 172.930ms, non-child: 172.930ms, % non-child: 100.00%) - BytesSent: 8.85 MB (9278109) - NetworkThroughput(*): 115.01 MB/sec - OverallThroughput: 51.17 MB/sec - PeakMemoryUsage: 1.27 MB (1334952) - RowsReturned: 202.89K (202890) - SerializeBatchTime: 95.713ms - TransmitDataRPCTime: 76.931ms - UncompressedRowBatchSize: 24.01 MB (25174200) SUBPLAN_NODE (id=1):(Total: 23s533ms, non-child: 12.024ms, % non-child: 0.05%) - PeakMemoryUsage: 14.71 MB (15424224) - RowsReturned: 202.89K (202890) - RowsReturnedRate: 8.62 K/sec HASH_JOIN_NODE (id=6):(Total: 22s975ms, non-child: 22s853ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 229.145ms - BuildRows: 2.26M (2263208) - BuildRowsPartitioned: 2.26M (2263208) - BuildTime: 158.904ms - GetNewBlockTime: 2s566ms - HashBuckets: 4.01M (4008487) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1405792) - PeakMemoryUsage: 2.10 MB (2204800) - PinTime: 0.000ns - ProbeRows: 235.54K (235545) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.666ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 43.975ms UNNEST_NODE (id=4):(Total: 30.185ms, non-child: 30.185ms, % non-child: 100.00%) - AvgCollectionSize: 25.76 - MaxCollectionSize: 1.52K (1519) - MinCollectionSize: 1 (1) - NumCollections: 87.86K (87862) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 33.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 169.599ms, non-child: 131.413ms, % non-child: 77.48%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.54K (235545) - ProbeTime: 0.000ns - RowsReturned: 904.13K (904131) - RowsReturnedRate: 5.33 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 38.185ms, non-child: 38.185ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 102 (102) - MinCollectionSize: 1 (1) - NumCollections: 87.86K (87862) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 26.00 /sec HDFS_SCAN_NODE (id=0):(Total: 545.303ms, non-child: 545.303ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 8:1/128.00 MB 7:1/36.35 MB 2:3/192.38 MB 10:1/32.03 MB 9:2/159.82 MB 4:2/160.85 MB 3:2/158.55 MB 5:2/160.08 MB 0:1/28.77 MB 1:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:96.08% 1:3.922% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:96 BytesRead(500.000ms): 0, 35.32 MB, 54.95 MB, 55.17 MB, 55.98 MB, 56.47 MB, 56.51 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB, 56.69 MB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 0.37 - BytesRead: 56.69 MB (59442838) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.30 MB (59033238) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.30 MB (59033238) - DecompressionTime: 173.578ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 11 (11) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 16 (16) - PeakMemoryUsage: 870.44 MB (912720920) - PerReadThreadRawHdfsThroughput: 16.44 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.32M (7315100) - RowsReturned: 87.86K (87862) - RowsReturnedRate: 161.12 K/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 194 (194) - ScannerThreadsTotalWallClockTime: 13s059ms - MaterializeTupleTime(*): 1s304ms - ScannerThreadsSysTime: 448.022ms - ScannerThreadsUserTime: 1s156ms - ScannerThreadsVoluntaryContextSwitches: 750 (750) - TotalRawHdfsReadTime(*): 3s448ms - TotalReadThroughput: 2.18 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e8 (host=dn3.hadoop.trivago.com:22000):(Total: 37s541ms, non-child: 1s675ms, % non-child: 4.46%) Hdfs split stats (:<# splits>/): 1:1/33.29 MB 2:2/68.83 MB 7:2/256.00 MB 4:1/32.23 MB 0:1/30.41 MB 5:3/292.13 MB 3:4/125.20 MB 8:1/29.48 MB 6:3/186.99 MB 9:2/157.16 MB MemoryUsage(1s000ms): 17.92 MB, 600.76 MB, 901.28 MB, 880.02 MB, 863.38 MB, 832.48 MB, 804.07 MB, 780.18 MB, 758.21 MB, 735.11 MB, 714.48 MB, 689.41 MB, 663.67 MB, 650.74 MB, 630.71 MB, 604.48 MB, 578.72 MB, 565.93 MB, 554.97 MB, 532.10 MB, 499.90 MB, 477.97 MB, 453.73 MB, 436.91 MB, 413.85 MB, 388.52 MB, 357.74 MB, 337.07 MB, 320.15 MB, 288.71 MB, 271.47 MB, 234.41 MB, 204.83 MB, 171.14 MB, 145.68 MB, 117.06 MB, 85.04 MB, 57.85 MB, 10.86 MB, 4.47 MB ThreadUsage(1s000ms): 11, 13, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.65 - BloomFilterBytes: 0 - PeakMemoryUsage: 906.31 MB (950330584) - PerHostPeakMemUsage: 954.41 MB (1000770736) - PrepareTime: 220.730ms - RowsProduced: 211.93K (211929) - TotalCpuTime: 42s697ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 890.943ms - TotalStorageWaitTime: 23s615ms CodeGen:(Total: 504.528ms, non-child: 504.528ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 85.309ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 203.669ms - PrepareTime: 214.787ms DataStreamSender (dst_id=10):(Total: 207.695ms, non-child: 207.695ms, % non-child: 100.00%) - BytesSent: 9.24 MB (9688293) - NetworkThroughput(*): 131.80 MB/sec - OverallThroughput: 44.49 MB/sec - PeakMemoryUsage: 1.19 MB (1253032) - RowsReturned: 211.93K (211929) - SerializeBatchTime: 137.189ms - TransmitDataRPCTime: 70.104ms - UncompressedRowBatchSize: 25.08 MB (26295672) SUBPLAN_NODE (id=1):(Total: 35s153ms, non-child: 121.021ms, % non-child: 0.34%) - PeakMemoryUsage: 14.72 MB (15433824) - RowsReturned: 211.93K (211929) - RowsReturnedRate: 6.03 K/sec HASH_JOIN_NODE (id=6):(Total: 34s279ms, non-child: 34s038ms, % non-child: 99.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 358.026ms - BuildRows: 2.34M (2336862) - BuildRowsPartitioned: 2.34M (2336862) - BuildTime: 272.130ms - GetNewBlockTime: 3s889ms - HashBuckets: 4.14M (4138605) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.45M (1445968) - PeakMemoryUsage: 2.10 MB (2202752) - PinTime: 0.000ns - ProbeRows: 242.38K (242381) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 85.526ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 61.052ms UNNEST_NODE (id=4):(Total: 44.750ms, non-child: 44.750ms, % non-child: 100.00%) - AvgCollectionSize: 25.86 - MaxCollectionSize: 1.62K (1620) - MinCollectionSize: 1 (1) - NumCollections: 90.37K (90373) - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 335.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 302.038ms, non-child: 246.128ms, % non-child: 81.49%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 242.38K (242381) - ProbeTime: 0.000ns - RowsReturned: 945.09K (945090) - RowsReturnedRate: 3.13 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 55.910ms, non-child: 55.910ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 190 (190) - MinCollectionSize: 1 (1) - NumCollections: 90.37K (90373) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 35.00 /sec HDFS_SCAN_NODE (id=0):(Total: 752.723ms, non-child: 752.723ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 20 Hdfs split stats (:<# splits>/): 1:1/33.29 MB 2:2/68.83 MB 7:2/256.00 MB 4:1/32.23 MB 0:1/30.41 MB 5:3/292.13 MB 3:4/125.20 MB 8:1/29.48 MB 6:3/186.99 MB 9:2/157.16 MB Hdfs Read Thread Concurrency Bucket: 0:96.05% 1:2.632% 2:0% 3:0% 4:0% 5:1.316% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:120 BytesRead(1s000ms): 6.09 MB, 40.76 MB, 57.63 MB, 57.80 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB, 58.12 MB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 0.70 - BytesRead: 58.12 MB (60940601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 52.04 MB (54570189) - BytesReadRemoteUnexpected: 5.78 MB (6063212) - BytesReadShortCircuit: 52.04 MB (54570189) - DecompressionTime: 175.902ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 11 (11) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 20 (20) - PeakMemoryUsage: 894.59 MB (938050288) - PerReadThreadRawHdfsThroughput: 9.98 MB/sec - RemoteScanRanges: 27 (27) - RowsRead: 7.43M (7430894) - RowsReturned: 90.37K (90373) - RowsReturnedRate: 120.06 K/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 245 (245) - ScannerThreadsTotalWallClockTime: 26s586ms - MaterializeTupleTime(*): 1s489ms - ScannerThreadsSysTime: 448.021ms - ScannerThreadsUserTime: 1s348ms - ScannerThreadsVoluntaryContextSwitches: 898 (898) - TotalRawHdfsReadTime(*): 5s823ms - TotalReadThroughput: 1.51 MB/sec Instance b64a3852190d9ac2:412186998b9ee4fb (host=dn43.hadoop.trivago.com:22000):(Total: 28s887ms, non-child: 424.001ms, % non-child: 1.47%) Hdfs split stats (:<# splits>/): 6:1/128.00 MB 4:1/128.00 MB 9:3/288.62 MB 3:1/31.85 MB 5:1/31.59 MB 1:1/32.66 MB 0:2/256.00 MB 8:3/286.53 MB MemoryUsage(500.000ms): 2.79 MB, 307.57 MB, 766.56 MB, 848.21 MB, 842.47 MB, 847.98 MB, 827.81 MB, 819.00 MB, 796.46 MB, 782.95 MB, 757.73 MB, 745.49 MB, 726.80 MB, 703.57 MB, 693.79 MB, 682.95 MB, 672.61 MB, 664.02 MB, 643.94 MB, 636.55 MB, 609.59 MB, 601.50 MB, 586.06 MB, 575.29 MB, 564.15 MB, 544.83 MB, 535.09 MB, 526.94 MB, 519.46 MB, 510.36 MB, 489.84 MB, 481.34 MB, 464.68 MB, 441.81 MB, 432.13 MB, 411.99 MB, 403.34 MB, 391.48 MB, 374.71 MB, 365.43 MB, 355.14 MB, 334.23 MB, 323.14 MB, 297.55 MB, 278.86 MB, 261.10 MB, 237.93 MB, 218.61 MB, 204.26 MB, 196.52 MB, 176.31 MB, 164.17 MB, 147.25 MB, 135.21 MB, 117.28 MB, 108.52 MB, 101.96 MB, 75.12 MB, 57.13 MB, 36.33 MB, 20.17 MB, 6.13 MB ThreadUsage(500.000ms): 14, 13, 6, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 861.31 MB (903145992) - PerHostPeakMemUsage: 909.43 MB (953603728) - PrepareTime: 202.228ms - RowsProduced: 198.57K (198574) - TotalCpuTime: 33s151ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 240.773ms - TotalStorageWaitTime: 10s779ms CodeGen:(Total: 424.573ms, non-child: 424.573ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 62.022ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 165.232ms - PrepareTime: 196.630ms DataStreamSender (dst_id=10):(Total: 177.686ms, non-child: 177.686ms, % non-child: 100.00%) - BytesSent: 8.65 MB (9068825) - NetworkThroughput(*): 143.38 MB/sec - OverallThroughput: 48.67 MB/sec - PeakMemoryUsage: 1.23 MB (1293992) - RowsReturned: 198.57K (198574) - SerializeBatchTime: 117.026ms - TransmitDataRPCTime: 60.320ms - UncompressedRowBatchSize: 23.50 MB (24638656) SUBPLAN_NODE (id=1):(Total: 27s861ms, non-child: 43.866ms, % non-child: 0.16%) - PeakMemoryUsage: 13.93 MB (14611408) - RowsReturned: 198.57K (198574) - RowsReturnedRate: 7.13 K/sec HASH_JOIN_NODE (id=6):(Total: 27s229ms, non-child: 27s078ms, % non-child: 99.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 296.084ms - BuildRows: 2.20M (2196374) - BuildRowsPartitioned: 2.20M (2196374) - BuildTime: 194.006ms - GetNewBlockTime: 3s095ms - HashBuckets: 3.88M (3884913) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.38M (1376416) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 228.99K (228985) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 55.410ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 55.723ms UNNEST_NODE (id=4):(Total: 40.430ms, non-child: 40.430ms, % non-child: 100.00%) - AvgCollectionSize: 25.53 - MaxCollectionSize: 1.93K (1929) - MinCollectionSize: 1 (1) - NumCollections: 86.03K (86026) - PeakMemoryUsage: 0 - RowsReturned: 22 (22) - RowsReturnedRate: 544.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 198.778ms, non-child: 152.943ms, % non-child: 76.94%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 228.99K (228985) - ProbeTime: 0.000ns - RowsReturned: 863.40K (863396) - RowsReturnedRate: 4.34 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 45.835ms, non-child: 45.835ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 120 (120) - MinCollectionSize: 1 (1) - NumCollections: 86.03K (86026) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 65.00 /sec HDFS_SCAN_NODE (id=0):(Total: 587.547ms, non-child: 587.547ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 6:1/128.00 MB 4:1/128.00 MB 9:3/288.62 MB 3:1/31.85 MB 5:1/31.59 MB 1:1/32.66 MB 0:2/256.00 MB 8:3/286.53 MB Hdfs Read Thread Concurrency Bucket: 0:96.72% 1:0% 2:0% 3:1.639% 4:0% 5:0% 6:1.639% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 0, 27.90 MB, 48.77 MB, 54.97 MB, 55.58 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB, 55.80 MB - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 0.54 - BytesRead: 55.80 MB (58513951) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.22 MB (57899551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.22 MB (57899551) - DecompressionTime: 179.978ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 848.69 MB (889918344) - PerReadThreadRawHdfsThroughput: 12.66 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.25M (7246679) - RowsReturned: 86.03K (86026) - RowsReturnedRate: 146.41 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 182 (182) - ScannerThreadsTotalWallClockTime: 12s835ms - MaterializeTupleTime(*): 1s265ms - ScannerThreadsSysTime: 448.024ms - ScannerThreadsUserTime: 1s140ms - ScannerThreadsVoluntaryContextSwitches: 664 (664) - TotalRawHdfsReadTime(*): 4s409ms - TotalReadThroughput: 1.83 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f1 (host=dn4.hadoop.trivago.com:22000):(Total: 32s860ms, non-child: 670.344ms, % non-child: 2.04%) Hdfs split stats (:<# splits>/): 9:1/33.38 MB 8:1/32.99 MB 0:4/225.50 MB 4:1/32.70 MB 5:4/229.90 MB 1:1/30.59 MB 6:3/285.74 MB 3:1/128.00 MB 7:1/128.00 MB MemoryUsage(1s000ms): 130.39 KB, 499.46 MB, 837.87 MB, 802.36 MB, 784.66 MB, 757.82 MB, 727.30 MB, 700.03 MB, 677.24 MB, 659.24 MB, 639.41 MB, 621.90 MB, 594.38 MB, 575.60 MB, 555.41 MB, 537.71 MB, 516.29 MB, 489.11 MB, 453.51 MB, 438.05 MB, 409.45 MB, 385.21 MB, 355.09 MB, 329.90 MB, 304.79 MB, 281.93 MB, 257.07 MB, 228.58 MB, 199.17 MB, 170.89 MB, 146.99 MB, 120.00 MB, 91.53 MB, 57.38 MB, 23.39 MB, 5.50 MB ThreadUsage(1s000ms): 1, 12, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 844.67 MB (885704016) - PerHostPeakMemUsage: 892.74 MB (936103544) - PrepareTime: 241.895ms - RowsProduced: 192.42K (192421) - TotalCpuTime: 37s072ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 773.102ms - TotalStorageWaitTime: 12s861ms CodeGen:(Total: 539.315ms, non-child: 539.315ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 90.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 212.715ms - PrepareTime: 235.568ms DataStreamSender (dst_id=10):(Total: 187.320ms, non-child: 187.320ms, % non-child: 100.00%) - BytesSent: 8.40 MB (8806788) - NetworkThroughput(*): 130.24 MB/sec - OverallThroughput: 44.84 MB/sec - PeakMemoryUsage: 1.18 MB (1236648) - RowsReturned: 192.42K (192421) - SerializeBatchTime: 122.473ms - TransmitDataRPCTime: 64.488ms - UncompressedRowBatchSize: 22.77 MB (23875216) SUBPLAN_NODE (id=1):(Total: 31s463ms, non-child: 47.767ms, % non-child: 0.15%) - PeakMemoryUsage: 13.64 MB (14299112) - RowsReturned: 192.42K (192421) - RowsReturnedRate: 6.12 K/sec HASH_JOIN_NODE (id=6):(Total: 30s708ms, non-child: 30s511ms, % non-child: 99.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 333.512ms - BuildRows: 2.12M (2124118) - BuildRowsPartitioned: 2.12M (2124118) - BuildTime: 249.355ms - GetNewBlockTime: 3s273ms - HashBuckets: 3.77M (3768465) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.32M (1316176) - PeakMemoryUsage: 2.11 MB (2217088) - PinTime: 0.000ns - ProbeRows: 220.37K (220368) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 69.581ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 54.026ms UNNEST_NODE (id=4):(Total: 42.147ms, non-child: 42.147ms, % non-child: 100.00%) - AvgCollectionSize: 25.82 - MaxCollectionSize: 2.19K (2192) - MinCollectionSize: 1 (1) - NumCollections: 82.26K (82261) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 47.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 261.974ms, non-child: 215.658ms, % non-child: 82.32%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 220.37K (220368) - ProbeTime: 0.000ns - RowsReturned: 844.34K (844335) - RowsReturnedRate: 3.22 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 46.316ms, non-child: 46.316ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 119 (119) - MinCollectionSize: 1 (1) - NumCollections: 82.26K (82261) - PeakMemoryUsage: 0 - RowsReturned: 12 (12) - RowsReturnedRate: 259.00 /sec HDFS_SCAN_NODE (id=0):(Total: 707.719ms, non-child: 707.719ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 9:1/33.38 MB 8:1/32.99 MB 0:4/225.50 MB 4:1/32.70 MB 5:4/229.90 MB 1:1/30.59 MB 6:3/285.74 MB 3:1/128.00 MB 7:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:95.59% 1:1.471% 2:0% 3:0% 4:1.471% 5:0% 6:1.471% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(1s000ms): 11.50 MB, 51.52 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB, 54.20 MB - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 0.34 - BytesRead: 54.20 MB (56837364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.91 MB (56530164) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.91 MB (56530164) - DecompressionTime: 157.904ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 830.53 MB (870868832) - PerReadThreadRawHdfsThroughput: 10.95 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 6.93M (6926390) - RowsReturned: 82.26K (82261) - RowsReturnedRate: 116.23 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 245 (245) - ScannerThreadsTotalWallClockTime: 15s030ms - MaterializeTupleTime(*): 1s448ms - ScannerThreadsSysTime: 448.022ms - ScannerThreadsUserTime: 1s260ms - ScannerThreadsVoluntaryContextSwitches: 728 (728) - TotalRawHdfsReadTime(*): 4s949ms - TotalReadThroughput: 1.57 MB/sec Instance b64a3852190d9ac2:412186998b9ee4df (host=dn17.hadoop.trivago.com:22000):(Total: 25s835ms, non-child: 253.898ms, % non-child: 0.98%) Hdfs split stats (:<# splits>/): 9:1/128.00 MB 2:1/128.00 MB 10:1/32.80 MB 1:2/66.49 MB 5:2/156.93 MB 6:1/128.00 MB 3:2/256.00 MB 0:5/258.56 MB MemoryUsage(500.000ms): 0, 22.22 MB, 577.08 MB, 660.20 MB, 666.50 MB, 660.14 MB, 650.90 MB, 664.60 MB, 646.35 MB, 635.75 MB, 728.04 MB, 784.84 MB, 776.69 MB, 765.35 MB, 744.27 MB, 731.72 MB, 710.97 MB, 700.73 MB, 680.68 MB, 673.28 MB, 645.50 MB, 635.37 MB, 616.46 MB, 596.21 MB, 580.86 MB, 575.23 MB, 567.35 MB, 554.04 MB, 555.12 MB, 533.16 MB, 513.69 MB, 493.29 MB, 487.10 MB, 463.22 MB, 445.69 MB, 423.50 MB, 401.51 MB, 385.74 MB, 369.33 MB, 343.96 MB, 326.45 MB, 309.83 MB, 276.19 MB, 252.95 MB, 229.21 MB, 212.25 MB, 196.73 MB, 165.80 MB, 143.19 MB, 114.67 MB, 95.12 MB, 85.09 MB, 65.39 MB, 46.97 MB, 21.26 MB, 1008.79 KB, 420.79 KB ThreadUsage(500.000ms): 1, 16, 13, 9, 6, 6, 6, 5, 5, 5, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 791.50 MB (829947440) - PerHostPeakMemUsage: 839.65 MB (880436968) - PrepareTime: 262.510ms - RowsProduced: 189.51K (189507) - TotalCpuTime: 30s519ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 671.057ms - TotalStorageWaitTime: 28s179ms CodeGen:(Total: 570.395ms, non-child: 570.395ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 85.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 227.275ms - PrepareTime: 257.018ms DataStreamSender (dst_id=10):(Total: 157.863ms, non-child: 157.863ms, % non-child: 100.00%) - BytesSent: 8.29 MB (8690641) - NetworkThroughput(*): 126.62 MB/sec - OverallThroughput: 52.50 MB/sec - PeakMemoryUsage: 1.16 MB (1220264) - RowsReturned: 189.51K (189507) - SerializeBatchTime: 92.122ms - TransmitDataRPCTime: 65.454ms - UncompressedRowBatchSize: 22.42 MB (23513664) SUBPLAN_NODE (id=1):(Total: 24s853ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.87 MB (14543680) - RowsReturned: 189.51K (189507) - RowsReturnedRate: 7.62 K/sec HASH_JOIN_NODE (id=6):(Total: 24s020ms, non-child: 23s892ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 238.624ms - BuildRows: 2.13M (2133395) - BuildRowsPartitioned: 2.13M (2133395) - BuildTime: 165.057ms - GetNewBlockTime: 2s789ms - HashBuckets: 3.77M (3769650) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.35M (1350560) - PeakMemoryUsage: 2.13 MB (2229376) - PinTime: 0.000ns - ProbeRows: 225.90K (225904) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.544ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 42.313ms UNNEST_NODE (id=4):(Total: 29.825ms, non-child: 29.825ms, % non-child: 100.00%) - AvgCollectionSize: 25.27 - MaxCollectionSize: 2.48K (2478) - MinCollectionSize: 1 (1) - NumCollections: 84.41K (84410) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 67.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 168.855ms, non-child: 134.426ms, % non-child: 79.61%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 225.90K (225904) - ProbeTime: 0.000ns - RowsReturned: 872.22K (872222) - RowsReturnedRate: 5.17 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 34.428ms, non-child: 34.428ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 188 (188) - MinCollectionSize: 1 (1) - NumCollections: 84.41K (84410) - PeakMemoryUsage: 0 - RowsReturned: 6 (6) - RowsReturnedRate: 174.00 /sec HDFS_SCAN_NODE (id=0):(Total: 871.544ms, non-child: 871.544ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 9:1/128.00 MB 2:1/128.00 MB 10:1/32.80 MB 1:2/66.49 MB 5:2/156.93 MB 6:1/128.00 MB 3:2/256.00 MB 0:5/258.56 MB Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:1.852% 2:0% 3:0% 4:1.852% 5:1.852% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 4.90 MB, 38.36 MB, 42.60 MB, 42.79 MB, 44.16 MB, 44.16 MB, 44.53 MB, 44.53 MB, 45.48 MB, 52.08 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB, 54.75 MB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 1.20 - BytesRead: 54.75 MB (57404870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.35 MB (56995270) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.35 MB (56995270) - DecompressionTime: 161.994ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 779.24 MB (817087368) - PerReadThreadRawHdfsThroughput: 19.62 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.08M (7077690) - RowsReturned: 84.41K (84410) - RowsReturnedRate: 96.85 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 324 (324) - ScannerThreadsTotalWallClockTime: 30s520ms - MaterializeTupleTime(*): 1s525ms - ScannerThreadsSysTime: 384.019ms - ScannerThreadsUserTime: 1s316ms - ScannerThreadsVoluntaryContextSwitches: 634 (634) - TotalRawHdfsReadTime(*): 2s790ms - TotalReadThroughput: 2.03 MB/sec Instance b64a3852190d9ac2:412186998b9ee4fe (host=dn33.hadoop.trivago.com:22000):(Total: 27s631ms, non-child: 345.766ms, % non-child: 1.25%) Hdfs split stats (:<# splits>/): 2:1/128.00 MB 6:2/160.42 MB 9:3/289.40 MB 7:1/128.00 MB 4:1/30.72 MB 0:2/156.80 MB 1:2/160.68 MB 5:1/128.00 MB MemoryUsage(500.000ms): 0, 2.79 MB, 497.88 MB, 501.45 MB, 623.75 MB, 706.46 MB, 733.37 MB, 803.31 MB, 794.72 MB, 788.36 MB, 768.18 MB, 769.27 MB, 747.44 MB, 736.44 MB, 727.31 MB, 717.68 MB, 706.79 MB, 698.69 MB, 678.05 MB, 659.78 MB, 648.82 MB, 642.03 MB, 632.46 MB, 624.70 MB, 604.01 MB, 597.45 MB, 588.92 MB, 578.45 MB, 563.03 MB, 549.25 MB, 524.17 MB, 516.97 MB, 494.64 MB, 481.20 MB, 462.80 MB, 449.15 MB, 428.84 MB, 416.60 MB, 405.81 MB, 381.82 MB, 362.68 MB, 341.14 MB, 330.43 MB, 305.14 MB, 287.05 MB, 278.44 MB, 255.52 MB, 236.36 MB, 209.35 MB, 189.64 MB, 168.86 MB, 141.27 MB, 121.81 MB, 102.71 MB, 88.16 MB, 65.94 MB, 41.89 MB, 25.89 MB, 17.01 MB, 6.97 MB ThreadUsage(500.000ms): 1, 14, 9, 9, 7, 7, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - PeakMemoryUsage: 805.17 MB (844278168) - PerHostPeakMemUsage: 853.27 MB (894718320) - PrepareTime: 252.149ms - RowsProduced: 190.06K (190057) - TotalCpuTime: 31s260ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 468.590ms - TotalStorageWaitTime: 18s143ms CodeGen:(Total: 497.560ms, non-child: 497.560ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 75.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 177.527ms - PrepareTime: 211.793ms DataStreamSender (dst_id=10):(Total: 157.304ms, non-child: 157.304ms, % non-child: 100.00%) - BytesSent: 8.32 MB (8721484) - NetworkThroughput(*): 147.68 MB/sec - OverallThroughput: 52.87 MB/sec - PeakMemoryUsage: 1.25 MB (1310376) - RowsReturned: 190.06K (190057) - SerializeBatchTime: 100.665ms - TransmitDataRPCTime: 56.319ms - UncompressedRowBatchSize: 22.49 MB (23581888) SUBPLAN_NODE (id=1):(Total: 26s630ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 15.12 MB (15858688) - RowsReturned: 190.06K (190057) - RowsReturnedRate: 7.14 K/sec HASH_JOIN_NODE (id=6):(Total: 25s984ms, non-child: 25s848ms, % non-child: 99.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 252.089ms - BuildRows: 2.14M (2141132) - BuildRowsPartitioned: 2.14M (2141132) - BuildTime: 164.057ms - GetNewBlockTime: 2s889ms - HashBuckets: 3.78M (3779366) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.37M (1374832) - PeakMemoryUsage: 2.11 MB (2212992) - PinTime: 0.000ns - ProbeRows: 228.47K (228469) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.403ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 50.772ms UNNEST_NODE (id=4):(Total: 35.122ms, non-child: 35.122ms, % non-child: 100.00%) - AvgCollectionSize: 24.92 - MaxCollectionSize: 2.23K (2233) - MinCollectionSize: 1 (1) - NumCollections: 85.93K (85927) - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 1.48 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 183.858ms, non-child: 140.580ms, % non-child: 76.46%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 228.47K (228469) - ProbeTime: 0.000ns - RowsReturned: 864.20K (864204) - RowsReturnedRate: 4.70 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 43.277ms, non-child: 43.277ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 79 (79) - MinCollectionSize: 1 (1) - NumCollections: 85.93K (85927) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 46.00 /sec HDFS_SCAN_NODE (id=0):(Total: 669.062ms, non-child: 669.062ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 2:1/128.00 MB 6:2/160.42 MB 9:3/289.40 MB 7:1/128.00 MB 4:1/30.72 MB 0:2/156.80 MB 1:2/160.68 MB 5:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:93.1% 1:3.448% 2:0% 3:0% 4:1.724% 5:1.724% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 0, 31.45 MB, 31.93 MB, 43.81 MB, 47.33 MB, 49.86 MB, 55.09 MB, 55.44 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB, 55.60 MB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 0.78 - BytesRead: 55.60 MB (58303656) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.02 MB (57689256) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.02 MB (57689256) - DecompressionTime: 172.033ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 792.72 MB (831225392) - PerReadThreadRawHdfsThroughput: 7.55 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.18M (7176470) - RowsReturned: 85.93K (85927) - RowsReturnedRate: 128.43 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 185 (185) - ScannerThreadsTotalWallClockTime: 19s982ms - MaterializeTupleTime(*): 1s303ms - ScannerThreadsSysTime: 472.023ms - ScannerThreadsUserTime: 1s140ms - ScannerThreadsVoluntaryContextSwitches: 568 (568) - TotalRawHdfsReadTime(*): 7s361ms - TotalReadThroughput: 1.92 MB/sec Instance b64a3852190d9ac2:412186998b9ee4fc (host=dn39.hadoop.trivago.com:22000):(Total: 22s687ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/34.79 MB 10:1/128.00 MB 5:1/128.00 MB 1:1/33.59 MB 4:4/322.26 MB 7:3/289.39 MB 9:2/160.62 MB 6:2/62.98 MB MemoryUsage(500.000ms): 0, 6.29 MB, 211.49 MB, 352.34 MB, 722.22 MB, 852.14 MB, 840.22 MB, 845.36 MB, 829.18 MB, 821.30 MB, 808.33 MB, 790.80 MB, 781.56 MB, 768.62 MB, 746.71 MB, 737.92 MB, 718.28 MB, 697.50 MB, 677.29 MB, 656.25 MB, 636.82 MB, 612.51 MB, 592.14 MB, 571.31 MB, 564.08 MB, 546.10 MB, 539.06 MB, 507.55 MB, 491.82 MB, 469.89 MB, 449.63 MB, 419.93 MB, 390.58 MB, 364.95 MB, 347.85 MB, 329.68 MB, 314.21 MB, 279.61 MB, 262.32 MB, 242.33 MB, 213.41 MB, 174.24 MB, 156.98 MB, 137.61 MB, 113.41 MB, 84.71 MB, 62.68 MB, 45.89 MB, 28.55 MB ThreadUsage(500.000ms): 1, 16, 13, 12, 6, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 0 - PeakMemoryUsage: 855.41 MB (896959792) - PerHostPeakMemUsage: 903.53 MB (947417528) - PrepareTime: 261.533ms - RowsProduced: 193.02K (193022) - TotalCpuTime: 28s171ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 112.302ms - TotalStorageWaitTime: 18s850ms CodeGen:(Total: 556.308ms, non-child: 556.308ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 75.942ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 224.918ms - PrepareTime: 254.761ms DataStreamSender (dst_id=10):(Total: 146.020ms, non-child: 146.020ms, % non-child: 100.00%) - BytesSent: 8.40 MB (8803512) - NetworkThroughput(*): 149.00 MB/sec - OverallThroughput: 57.50 MB/sec - PeakMemoryUsage: 1.34 MB (1408680) - RowsReturned: 193.02K (193022) - SerializeBatchTime: 89.418ms - TransmitDataRPCTime: 56.348ms - UncompressedRowBatchSize: 22.84 MB (23949812) SUBPLAN_NODE (id=1):(Total: 22s284ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 15.12 MB (15858920) - RowsReturned: 193.02K (193022) - RowsReturnedRate: 8.66 K/sec HASH_JOIN_NODE (id=6):(Total: 21s502ms, non-child: 21s384ms, % non-child: 99.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 202.633ms - BuildRows: 2.14M (2144784) - BuildRowsPartitioned: 2.14M (2144784) - BuildTime: 150.415ms - GetNewBlockTime: 2s467ms - HashBuckets: 3.79M (3793756) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.34M (1343440) - PeakMemoryUsage: 2.09 MB (2194560) - PinTime: 0.000ns - ProbeRows: 224.42K (224417) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.064ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 43.168ms UNNEST_NODE (id=4):(Total: 28.314ms, non-child: 28.314ms, % non-child: 100.00%) - AvgCollectionSize: 25.54 - MaxCollectionSize: 1.39K (1394) - MinCollectionSize: 1 (1) - NumCollections: 83.97K (83965) - PeakMemoryUsage: 0 - RowsReturned: 19 (19) - RowsReturnedRate: 671.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 155.182ms, non-child: 119.628ms, % non-child: 77.09%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 224.42K (224417) - ProbeTime: 0.000ns - RowsReturned: 849.37K (849370) - RowsReturnedRate: 5.47 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 35.553ms, non-child: 35.553ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 86 (86) - MinCollectionSize: 1 (1) - NumCollections: 83.97K (83965) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 84.00 /sec HDFS_SCAN_NODE (id=0):(Total: 855.147ms, non-child: 855.147ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 0:1/34.79 MB 10:1/128.00 MB 5:1/128.00 MB 1:1/33.59 MB 4:4/322.26 MB 7:3/289.39 MB 9:2/160.62 MB 6:2/62.98 MB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:2.083% 2:0% 3:2.083% 4:0% 5:0% 6:0% 7:0% 8:2.083% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 1.33 MB, 20.19 MB, 29.46 MB, 50.40 MB, 54.26 MB, 54.45 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 55.44 MB (58137272) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.95 MB (57615164) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.95 MB (57615164) - DecompressionTime: 174.912ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 844.94 MB (885982544) - PerReadThreadRawHdfsThroughput: 10.88 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.16M (7160540) - RowsReturned: 83.97K (83965) - RowsReturnedRate: 98.19 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 307 (307) - ScannerThreadsTotalWallClockTime: 22s404ms - MaterializeTupleTime(*): 1s704ms - ScannerThreadsSysTime: 452.023ms - ScannerThreadsUserTime: 1s408ms - ScannerThreadsVoluntaryContextSwitches: 560 (560) - TotalRawHdfsReadTime(*): 5s093ms - TotalReadThroughput: 2.31 MB/sec Instance b64a3852190d9ac2:412186998b9ee4fd (host=dn23.hadoop.trivago.com:22000):(Total: 27s627ms, non-child: 430.957ms, % non-child: 1.56%) Hdfs split stats (:<# splits>/): 2:1/32.56 MB 5:1/35.43 MB 0:1/31.09 MB 3:3/192.43 MB 10:3/288.70 MB 1:3/95.27 MB 4:2/158.53 MB 6:2/157.87 MB 7:2/256.00 MB MemoryUsage(500.000ms): 0, 5.02 MB, 664.17 MB, 782.06 MB, 792.74 MB, 805.47 MB, 808.32 MB, 853.37 MB, 848.82 MB, 832.55 MB, 814.72 MB, 793.97 MB, 778.93 MB, 756.58 MB, 739.73 MB, 720.19 MB, 708.24 MB, 685.37 MB, 666.21 MB, 642.68 MB, 621.01 MB, 599.69 MB, 593.12 MB, 569.35 MB, 548.85 MB, 516.85 MB, 493.99 MB, 481.82 MB, 461.49 MB, 453.62 MB, 434.43 MB, 422.08 MB, 411.45 MB, 392.20 MB, 372.92 MB, 353.11 MB, 336.68 MB, 315.73 MB, 306.90 MB, 286.14 MB, 273.85 MB, 264.24 MB, 256.07 MB, 237.15 MB, 220.53 MB, 208.55 MB, 191.56 MB, 176.23 MB, 158.82 MB, 142.61 MB, 130.10 MB, 115.67 MB, 109.27 MB, 89.43 MB, 69.21 MB, 59.83 MB, 40.24 MB, 30.76 MB, 7.03 MB, 4.90 MB ThreadUsage(500.000ms): 1, 19, 14, 7, 6, 5, 4, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 858.85 MB (900567768) - PerHostPeakMemUsage: 906.90 MB (950955168) - PrepareTime: 301.706ms - RowsProduced: 213.89K (213893) - TotalCpuTime: 32s352ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 180.264ms - TotalStorageWaitTime: 19s904ms CodeGen:(Total: 563.775ms, non-child: 563.775ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 84.808ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 182.462ms - PrepareTime: 208.157ms DataStreamSender (dst_id=10):(Total: 167.221ms, non-child: 167.221ms, % non-child: 100.00%) - BytesSent: 9.34 MB (9790019) - NetworkThroughput(*): 149.41 MB/sec - OverallThroughput: 55.83 MB/sec - PeakMemoryUsage: 1.27 MB (1334952) - RowsReturned: 213.89K (213893) - SerializeBatchTime: 104.412ms - TransmitDataRPCTime: 62.489ms - UncompressedRowBatchSize: 25.31 MB (26539412) SUBPLAN_NODE (id=1):(Total: 26s465ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.19 MB (13835304) - RowsReturned: 213.89K (213893) - RowsReturnedRate: 8.08 K/sec HASH_JOIN_NODE (id=6):(Total: 25s772ms, non-child: 25s640ms, % non-child: 99.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 251.408ms - BuildRows: 2.35M (2352706) - BuildRowsPartitioned: 2.35M (2352706) - BuildTime: 169.626ms - GetNewBlockTime: 2s911ms - HashBuckets: 4.16M (4158791) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.48M (1481248) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 247.86K (247857) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.149ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 49.155ms UNNEST_NODE (id=4):(Total: 32.709ms, non-child: 32.709ms, % non-child: 100.00%) - AvgCollectionSize: 25.41 - MaxCollectionSize: 2.12K (2123) - MinCollectionSize: 1 (1) - NumCollections: 92.58K (92578) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 30.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 181.362ms, non-child: 141.372ms, % non-child: 77.95%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 247.86K (247857) - ProbeTime: 0.000ns - RowsReturned: 941.26K (941258) - RowsReturnedRate: 5.19 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.989ms, non-child: 39.989ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 89 (89) - MinCollectionSize: 1 (1) - NumCollections: 92.58K (92578) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 25.00 /sec HDFS_SCAN_NODE (id=0):(Total: 766.498ms, non-child: 766.498ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 2:1/32.56 MB 5:1/35.43 MB 0:1/31.09 MB 3:3/192.43 MB 10:3/288.70 MB 1:3/95.27 MB 4:2/158.53 MB 6:2/157.87 MB 7:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:94.83% 1:1.724% 2:3.448% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:108 BytesRead(500.000ms): 1010.39 KB, 44.94 MB, 50.03 MB, 53.30 MB, 54.86 MB, 56.23 MB, 58.60 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB, 59.45 MB - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 0.90 - BytesRead: 59.45 MB (62336430) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.96 MB (61824430) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.96 MB (61824430) - DecompressionTime: 192.043ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 18 (18) - PeakMemoryUsage: 846.38 MB (887489344) - PerReadThreadRawHdfsThroughput: 19.63 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.59M (7594955) - RowsReturned: 92.58K (92578) - RowsReturnedRate: 120.78 K/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 213 (213) - ScannerThreadsTotalWallClockTime: 22s499ms - MaterializeTupleTime(*): 1s371ms - ScannerThreadsSysTime: 484.021ms - ScannerThreadsUserTime: 1s220ms - ScannerThreadsVoluntaryContextSwitches: 694 (694) - TotalRawHdfsReadTime(*): 3s027ms - TotalReadThroughput: 2.05 MB/sec Instance b64a3852190d9ac2:412186998b9ee4d8 (host=dn45.hadoop.trivago.com:22000):(Total: 32s217ms, non-child: 672.083ms, % non-child: 2.09%) Hdfs split stats (:<# splits>/): 9:1/128.00 MB 2:1/32.61 MB 3:1/128.00 MB 5:1/31.23 MB 0:1/33.60 MB 8:1/128.00 MB 4:3/196.01 MB 6:3/286.24 MB 1:2/256.00 MB MemoryUsage(1s000ms): 15.94 MB, 739.37 MB, 897.60 MB, 869.37 MB, 841.30 MB, 801.36 MB, 776.98 MB, 751.99 MB, 732.29 MB, 713.32 MB, 688.09 MB, 659.13 MB, 631.54 MB, 597.10 MB, 568.63 MB, 546.00 MB, 520.84 MB, 492.38 MB, 473.89 MB, 445.15 MB, 420.84 MB, 388.70 MB, 353.39 MB, 322.80 MB, 295.01 MB, 270.32 MB, 246.18 MB, 214.72 MB, 180.44 MB, 154.40 MB, 126.29 MB, 103.78 MB, 65.26 MB, 34.14 MB, 6.45 MB ThreadUsage(1s000ms): 8, 7, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 919.32 MB (963977248) - PerHostPeakMemUsage: 967.39 MB (1014382232) - PrepareTime: 195.935ms - RowsProduced: 202.80K (202799) - TotalCpuTime: 36s431ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 452.372ms - TotalStorageWaitTime: 11s369ms CodeGen:(Total: 391.386ms, non-child: 391.386ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 140.569ms - PrepareTime: 191.382ms DataStreamSender (dst_id=10):(Total: 175.339ms, non-child: 175.339ms, % non-child: 100.00%) - BytesSent: 8.86 MB (9291478) - NetworkThroughput(*): 144.06 MB/sec - OverallThroughput: 50.54 MB/sec - PeakMemoryUsage: 1.18 MB (1236648) - RowsReturned: 202.80K (202799) - SerializeBatchTime: 113.529ms - TransmitDataRPCTime: 61.508ms - UncompressedRowBatchSize: 24.00 MB (25162868) SUBPLAN_NODE (id=1):(Total: 30s979ms, non-child: 57.166ms, % non-child: 0.18%) - PeakMemoryUsage: 13.95 MB (14622440) - RowsReturned: 202.80K (202799) - RowsReturnedRate: 6.55 K/sec HASH_JOIN_NODE (id=6):(Total: 30s362ms, non-child: 30s232ms, % non-child: 99.57%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 273.592ms - BuildRows: 2.28M (2277760) - BuildRowsPartitioned: 2.28M (2277760) - BuildTime: 193.155ms - GetNewBlockTime: 3s725ms - HashBuckets: 4.03M (4032630) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.42M (1418912) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 235.78K (235777) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.425ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 53.981ms UNNEST_NODE (id=4):(Total: 37.119ms, non-child: 37.119ms, % non-child: 100.00%) - AvgCollectionSize: 25.68 - MaxCollectionSize: 1.96K (1961) - MinCollectionSize: 1 (1) - NumCollections: 88.68K (88682) - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 808.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 179.642ms, non-child: 137.125ms, % non-child: 76.33%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.78K (235777) - ProbeTime: 0.000ns - RowsReturned: 880.75K (880748) - RowsReturnedRate: 4.90 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 42.517ms, non-child: 42.517ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 103 (103) - MinCollectionSize: 1 (1) - NumCollections: 88.68K (88682) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 47.00 /sec HDFS_SCAN_NODE (id=0):(Total: 559.336ms, non-child: 559.336ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 9:1/128.00 MB 2:1/32.61 MB 3:1/128.00 MB 5:1/31.23 MB 0:1/33.60 MB 8:1/128.00 MB 4:3/196.01 MB 6:3/286.24 MB 1:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:94.12% 1:2.941% 2:0% 3:0% 4:1.471% 5:0% 6:1.471% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(1s000ms): 26.86 MB, 57.96 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB, 58.07 MB - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 0.43 - BytesRead: 58.07 MB (60890749) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.39 MB (60173949) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.39 MB (60173949) - DecompressionTime: 188.484ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 907.07 MB (951136312) - PerReadThreadRawHdfsThroughput: 13.00 MB/sec - RemoteScanRanges: 7 (7) - RowsRead: 7.54M (7535728) - RowsReturned: 88.68K (88682) - RowsReturnedRate: 158.55 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 209 (209) - ScannerThreadsTotalWallClockTime: 13s196ms - MaterializeTupleTime(*): 1s408ms - ScannerThreadsSysTime: 468.024ms - ScannerThreadsUserTime: 1s268ms - ScannerThreadsVoluntaryContextSwitches: 634 (634) - TotalRawHdfsReadTime(*): 4s466ms - TotalReadThroughput: 1.71 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e6 (host=dn14.hadoop.trivago.com:22000):(Total: 25s927ms, non-child: 75.309us, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/256.00 MB 7:4/131.35 MB 1:2/256.00 MB 0:1/128.00 MB 3:2/163.62 MB 8:2/61.67 MB 4:2/161.43 MB 6:1/128.00 MB MemoryUsage(500.000ms): 0, 149.10 MB, 708.85 MB, 766.88 MB, 824.27 MB, 842.15 MB, 856.50 MB, 854.70 MB, 846.17 MB, 815.81 MB, 808.85 MB, 788.18 MB, 773.43 MB, 751.72 MB, 730.20 MB, 718.13 MB, 698.47 MB, 689.41 MB, 669.08 MB, 659.87 MB, 639.19 MB, 628.87 MB, 610.94 MB, 596.04 MB, 577.41 MB, 567.51 MB, 548.22 MB, 530.02 MB, 520.95 MB, 502.42 MB, 484.10 MB, 462.97 MB, 453.10 MB, 445.12 MB, 420.78 MB, 414.54 MB, 396.36 MB, 377.64 MB, 368.44 MB, 345.22 MB, 318.04 MB, 296.01 MB, 274.91 MB, 253.42 MB, 227.79 MB, 206.09 MB, 189.06 MB, 171.28 MB, 153.23 MB, 137.40 MB, 115.65 MB, 92.25 MB, 74.69 MB, 57.70 MB, 43.53 MB, 18.10 MB, 5.49 MB ThreadUsage(500.000ms): 1, 17, 13, 6, 5, 4, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.72 - BloomFilterBytes: 0 - PeakMemoryUsage: 880.73 MB (923516664) - PerHostPeakMemUsage: 928.85 MB (973974400) - PrepareTime: 182.839ms - RowsProduced: 209.75K (209749) - TotalCpuTime: 30s194ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 37.602ms - TotalStorageWaitTime: 16s830ms CodeGen:(Total: 408.978ms, non-child: 408.978ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 73.396ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 156.830ms - PrepareTime: 177.851ms DataStreamSender (dst_id=10):(Total: 171.509ms, non-child: 171.509ms, % non-child: 100.00%) - BytesSent: 9.16 MB (9605998) - NetworkThroughput(*): 129.79 MB/sec - OverallThroughput: 53.41 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 209.75K (209749) - SerializeBatchTime: 100.621ms - TransmitDataRPCTime: 70.582ms - UncompressedRowBatchSize: 24.82 MB (26025220) SUBPLAN_NODE (id=1):(Total: 25s346ms, non-child: 42.942ms, % non-child: 0.17%) - PeakMemoryUsage: 13.01 MB (13637800) - RowsReturned: 209.75K (209749) - RowsReturnedRate: 8.28 K/sec HASH_JOIN_NODE (id=6):(Total: 24s791ms, non-child: 24s644ms, % non-child: 99.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 250.410ms - BuildRows: 2.33M (2330916) - BuildRowsPartitioned: 2.33M (2330916) - BuildTime: 173.344ms - GetNewBlockTime: 2s690ms - HashBuckets: 4.12M (4119890) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.49M (1492016) - PeakMemoryUsage: 2.10 MB (2206848) - PinTime: 0.000ns - ProbeRows: 248.41K (248406) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53.475ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 47.000ms UNNEST_NODE (id=4):(Total: 31.979ms, non-child: 31.979ms, % non-child: 100.00%) - AvgCollectionSize: 25.00 - MaxCollectionSize: 1.60K (1596) - MinCollectionSize: 1 (1) - NumCollections: 93.25K (93251) - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 218.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 188.111ms, non-child: 152.456ms, % non-child: 81.05%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 248.41K (248406) - ProbeTime: 0.000ns - RowsReturned: 943.85K (943852) - RowsReturnedRate: 5.02 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 35.655ms, non-child: 35.655ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 80 (80) - MinCollectionSize: 1 (1) - NumCollections: 93.25K (93251) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 28.00 /sec HDFS_SCAN_NODE (id=0):(Total: 512.892ms, non-child: 512.892ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 2:2/256.00 MB 7:4/131.35 MB 1:2/256.00 MB 0:1/128.00 MB 3:2/163.62 MB 8:2/61.67 MB 4:2/161.43 MB 6:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:89.09% 1:5.455% 2:1.818% 3:0% 4:0% 5:1.818% 6:0% 7:1.818% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:96 BytesRead(500.000ms): 20.34 MB, 44.82 MB, 53.05 MB, 54.54 MB, 58.65 MB, 60.19 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB, 60.40 MB - AverageHdfsReadThreadConcurrency: 0.31 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 60.40 MB (63335835) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.91 MB (62823835) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.91 MB (62823835) - DecompressionTime: 183.979ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 16 (16) - PeakMemoryUsage: 866.67 MB (908766104) - PerReadThreadRawHdfsThroughput: 11.27 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.78M (7775586) - RowsReturned: 93.25K (93251) - RowsReturnedRate: 181.81 K/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 232 (232) - ScannerThreadsTotalWallClockTime: 18s918ms - MaterializeTupleTime(*): 1s495ms - ScannerThreadsSysTime: 464.023ms - ScannerThreadsUserTime: 1s352ms - ScannerThreadsVoluntaryContextSwitches: 698 (698) - TotalRawHdfsReadTime(*): 5s359ms - TotalReadThroughput: 2.20 MB/sec Instance b64a3852190d9ac2:412186998b9ee4ef (host=dn41.hadoop.trivago.com:22000):(Total: 26s918ms, non-child: 2s185ms, % non-child: 8.12%) Hdfs split stats (:<# splits>/): 0:1/33.25 MB 1:2/159.93 MB 9:1/35.50 MB 3:1/33.16 MB 2:1/128.00 MB 8:3/191.23 MB 7:3/384.00 MB 4:3/188.68 MB MemoryUsage(500.000ms): 0, 3.25 MB, 302.72 MB, 397.63 MB, 692.48 MB, 710.68 MB, 697.55 MB, 692.77 MB, 769.86 MB, 762.00 MB, 746.24 MB, 736.34 MB, 725.92 MB, 703.29 MB, 678.81 MB, 659.93 MB, 642.37 MB, 622.67 MB, 598.63 MB, 590.74 MB, 574.86 MB, 555.50 MB, 544.83 MB, 535.79 MB, 517.82 MB, 496.19 MB, 485.98 MB, 477.12 MB, 451.50 MB, 436.31 MB, 428.31 MB, 403.70 MB, 395.67 MB, 387.09 MB, 374.43 MB, 354.06 MB, 336.70 MB, 322.05 MB, 311.15 MB, 285.01 MB, 276.20 MB, 267.81 MB, 248.57 MB, 233.92 MB, 212.61 MB, 203.40 MB, 203.40 MB, 180.19 MB, 159.74 MB, 129.88 MB, 109.33 MB, 77.75 MB, 59.88 MB, 35.27 MB, 18.04 MB, 6.77 MB, 6.62 MB, 6.62 MB, 6.56 MB ThreadUsage(500.000ms): 1, 16, 14, 13, 5, 4, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 780.87 MB (818798080) - PerHostPeakMemUsage: 828.94 MB (869203064) - PrepareTime: 205.413ms - RowsProduced: 195.94K (195944) - TotalCpuTime: 29s306ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s648ms - TotalStorageWaitTime: 22s222ms CodeGen:(Total: 441.822ms, non-child: 441.822ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.377ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 175.860ms - PrepareTime: 199.630ms DataStreamSender (dst_id=10):(Total: 160.562ms, non-child: 160.562ms, % non-child: 100.00%) - BytesSent: 8.50 MB (8917969) - NetworkThroughput(*): 146.93 MB/sec - OverallThroughput: 52.97 MB/sec - PeakMemoryUsage: 1.30 MB (1359528) - RowsReturned: 195.94K (195944) - SerializeBatchTime: 102.434ms - TransmitDataRPCTime: 57.884ms - UncompressedRowBatchSize: 23.19 MB (24312332) SUBPLAN_NODE (id=1):(Total: 24s130ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.88 MB (14553456) - RowsReturned: 195.94K (195944) - RowsReturnedRate: 8.12 K/sec HASH_JOIN_NODE (id=6):(Total: 23s472ms, non-child: 23s357ms, % non-child: 99.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 247.464ms - BuildRows: 2.16M (2163144) - BuildRowsPartitioned: 2.16M (2163144) - BuildTime: 162.890ms - GetNewBlockTime: 2s625ms - HashBuckets: 3.84M (3839603) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.31M (1313600) - PeakMemoryUsage: 2.14 MB (2241664) - PinTime: 0.000ns - ProbeRows: 220.84K (220842) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.265ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 47.262ms UNNEST_NODE (id=4):(Total: 34.983ms, non-child: 34.983ms, % non-child: 100.00%) - AvgCollectionSize: 26.35 - MaxCollectionSize: 2.75K (2752) - MinCollectionSize: 1 (1) - NumCollections: 82.10K (82100) - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 200.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 162.053ms, non-child: 122.356ms, % non-child: 75.50%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 220.84K (220842) - ProbeTime: 0.000ns - RowsReturned: 855.74K (855738) - RowsReturnedRate: 5.28 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.696ms, non-child: 39.696ms, % non-child: 100.00%) - AvgCollectionSize: 2.69 - MaxCollectionSize: 91 (91) - MinCollectionSize: 1 (1) - NumCollections: 82.10K (82100) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 25.00 /sec HDFS_SCAN_NODE (id=0):(Total: 658.744ms, non-child: 658.744ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 0:1/33.25 MB 1:2/159.93 MB 9:1/35.50 MB 3:1/33.16 MB 2:1/128.00 MB 8:3/191.23 MB 7:3/384.00 MB 4:3/188.68 MB Hdfs Read Thread Concurrency Bucket: 0:90.74% 1:5.556% 2:0% 3:0% 4:0% 5:0% 6:1.852% 7:1.852% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 500.00 KB, 25.57 MB, 30.46 MB, 44.69 MB, 48.89 MB, 49.04 MB, 51.64 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB, 55.20 MB - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 0.93 - BytesRead: 55.20 MB (57885764) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.81 MB (57476164) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.81 MB (57476164) - DecompressionTime: 182.628ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 768.10 MB (805413776) - PerReadThreadRawHdfsThroughput: 7.87 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.16M (7158601) - RowsReturned: 82.10K (82100) - RowsReturnedRate: 124.63 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 184 (184) - ScannerThreadsTotalWallClockTime: 24s065ms - MaterializeTupleTime(*): 1s357ms - ScannerThreadsSysTime: 448.024ms - ScannerThreadsUserTime: 1s248ms - ScannerThreadsVoluntaryContextSwitches: 750 (750) - TotalRawHdfsReadTime(*): 7s016ms - TotalReadThroughput: 2.04 MB/sec Instance b64a3852190d9ac2:412186998b9ee4ea (host=dn22.hadoop.trivago.com:22000):(Total: 28s474ms, non-child: 963.522ms, % non-child: 3.38%) Hdfs split stats (:<# splits>/): 2:2/160.81 MB 3:3/195.85 MB 9:3/384.00 MB 7:2/157.26 MB 4:1/128.00 MB 6:1/30.42 MB 8:2/157.93 MB MemoryUsage(500.000ms): 0, 2.74 MB, 427.58 MB, 633.66 MB, 731.90 MB, 811.79 MB, 787.27 MB, 792.74 MB, 787.48 MB, 770.33 MB, 765.01 MB, 752.05 MB, 745.61 MB, 730.34 MB, 723.68 MB, 707.93 MB, 701.86 MB, 678.55 MB, 663.15 MB, 646.13 MB, 638.40 MB, 625.34 MB, 603.23 MB, 592.09 MB, 580.27 MB, 562.09 MB, 552.67 MB, 532.85 MB, 521.48 MB, 499.88 MB, 483.47 MB, 474.93 MB, 453.87 MB, 444.01 MB, 433.30 MB, 425.28 MB, 410.53 MB, 389.08 MB, 368.23 MB, 361.58 MB, 342.57 MB, 322.66 MB, 305.25 MB, 283.70 MB, 263.57 MB, 242.20 MB, 223.30 MB, 206.17 MB, 200.01 MB, 171.87 MB, 161.70 MB, 137.16 MB, 118.18 MB, 109.72 MB, 92.18 MB, 72.18 MB, 64.23 MB, 44.46 MB, 28.20 MB, 4.98 MB, 4.88 MB, 4.61 MB ThreadUsage(500.000ms): 1, 15, 11, 7, 4, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 0 - PeakMemoryUsage: 829.92 MB (870229088) - PerHostPeakMemUsage: 877.97 MB (920616488) - PrepareTime: 238.386ms - RowsProduced: 207.40K (207397) - TotalCpuTime: 31s673ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 794.580ms - TotalStorageWaitTime: 15s477ms CodeGen:(Total: 445.435ms, non-child: 445.435ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 153.357ms - PrepareTime: 231.986ms DataStreamSender (dst_id=10):(Total: 175.348ms, non-child: 175.348ms, % non-child: 100.00%) - BytesSent: 9.04 MB (9477496) - NetworkThroughput(*): 141.54 MB/sec - OverallThroughput: 51.55 MB/sec - PeakMemoryUsage: 1.28 MB (1343144) - RowsReturned: 207.40K (207397) - SerializeBatchTime: 111.079ms - TransmitDataRPCTime: 63.858ms - UncompressedRowBatchSize: 24.54 MB (25733404) SUBPLAN_NODE (id=1):(Total: 26s890ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 15.84 MB (16605768) - RowsReturned: 207.40K (207397) - RowsReturnedRate: 7.71 K/sec HASH_JOIN_NODE (id=6):(Total: 26s211ms, non-child: 26s071ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 284.887ms - BuildRows: 2.28M (2283870) - BuildRowsPartitioned: 2.28M (2283870) - BuildTime: 182.130ms - GetNewBlockTime: 2s909ms - HashBuckets: 4.05M (4047382) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1411312) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 237.66K (237658) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.324ms - RowsReturned: 5 (5) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 53.154ms UNNEST_NODE (id=4):(Total: 40.354ms, non-child: 40.354ms, % non-child: 100.00%) - AvgCollectionSize: 25.89 - MaxCollectionSize: 2.08K (2080) - MinCollectionSize: 1 (1) - NumCollections: 88.21K (88207) - PeakMemoryUsage: 0 - RowsReturned: 57 (57) - RowsReturnedRate: 1.41 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 186.721ms, non-child: 144.649ms, % non-child: 77.47%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 237.66K (237658) - ProbeTime: 0.000ns - RowsReturned: 911.46K (911456) - RowsReturnedRate: 4.88 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 42.072ms, non-child: 42.072ms, % non-child: 100.00%) - AvgCollectionSize: 2.69 - MaxCollectionSize: 188 (188) - MinCollectionSize: 1 (1) - NumCollections: 88.21K (88207) - PeakMemoryUsage: 0 - RowsReturned: 5 (5) - RowsReturnedRate: 118.00 /sec HDFS_SCAN_NODE (id=0):(Total: 680.373ms, non-child: 680.373ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 2:2/160.81 MB 3:3/195.85 MB 9:3/384.00 MB 7:2/157.26 MB 4:1/128.00 MB 6:1/30.42 MB 8:2/157.93 MB Hdfs Read Thread Concurrency Bucket: 0:89.66% 1:5.172% 2:3.448% 3:1.724% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 309.49 KB, 31.43 MB, 41.19 MB, 48.48 MB, 54.27 MB, 54.27 MB, 56.74 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB, 57.10 MB - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.66 - BytesRead: 57.10 MB (59871054) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.60 MB (59349339) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.60 MB (59349339) - DecompressionTime: 184.746ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 816.52 MB (856186016) - PerReadThreadRawHdfsThroughput: 12.48 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.39M (7388144) - RowsReturned: 88.21K (88207) - RowsReturnedRate: 129.65 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 188 (188) - ScannerThreadsTotalWallClockTime: 17s163ms - MaterializeTupleTime(*): 1s245ms - ScannerThreadsSysTime: 472.025ms - ScannerThreadsUserTime: 1s080ms - ScannerThreadsVoluntaryContextSwitches: 487 (487) - TotalRawHdfsReadTime(*): 4s574ms - TotalReadThroughput: 1.97 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e0 (host=dn46.hadoop.trivago.com:22000):(Total: 28s208ms, non-child: 104.181ms, % non-child: 0.37%) Hdfs split stats (:<# splits>/): 5:3/291.04 MB 4:2/64.98 MB 9:2/160.90 MB 2:3/291.23 MB 10:1/30.05 MB 6:2/157.42 MB 0:2/160.73 MB MemoryUsage(500.000ms): 260.79 KB, 120.22 MB, 587.78 MB, 717.95 MB, 708.55 MB, 716.92 MB, 786.74 MB, 788.92 MB, 784.28 MB, 783.28 MB, 772.47 MB, 752.29 MB, 744.54 MB, 735.76 MB, 726.48 MB, 707.10 MB, 698.03 MB, 679.11 MB, 671.39 MB, 657.24 MB, 645.11 MB, 638.40 MB, 621.93 MB, 611.48 MB, 604.71 MB, 594.32 MB, 584.55 MB, 565.39 MB, 553.00 MB, 535.50 MB, 516.51 MB, 502.00 MB, 486.41 MB, 477.72 MB, 456.81 MB, 444.12 MB, 438.06 MB, 426.91 MB, 413.94 MB, 398.40 MB, 372.20 MB, 353.68 MB, 332.82 MB, 316.84 MB, 301.48 MB, 286.22 MB, 260.89 MB, 250.60 MB, 229.20 MB, 215.23 MB, 189.68 MB, 162.51 MB, 151.28 MB, 124.23 MB, 110.07 MB, 91.31 MB, 80.53 MB, 59.12 MB, 41.16 MB, 24.31 MB, 10.56 MB ThreadUsage(500.000ms): 1, 16, 9, 4, 4, 4, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 0 - PeakMemoryUsage: 803.58 MB (842612368) - PerHostPeakMemUsage: 851.65 MB (893017352) - PrepareTime: 269.329ms - RowsProduced: 193.00K (192997) - TotalCpuTime: 32s256ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 237.849ms - TotalStorageWaitTime: 16s292ms CodeGen:(Total: 540.249ms, non-child: 540.249ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 88.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 187.975ms - PrepareTime: 212.795ms DataStreamSender (dst_id=10):(Total: 167.442ms, non-child: 167.442ms, % non-child: 100.00%) - BytesSent: 8.43 MB (8841644) - NetworkThroughput(*): 143.08 MB/sec - OverallThroughput: 50.36 MB/sec - PeakMemoryUsage: 1.15 MB (1203880) - RowsReturned: 193.00K (192997) - SerializeBatchTime: 108.194ms - TransmitDataRPCTime: 58.932ms - UncompressedRowBatchSize: 22.84 MB (23946676) SUBPLAN_NODE (id=1):(Total: 27s396ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 14.24 MB (14930904) - RowsReturned: 193.00K (192997) - RowsReturnedRate: 7.04 K/sec HASH_JOIN_NODE (id=6):(Total: 26s708ms, non-child: 26s572ms, % non-child: 99.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 255.439ms - BuildRows: 2.16M (2164726) - BuildRowsPartitioned: 2.16M (2164726) - BuildTime: 184.248ms - GetNewBlockTime: 2s927ms - HashBuckets: 3.84M (3839744) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.34M (1343200) - PeakMemoryUsage: 2.15 MB (2249856) - PinTime: 0.000ns - ProbeRows: 223.35K (223350) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50.540ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 51.124ms UNNEST_NODE (id=4):(Total: 37.365ms, non-child: 37.365ms, % non-child: 100.00%) - AvgCollectionSize: 25.79 - MaxCollectionSize: 2.89K (2890) - MinCollectionSize: 1 (1) - NumCollections: 83.95K (83950) - PeakMemoryUsage: 0 - RowsReturned: 22 (22) - RowsReturnedRate: 588.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 184.489ms, non-child: 144.764ms, % non-child: 78.47%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 223.35K (223350) - ProbeTime: 0.000ns - RowsReturned: 840.60K (840602) - RowsReturnedRate: 4.56 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.725ms, non-child: 39.725ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 131 (131) - MinCollectionSize: 1 (1) - NumCollections: 83.95K (83950) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 50.00 /sec HDFS_SCAN_NODE (id=0):(Total: 713.602ms, non-child: 713.602ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 5:3/291.04 MB 4:2/64.98 MB 9:2/160.90 MB 2:3/291.23 MB 10:1/30.05 MB 6:2/157.42 MB 0:2/160.73 MB Hdfs Read Thread Concurrency Bucket: 0:86.44% 1:10.17% 2:0% 3:1.695% 4:0% 5:0% 6:1.695% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 17.07 MB, 41.39 MB, 47.94 MB, 50.59 MB, 52.61 MB, 54.03 MB, 54.82 MB, 55.30 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB, 55.56 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 0.61 - BytesRead: 55.56 MB (58260331) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.16 MB (57841247) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.16 MB (57841247) - DecompressionTime: 182.070ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 789.44 MB (827786328) - PerReadThreadRawHdfsThroughput: 7.55 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.15M (7153457) - RowsReturned: 83.95K (83950) - RowsReturnedRate: 117.64 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 187 (187) - ScannerThreadsTotalWallClockTime: 18s120ms - MaterializeTupleTime(*): 1s384ms - ScannerThreadsSysTime: 508.028ms - ScannerThreadsUserTime: 1s204ms - ScannerThreadsVoluntaryContextSwitches: 691 (691) - TotalRawHdfsReadTime(*): 7s359ms - TotalReadThroughput: 1.85 MB/sec Instance b64a3852190d9ac2:412186998b9ee502 (host=dn25.hadoop.trivago.com:22000):(Total: 24s513ms, non-child: 256.550ms, % non-child: 1.05%) Hdfs split stats (:<# splits>/): 10:1/128.00 MB 2:1/128.00 MB 8:1/32.63 MB 9:1/128.00 MB 3:1/32.96 MB 6:1/35.13 MB 4:1/128.00 MB 0:1/128.00 MB 7:2/157.37 MB 1:4/318.73 MB 5:1/30.09 MB MemoryUsage(500.000ms): 0, 260.79 KB, 607.13 MB, 637.40 MB, 665.68 MB, 647.97 MB, 669.89 MB, 654.28 MB, 707.36 MB, 854.12 MB, 844.96 MB, 834.62 MB, 815.44 MB, 804.26 MB, 781.02 MB, 761.60 MB, 753.24 MB, 725.24 MB, 702.05 MB, 688.93 MB, 671.70 MB, 650.77 MB, 628.13 MB, 608.11 MB, 585.73 MB, 570.76 MB, 553.64 MB, 545.62 MB, 521.12 MB, 485.61 MB, 474.97 MB, 440.43 MB, 418.75 MB, 404.09 MB, 381.65 MB, 362.68 MB, 345.86 MB, 330.12 MB, 300.47 MB, 272.28 MB, 254.18 MB, 237.75 MB, 210.45 MB, 186.99 MB, 166.33 MB, 158.23 MB, 141.26 MB, 118.18 MB, 99.92 MB, 80.32 MB, 48.44 MB, 24.92 MB, 7.31 MB, 6.71 MB ThreadUsage(500.000ms): 1, 1, 10, 7, 6, 6, 5, 4, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.63 - BloomFilterBytes: 0 - PeakMemoryUsage: 854.63 MB (896143496) - PerHostPeakMemUsage: 902.72 MB (946566064) - PrepareTime: 257.594ms - RowsProduced: 206.33K (206331) - TotalCpuTime: 28s501ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 259.628ms - TotalStorageWaitTime: 19s467ms CodeGen:(Total: 585.944ms, non-child: 585.944ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 110.528ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 222.115ms - PrepareTime: 252.508ms DataStreamSender (dst_id=10):(Total: 160.124ms, non-child: 160.124ms, % non-child: 100.00%) - BytesSent: 9.01 MB (9449706) - NetworkThroughput(*): 129.29 MB/sec - OverallThroughput: 56.28 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 206.33K (206331) - SerializeBatchTime: 90.183ms - TransmitDataRPCTime: 69.704ms - UncompressedRowBatchSize: 24.42 MB (25601076) SUBPLAN_NODE (id=1):(Total: 23s511ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 15.17 MB (15911096) - RowsReturned: 206.33K (206331) - RowsReturnedRate: 8.78 K/sec HASH_JOIN_NODE (id=6):(Total: 22s947ms, non-child: 22s785ms, % non-child: 99.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 230.873ms - BuildRows: 2.30M (2304698) - BuildRowsPartitioned: 2.30M (2304698) - BuildTime: 159.187ms - GetNewBlockTime: 2s563ms - HashBuckets: 4.08M (4082547) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.45M (1449696) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 242.36K (242356) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.150ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 41.888ms UNNEST_NODE (id=4):(Total: 32.426ms, non-child: 32.426ms, % non-child: 100.00%) - AvgCollectionSize: 25.44 - MaxCollectionSize: 2.18K (2178) - MinCollectionSize: 1 (1) - NumCollections: 90.61K (90606) - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 431.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 201.542ms, non-child: 163.319ms, % non-child: 81.03%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 242.36K (242356) - ProbeTime: 0.000ns - RowsReturned: 930.70K (930699) - RowsReturnedRate: 4.62 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 38.223ms, non-child: 38.223ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 127 (127) - MinCollectionSize: 1 (1) - NumCollections: 90.61K (90606) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 26.00 /sec HDFS_SCAN_NODE (id=0):(Total: 597.906ms, non-child: 597.906ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 10:1/128.00 MB 2:1/128.00 MB 8:1/32.63 MB 9:1/128.00 MB 3:1/32.96 MB 6:1/35.13 MB 4:1/128.00 MB 0:1/128.00 MB 7:2/157.37 MB 1:4/318.73 MB 5:1/30.09 MB Hdfs Read Thread Concurrency Bucket: 0:96% 1:2% 2:2% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 37.31 MB, 40.91 MB, 45.25 MB, 45.25 MB, 45.48 MB, 45.48 MB, 51.30 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB, 58.61 MB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 0.68 - BytesRead: 58.61 MB (61461718) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.22 MB (61043058) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.22 MB (61043058) - DecompressionTime: 171.579ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 12 (12) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 842.30 MB (883216568) - PerReadThreadRawHdfsThroughput: 22.13 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.61M (7608472) - RowsReturned: 90.61K (90606) - RowsReturnedRate: 151.54 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 397 (397) - ScannerThreadsTotalWallClockTime: 21s448ms - MaterializeTupleTime(*): 1s588ms - ScannerThreadsSysTime: 404.018ms - ScannerThreadsUserTime: 1s368ms - ScannerThreadsVoluntaryContextSwitches: 669 (669) - TotalRawHdfsReadTime(*): 2s648ms - TotalReadThroughput: 2.30 MB/sec Instance b64a3852190d9ac2:412186998b9ee504 (host=dn21.hadoop.trivago.com:22000):(Total: 27s871ms, non-child: 583.344ms, % non-child: 2.09%) Hdfs split stats (:<# splits>/): 0:1/128.00 MB 5:1/128.00 MB 4:2/256.00 MB 8:2/63.95 MB 9:2/161.16 MB 6:1/128.00 MB 7:1/29.08 MB 10:3/191.32 MB 3:1/128.00 MB MemoryUsage(500.000ms): 0, 2.74 MB, 662.76 MB, 736.75 MB, 770.66 MB, 757.73 MB, 762.50 MB, 753.44 MB, 823.83 MB, 818.73 MB, 799.10 MB, 789.75 MB, 777.53 MB, 758.98 MB, 749.10 MB, 739.71 MB, 734.35 MB, 710.70 MB, 700.79 MB, 681.74 MB, 671.59 MB, 658.79 MB, 640.89 MB, 627.90 MB, 607.89 MB, 599.74 MB, 587.49 MB, 570.55 MB, 558.35 MB, 539.97 MB, 530.55 MB, 516.43 MB, 504.78 MB, 498.07 MB, 476.82 MB, 464.90 MB, 454.19 MB, 436.28 MB, 427.39 MB, 403.19 MB, 380.71 MB, 371.21 MB, 354.67 MB, 334.98 MB, 316.41 MB, 299.02 MB, 274.46 MB, 253.53 MB, 226.48 MB, 203.37 MB, 182.38 MB, 156.72 MB, 138.25 MB, 110.24 MB, 91.33 MB, 68.23 MB, 47.78 MB, 27.62 MB, 10.30 MB, 9.17 MB, 8.87 MB ThreadUsage(500.000ms): 1, 15, 11, 8, 5, 5, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.70 - BloomFilterBytes: 0 - PeakMemoryUsage: 831.97 MB (872383184) - PerHostPeakMemUsage: 880.06 MB (922805752) - PrepareTime: 278.503ms - RowsProduced: 215.54K (215539) - TotalCpuTime: 31s981ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38.737ms - TotalStorageWaitTime: 17s062ms CodeGen:(Total: 508.037ms, non-child: 508.037ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.992ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 174.856ms - PrepareTime: 212.110ms DataStreamSender (dst_id=10):(Total: 183.986ms, non-child: 183.986ms, % non-child: 100.00%) - BytesSent: 9.38 MB (9840640) - NetworkThroughput(*): 143.43 MB/sec - OverallThroughput: 51.01 MB/sec - PeakMemoryUsage: 1.30 MB (1367720) - RowsReturned: 215.54K (215539) - SerializeBatchTime: 118.210ms - TransmitDataRPCTime: 65.431ms - UncompressedRowBatchSize: 25.50 MB (26743600) SUBPLAN_NODE (id=1):(Total: 26s596ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 14.08 MB (14759664) - RowsReturned: 215.54K (215539) - RowsReturnedRate: 8.10 K/sec HASH_JOIN_NODE (id=6):(Total: 25s927ms, non-child: 25s794ms, % non-child: 99.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 271.550ms - BuildRows: 2.34M (2343570) - BuildRowsPartitioned: 2.34M (2343570) - BuildTime: 174.625ms - GetNewBlockTime: 2s893ms - HashBuckets: 4.16M (4158075) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1409728) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 235.76K (235758) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.046ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 50.400ms UNNEST_NODE (id=4):(Total: 35.778ms, non-child: 35.778ms, % non-child: 100.00%) - AvgCollectionSize: 26.60 - MaxCollectionSize: 4.40K (4402) - MinCollectionSize: 1 (1) - NumCollections: 88.11K (88108) - PeakMemoryUsage: 0 - RowsReturned: 84 (84) - RowsReturnedRate: 2.35 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 178.529ms, non-child: 135.871ms, % non-child: 76.11%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.76K (235758) - ProbeTime: 0.000ns - RowsReturned: 912.64K (912639) - RowsReturnedRate: 5.11 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 42.657ms, non-child: 42.657ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 80 (80) - MinCollectionSize: 1 (1) - NumCollections: 88.11K (88108) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 23.00 /sec HDFS_SCAN_NODE (id=0):(Total: 721.052ms, non-child: 721.052ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 0:1/128.00 MB 5:1/128.00 MB 4:2/256.00 MB 8:2/63.95 MB 9:2/161.16 MB 6:1/128.00 MB 7:1/29.08 MB 10:3/191.32 MB 3:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:93.1% 1:3.448% 2:0% 3:3.448% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 42.68 MB, 46.46 MB, 49.57 MB, 50.97 MB, 51.46 MB, 55.93 MB, 57.23 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB, 57.41 MB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 0.74 - BytesRead: 57.41 MB (60203215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.02 MB (59793615) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.02 MB (59793615) - DecompressionTime: 181.492ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 816.08 MB (855719496) - PerReadThreadRawHdfsThroughput: 12.96 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.50M (7502750) - RowsReturned: 88.11K (88108) - RowsReturnedRate: 122.19 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 208 (208) - ScannerThreadsTotalWallClockTime: 18s939ms - MaterializeTupleTime(*): 1s471ms - ScannerThreadsSysTime: 464.025ms - ScannerThreadsUserTime: 1s312ms - ScannerThreadsVoluntaryContextSwitches: 678 (678) - TotalRawHdfsReadTime(*): 4s430ms - TotalReadThroughput: 1.98 MB/sec Instance b64a3852190d9ac2:412186998b9ee503 (host=dn48.hadoop.trivago.com:22000):(Total: 25s664ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/128.00 MB 8:1/32.04 MB 0:2/160.80 MB 10:3/288.44 MB 4:2/158.93 MB 2:1/28.90 MB 7:4/220.13 MB 5:1/128.00 MB MemoryUsage(500.000ms): 260.79 KB, 21.73 MB, 632.88 MB, 785.47 MB, 817.57 MB, 805.00 MB, 818.33 MB, 818.73 MB, 811.99 MB, 804.29 MB, 793.15 MB, 783.11 MB, 772.84 MB, 761.33 MB, 748.51 MB, 736.03 MB, 711.17 MB, 701.40 MB, 682.13 MB, 665.83 MB, 657.32 MB, 641.13 MB, 611.73 MB, 605.03 MB, 596.72 MB, 587.37 MB, 571.40 MB, 552.02 MB, 529.15 MB, 516.50 MB, 500.72 MB, 480.90 MB, 458.97 MB, 440.93 MB, 425.43 MB, 400.59 MB, 390.27 MB, 371.38 MB, 351.38 MB, 322.44 MB, 300.94 MB, 277.61 MB, 266.22 MB, 250.84 MB, 227.76 MB, 210.67 MB, 198.19 MB, 172.73 MB, 148.11 MB, 132.60 MB, 111.88 MB, 86.13 MB, 68.31 MB, 49.27 MB, 21.39 MB, 7.60 MB ThreadUsage(500.000ms): 1, 16, 10, 5, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 821.15 MB (861033000) - PerHostPeakMemUsage: 869.27 MB (911490736) - PrepareTime: 301.407ms - RowsProduced: 192.70K (192700) - TotalCpuTime: 30s739ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 35.025ms - TotalStorageWaitTime: 13s210ms CodeGen:(Total: 617.682ms, non-child: 617.682ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 97.118ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 225.060ms - PrepareTime: 266.555ms DataStreamSender (dst_id=10):(Total: 150.385ms, non-child: 150.385ms, % non-child: 100.00%) - BytesSent: 8.41 MB (8823698) - NetworkThroughput(*): 149.54 MB/sec - OverallThroughput: 55.96 MB/sec - PeakMemoryUsage: 1.30 MB (1367720) - RowsReturned: 192.70K (192700) - SerializeBatchTime: 93.824ms - TransmitDataRPCTime: 56.273ms - UncompressedRowBatchSize: 22.80 MB (23909836) SUBPLAN_NODE (id=1):(Total: 25s097ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.07 MB (13705648) - RowsReturned: 192.70K (192700) - RowsReturnedRate: 7.68 K/sec HASH_JOIN_NODE (id=6):(Total: 24s301ms, non-child: 24s179ms, % non-child: 99.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 238.309ms - BuildRows: 2.14M (2136412) - BuildRowsPartitioned: 2.14M (2136412) - BuildTime: 161.604ms - GetNewBlockTime: 2s762ms - HashBuckets: 3.78M (3778768) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.35M (1350336) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 225.66K (225660) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.031ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.054ms UNNEST_NODE (id=4):(Total: 35.141ms, non-child: 35.141ms, % non-child: 100.00%) - AvgCollectionSize: 25.31 - MaxCollectionSize: 1.57K (1573) - MinCollectionSize: 1 (1) - NumCollections: 84.40K (84396) - PeakMemoryUsage: 0 - RowsReturned: 19 (19) - RowsReturnedRate: 540.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 166.936ms, non-child: 127.103ms, % non-child: 76.14%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 225.66K (225660) - ProbeTime: 0.000ns - RowsReturned: 859.25K (859252) - RowsReturnedRate: 5.15 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.833ms, non-child: 39.833ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 84 (84) - MinCollectionSize: 1 (1) - NumCollections: 84.40K (84396) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 50.00 /sec HDFS_SCAN_NODE (id=0):(Total: 886.241ms, non-child: 886.241ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 1:1/128.00 MB 8:1/32.04 MB 0:2/160.80 MB 10:3/288.44 MB 4:2/158.93 MB 2:1/28.90 MB 7:4/220.13 MB 5:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:3.704% 2:5.556% 3:0% 4:0% 5:1.852% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 7.69 MB, 45.82 MB, 49.72 MB, 52.47 MB, 53.42 MB, 54.13 MB, 54.48 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB, 54.50 MB - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 0.65 - BytesRead: 54.50 MB (57149009) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.00 MB (56627103) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.00 MB (56627103) - DecompressionTime: 201.220ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 811.54 MB (850958064) - PerReadThreadRawHdfsThroughput: 11.70 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 6.99M (6986119) - RowsReturned: 84.40K (84396) - RowsReturnedRate: 95.23 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 429 (429) - ScannerThreadsTotalWallClockTime: 16s057ms - MaterializeTupleTime(*): 2s113ms - ScannerThreadsSysTime: 444.022ms - ScannerThreadsUserTime: 1s452ms - ScannerThreadsVoluntaryContextSwitches: 545 (545) - TotalRawHdfsReadTime(*): 4s656ms - TotalReadThroughput: 1.98 MB/sec Instance b64a3852190d9ac2:412186998b9ee4d9 (host=dn42.hadoop.trivago.com:22000):(Total: 27s878ms, non-child: 34.817ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 0:1/33.24 MB 2:3/291.14 MB 5:2/157.72 MB 1:2/256.00 MB 6:4/317.23 MB 4:1/29.92 MB 10:2/159.89 MB MemoryUsage(500.000ms): 260.79 KB, 315.21 MB, 478.75 MB, 785.37 MB, 860.09 MB, 890.42 MB, 875.78 MB, 854.36 MB, 845.16 MB, 834.10 MB, 825.81 MB, 803.80 MB, 795.11 MB, 784.69 MB, 767.32 MB, 760.89 MB, 753.95 MB, 730.42 MB, 722.38 MB, 709.96 MB, 686.93 MB, 678.53 MB, 667.45 MB, 658.35 MB, 641.49 MB, 635.38 MB, 614.51 MB, 602.24 MB, 580.36 MB, 572.87 MB, 555.17 MB, 540.00 MB, 518.54 MB, 502.28 MB, 490.74 MB, 470.25 MB, 459.85 MB, 449.30 MB, 430.92 MB, 418.76 MB, 403.61 MB, 386.65 MB, 369.04 MB, 355.79 MB, 323.78 MB, 311.83 MB, 278.30 MB, 259.59 MB, 240.13 MB, 217.68 MB, 196.37 MB, 173.43 MB, 161.35 MB, 146.18 MB, 125.80 MB, 99.26 MB, 88.26 MB, 56.11 MB, 37.00 MB, 20.64 MB ThreadUsage(500.000ms): 1, 13, 9, 6, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 891.89 MB (935219288) - PerHostPeakMemUsage: 940.00 MB (985659440) - PrepareTime: 192.486ms - RowsProduced: 208.79K (208790) - TotalCpuTime: 31s791ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.738ms - TotalStorageWaitTime: 16s571ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 40 (40) - BlocksRecycled: 2.94M (2937696) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 22.40 GB (24051816448) - PeakMemoryUsage: 64.06 MB (67174400) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 391.038ms, non-child: 391.038ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 61.845ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 140.569ms - PrepareTime: 187.997ms DataStreamSender (dst_id=10):(Total: 169.303ms, non-child: 169.303ms, % non-child: 100.00%) - BytesSent: 9.12 MB (9558156) - NetworkThroughput(*): 150.36 MB/sec - OverallThroughput: 53.84 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 208.79K (208790) - SerializeBatchTime: 108.365ms - TransmitDataRPCTime: 60.623ms - UncompressedRowBatchSize: 24.71 MB (25906232) SUBPLAN_NODE (id=1):(Total: 27s283ms, non-child: 52.037ms, % non-child: 0.19%) - PeakMemoryUsage: 14.53 MB (15239296) - RowsReturned: 208.79K (208790) - RowsReturnedRate: 7.65 K/sec HASH_JOIN_NODE (id=6):(Total: 26s606ms, non-child: 26s453ms, % non-child: 99.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 272.028ms - BuildRows: 2.35M (2353458) - BuildRowsPartitioned: 2.35M (2353458) - BuildTime: 182.605ms - GetNewBlockTime: 2s999ms - HashBuckets: 4.17M (4168685) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.47M (1468864) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 244.31K (244307) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 53.134ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 51.946ms UNNEST_NODE (id=4):(Total: 36.400ms, non-child: 36.400ms, % non-child: 100.00%) - AvgCollectionSize: 25.64 - MaxCollectionSize: 2.00K (1996) - MinCollectionSize: 1 (1) - NumCollections: 91.80K (91804) - PeakMemoryUsage: 0 - RowsReturned: 11 (11) - RowsReturnedRate: 302.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 198.832ms, non-child: 161.461ms, % non-child: 81.21%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 244.31K (244307) - ProbeTime: 0.000ns - RowsReturned: 911.92K (911921) - RowsReturnedRate: 4.59 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 37.370ms, non-child: 37.370ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 82 (82) - MinCollectionSize: 1 (1) - NumCollections: 91.80K (91804) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 26.00 /sec HDFS_SCAN_NODE (id=0):(Total: 625.289ms, non-child: 625.289ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 0:1/33.24 MB 2:3/291.14 MB 5:2/157.72 MB 1:2/256.00 MB 6:4/317.23 MB 4:1/29.92 MB 10:2/159.89 MB Hdfs Read Thread Concurrency Bucket: 0:93.22% 1:1.695% 2:0% 3:3.39% 4:1.695% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 22.05 MB, 34.93 MB, 55.19 MB, 57.58 MB, 58.30 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB, 58.47 MB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 0.47 - BytesRead: 58.47 MB (61307669) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.97 MB (60786271) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.97 MB (60786271) - DecompressionTime: 185.095ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 878.91 MB (921607472) - PerReadThreadRawHdfsThroughput: 8.80 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.56M (7555382) - RowsReturned: 91.80K (91804) - RowsReturnedRate: 146.82 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 188 (188) - ScannerThreadsTotalWallClockTime: 18s278ms - MaterializeTupleTime(*): 1s292ms - ScannerThreadsSysTime: 508.028ms - ScannerThreadsUserTime: 1s108ms - ScannerThreadsVoluntaryContextSwitches: 628 (628) - TotalRawHdfsReadTime(*): 6s643ms - TotalReadThroughput: 1.95 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e9 (host=dn16.hadoop.trivago.com:22000):(Total: 25s148ms, non-child: 397.703ms, % non-child: 1.58%) Hdfs split stats (:<# splits>/): 0:1/128.00 MB 2:2/67.66 MB 7:2/256.00 MB 5:2/64.11 MB 6:1/128.00 MB 4:2/157.06 MB 9:4/414.92 MB MemoryUsage(500.000ms): 260.79 KB, 335.36 MB, 690.33 MB, 898.25 MB, 903.46 MB, 894.22 MB, 866.80 MB, 843.45 MB, 820.90 MB, 810.05 MB, 801.22 MB, 783.41 MB, 766.73 MB, 749.29 MB, 740.57 MB, 716.86 MB, 688.61 MB, 673.27 MB, 662.96 MB, 639.60 MB, 629.65 MB, 611.00 MB, 589.47 MB, 580.48 MB, 561.21 MB, 551.94 MB, 531.46 MB, 523.21 MB, 503.22 MB, 481.11 MB, 463.84 MB, 448.59 MB, 431.89 MB, 409.94 MB, 398.44 MB, 388.71 MB, 368.22 MB, 348.84 MB, 341.43 MB, 317.77 MB, 288.68 MB, 267.58 MB, 239.60 MB, 221.40 MB, 200.98 MB, 182.08 MB, 159.00 MB, 140.49 MB, 127.90 MB, 97.71 MB, 75.51 MB, 59.35 MB, 32.78 MB, 908.79 KB, 388.79 KB ThreadUsage(500.000ms): 1, 12, 9, 5, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.47 - BloomFilterBytes: 0 - PeakMemoryUsage: 908.31 MB (952433688) - PerHostPeakMemUsage: 956.42 MB (1002873840) - PrepareTime: 202.744ms - RowsProduced: 203.85K (203853) - TotalCpuTime: 28s609ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 464.698ms - TotalStorageWaitTime: 11s278ms CodeGen:(Total: 424.195ms, non-child: 424.195ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 68.058ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 157.918ms - PrepareTime: 197.465ms DataStreamSender (dst_id=10):(Total: 168.458ms, non-child: 168.458ms, % non-child: 100.00%) - BytesSent: 8.91 MB (9345051) - NetworkThroughput(*): 123.32 MB/sec - OverallThroughput: 52.90 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 203.85K (203853) - SerializeBatchTime: 95.940ms - TransmitDataRPCTime: 72.268ms - UncompressedRowBatchSize: 24.12 MB (25293684) SUBPLAN_NODE (id=1):(Total: 24s157ms, non-child: 34.957ms, % non-child: 0.14%) - PeakMemoryUsage: 15.78 MB (16547392) - RowsReturned: 203.85K (203853) - RowsReturnedRate: 8.44 K/sec HASH_JOIN_NODE (id=6):(Total: 23s588ms, non-child: 23s454ms, % non-child: 99.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 252.362ms - BuildRows: 2.28M (2275482) - BuildRowsPartitioned: 2.28M (2275482) - BuildTime: 168.033ms - GetNewBlockTime: 2s605ms - HashBuckets: 4.03M (4032394) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1411888) - PeakMemoryUsage: 2.10 MB (2206848) - PinTime: 0.000ns - ProbeRows: 236.33K (236331) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.371ms - RowsReturned: 10 (10) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 44.056ms UNNEST_NODE (id=4):(Total: 29.997ms, non-child: 29.997ms, % non-child: 100.00%) - AvgCollectionSize: 25.79 - MaxCollectionSize: 1.60K (1602) - MinCollectionSize: 1 (1) - NumCollections: 88.24K (88243) - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 1.40 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 175.751ms, non-child: 136.549ms, % non-child: 77.69%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 236.33K (236331) - ProbeTime: 0.000ns - RowsReturned: 883.84K (883840) - RowsReturnedRate: 5.03 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.201ms, non-child: 39.201ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 90 (90) - MinCollectionSize: 1 (1) - NumCollections: 88.24K (88243) - PeakMemoryUsage: 0 - RowsReturned: 11 (11) - RowsReturnedRate: 280.00 /sec HDFS_SCAN_NODE (id=0):(Total: 534.254ms, non-child: 534.254ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 0:1/128.00 MB 2:2/67.66 MB 7:2/256.00 MB 5:2/64.11 MB 6:1/128.00 MB 4:2/157.06 MB 9:4/414.92 MB Hdfs Read Thread Concurrency Bucket: 0:94.23% 1:0% 2:3.846% 3:1.923% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 29.18 MB, 46.99 MB, 56.30 MB, 57.05 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB, 57.42 MB - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 57.42 MB (60210054) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.93 MB (59698054) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.93 MB (59698054) - DecompressionTime: 177.454ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 896.31 MB (939853296) - PerReadThreadRawHdfsThroughput: 21.32 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.45M (7447287) - RowsReturned: 88.24K (88243) - RowsReturnedRate: 165.17 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 192 (192) - ScannerThreadsTotalWallClockTime: 13s045ms - MaterializeTupleTime(*): 1s346ms - ScannerThreadsSysTime: 428.021ms - ScannerThreadsUserTime: 1s228ms - ScannerThreadsVoluntaryContextSwitches: 792 (792) - TotalRawHdfsReadTime(*): 2s692ms - TotalReadThroughput: 2.17 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f3 (host=dn9.hadoop.trivago.com:22000):(Total: 25s032ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/128.00 MB 3:1/128.00 MB 1:2/160.24 MB 7:1/128.00 MB 5:3/384.00 MB 10:2/159.25 MB 0:1/128.00 MB MemoryUsage(500.000ms): 0, 25.25 MB, 326.31 MB, 573.18 MB, 690.69 MB, 777.40 MB, 818.21 MB, 808.72 MB, 802.15 MB, 792.06 MB, 773.25 MB, 756.91 MB, 750.63 MB, 731.39 MB, 718.69 MB, 707.80 MB, 701.39 MB, 683.17 MB, 674.93 MB, 663.09 MB, 642.19 MB, 632.40 MB, 614.19 MB, 602.66 MB, 595.52 MB, 574.57 MB, 565.45 MB, 541.44 MB, 519.92 MB, 496.31 MB, 479.13 MB, 467.91 MB, 446.41 MB, 426.55 MB, 417.61 MB, 400.74 MB, 389.17 MB, 368.53 MB, 347.95 MB, 329.36 MB, 304.84 MB, 286.88 MB, 264.10 MB, 244.75 MB, 217.17 MB, 210.73 MB, 196.25 MB, 176.17 MB, 145.08 MB, 121.07 MB, 99.04 MB, 85.02 MB, 54.32 MB, 38.88 MB, 9.92 MB ThreadUsage(500.000ms): 1, 12, 11, 9, 7, 6, 5, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 823.69 MB (863701752) - PerHostPeakMemUsage: 871.81 MB (914159488) - PrepareTime: 195.641ms - RowsProduced: 205.14K (205138) - TotalCpuTime: 28s980ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 35.128ms - TotalStorageWaitTime: 20s079ms CodeGen:(Total: 470.957ms, non-child: 470.957ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 98.319ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 181.427ms - PrepareTime: 190.550ms DataStreamSender (dst_id=10):(Total: 171.312ms, non-child: 171.312ms, % non-child: 100.00%) - BytesSent: 8.96 MB (9395962) - NetworkThroughput(*): 125.26 MB/sec - OverallThroughput: 52.31 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 205.14K (205138) - SerializeBatchTime: 99.461ms - TransmitDataRPCTime: 71.536ms - UncompressedRowBatchSize: 24.27 MB (25453132) SUBPLAN_NODE (id=1):(Total: 24s452ms, non-child: 26.011ms, % non-child: 0.11%) - PeakMemoryUsage: 13.13 MB (13768416) - RowsReturned: 205.14K (205138) - RowsReturnedRate: 8.39 K/sec HASH_JOIN_NODE (id=6):(Total: 23s920ms, non-child: 23s789ms, % non-child: 99.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 247.478ms - BuildRows: 2.27M (2270309) - BuildRowsPartitioned: 2.27M (2270309) - BuildTime: 171.925ms - GetNewBlockTime: 2s723ms - HashBuckets: 4.02M (4017679) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1413872) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 235.18K (235179) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.695ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.325ms UNNEST_NODE (id=4):(Total: 31.677ms, non-child: 31.677ms, % non-child: 100.00%) - AvgCollectionSize: 25.69 - MaxCollectionSize: 2.05K (2050) - MinCollectionSize: 1 (1) - NumCollections: 88.37K (88367) - PeakMemoryUsage: 0 - RowsReturned: 9 (9) - RowsReturnedRate: 284.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 173.663ms, non-child: 135.648ms, % non-child: 78.11%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.18K (235179) - ProbeTime: 0.000ns - RowsReturned: 877.75K (877754) - RowsReturnedRate: 5.05 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 38.014ms, non-child: 38.014ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 95 (95) - MinCollectionSize: 1 (1) - NumCollections: 88.37K (88367) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 26.00 /sec HDFS_SCAN_NODE (id=0):(Total: 505.923ms, non-child: 505.923ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 11 Hdfs split stats (:<# splits>/): 9:1/128.00 MB 3:1/128.00 MB 1:2/160.24 MB 7:1/128.00 MB 5:3/384.00 MB 10:2/159.25 MB 0:1/128.00 MB Hdfs Read Thread Concurrency Bucket: 0:88.68% 1:3.774% 2:3.774% 3:0% 4:1.887% 5:0% 6:1.887% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:66 BytesRead(500.000ms): 5.38 MB, 22.74 MB, 40.39 MB, 45.53 MB, 52.51 MB, 55.02 MB, 55.77 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB, 56.61 MB - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 0.91 - BytesRead: 56.61 MB (59358367) - BytesReadDataNodeCache: 0 - BytesReadLocal: 49.78 MB (52202580) - BytesReadRemoteUnexpected: 6.04 MB (6336587) - BytesReadShortCircuit: 49.78 MB (52202580) - DecompressionTime: 171.325ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 808.92 MB (848218272) - PerReadThreadRawHdfsThroughput: 12.57 MB/sec - RemoteScanRanges: 32 (32) - RowsRead: 7.40M (7397735) - RowsReturned: 88.37K (88367) - RowsReturnedRate: 174.66 K/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 184 (184) - ScannerThreadsTotalWallClockTime: 21s748ms - MaterializeTupleTime(*): 1s311ms - ScannerThreadsSysTime: 464.025ms - ScannerThreadsUserTime: 1s136ms - ScannerThreadsVoluntaryContextSwitches: 753 (753) - TotalRawHdfsReadTime(*): 4s504ms - TotalReadThroughput: 2.14 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e2 (host=dn31.hadoop.trivago.com:22000):(Total: 29s437ms, non-child: 3s363ms, % non-child: 11.43%) Hdfs split stats (:<# splits>/): 6:1/32.64 MB 1:1/33.26 MB 9:4/321.09 MB 8:2/156.62 MB 3:4/118.93 MB 0:2/156.34 MB 7:3/384.00 MB MemoryUsage(500.000ms): 260.79 KB, 211.43 MB, 750.53 MB, 774.39 MB, 819.77 MB, 838.70 MB, 826.74 MB, 808.70 MB, 804.46 MB, 787.79 MB, 760.50 MB, 748.63 MB, 729.25 MB, 713.95 MB, 699.27 MB, 689.63 MB, 669.30 MB, 657.27 MB, 627.53 MB, 619.39 MB, 602.53 MB, 591.67 MB, 572.96 MB, 563.95 MB, 541.55 MB, 521.47 MB, 493.00 MB, 483.03 MB, 474.13 MB, 474.13 MB, 454.19 MB, 442.22 MB, 418.74 MB, 400.63 MB, 389.09 MB, 365.56 MB, 347.59 MB, 337.56 MB, 317.21 MB, 290.88 MB, 283.39 MB, 259.84 MB, 239.07 MB, 239.07 MB, 228.74 MB, 220.29 MB, 202.66 MB, 176.67 MB, 158.62 MB, 147.64 MB, 129.40 MB, 114.91 MB, 104.29 MB, 92.82 MB, 83.25 MB, 64.89 MB, 42.74 MB, 29.86 MB, 18.14 MB, 5.80 MB, 5.68 MB, 5.66 MB, 5.66 MB ThreadUsage(500.000ms): 1, 16, 9, 7, 6, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 0 - PeakMemoryUsage: 853.92 MB (895403696) - PerHostPeakMemUsage: 902.00 MB (945815016) - PrepareTime: 212.548ms - RowsProduced: 206.82K (206819) - TotalCpuTime: 31s000ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s595ms - TotalStorageWaitTime: 19s724ms CodeGen:(Total: 415.979ms, non-child: 415.979ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 57.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 150.346ms - PrepareTime: 206.031ms DataStreamSender (dst_id=10):(Total: 163.794ms, non-child: 163.794ms, % non-child: 100.00%) - BytesSent: 9.02 MB (9453739) - NetworkThroughput(*): 150.48 MB/sec - OverallThroughput: 55.04 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 206.82K (206819) - SerializeBatchTime: 103.638ms - TransmitDataRPCTime: 59.913ms - UncompressedRowBatchSize: 24.47 MB (25661648) SUBPLAN_NODE (id=1):(Total: 25s493ms, non-child: 2.398ms, % non-child: 0.01%) - PeakMemoryUsage: 15.82 MB (16584760) - RowsReturned: 206.82K (206819) - RowsReturnedRate: 8.11 K/sec HASH_JOIN_NODE (id=6):(Total: 24s820ms, non-child: 24s694ms, % non-child: 99.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 244.253ms - BuildRows: 2.27M (2273490) - BuildRowsPartitioned: 2.27M (2273490) - BuildTime: 159.451ms - GetNewBlockTime: 2s736ms - HashBuckets: 4.03M (4026131) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.41M (1408544) - PeakMemoryUsage: 2.15 MB (2258048) - PinTime: 0.000ns - ProbeRows: 235.57K (235566) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.578ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 47.159ms UNNEST_NODE (id=4):(Total: 32.561ms, non-child: 32.561ms, % non-child: 100.00%) - AvgCollectionSize: 25.83 - MaxCollectionSize: 3.23K (3233) - MinCollectionSize: 1 (1) - NumCollections: 88.03K (88034) - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 921.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 170.617ms, non-child: 126.788ms, % non-child: 74.31%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.57K (235566) - ProbeTime: 0.000ns - RowsReturned: 906.96K (906959) - RowsReturnedRate: 5.32 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 43.829ms, non-child: 43.829ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 101 (101) - MinCollectionSize: 1 (1) - NumCollections: 88.03K (88034) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 45.00 /sec HDFS_SCAN_NODE (id=0):(Total: 670.932ms, non-child: 670.932ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 6:1/32.64 MB 1:1/33.26 MB 9:4/321.09 MB 8:2/156.62 MB 3:4/118.93 MB 0:2/156.34 MB 7:3/384.00 MB Hdfs Read Thread Concurrency Bucket: 0:94.83% 1:1.724% 2:1.724% 3:1.724% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(500.000ms): 0, 22.89 MB, 49.68 MB, 52.26 MB, 54.58 MB, 56.82 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB, 57.12 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 0.64 - BytesRead: 57.12 MB (59895275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.63 MB (59383275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.63 MB (59383275) - DecompressionTime: 197.595ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 837.55 MB (878235296) - PerReadThreadRawHdfsThroughput: 17.49 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.35M (7350842) - RowsReturned: 88.03K (88034) - RowsReturnedRate: 131.21 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 215 (215) - ScannerThreadsTotalWallClockTime: 21s688ms - MaterializeTupleTime(*): 1s412ms - ScannerThreadsSysTime: 516.028ms - ScannerThreadsUserTime: 1s264ms - ScannerThreadsVoluntaryContextSwitches: 714 (714) - TotalRawHdfsReadTime(*): 3s266ms - TotalReadThroughput: 1.94 MB/sec Instance b64a3852190d9ac2:412186998b9ee4dd (host=dn49.hadoop.trivago.com:22000):(Total: 25s773ms, non-child: 621.299ms, % non-child: 2.41%) Hdfs split stats (:<# splits>/): 1:1/128.00 MB 6:1/128.00 MB 4:1/33.92 MB 10:2/256.00 MB 0:1/128.00 MB 3:2/256.00 MB 2:2/156.92 MB MemoryUsage(500.000ms): 0, 19.22 MB, 693.33 MB, 718.09 MB, 785.38 MB, 783.01 MB, 766.22 MB, 751.25 MB, 739.27 MB, 718.82 MB, 699.31 MB, 699.45 MB, 691.41 MB, 679.79 MB, 658.45 MB, 638.71 MB, 627.33 MB, 614.82 MB, 592.49 MB, 585.81 MB, 577.92 MB, 569.59 MB, 560.85 MB, 551.62 MB, 538.74 MB, 531.98 MB, 522.46 MB, 500.20 MB, 482.44 MB, 471.70 MB, 465.57 MB, 456.53 MB, 433.32 MB, 422.15 MB, 404.91 MB, 390.79 MB, 368.39 MB, 347.81 MB, 337.86 MB, 319.16 MB, 295.09 MB, 288.38 MB, 262.76 MB, 240.14 MB, 222.69 MB, 213.64 MB, 184.47 MB, 172.73 MB, 150.08 MB, 117.32 MB, 97.67 MB, 76.37 MB, 56.71 MB, 47.16 MB, 26.52 MB, 4.40 MB ThreadUsage(500.000ms): 1, 11, 7, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 793.97 MB (832533624) - PerHostPeakMemUsage: 842.09 MB (882991360) - PrepareTime: 224.764ms - RowsProduced: 194.96K (194957) - TotalCpuTime: 28s655ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 941.139ms - TotalStorageWaitTime: 7s209ms CodeGen:(Total: 489.625ms, non-child: 489.625ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 91.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 177.711ms - PrepareTime: 213.633ms DataStreamSender (dst_id=10):(Total: 158.565ms, non-child: 158.565ms, % non-child: 100.00%) - BytesSent: 8.47 MB (8883711) - NetworkThroughput(*): 142.03 MB/sec - OverallThroughput: 53.43 MB/sec - PeakMemoryUsage: 1.27 MB (1334952) - RowsReturned: 194.96K (194957) - SerializeBatchTime: 98.609ms - TransmitDataRPCTime: 59.651ms - UncompressedRowBatchSize: 23.07 MB (24189848) SUBPLAN_NODE (id=1):(Total: 24s504ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.02 MB (13647952) - RowsReturned: 194.96K (194957) - RowsReturnedRate: 7.96 K/sec HASH_JOIN_NODE (id=6):(Total: 23s888ms, non-child: 23s763ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 217.572ms - BuildRows: 2.10M (2098927) - BuildRowsPartitioned: 2.10M (2098927) - BuildTime: 158.571ms - GetNewBlockTime: 2s578ms - HashBuckets: 3.72M (3719283) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.27M (1273728) - PeakMemoryUsage: 2.14 MB (2241664) - PinTime: 0.000ns - ProbeRows: 215.23K (215230) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.430ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 43.755ms UNNEST_NODE (id=4):(Total: 31.005ms, non-child: 31.005ms, % non-child: 100.00%) - AvgCollectionSize: 26.37 - MaxCollectionSize: 2.62K (2615) - MinCollectionSize: 1 (1) - NumCollections: 79.61K (79608) - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 483.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 171.138ms, non-child: 135.005ms, % non-child: 78.89%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 215.23K (215230) - ProbeTime: 0.000ns - RowsReturned: 845.55K (845552) - RowsReturnedRate: 4.94 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 36.132ms, non-child: 36.132ms, % non-child: 100.00%) - AvgCollectionSize: 2.70 - MaxCollectionSize: 124 (124) - MinCollectionSize: 1 (1) - NumCollections: 79.61K (79608) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 55.00 /sec HDFS_SCAN_NODE (id=0):(Total: 632.512ms, non-child: 632.512ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 10 Hdfs split stats (:<# splits>/): 1:1/128.00 MB 6:1/128.00 MB 4:1/33.92 MB 10:2/256.00 MB 0:1/128.00 MB 3:2/256.00 MB 2:2/156.92 MB Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:3.704% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:1.852% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:60 BytesRead(500.000ms): 4.62 MB, 43.74 MB, 45.33 MB, 50.79 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB, 51.29 MB - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 0.35 - BytesRead: 51.29 MB (53778441) - BytesReadDataNodeCache: 0 - BytesReadLocal: 50.50 MB (52949670) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 50.50 MB (52949670) - DecompressionTime: 167.160ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 780.63 MB (818549544) - PerReadThreadRawHdfsThroughput: 13.68 MB/sec - RemoteScanRanges: 8 (8) - RowsRead: 6.68M (6680208) - RowsReturned: 79.61K (79608) - RowsReturnedRate: 125.86 K/sec - ScanRangesComplete: 10 (10) - ScannerThreadsInvoluntaryContextSwitches: 159 (159) - ScannerThreadsTotalWallClockTime: 8s868ms - MaterializeTupleTime(*): 1s283ms - ScannerThreadsSysTime: 392.020ms - ScannerThreadsUserTime: 1s192ms - ScannerThreadsVoluntaryContextSwitches: 527 (527) - TotalRawHdfsReadTime(*): 3s748ms - TotalReadThroughput: 1.90 MB/sec Instance b64a3852190d9ac2:412186998b9ee4fa (host=dn10.hadoop.trivago.com:22000):(Total: 27s176ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:2/256.00 MB 9:1/32.53 MB 10:1/35.53 MB 2:1/33.16 MB 0:1/128.00 MB 8:1/28.74 MB 6:3/384.00 MB 5:4/326.63 MB MemoryUsage(500.000ms): 260.79 KB, 217.31 MB, 591.27 MB, 664.85 MB, 798.53 MB, 837.97 MB, 847.13 MB, 846.68 MB, 843.55 MB, 823.34 MB, 814.40 MB, 806.43 MB, 792.91 MB, 778.38 MB, 756.32 MB, 735.84 MB, 728.16 MB, 719.27 MB, 701.49 MB, 693.20 MB, 683.73 MB, 672.37 MB, 650.36 MB, 643.64 MB, 621.98 MB, 594.13 MB, 584.69 MB, 564.32 MB, 547.35 MB, 534.74 MB, 517.71 MB, 508.41 MB, 487.30 MB, 474.87 MB, 455.11 MB, 426.72 MB, 416.80 MB, 396.58 MB, 368.86 MB, 359.13 MB, 341.47 MB, 319.86 MB, 296.09 MB, 285.96 MB, 266.19 MB, 243.04 MB, 233.85 MB, 216.24 MB, 200.04 MB, 182.07 MB, 165.94 MB, 144.09 MB, 132.62 MB, 111.35 MB, 88.61 MB, 72.15 MB, 54.17 MB, 32.92 MB, 5.55 MB ThreadUsage(500.000ms): 1, 13, 9, 7, 5, 5, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.63 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.60 MB (902404888) - PerHostPeakMemUsage: 908.69 MB (952827456) - PrepareTime: 210.040ms - RowsProduced: 195.26K (195265) - TotalCpuTime: 31s248ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 144.357ms - TotalStorageWaitTime: 18s809ms CodeGen:(Total: 455.975ms, non-child: 455.975ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 85.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 165.116ms - PrepareTime: 199.119ms DataStreamSender (dst_id=10):(Total: 175.218ms, non-child: 175.218ms, % non-child: 100.00%) - BytesSent: 8.54 MB (8953542) - NetworkThroughput(*): 121.43 MB/sec - OverallThroughput: 48.73 MB/sec - PeakMemoryUsage: 1.27 MB (1326760) - RowsReturned: 195.26K (195265) - SerializeBatchTime: 104.587ms - TransmitDataRPCTime: 70.316ms - UncompressedRowBatchSize: 23.11 MB (24228100) SUBPLAN_NODE (id=1):(Total: 26s690ms, non-child: 20.922ms, % non-child: 0.08%) - PeakMemoryUsage: 15.00 MB (15723584) - RowsReturned: 195.26K (195265) - RowsReturnedRate: 7.32 K/sec HASH_JOIN_NODE (id=6):(Total: 26s048ms, non-child: 25s916ms, % non-child: 99.49%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 291.487ms - BuildRows: 2.20M (2202615) - BuildRowsPartitioned: 2.20M (2202615) - BuildTime: 175.899ms - GetNewBlockTime: 2s899ms - HashBuckets: 3.89M (3889605) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.42M (1417152) - PeakMemoryUsage: 2.09 MB (2192512) - PinTime: 0.000ns - ProbeRows: 235.97K (235965) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 51.397ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 47.035ms UNNEST_NODE (id=4):(Total: 34.068ms, non-child: 34.068ms, % non-child: 100.00%) - AvgCollectionSize: 24.87 - MaxCollectionSize: 1.40K (1400) - MinCollectionSize: 1 (1) - NumCollections: 88.57K (88572) - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 117.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 180.749ms, non-child: 138.222ms, % non-child: 76.47%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.97K (235965) - ProbeTime: 0.000ns - RowsReturned: 888.23K (888230) - RowsReturnedRate: 4.91 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 42.527ms, non-child: 42.527ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 91 (91) - MinCollectionSize: 1 (1) - NumCollections: 88.57K (88572) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 23.00 /sec HDFS_SCAN_NODE (id=0):(Total: 620.997ms, non-child: 620.997ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 7:2/256.00 MB 9:1/32.53 MB 10:1/35.53 MB 2:1/33.16 MB 0:1/128.00 MB 8:1/28.74 MB 6:3/384.00 MB 5:4/326.63 MB Hdfs Read Thread Concurrency Bucket: 0:91.23% 1:7.018% 2:1.754% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 0, 15.19 MB, 37.68 MB, 46.07 MB, 54.65 MB, 55.79 MB, 57.06 MB, 57.83 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB, 58.10 MB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 0.65 - BytesRead: 58.10 MB (60927012) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.51 MB (60306644) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.51 MB (60306644) - DecompressionTime: 182.233ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 847.45 MB (888614312) - PerReadThreadRawHdfsThroughput: 13.24 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.54M (7538515) - RowsReturned: 88.57K (88572) - RowsReturnedRate: 142.63 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 185 (185) - ScannerThreadsTotalWallClockTime: 20s704ms - MaterializeTupleTime(*): 1s328ms - ScannerThreadsSysTime: 476.024ms - ScannerThreadsUserTime: 1s176ms - ScannerThreadsVoluntaryContextSwitches: 758 (758) - TotalRawHdfsReadTime(*): 4s386ms - TotalReadThroughput: 2.00 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f8 (host=dn2.hadoop.trivago.com:22000):(Total: 34s671ms, non-child: 392.362ms, % non-child: 1.13%) Hdfs split stats (:<# splits>/): 1:1/128.00 MB 0:1/34.11 MB 4:1/33.81 MB 10:3/288.56 MB 2:2/67.99 MB 9:2/160.34 MB 3:2/156.90 MB 5:1/30.51 MB 7:3/193.43 MB 6:2/160.75 MB MemoryUsage(1s000ms): 154.81 MB, 744.52 MB, 820.13 MB, 876.37 MB, 862.61 MB, 834.42 MB, 813.48 MB, 792.45 MB, 763.76 MB, 744.45 MB, 727.36 MB, 708.64 MB, 683.83 MB, 658.59 MB, 628.51 MB, 609.69 MB, 582.20 MB, 552.15 MB, 529.74 MB, 498.23 MB, 474.28 MB, 445.16 MB, 418.27 MB, 396.59 MB, 371.79 MB, 343.50 MB, 324.12 MB, 310.83 MB, 275.90 MB, 239.53 MB, 199.64 MB, 167.25 MB, 138.15 MB, 112.85 MB, 83.62 MB, 48.68 MB, 16.80 MB ThreadUsage(1s000ms): 7, 4, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 885.66 MB (928680792) - PerHostPeakMemUsage: 933.78 MB (979138528) - PrepareTime: 238.989ms - RowsProduced: 211.63K (211626) - TotalCpuTime: 39s181ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 466.233ms - TotalStorageWaitTime: 14s051ms CodeGen:(Total: 526.513ms, non-child: 526.513ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 85.572ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 207.035ms - PrepareTime: 206.068ms DataStreamSender (dst_id=10):(Total: 198.753ms, non-child: 198.753ms, % non-child: 100.00%) - BytesSent: 9.24 MB (9688892) - NetworkThroughput(*): 127.91 MB/sec - OverallThroughput: 46.49 MB/sec - PeakMemoryUsage: 1.27 MB (1334952) - RowsReturned: 211.63K (211626) - SerializeBatchTime: 126.176ms - TransmitDataRPCTime: 72.236ms - UncompressedRowBatchSize: 25.04 MB (26258124) SUBPLAN_NODE (id=1):(Total: 33s553ms, non-child: 82.933ms, % non-child: 0.25%) - PeakMemoryUsage: 12.88 MB (13507000) - RowsReturned: 211.63K (211626) - RowsReturnedRate: 6.31 K/sec HASH_JOIN_NODE (id=6):(Total: 32s791ms, non-child: 32s550ms, % non-child: 99.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 340.950ms - BuildRows: 2.36M (2364489) - BuildRowsPartitioned: 2.36M (2364489) - BuildTime: 252.256ms - GetNewBlockTime: 3s620ms - HashBuckets: 4.18M (4176427) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.50M (1502672) - PeakMemoryUsage: 2.09 MB (2192512) - PinTime: 0.000ns - ProbeRows: 251.01K (251010) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 71.596ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 59.529ms UNNEST_NODE (id=4):(Total: 44.748ms, non-child: 44.748ms, % non-child: 100.00%) - AvgCollectionSize: 25.18 - MaxCollectionSize: 1.44K (1436) - MinCollectionSize: 1 (1) - NumCollections: 93.92K (93917) - PeakMemoryUsage: 0 - RowsReturned: 34 (34) - RowsReturnedRate: 759.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 297.457ms, non-child: 245.283ms, % non-child: 82.46%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 251.01K (251010) - ProbeTime: 0.000ns - RowsReturned: 946.54K (946539) - RowsReturnedRate: 3.18 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 52.174ms, non-child: 52.174ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 85 (85) - MinCollectionSize: 1 (1) - NumCollections: 93.92K (93917) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 57.00 /sec HDFS_SCAN_NODE (id=0):(Total: 679.789ms, non-child: 679.789ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 1:1/128.00 MB 0:1/34.11 MB 4:1/33.81 MB 10:3/288.56 MB 2:2/67.99 MB 9:2/160.34 MB 3:2/156.90 MB 5:1/30.51 MB 7:3/193.43 MB 6:2/160.75 MB Hdfs Read Thread Concurrency Bucket: 0:91.78% 1:5.479% 2:1.37% 3:0% 4:0% 5:0% 6:1.37% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:108 BytesRead(1s000ms): 11.91 MB, 47.49 MB, 54.69 MB, 58.72 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB, 59.16 MB - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 0.36 - BytesRead: 59.16 MB (62032060) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.87 MB (61724860) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.87 MB (61724860) - DecompressionTime: 157.145ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 11 (11) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 869.84 MB (912096856) - PerReadThreadRawHdfsThroughput: 9.12 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.57M (7574044) - RowsReturned: 93.92K (93917) - RowsReturnedRate: 138.16 K/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 194 (194) - ScannerThreadsTotalWallClockTime: 16s001ms - MaterializeTupleTime(*): 1s314ms - ScannerThreadsSysTime: 412.021ms - ScannerThreadsUserTime: 1s196ms - ScannerThreadsVoluntaryContextSwitches: 732 (732) - TotalRawHdfsReadTime(*): 6s489ms - TotalReadThroughput: 1.60 MB/sec Instance b64a3852190d9ac2:412186998b9ee508 (host=dn1.hadoop.trivago.com:22000):(Total: 32s078ms, non-child: 148.365ms, % non-child: 0.46%) Hdfs split stats (:<# splits>/): 5:1/128.00 MB 2:1/128.00 MB 8:2/160.03 MB 7:2/256.00 MB 3:3/192.18 MB 1:1/128.00 MB 10:4/124.93 MB 6:1/29.00 MB MemoryUsage(1s000ms): 5.10 MB, 578.72 MB, 811.87 MB, 809.74 MB, 791.16 MB, 760.00 MB, 741.68 MB, 714.93 MB, 693.47 MB, 670.25 MB, 651.36 MB, 620.49 MB, 601.63 MB, 577.98 MB, 554.48 MB, 526.81 MB, 498.95 MB, 476.67 MB, 448.99 MB, 418.27 MB, 389.02 MB, 356.12 MB, 331.11 MB, 301.49 MB, 279.59 MB, 252.50 MB, 221.51 MB, 201.85 MB, 173.72 MB, 147.42 MB, 123.06 MB, 92.86 MB, 63.60 MB, 38.81 MB, 12.53 MB ThreadUsage(1s000ms): 8, 10, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.53 - BloomFilterBytes: 0 - PeakMemoryUsage: 841.72 MB (882608440) - PerHostPeakMemUsage: 889.79 MB (933013424) - PrepareTime: 231.575ms - RowsProduced: 197.64K (197638) - TotalCpuTime: 37s462ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 253.635ms - TotalStorageWaitTime: 14s276ms CodeGen:(Total: 525.751ms, non-child: 525.751ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 83.473ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 215.881ms - PrepareTime: 225.617ms DataStreamSender (dst_id=10):(Total: 186.786ms, non-child: 186.786ms, % non-child: 100.00%) - BytesSent: 8.64 MB (9057207) - NetworkThroughput(*): 132.32 MB/sec - OverallThroughput: 46.24 MB/sec - PeakMemoryUsage: 1.24 MB (1302184) - RowsReturned: 197.64K (197638) - SerializeBatchTime: 121.242ms - TransmitDataRPCTime: 65.278ms - UncompressedRowBatchSize: 23.39 MB (24522532) SUBPLAN_NODE (id=1):(Total: 31s217ms, non-child: 77.380ms, % non-child: 0.25%) - PeakMemoryUsage: 13.18 MB (13824248) - RowsReturned: 197.64K (197638) - RowsReturnedRate: 6.33 K/sec HASH_JOIN_NODE (id=6):(Total: 30s416ms, non-child: 30s191ms, % non-child: 99.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 321.265ms - BuildRows: 2.19M (2192094) - BuildRowsPartitioned: 2.19M (2192094) - BuildTime: 241.156ms - GetNewBlockTime: 3s247ms - HashBuckets: 3.88M (3881560) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.35M (1353264) - PeakMemoryUsage: 2.16 MB (2266240) - PinTime: 0.000ns - ProbeRows: 225.56K (225563) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 68.697ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 57.118ms UNNEST_NODE (id=4):(Total: 44.150ms, non-child: 44.150ms, % non-child: 100.00%) - AvgCollectionSize: 25.92 - MaxCollectionSize: 3.37K (3369) - MinCollectionSize: 1 (1) - NumCollections: 84.58K (84579) - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 951.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 281.521ms, non-child: 234.408ms, % non-child: 83.26%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 225.56K (225563) - ProbeTime: 0.000ns - RowsReturned: 855.72K (855721) - RowsReturnedRate: 3.04 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 47.112ms, non-child: 47.112ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 98 (98) - MinCollectionSize: 1 (1) - NumCollections: 84.58K (84579) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 21.00 /sec HDFS_SCAN_NODE (id=0):(Total: 723.008ms, non-child: 723.008ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 5:1/128.00 MB 2:1/128.00 MB 8:2/160.03 MB 7:2/256.00 MB 3:3/192.18 MB 1:1/128.00 MB 10:4/124.93 MB 6:1/29.00 MB Hdfs Read Thread Concurrency Bucket: 0:95.59% 1:0% 2:1.471% 3:0% 4:0% 5:0% 6:1.471% 7:0% 8:1.471% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(1s000ms): 18.17 MB, 47.49 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB, 54.14 MB - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 0.54 - BytesRead: 54.14 MB (56772667) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.75 MB (56363067) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.75 MB (56363067) - DecompressionTime: 163.682ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 827.58 MB (867779568) - PerReadThreadRawHdfsThroughput: 10.18 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 6.98M (6980385) - RowsReturned: 84.58K (84579) - RowsReturnedRate: 116.98 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 246 (246) - ScannerThreadsTotalWallClockTime: 17s098ms - MaterializeTupleTime(*): 1s454ms - ScannerThreadsSysTime: 384.017ms - ScannerThreadsUserTime: 1s300ms - ScannerThreadsVoluntaryContextSwitches: 709 (709) - TotalRawHdfsReadTime(*): 5s317ms - TotalReadThroughput: 1.59 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f2 (host=dn37.hadoop.trivago.com:22000):(Total: 28s434ms, non-child: 510.605ms, % non-child: 1.80%) Hdfs split stats (:<# splits>/): 10:1/128.00 MB 5:1/128.00 MB 6:2/63.17 MB 3:1/128.00 MB 9:2/256.00 MB 1:1/30.53 MB 8:3/188.85 MB 7:2/256.00 MB MemoryUsage(500.000ms): 0, 7.72 MB, 377.22 MB, 466.48 MB, 705.55 MB, 716.49 MB, 812.63 MB, 807.36 MB, 798.26 MB, 781.76 MB, 773.69 MB, 763.72 MB, 743.25 MB, 731.89 MB, 724.65 MB, 717.14 MB, 705.15 MB, 686.11 MB, 676.98 MB, 669.72 MB, 659.93 MB, 652.63 MB, 627.85 MB, 619.37 MB, 608.00 MB, 607.84 MB, 587.75 MB, 573.70 MB, 562.75 MB, 551.56 MB, 527.44 MB, 506.39 MB, 499.55 MB, 477.85 MB, 465.39 MB, 446.97 MB, 431.08 MB, 424.23 MB, 413.98 MB, 405.43 MB, 382.51 MB, 363.81 MB, 352.42 MB, 332.82 MB, 312.16 MB, 289.96 MB, 267.69 MB, 249.92 MB, 230.97 MB, 215.75 MB, 197.82 MB, 178.15 MB, 159.41 MB, 144.48 MB, 120.99 MB, 92.39 MB, 72.59 MB, 46.10 MB, 25.96 MB, 17.18 MB, 7.90 MB, 7.64 MB ThreadUsage(500.000ms): 1, 14, 12, 10, 7, 4, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.73 - BloomFilterBytes: 0 - PeakMemoryUsage: 826.47 MB (866621368) - PerHostPeakMemUsage: 874.63 MB (917114272) - PrepareTime: 298.116ms - RowsProduced: 196.94K (196939) - TotalCpuTime: 32s560ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36.437ms - TotalStorageWaitTime: 18s819ms CodeGen:(Total: 542.829ms, non-child: 542.829ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 72.052ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 177.766ms - PrepareTime: 212.055ms DataStreamSender (dst_id=10):(Total: 162.520ms, non-child: 162.520ms, % non-child: 100.00%) - BytesSent: 8.59 MB (9005269) - NetworkThroughput(*): 147.82 MB/sec - OverallThroughput: 52.84 MB/sec - PeakMemoryUsage: 1.22 MB (1277608) - RowsReturned: 196.94K (196939) - SerializeBatchTime: 104.112ms - TransmitDataRPCTime: 58.098ms - UncompressedRowBatchSize: 23.30 MB (24435784) SUBPLAN_NODE (id=1):(Total: 27s218ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 14.15 MB (14842088) - RowsReturned: 196.94K (196939) - RowsReturnedRate: 7.24 K/sec HASH_JOIN_NODE (id=6):(Total: 26s375ms, non-child: 26s244ms, % non-child: 99.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 254.641ms - BuildRows: 2.20M (2201254) - BuildRowsPartitioned: 2.20M (2201254) - BuildTime: 173.631ms - GetNewBlockTime: 2s958ms - HashBuckets: 3.90M (3903928) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.37M (1373712) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 229.73K (229730) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50.086ms - RowsReturned: 16 (16) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 57.726ms UNNEST_NODE (id=4):(Total: 36.281ms, non-child: 36.281ms, % non-child: 100.00%) - AvgCollectionSize: 25.64 - MaxCollectionSize: 1.72K (1719) - MinCollectionSize: 1 (1) - NumCollections: 85.86K (85857) - PeakMemoryUsage: 0 - RowsReturned: 50 (50) - RowsReturnedRate: 1.38 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 178.519ms, non-child: 139.645ms, % non-child: 78.22%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 229.73K (229730) - ProbeTime: 0.000ns - RowsReturned: 879.71K (879712) - RowsReturnedRate: 4.93 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 38.874ms, non-child: 38.874ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 104 (104) - MinCollectionSize: 1 (1) - NumCollections: 85.86K (85857) - PeakMemoryUsage: 0 - RowsReturned: 16 (16) - RowsReturnedRate: 411.00 /sec HDFS_SCAN_NODE (id=0):(Total: 911.623ms, non-child: 911.623ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 10:1/128.00 MB 5:1/128.00 MB 6:2/63.17 MB 3:1/128.00 MB 9:2/256.00 MB 1:1/30.53 MB 8:3/188.85 MB 7:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:94.92% 1:0% 2:0% 3:0% 4:1.695% 5:0% 6:0% 7:1.695% 8:0% 9:1.695% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 949.71 KB, 27.30 MB, 33.88 MB, 46.77 MB, 49.42 MB, 54.69 MB, 55.54 MB, 55.63 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB, 55.71 MB - AverageHdfsReadThreadConcurrency: 0.34 - AverageScannerThreadConcurrency: 0.76 - BytesRead: 55.71 MB (58412618) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.01 MB (57686177) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.01 MB (57686177) - DecompressionTime: 178.640ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 810.59 MB (849960744) - PerReadThreadRawHdfsThroughput: 6.43 MB/sec - RemoteScanRanges: 7 (7) - RowsRead: 7.19M (7189919) - RowsReturned: 85.86K (85857) - RowsReturnedRate: 94.18 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 210 (210) - ScannerThreadsTotalWallClockTime: 20s639ms - MaterializeTupleTime(*): 1s310ms - ScannerThreadsSysTime: 484.026ms - ScannerThreadsUserTime: 1s144ms - ScannerThreadsVoluntaryContextSwitches: 612 (612) - TotalRawHdfsReadTime(*): 8s663ms - TotalReadThroughput: 1.89 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e7 (host=dn34.hadoop.trivago.com:22000):(Total: 30s113ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/128.00 MB 8:2/164.18 MB 4:1/33.24 MB 0:1/128.00 MB 2:1/128.00 MB 9:1/29.46 MB 3:1/29.38 MB 10:4/222.19 MB 5:3/287.47 MB 1:2/160.33 MB MemoryUsage(1s000ms): 1.24 MB, 425.41 MB, 591.63 MB, 786.25 MB, 896.62 MB, 918.45 MB, 905.68 MB, 881.22 MB, 859.71 MB, 826.60 MB, 790.56 MB, 763.90 MB, 733.16 MB, 689.10 MB, 653.56 MB, 618.39 MB, 572.70 MB, 539.31 MB, 502.27 MB, 469.50 MB, 439.89 MB, 397.77 MB, 367.13 MB, 325.10 MB, 284.98 MB, 251.41 MB, 219.08 MB, 184.04 MB, 148.79 MB, 123.69 MB, 87.20 MB, 53.34 MB, 17.03 MB ThreadUsage(1s000ms): 9, 13, 9, 6, 4, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 924.43 MB (969336256) - PerHostPeakMemUsage: 972.57 MB (1019811576) - PrepareTime: 295.314ms - RowsProduced: 218.24K (218239) - TotalCpuTime: 36s807ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41.382ms - TotalStorageWaitTime: 34s261ms CodeGen:(Total: 638.564ms, non-child: 638.564ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 97.632ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 251.617ms - PrepareTime: 288.327ms DataStreamSender (dst_id=10):(Total: 182.042ms, non-child: 182.042ms, % non-child: 100.00%) - BytesSent: 9.53 MB (9990275) - NetworkThroughput(*): 144.31 MB/sec - OverallThroughput: 52.34 MB/sec - PeakMemoryUsage: 1.25 MB (1310376) - RowsReturned: 218.24K (218239) - SerializeBatchTime: 115.652ms - TransmitDataRPCTime: 66.022ms - UncompressedRowBatchSize: 25.82 MB (27078628) SUBPLAN_NODE (id=1):(Total: 29s400ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 13.65 MB (14308104) - RowsReturned: 218.24K (218239) - RowsReturnedRate: 7.42 K/sec HASH_JOIN_NODE (id=6):(Total: 28s651ms, non-child: 28s492ms, % non-child: 99.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 266.539ms - BuildRows: 2.46M (2459945) - BuildRowsPartitioned: 2.46M (2459945) - BuildTime: 194.266ms - GetNewBlockTime: 3s253ms - HashBuckets: 4.37M (4365152) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.52M (1518496) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 253.83K (253833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 54.815ms - RowsReturned: 11 (11) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 54.426ms UNNEST_NODE (id=4):(Total: 40.992ms, non-child: 40.992ms, % non-child: 100.00%) - AvgCollectionSize: 25.92 - MaxCollectionSize: 2.30K (2304) - MinCollectionSize: 1 (1) - NumCollections: 94.91K (94906) - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 2.98 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 214.240ms, non-child: 166.486ms, % non-child: 77.71%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 253.83K (253833) - ProbeTime: 0.000ns - RowsReturned: 1.05M (1047205) - RowsReturnedRate: 4.89 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 47.754ms, non-child: 47.754ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 405 (405) - MinCollectionSize: 1 (1) - NumCollections: 94.91K (94906) - PeakMemoryUsage: 0 - RowsReturned: 11 (11) - RowsReturnedRate: 230.00 /sec HDFS_SCAN_NODE (id=0):(Total: 778.284ms, non-child: 778.284ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/128.00 MB 8:2/164.18 MB 4:1/33.24 MB 0:1/128.00 MB 2:1/128.00 MB 9:1/29.46 MB 3:1/29.38 MB 10:4/222.19 MB 5:3/287.47 MB 1:2/160.33 MB Hdfs Read Thread Concurrency Bucket: 0:95.31% 1:1.562% 2:3.125% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(1s000ms): 13.83 MB, 34.57 MB, 48.44 MB, 57.46 MB, 61.17 MB, 61.58 MB, 62.19 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB, 62.36 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.28 - BytesRead: 62.36 MB (65385363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.06 MB (65078163) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.06 MB (65078163) - DecompressionTime: 203.086ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 11 (11) - NumRowGroups: 40 (40) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 912.28 MB (956592632) - PerReadThreadRawHdfsThroughput: 15.23 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 8.07M (8073900) - RowsReturned: 94.91K (94906) - RowsReturnedRate: 121.94 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 351 (351) - ScannerThreadsTotalWallClockTime: 36s807ms - MaterializeTupleTime(*): 1s947ms - ScannerThreadsSysTime: 480.023ms - ScannerThreadsUserTime: 1s668ms - ScannerThreadsVoluntaryContextSwitches: 659 (659) - TotalRawHdfsReadTime(*): 4s093ms - TotalReadThroughput: 1.95 MB/sec Instance b64a3852190d9ac2:412186998b9ee4dc (host=dn24.hadoop.trivago.com:22000):(Total: 29s485ms, non-child: 967.499ms, % non-child: 3.28%) Hdfs split stats (:<# splits>/): 8:1/32.16 MB 2:2/160.62 MB 0:1/32.83 MB 5:1/32.33 MB 1:1/128.00 MB 4:1/32.98 MB 10:2/158.36 MB 6:7/518.74 MB 9:2/63.54 MB MemoryUsage(1s000ms): 130.39 KB, 428.58 MB, 639.55 MB, 812.83 MB, 779.71 MB, 747.22 MB, 715.12 MB, 685.60 MB, 655.93 MB, 630.20 MB, 609.42 MB, 581.82 MB, 562.46 MB, 536.40 MB, 510.85 MB, 490.96 MB, 465.18 MB, 445.85 MB, 422.67 MB, 391.21 MB, 367.31 MB, 333.55 MB, 306.23 MB, 273.54 MB, 236.19 MB, 203.85 MB, 170.56 MB, 142.50 MB, 104.47 MB, 70.11 MB, 38.84 MB, 9.83 MB ThreadUsage(1s000ms): 1, 10, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 830.55 MB (870894536) - PerHostPeakMemUsage: 878.60 MB (921281936) - PrepareTime: 214.899ms - RowsProduced: 192.52K (192519) - TotalCpuTime: 33s298ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 974.095ms - TotalStorageWaitTime: 16s866ms CodeGen:(Total: 464.277ms, non-child: 464.277ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 61.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 194.677ms - PrepareTime: 207.537ms DataStreamSender (dst_id=10):(Total: 168.319ms, non-child: 168.319ms, % non-child: 100.00%) - BytesSent: 8.41 MB (8823731) - NetworkThroughput(*): 121.92 MB/sec - OverallThroughput: 49.99 MB/sec - PeakMemoryUsage: 1.26 MB (1318568) - RowsReturned: 192.52K (192519) - SerializeBatchTime: 98.990ms - TransmitDataRPCTime: 69.020ms - UncompressedRowBatchSize: 22.78 MB (23887380) SUBPLAN_NODE (id=1):(Total: 27s885ms, non-child: 30.223ms, % non-child: 0.11%) - PeakMemoryUsage: 13.94 MB (14617760) - RowsReturned: 192.52K (192519) - RowsReturnedRate: 6.90 K/sec HASH_JOIN_NODE (id=6):(Total: 27s303ms, non-child: 27s182ms, % non-child: 99.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 248.454ms - BuildRows: 2.14M (2138602) - BuildRowsPartitioned: 2.14M (2138602) - BuildTime: 168.906ms - GetNewBlockTime: 3s091ms - HashBuckets: 3.78M (3779251) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.36M (1360592) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 227.54K (227544) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.631ms - RowsReturned: 11 (11) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.722ms UNNEST_NODE (id=4):(Total: 32.968ms, non-child: 32.968ms, % non-child: 100.00%) - AvgCollectionSize: 25.15 - MaxCollectionSize: 1.84K (1837) - MinCollectionSize: 1 (1) - NumCollections: 85.04K (85037) - PeakMemoryUsage: 0 - RowsReturned: 41 (41) - RowsReturnedRate: 1.24 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 177.363ms, non-child: 143.175ms, % non-child: 80.72%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 227.54K (227544) - ProbeTime: 0.000ns - RowsReturned: 875.22K (875220) - RowsReturnedRate: 4.93 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 34.187ms, non-child: 34.187ms, % non-child: 100.00%) - AvgCollectionSize: 2.68 - MaxCollectionSize: 119 (119) - MinCollectionSize: 1 (1) - NumCollections: 85.04K (85037) - PeakMemoryUsage: 0 - RowsReturned: 11 (11) - RowsReturnedRate: 321.00 /sec HDFS_SCAN_NODE (id=0):(Total: 551.507ms, non-child: 551.507ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 18 Hdfs split stats (:<# splits>/): 8:1/32.16 MB 2:2/160.62 MB 0:1/32.83 MB 5:1/32.33 MB 1:1/128.00 MB 4:1/32.98 MB 10:2/158.36 MB 6:7/518.74 MB 9:2/63.54 MB Hdfs Read Thread Concurrency Bucket: 0:98.36% 1:1.639% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:108 BytesRead(500.000ms): 0, 30.83 MB, 31.54 MB, 35.99 MB, 52.19 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB, 55.67 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 0.49 - BytesRead: 55.67 MB (58373595) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.38 MB (58066395) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.38 MB (58066395) - DecompressionTime: 175.930ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 819.09 MB (858880096) - PerReadThreadRawHdfsThroughput: 23.83 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.06M (7062119) - RowsReturned: 85.04K (85037) - RowsReturnedRate: 154.19 K/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 204 (204) - ScannerThreadsTotalWallClockTime: 18s768ms - MaterializeTupleTime(*): 1s246ms - ScannerThreadsSysTime: 408.020ms - ScannerThreadsUserTime: 1s172ms - ScannerThreadsVoluntaryContextSwitches: 585 (585) - TotalRawHdfsReadTime(*): 2s335ms - TotalReadThroughput: 1.80 MB/sec Instance b64a3852190d9ac2:412186998b9ee4d6 (host=dn35.hadoop.trivago.com:22000):(Total: 26s899ms, non-child: 1s119ms, % non-child: 4.16%) Hdfs split stats (:<# splits>/): 7:1/32.06 MB 5:2/256.00 MB 0:1/33.34 MB 10:2/160.27 MB 8:1/33.70 MB 3:2/157.32 MB 1:1/128.00 MB 6:4/318.15 MB 4:2/58.67 MB 9:1/28.62 MB MemoryUsage(500.000ms): 0, 4.73 MB, 460.86 MB, 602.59 MB, 640.44 MB, 706.94 MB, 767.80 MB, 778.14 MB, 764.51 MB, 768.88 MB, 736.45 MB, 745.49 MB, 743.21 MB, 721.97 MB, 720.37 MB, 715.85 MB, 695.58 MB, 675.05 MB, 654.48 MB, 636.04 MB, 622.93 MB, 596.12 MB, 575.65 MB, 555.17 MB, 537.22 MB, 526.49 MB, 509.34 MB, 484.10 MB, 459.55 MB, 450.81 MB, 435.45 MB, 415.19 MB, 406.62 MB, 385.78 MB, 358.11 MB, 336.65 MB, 320.71 MB, 302.03 MB, 282.37 MB, 252.18 MB, 234.01 MB, 214.22 MB, 206.88 MB, 197.30 MB, 176.77 MB, 163.68 MB, 142.17 MB, 129.95 MB, 114.49 MB, 101.75 MB, 81.11 MB, 73.92 MB, 57.60 MB, 44.30 MB, 27.06 MB, 17.24 MB, 9.28 MB, 8.97 MB, 8.75 MB ThreadUsage(500.000ms): 1, 18, 12, 8, 7, 5, 5, 4, 4, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 795.23 MB (833856040) - PerHostPeakMemUsage: 843.33 MB (884296192) - PrepareTime: 187.604ms - RowsProduced: 215.64K (215637) - TotalCpuTime: 30s197ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 695.803ms - TotalStorageWaitTime: 28s280ms CodeGen:(Total: 380.322ms, non-child: 380.322ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 55.896ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 141.003ms - PrepareTime: 182.794ms DataStreamSender (dst_id=10):(Total: 167.222ms, non-child: 167.222ms, % non-child: 100.00%) - BytesSent: 9.40 MB (9858196) - NetworkThroughput(*): 149.68 MB/sec - OverallThroughput: 56.22 MB/sec - PeakMemoryUsage: 1.21 MB (1269416) - RowsReturned: 215.64K (215637) - SerializeBatchTime: 104.149ms - TransmitDataRPCTime: 62.810ms - UncompressedRowBatchSize: 25.52 MB (26755764) SUBPLAN_NODE (id=1):(Total: 25s232ms, non-child: 30.357ms, % non-child: 0.12%) - PeakMemoryUsage: 14.37 MB (15072408) - RowsReturned: 215.64K (215637) - RowsReturnedRate: 8.55 K/sec HASH_JOIN_NODE (id=6):(Total: 24s622ms, non-child: 24s513ms, % non-child: 99.56%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 247.708ms - BuildRows: 2.35M (2346786) - BuildRowsPartitioned: 2.35M (2346786) - BuildTime: 166.227ms - GetNewBlockTime: 2s709ms - HashBuckets: 4.16M (4158055) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.43M (1428032) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 237.96K (237955) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.738ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.818ms UNNEST_NODE (id=4):(Total: 32.430ms, non-child: 32.430ms, % non-child: 100.00%) - AvgCollectionSize: 26.29 - MaxCollectionSize: 3.78K (3781) - MinCollectionSize: 1 (1) - NumCollections: 89.25K (89252) - PeakMemoryUsage: 0 - RowsReturned: 5 (5) - RowsReturnedRate: 154.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 154.188ms, non-child: 118.785ms, % non-child: 77.04%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 237.96K (237955) - ProbeTime: 0.000ns - RowsReturned: 894.85K (894849) - RowsReturnedRate: 5.80 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 35.403ms, non-child: 35.403ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 98 (98) - MinCollectionSize: 1 (1) - NumCollections: 89.25K (89252) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 28.00 /sec HDFS_SCAN_NODE (id=0):(Total: 579.575ms, non-child: 579.575ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 7:1/32.06 MB 5:2/256.00 MB 0:1/33.34 MB 10:2/160.27 MB 8:1/33.70 MB 3:2/157.32 MB 1:1/128.00 MB 6:4/318.15 MB 4:2/58.67 MB 9:1/28.62 MB Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:5.455% 2:1.818% 3:0% 4:1.818% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(500.000ms): 450.90 KB, 35.87 MB, 40.65 MB, 44.98 MB, 49.05 MB, 53.97 MB, 53.97 MB, 55.22 MB, 55.41 MB, 55.43 MB, 57.23 MB, 57.53 MB, 57.71 MB, 58.07 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB, 58.40 MB - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 1.22 - BytesRead: 58.40 MB (61241860) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.11 MB (60934660) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.11 MB (60934660) - DecompressionTime: 189.927ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 11 (11) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 783.89 MB (821972720) - PerReadThreadRawHdfsThroughput: 16.46 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.49M (7487814) - RowsReturned: 89.25K (89252) - RowsReturnedRate: 154.00 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 184 (184) - ScannerThreadsTotalWallClockTime: 30s074ms - MaterializeTupleTime(*): 1s328ms - ScannerThreadsSysTime: 420.019ms - ScannerThreadsUserTime: 1s264ms - ScannerThreadsVoluntaryContextSwitches: 681 (681) - TotalRawHdfsReadTime(*): 3s548ms - TotalReadThroughput: 2.12 MB/sec Instance b64a3852190d9ac2:412186998b9ee4da (host=dn7.hadoop.trivago.com:22000):(Total: 24s729ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/65.22 MB 8:1/33.45 MB 7:2/160.60 MB 2:1/33.27 MB 9:3/384.00 MB 4:1/29.33 MB 5:3/286.13 MB 10:3/194.08 MB 0:1/29.56 MB MemoryUsage(500.000ms): 260.79 KB, 252.37 MB, 610.90 MB, 769.78 MB, 760.37 MB, 847.53 MB, 852.13 MB, 845.16 MB, 826.11 MB, 806.98 MB, 787.00 MB, 767.75 MB, 746.49 MB, 731.61 MB, 711.87 MB, 688.23 MB, 670.89 MB, 661.19 MB, 639.97 MB, 617.30 MB, 606.64 MB, 584.98 MB, 566.57 MB, 557.09 MB, 545.48 MB, 528.14 MB, 515.34 MB, 497.36 MB, 488.43 MB, 474.70 MB, 462.52 MB, 441.79 MB, 418.00 MB, 401.51 MB, 380.84 MB, 369.86 MB, 344.04 MB, 331.49 MB, 315.46 MB, 299.89 MB, 283.81 MB, 259.80 MB, 245.90 MB, 212.51 MB, 190.10 MB, 169.62 MB, 151.47 MB, 135.77 MB, 118.67 MB, 94.42 MB, 74.85 MB, 40.78 MB, 18.79 MB, 5.22 MB ThreadUsage(500.000ms): 1, 15, 9, 5, 5, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.61 - BloomFilterBytes: 0 - PeakMemoryUsage: 859.77 MB (901535080) - PerHostPeakMemUsage: 907.87 MB (951975232) - PrepareTime: 197.734ms - RowsProduced: 205.73K (205728) - TotalCpuTime: 28s546ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 237.693ms - TotalStorageWaitTime: 18s127ms CodeGen:(Total: 419.461ms, non-child: 419.461ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 65.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 160.395ms - PrepareTime: 192.655ms DataStreamSender (dst_id=10):(Total: 167.995ms, non-child: 167.995ms, % non-child: 100.00%) - BytesSent: 8.99 MB (9426713) - NetworkThroughput(*): 128.72 MB/sec - OverallThroughput: 53.51 MB/sec - PeakMemoryUsage: 1.21 MB (1269416) - RowsReturned: 205.73K (205728) - SerializeBatchTime: 97.866ms - TransmitDataRPCTime: 69.840ms - UncompressedRowBatchSize: 24.34 MB (25526304) SUBPLAN_NODE (id=1):(Total: 24s169ms, non-child: 21.138ms, % non-child: 0.09%) - PeakMemoryUsage: 14.19 MB (14880584) - RowsReturned: 205.73K (205728) - RowsReturnedRate: 8.51 K/sec HASH_JOIN_NODE (id=6):(Total: 23s610ms, non-child: 23s485ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 227.823ms - BuildRows: 2.30M (2297977) - BuildRowsPartitioned: 2.30M (2297977) - BuildTime: 163.725ms - GetNewBlockTime: 2s588ms - HashBuckets: 4.07M (4070511) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.43M (1430384) - PeakMemoryUsage: 2.17 MB (2270336) - PinTime: 0.000ns - ProbeRows: 238.46K (238457) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.030ms - RowsReturned: 14 (14) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 45.145ms UNNEST_NODE (id=4):(Total: 30.394ms, non-child: 30.394ms, % non-child: 100.00%) - AvgCollectionSize: 25.70 - MaxCollectionSize: 3.12K (3119) - MinCollectionSize: 1 (1) - NumCollections: 89.40K (89399) - PeakMemoryUsage: 0 - RowsReturned: 71 (71) - RowsReturnedRate: 2.33 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 171.777ms, non-child: 134.112ms, % non-child: 78.07%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 238.46K (238457) - ProbeTime: 0.000ns - RowsReturned: 938.94K (938937) - RowsReturnedRate: 5.47 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 37.665ms, non-child: 37.665ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 288 (288) - MinCollectionSize: 1 (1) - NumCollections: 89.40K (89399) - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 371.00 /sec HDFS_SCAN_NODE (id=0):(Total: 537.288ms, non-child: 537.288ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 6:2/65.22 MB 8:1/33.45 MB 7:2/160.60 MB 2:1/33.27 MB 9:3/384.00 MB 4:1/29.33 MB 5:3/286.13 MB 10:3/194.08 MB 0:1/29.56 MB Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:3.846% 2:1.923% 3:0% 4:0% 5:1.923% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(500.000ms): 0, 17.59 MB, 39.96 MB, 49.39 MB, 52.48 MB, 56.72 MB, 57.65 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB, 57.81 MB - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.63 - BytesRead: 57.81 MB (60615722) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.22 MB (59994854) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.22 MB (59994854) - DecompressionTime: 183.487ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 848.21 MB (889414208) - PerReadThreadRawHdfsThroughput: 11.37 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.41M (7405561) - RowsReturned: 89.40K (89399) - RowsReturnedRate: 166.39 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 201 (201) - ScannerThreadsTotalWallClockTime: 19s998ms - MaterializeTupleTime(*): 1s373ms - ScannerThreadsSysTime: 528.028ms - ScannerThreadsUserTime: 1s188ms - ScannerThreadsVoluntaryContextSwitches: 697 (697) - TotalRawHdfsReadTime(*): 5s084ms - TotalReadThroughput: 2.18 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e1 (host=dn8.hadoop.trivago.com:22000):(Total: 26s688ms, non-child: 779.637ms, % non-child: 2.92%) Hdfs split stats (:<# splits>/): 3:2/256.00 MB 8:1/32.57 MB 2:1/32.39 MB 0:1/32.48 MB 4:1/128.00 MB 7:2/161.90 MB 6:1/30.53 MB 5:3/285.41 MB 1:3/285.72 MB MemoryUsage(500.000ms): 0, 49.88 MB, 785.66 MB, 853.18 MB, 887.56 MB, 907.34 MB, 905.43 MB, 895.20 MB, 884.06 MB, 873.57 MB, 853.94 MB, 842.46 MB, 835.38 MB, 815.36 MB, 804.50 MB, 784.87 MB, 771.73 MB, 752.59 MB, 736.62 MB, 726.49 MB, 703.58 MB, 678.15 MB, 664.73 MB, 645.63 MB, 623.61 MB, 601.31 MB, 591.49 MB, 574.37 MB, 555.33 MB, 539.09 MB, 515.47 MB, 507.24 MB, 489.45 MB, 468.73 MB, 447.70 MB, 426.04 MB, 407.17 MB, 395.52 MB, 375.06 MB, 357.99 MB, 339.54 MB, 318.28 MB, 290.64 MB, 281.46 MB, 257.41 MB, 238.07 MB, 216.61 MB, 201.69 MB, 181.12 MB, 163.79 MB, 138.18 MB, 116.07 MB, 101.29 MB, 70.29 MB, 55.32 MB, 30.10 MB, 4.94 MB, 4.94 MB ThreadUsage(500.000ms): 1, 16, 9, 8, 4, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 0 - PeakMemoryUsage: 912.46 MB (956782824) - PerHostPeakMemUsage: 960.53 MB (1007187808) - PrepareTime: 192.826ms - RowsProduced: 205.44K (205436) - TotalCpuTime: 30s441ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 388.874ms - TotalStorageWaitTime: 15s111ms CodeGen:(Total: 422.169ms, non-child: 422.169ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 69.675ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 163.935ms - PrepareTime: 187.924ms DataStreamSender (dst_id=10):(Total: 171.078ms, non-child: 171.078ms, % non-child: 100.00%) - BytesSent: 9.01 MB (9443723) - NetworkThroughput(*): 129.55 MB/sec - OverallThroughput: 52.64 MB/sec - PeakMemoryUsage: 1.20 MB (1261224) - RowsReturned: 205.44K (205436) - SerializeBatchTime: 101.278ms - TransmitDataRPCTime: 69.520ms - UncompressedRowBatchSize: 24.31 MB (25490036) SUBPLAN_NODE (id=1):(Total: 25s315ms, non-child: 37.767ms, % non-child: 0.15%) - PeakMemoryUsage: 15.17 MB (15902248) - RowsReturned: 205.44K (205436) - RowsReturnedRate: 8.11 K/sec HASH_JOIN_NODE (id=6):(Total: 24s694ms, non-child: 24s549ms, % non-child: 99.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 260.448ms - BuildRows: 2.32M (2316657) - BuildRowsPartitioned: 2.32M (2316657) - BuildTime: 170.942ms - GetNewBlockTime: 2s809ms - HashBuckets: 4.10M (4101453) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.46M (1460272) - PeakMemoryUsage: 2.09 MB (2186368) - PinTime: 0.000ns - ProbeRows: 243.84K (243835) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.106ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.076ms UNNEST_NODE (id=4):(Total: 32.304ms, non-child: 32.304ms, % non-child: 100.00%) - AvgCollectionSize: 25.38 - MaxCollectionSize: 1.25K (1250) - MinCollectionSize: 1 (1) - NumCollections: 91.27K (91267) - PeakMemoryUsage: 0 - RowsReturned: 14 (14) - RowsReturnedRate: 433.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 187.186ms, non-child: 147.832ms, % non-child: 78.98%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 243.84K (243835) - ProbeTime: 0.000ns - RowsReturned: 921.67K (921666) - RowsReturnedRate: 4.92 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 39.354ms, non-child: 39.354ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 111 (111) - MinCollectionSize: 1 (1) - NumCollections: 91.27K (91267) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 50.00 /sec HDFS_SCAN_NODE (id=0):(Total: 583.887ms, non-child: 583.887ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 3:2/256.00 MB 8:1/32.57 MB 2:1/32.39 MB 0:1/32.48 MB 4:1/128.00 MB 7:2/161.90 MB 6:1/30.53 MB 5:3/285.41 MB 1:3/285.72 MB Hdfs Read Thread Concurrency Bucket: 0:92.73% 1:5.455% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:1.818% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 11.28 MB, 50.89 MB, 54.27 MB, 57.64 MB, 58.78 MB, 59.18 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB, 59.34 MB - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 0.64 - BytesRead: 59.34 MB (62225870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.66 MB (61509070) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.66 MB (61509070) - DecompressionTime: 174.157ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 901.92 MB (945735104) - PerReadThreadRawHdfsThroughput: 12.55 MB/sec - RemoteScanRanges: 7 (7) - RowsRead: 7.72M (7719761) - RowsReturned: 91.27K (91267) - RowsReturnedRate: 156.31 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 231 (231) - ScannerThreadsTotalWallClockTime: 16s990ms - MaterializeTupleTime(*): 1s484ms - ScannerThreadsSysTime: 364.016ms - ScannerThreadsUserTime: 1s404ms - ScannerThreadsVoluntaryContextSwitches: 704 (704) - TotalRawHdfsReadTime(*): 4s729ms - TotalReadThroughput: 2.16 MB/sec Instance b64a3852190d9ac2:412186998b9ee4e4 (host=dn30.hadoop.trivago.com:22000):(Total: 24s402ms, non-child: 353.120ms, % non-child: 1.45%) Hdfs split stats (:<# splits>/): 4:1/128.00 MB 6:1/128.00 MB 3:1/128.00 MB 2:1/128.00 MB 5:1/29.13 MB 7:2/157.89 MB 0:1/29.33 MB 8:3/96.17 MB 1:2/256.00 MB MemoryUsage(500.000ms): 0, 79.68 MB, 585.33 MB, 655.46 MB, 725.67 MB, 733.45 MB, 751.55 MB, 732.07 MB, 710.85 MB, 700.46 MB, 682.21 MB, 671.29 MB, 646.06 MB, 624.97 MB, 615.62 MB, 597.14 MB, 588.57 MB, 569.76 MB, 559.54 MB, 547.02 MB, 538.56 MB, 518.81 MB, 506.02 MB, 484.48 MB, 466.33 MB, 452.81 MB, 438.18 MB, 426.21 MB, 409.59 MB, 388.99 MB, 376.73 MB, 369.63 MB, 358.80 MB, 338.66 MB, 323.55 MB, 314.58 MB, 291.65 MB, 274.06 MB, 262.83 MB, 254.34 MB, 240.65 MB, 219.64 MB, 197.26 MB, 173.45 MB, 152.12 MB, 132.75 MB, 116.34 MB, 97.49 MB, 74.52 MB, 58.00 MB, 35.15 MB, 15.06 MB, 4.83 MB ThreadUsage(500.000ms): 1, 14, 6, 5, 4, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 752.48 MB (789028968) - PerHostPeakMemUsage: 800.53 MB (839416368) - PrepareTime: 192.933ms - RowsProduced: 185.62K (185624) - TotalCpuTime: 27s863ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 440.872ms - TotalStorageWaitTime: 11s089ms CodeGen:(Total: 453.760ms, non-child: 453.760ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 75.167ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 189.734ms - PrepareTime: 188.294ms DataStreamSender (dst_id=10):(Total: 153.223ms, non-child: 153.223ms, % non-child: 100.00%) - BytesSent: 8.09 MB (8487652) - NetworkThroughput(*): 151.91 MB/sec - OverallThroughput: 52.83 MB/sec - PeakMemoryUsage: 1.29 MB (1351336) - RowsReturned: 185.62K (185624) - SerializeBatchTime: 99.597ms - TransmitDataRPCTime: 53.285ms - UncompressedRowBatchSize: 21.96 MB (23031824) SUBPLAN_NODE (id=1):(Total: 23s442ms, non-child: 9.019ms, % non-child: 0.04%) - PeakMemoryUsage: 13.71 MB (14377056) - RowsReturned: 185.62K (185624) - RowsReturnedRate: 7.92 K/sec HASH_JOIN_NODE (id=6):(Total: 22s892ms, non-child: 22s780ms, % non-child: 99.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 235.930ms - BuildRows: 2.05M (2046959) - BuildRowsPartitioned: 2.05M (2046959) - BuildTime: 161.662ms - GetNewBlockTime: 2s612ms - HashBuckets: 3.62M (3619682) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.26M (1262896) - PeakMemoryUsage: 2.09 MB (2186368) - PinTime: 0.000ns - ProbeRows: 208.15K (208146) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.642ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 46.128ms UNNEST_NODE (id=4):(Total: 32.156ms, non-child: 32.156ms, % non-child: 100.00%) - AvgCollectionSize: 25.93 - MaxCollectionSize: 1.34K (1343) - MinCollectionSize: 1 (1) - NumCollections: 78.93K (78931) - PeakMemoryUsage: 0 - RowsReturned: 24 (24) - RowsReturnedRate: 746.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 161.251ms, non-child: 127.762ms, % non-child: 79.23%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 208.15K (208146) - ProbeTime: 0.000ns - RowsReturned: 769.99K (769994) - RowsReturnedRate: 4.78 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 33.489ms, non-child: 33.489ms, % non-child: 100.00%) - AvgCollectionSize: 2.64 - MaxCollectionSize: 95 (95) - MinCollectionSize: 1 (1) - NumCollections: 78.93K (78931) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 29.00 /sec HDFS_SCAN_NODE (id=0):(Total: 541.580ms, non-child: 541.580ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 4:1/128.00 MB 6:1/128.00 MB 3:1/128.00 MB 2:1/128.00 MB 5:1/29.13 MB 7:2/157.89 MB 0:1/29.33 MB 8:3/96.17 MB 1:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:92.16% 1:5.882% 2:0% 3:0% 4:0% 5:0% 6:0% 7:1.961% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 13.07 MB, 36.20 MB, 43.67 MB, 48.89 MB, 49.08 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 0.53 - BytesRead: 51.45 MB (53953820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.16 MB (53646620) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.16 MB (53646620) - DecompressionTime: 163.343ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 742.73 MB (778809008) - PerReadThreadRawHdfsThroughput: 13.27 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 6.69M (6691105) - RowsReturned: 78.93K (78931) - RowsReturnedRate: 145.74 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 165 (165) - ScannerThreadsTotalWallClockTime: 12s831ms - MaterializeTupleTime(*): 1s170ms - ScannerThreadsSysTime: 416.022ms - ScannerThreadsUserTime: 1s036ms - ScannerThreadsVoluntaryContextSwitches: 565 (565) - TotalRawHdfsReadTime(*): 3s878ms - TotalReadThroughput: 2.02 MB/sec Instance b64a3852190d9ac2:412186998b9ee500 (host=dn13.hadoop.trivago.com:22000):(Total: 27s828ms, non-child: 220.293ms, % non-child: 0.79%) Hdfs split stats (:<# splits>/): 1:2/160.58 MB 4:1/31.77 MB 3:1/128.00 MB 6:1/33.04 MB 9:2/161.23 MB 2:2/160.62 MB 7:2/157.31 MB 8:3/191.46 MB 0:3/193.67 MB MemoryUsage(500.000ms): 260.79 KB, 612.45 MB, 791.87 MB, 886.61 MB, 893.98 MB, 871.12 MB, 852.04 MB, 834.48 MB, 823.25 MB, 810.88 MB, 792.57 MB, 775.94 MB, 757.82 MB, 740.50 MB, 728.69 MB, 716.47 MB, 706.04 MB, 687.03 MB, 677.62 MB, 650.73 MB, 641.06 MB, 625.17 MB, 616.46 MB, 605.76 MB, 590.07 MB, 579.05 MB, 561.42 MB, 549.68 MB, 538.20 MB, 523.12 MB, 511.59 MB, 492.25 MB, 472.28 MB, 454.19 MB, 442.11 MB, 431.08 MB, 416.48 MB, 391.85 MB, 379.34 MB, 373.34 MB, 359.77 MB, 360.40 MB, 339.25 MB, 319.15 MB, 299.06 MB, 281.69 MB, 261.77 MB, 251.97 MB, 224.91 MB, 205.70 MB, 176.11 MB, 160.73 MB, 143.00 MB, 128.68 MB, 95.74 MB, 80.68 MB, 73.12 MB, 56.10 MB, 37.13 MB, 9.02 MB, 8.13 MB ThreadUsage(500.000ms): 1, 11, 5, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 903.62 MB (947510928) - PerHostPeakMemUsage: 951.69 MB (997915912) - PrepareTime: 183.177ms - RowsProduced: 203.91K (203909) - TotalCpuTime: 31s910ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 237.230ms - TotalStorageWaitTime: 9s611ms CodeGen:(Total: 401.889ms, non-child: 401.889ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 156.424ms - PrepareTime: 177.969ms DataStreamSender (dst_id=10):(Total: 177.923ms, non-child: 177.923ms, % non-child: 100.00%) - BytesSent: 8.92 MB (9350136) - NetworkThroughput(*): 120.88 MB/sec - OverallThroughput: 50.12 MB/sec - PeakMemoryUsage: 1.30 MB (1359528) - RowsReturned: 203.91K (203909) - SerializeBatchTime: 103.780ms - TransmitDataRPCTime: 73.764ms - UncompressedRowBatchSize: 24.13 MB (25300640) SUBPLAN_NODE (id=1):(Total: 27s028ms, non-child: 53.917ms, % non-child: 0.20%) - PeakMemoryUsage: 13.59 MB (14247304) - RowsReturned: 203.91K (203909) - RowsReturnedRate: 7.54 K/sec HASH_JOIN_NODE (id=6):(Total: 26s497ms, non-child: 26s343ms, % non-child: 99.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 270.543ms - BuildRows: 2.27M (2265839) - BuildRowsPartitioned: 2.27M (2265839) - BuildTime: 184.297ms - GetNewBlockTime: 3s039ms - HashBuckets: 4.01M (4007828) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.42M (1415984) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 235.58K (235581) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52.559ms - RowsReturned: 24 (24) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 49.057ms UNNEST_NODE (id=4):(Total: 34.580ms, non-child: 34.580ms, % non-child: 100.00%) - AvgCollectionSize: 25.60 - MaxCollectionSize: 1.98K (1979) - MinCollectionSize: 1 (1) - NumCollections: 88.50K (88499) - PeakMemoryUsage: 0 - RowsReturned: 106 (106) - RowsReturnedRate: 3.06 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 197.595ms, non-child: 159.937ms, % non-child: 80.94%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 235.58K (235581) - ProbeTime: 0.000ns - RowsReturned: 897.96K (897961) - RowsReturnedRate: 4.54 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 37.657ms, non-child: 37.657ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 107 (107) - MinCollectionSize: 1 (1) - NumCollections: 88.50K (88499) - PeakMemoryUsage: 0 - RowsReturned: 24 (24) - RowsReturnedRate: 637.00 /sec HDFS_SCAN_NODE (id=0):(Total: 477.350ms, non-child: 477.350ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 17 Hdfs split stats (:<# splits>/): 1:2/160.58 MB 4:1/31.77 MB 3:1/128.00 MB 6:1/33.04 MB 9:2/161.23 MB 2:2/160.62 MB 7:2/157.31 MB 8:3/191.46 MB 0:3/193.67 MB Hdfs Read Thread Concurrency Bucket: 0:96.61% 1:1.695% 2:0% 3:0% 4:1.695% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:102 BytesRead(500.000ms): 0, 45.05 MB, 52.07 MB, 56.78 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB, 58.23 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 58.23 MB (61059731) - BytesReadDataNodeCache: 0 - BytesReadLocal: 57.84 MB (60650131) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57.84 MB (60650131) - DecompressionTime: 181.224ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 891.27 MB (934567872) - PerReadThreadRawHdfsThroughput: 23.14 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.53M (7534703) - RowsReturned: 88.50K (88499) - RowsReturnedRate: 185.40 K/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 225 (225) - ScannerThreadsTotalWallClockTime: 11s391ms - MaterializeTupleTime(*): 1s369ms - ScannerThreadsSysTime: 388.017ms - ScannerThreadsUserTime: 1s300ms - ScannerThreadsVoluntaryContextSwitches: 768 (768) - TotalRawHdfsReadTime(*): 2s516ms - TotalReadThroughput: 1.94 MB/sec Instance b64a3852190d9ac2:412186998b9ee505 (host=dn19.hadoop.trivago.com:22000):(Total: 26s594ms, non-child: 473.121ms, % non-child: 1.78%) Hdfs split stats (:<# splits>/): 9:2/159.85 MB 4:2/160.78 MB 1:1/32.54 MB 5:1/128.00 MB 10:1/128.00 MB 7:2/161.56 MB 2:5/446.57 MB 0:2/61.02 MB MemoryUsage(500.000ms): 3.13 MB, 287.87 MB, 370.74 MB, 675.08 MB, 830.59 MB, 872.01 MB, 883.79 MB, 874.38 MB, 857.03 MB, 841.77 MB, 833.78 MB, 817.96 MB, 795.80 MB, 789.13 MB, 780.40 MB, 754.79 MB, 747.38 MB, 725.63 MB, 715.86 MB, 696.07 MB, 687.95 MB, 678.56 MB, 670.14 MB, 645.63 MB, 637.30 MB, 620.78 MB, 597.35 MB, 591.22 MB, 562.50 MB, 556.67 MB, 539.17 MB, 522.58 MB, 510.29 MB, 492.68 MB, 484.29 MB, 454.19 MB, 436.36 MB, 417.50 MB, 399.54 MB, 378.12 MB, 351.75 MB, 329.24 MB, 307.03 MB, 269.67 MB, 246.08 MB, 224.21 MB, 201.84 MB, 175.47 MB, 155.43 MB, 130.03 MB, 112.02 MB, 85.10 MB, 62.49 MB, 57.18 MB, 40.01 MB, 10.12 MB, 7.61 MB ThreadUsage(500.000ms): 17, 13, 10, 8, 6, 4, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 891.47 MB (934770672) - PerHostPeakMemUsage: 939.54 MB (985175656) - PrepareTime: 182.733ms - RowsProduced: 210.15K (210147) - TotalCpuTime: 30s241ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 503.195ms - TotalStorageWaitTime: 23s196ms CodeGen:(Total: 406.398ms, non-child: 406.398ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 80.854ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 146.905ms - PrepareTime: 178.029ms DataStreamSender (dst_id=10):(Total: 167.015ms, non-child: 167.015ms, % non-child: 100.00%) - BytesSent: 9.15 MB (9591249) - NetworkThroughput(*): 145.19 MB/sec - OverallThroughput: 54.77 MB/sec - PeakMemoryUsage: 1.36 MB (1425064) - RowsReturned: 210.15K (210147) - SerializeBatchTime: 103.704ms - TransmitDataRPCTime: 62.999ms - UncompressedRowBatchSize: 24.87 MB (26074608) SUBPLAN_NODE (id=1):(Total: 25s547ms, non-child: 28.274ms, % non-child: 0.11%) - PeakMemoryUsage: 13.88 MB (14554992) - RowsReturned: 210.15K (210147) - RowsReturnedRate: 8.22 K/sec HASH_JOIN_NODE (id=6):(Total: 24s867ms, non-child: 24s744ms, % non-child: 99.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 247.282ms - BuildRows: 2.36M (2356254) - BuildRowsPartitioned: 2.36M (2356254) - BuildTime: 173.195ms - GetNewBlockTime: 2s857ms - HashBuckets: 4.17M (4170737) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.48M (1475200) - PeakMemoryUsage: 2.11 MB (2208896) - PinTime: 0.000ns - ProbeRows: 246.19K (246189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 50.704ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 50.919ms UNNEST_NODE (id=4):(Total: 33.659ms, non-child: 33.659ms, % non-child: 100.00%) - AvgCollectionSize: 25.56 - MaxCollectionSize: 2.06K (2059) - MinCollectionSize: 1 (1) - NumCollections: 92.20K (92200) - PeakMemoryUsage: 0 - RowsReturned: 5 (5) - RowsReturnedRate: 148.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 170.314ms, non-child: 127.739ms, % non-child: 75.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 246.19K (246189) - ProbeTime: 0.000ns - RowsReturned: 941.53K (941534) - RowsReturnedRate: 5.53 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 42.574ms, non-child: 42.574ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 118 (118) - MinCollectionSize: 1 (1) - NumCollections: 92.20K (92200) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 23.00 /sec HDFS_SCAN_NODE (id=0):(Total: 652.163ms, non-child: 652.163ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 16 Hdfs split stats (:<# splits>/): 9:2/159.85 MB 4:2/160.78 MB 1:1/32.54 MB 5:1/128.00 MB 10:1/128.00 MB 7:2/161.56 MB 2:5/446.57 MB 0:2/61.02 MB Hdfs Read Thread Concurrency Bucket: 0:92.86% 1:3.571% 2:1.786% 3:0% 4:0% 5:1.786% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:96 BytesRead(500.000ms): 500.00 KB, 22.44 MB, 26.23 MB, 47.89 MB, 54.32 MB, 58.09 MB, 60.31 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB, 60.59 MB - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 0.96 - BytesRead: 60.59 MB (63538013) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.01 MB (62923613) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.01 MB (62923613) - DecompressionTime: 193.339ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 16 (16) - PeakMemoryUsage: 879.30 MB (922010824) - PerReadThreadRawHdfsThroughput: 12.38 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 7.85M (7852063) - RowsReturned: 92.20K (92200) - RowsReturnedRate: 141.38 K/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 190 (190) - ScannerThreadsTotalWallClockTime: 25s155ms - MaterializeTupleTime(*): 1s323ms - ScannerThreadsSysTime: 392.020ms - ScannerThreadsUserTime: 1s268ms - ScannerThreadsVoluntaryContextSwitches: 855 (855) - TotalRawHdfsReadTime(*): 4s896ms - TotalReadThroughput: 2.16 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f0 (host=dn0.hadoop.trivago.com:22000):(Total: 32s760ms, non-child: 160.915ms, % non-child: 0.49%) Hdfs split stats (:<# splits>/): 0:1/32.33 MB 4:1/128.00 MB 10:3/194.85 MB 8:2/163.87 MB 3:2/59.56 MB 6:2/156.53 MB 5:1/31.03 MB 9:1/29.75 MB 2:6/382.87 MB MemoryUsage(1s000ms): 66.97 MB, 488.95 MB, 728.76 MB, 761.80 MB, 786.11 MB, 799.68 MB, 771.66 MB, 732.43 MB, 713.87 MB, 692.20 MB, 664.07 MB, 644.69 MB, 616.85 MB, 599.49 MB, 577.64 MB, 551.13 MB, 528.64 MB, 501.72 MB, 471.79 MB, 446.23 MB, 420.72 MB, 406.16 MB, 379.18 MB, 354.83 MB, 329.65 MB, 301.12 MB, 261.19 MB, 228.63 MB, 192.13 MB, 169.89 MB, 139.06 MB, 113.54 MB, 86.04 MB, 58.41 MB, 26.90 MB ThreadUsage(1s000ms): 10, 12, 5, 5, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 823.08 MB (863060152) - PerHostPeakMemUsage: 871.18 MB (913500304) - PrepareTime: 218.225ms - RowsProduced: 210.07K (210071) - TotalCpuTime: 37s539ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 457.934ms - TotalStorageWaitTime: 30s667ms CodeGen:(Total: 529.486ms, non-child: 529.486ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 89.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 226.853ms - PrepareTime: 212.398ms DataStreamSender (dst_id=10):(Total: 199.336ms, non-child: 199.336ms, % non-child: 100.00%) - BytesSent: 9.16 MB (9605684) - NetworkThroughput(*): 131.30 MB/sec - OverallThroughput: 45.96 MB/sec - PeakMemoryUsage: 1.23 MB (1293992) - RowsReturned: 210.07K (210071) - SerializeBatchTime: 129.229ms - TransmitDataRPCTime: 69.769ms - UncompressedRowBatchSize: 24.86 MB (26065100) SUBPLAN_NODE (id=1):(Total: 31s870ms, non-child: 80.114ms, % non-child: 0.25%) - PeakMemoryUsage: 14.70 MB (15414096) - RowsReturned: 210.07K (210071) - RowsReturnedRate: 6.59 K/sec HASH_JOIN_NODE (id=6):(Total: 31s100ms, non-child: 30s883ms, % non-child: 99.30%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 333.654ms - BuildRows: 2.30M (2303123) - BuildRowsPartitioned: 2.30M (2303123) - BuildTime: 254.338ms - GetNewBlockTime: 3s381ms - HashBuckets: 4.08M (4084359) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.39M (1388448) - PeakMemoryUsage: 2.09 MB (2186368) - PinTime: 0.000ns - ProbeRows: 231.55K (231546) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 72.774ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 57.745ms UNNEST_NODE (id=4):(Total: 41.592ms, non-child: 41.592ms, % non-child: 100.00%) - AvgCollectionSize: 26.54 - MaxCollectionSize: 1.34K (1337) - MinCollectionSize: 1 (1) - NumCollections: 86.78K (86778) - PeakMemoryUsage: 0 - RowsReturned: 13 (13) - RowsReturnedRate: 312.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 282.467ms, non-child: 232.657ms, % non-child: 82.37%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 231.55K (231546) - ProbeTime: 0.000ns - RowsReturned: 875.77K (875773) - RowsReturnedRate: 3.10 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 49.809ms, non-child: 49.809ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 97 (97) - MinCollectionSize: 1 (1) - NumCollections: 86.78K (86778) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 20.00 /sec HDFS_SCAN_NODE (id=0):(Total: 690.341ms, non-child: 690.341ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 19 Hdfs split stats (:<# splits>/): 0:1/32.33 MB 4:1/128.00 MB 10:3/194.85 MB 8:2/163.87 MB 3:2/59.56 MB 6:2/156.53 MB 5:1/31.03 MB 9:1/29.75 MB 2:6/382.87 MB Hdfs Read Thread Concurrency Bucket: 0:92.75% 1:2.899% 2:0% 3:1.449% 4:1.449% 5:0% 6:0% 7:1.449% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:114 BytesRead(1s000ms): 7.71 MB, 34.77 MB, 49.28 MB, 52.83 MB, 55.32 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB, 57.33 MB - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 0.90 - BytesRead: 57.33 MB (60118031) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.84 MB (59606031) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.84 MB (59606031) - DecompressionTime: 178.065ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 19 (19) - PeakMemoryUsage: 809.65 MB (848981168) - PerReadThreadRawHdfsThroughput: 9.62 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.38M (7377742) - RowsReturned: 86.78K (86778) - RowsReturnedRate: 125.70 K/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 253 (253) - ScannerThreadsTotalWallClockTime: 32s965ms - MaterializeTupleTime(*): 1s545ms - ScannerThreadsSysTime: 412.021ms - ScannerThreadsUserTime: 1s444ms - ScannerThreadsVoluntaryContextSwitches: 942 (942) - TotalRawHdfsReadTime(*): 5s958ms - TotalReadThroughput: 1.64 MB/sec Instance b64a3852190d9ac2:412186998b9ee501 (host=dn38.hadoop.trivago.com:22000):(Total: 28s693ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:1/128.00 MB 4:1/33.69 MB 0:1/128.00 MB 5:2/256.00 MB 2:1/128.00 MB 6:2/157.55 MB 10:2/256.00 MB 8:3/94.10 MB MemoryUsage(500.000ms): 0, 2.60 MB, 199.64 MB, 505.73 MB, 713.85 MB, 829.71 MB, 843.40 MB, 829.83 MB, 813.89 MB, 793.56 MB, 785.13 MB, 775.74 MB, 768.71 MB, 746.72 MB, 736.74 MB, 725.97 MB, 720.85 MB, 712.68 MB, 704.33 MB, 693.30 MB, 681.64 MB, 662.65 MB, 653.80 MB, 645.99 MB, 632.50 MB, 621.88 MB, 600.87 MB, 592.71 MB, 582.73 MB, 569.88 MB, 560.80 MB, 535.72 MB, 518.82 MB, 507.22 MB, 486.07 MB, 467.58 MB, 460.20 MB, 439.41 MB, 431.86 MB, 420.36 MB, 407.11 MB, 382.61 MB, 364.34 MB, 350.70 MB, 328.22 MB, 309.38 MB, 287.81 MB, 267.23 MB, 258.68 MB, 241.32 MB, 220.38 MB, 200.92 MB, 192.78 MB, 165.40 MB, 152.43 MB, 133.19 MB, 115.46 MB, 92.39 MB, 85.31 MB, 58.72 MB, 43.51 MB, 15.58 MB, 3.39 MB ThreadUsage(500.000ms): 1, 14, 13, 10, 6, 4, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.71 - BloomFilterBytes: 0 - PeakMemoryUsage: 844.56 MB (885584352) - PerHostPeakMemUsage: 892.68 MB (936042088) - PrepareTime: 206.923ms - RowsProduced: 206.33K (206334) - TotalCpuTime: 35s317ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.313ms - TotalStorageWaitTime: 16s449ms CodeGen:(Total: 481.669ms, non-child: 481.669ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 79.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 200.502ms - PrepareTime: 201.211ms DataStreamSender (dst_id=10):(Total: 176.297ms, non-child: 176.297ms, % non-child: 100.00%) - BytesSent: 8.98 MB (9411920) - NetworkThroughput(*): 146.74 MB/sec - OverallThroughput: 50.91 MB/sec - PeakMemoryUsage: 1.25 MB (1310376) - RowsReturned: 206.33K (206334) - SerializeBatchTime: 114.777ms - TransmitDataRPCTime: 61.168ms - UncompressedRowBatchSize: 24.42 MB (25601484) SUBPLAN_NODE (id=1):(Total: 28s099ms, non-child: 33.637ms, % non-child: 0.12%) - PeakMemoryUsage: 14.00 MB (14683640) - RowsReturned: 206.33K (206334) - RowsReturnedRate: 7.34 K/sec HASH_JOIN_NODE (id=6):(Total: 27s216ms, non-child: 27s072ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 292.202ms - BuildRows: 2.28M (2276617) - BuildRowsPartitioned: 2.28M (2276617) - BuildTime: 192.531ms - GetNewBlockTime: 3s019ms - HashBuckets: 4.04M (4042034) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.38M (1380832) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 232.27K (232266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 54.155ms - RowsReturned: 2 (2) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 53.919ms UNNEST_NODE (id=4):(Total: 38.396ms, non-child: 38.396ms, % non-child: 100.00%) - AvgCollectionSize: 26.38 - MaxCollectionSize: 4.20K (4204) - MinCollectionSize: 1 (1) - NumCollections: 86.30K (86302) - PeakMemoryUsage: 0 - RowsReturned: 98 (98) - RowsReturnedRate: 2.55 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 191.140ms, non-child: 147.604ms, % non-child: 77.22%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 232.27K (232266) - ProbeTime: 0.000ns - RowsReturned: 924.17K (924171) - RowsReturnedRate: 4.84 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 43.535ms, non-child: 43.535ms, % non-child: 100.00%) - AvgCollectionSize: 2.69 - MaxCollectionSize: 237 (237) - MinCollectionSize: 1 (1) - NumCollections: 86.30K (86302) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 45.00 /sec HDFS_SCAN_NODE (id=0):(Total: 849.649ms, non-child: 849.649ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 13 Hdfs split stats (:<# splits>/): 3:1/128.00 MB 4:1/33.69 MB 0:1/128.00 MB 5:2/256.00 MB 2:1/128.00 MB 6:2/157.55 MB 10:2/256.00 MB 8:3/94.10 MB Hdfs Read Thread Concurrency Bucket: 0:90.16% 1:0% 2:3.279% 3:3.279% 4:0% 5:0% 6:3.279% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:78 BytesRead(500.000ms): 100.00 KB, 18.40 MB, 34.29 MB, 48.50 MB, 53.90 MB, 55.66 MB, 56.14 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB, 56.16 MB - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 0.74 - BytesRead: 56.16 MB (58888927) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.67 MB (58376927) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.67 MB (58376927) - DecompressionTime: 175.228ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 832.02 MB (872434640) - PerReadThreadRawHdfsThroughput: 5.98 MB/sec - RemoteScanRanges: 5 (5) - RowsRead: 7.29M (7291634) - RowsReturned: 86.30K (86302) - RowsReturnedRate: 101.57 K/sec - ScanRangesComplete: 13 (13) - ScannerThreadsInvoluntaryContextSwitches: 206 (206) - ScannerThreadsTotalWallClockTime: 20s833ms - MaterializeTupleTime(*): 1s334ms - ScannerThreadsSysTime: 500.026ms - ScannerThreadsUserTime: 1s144ms - ScannerThreadsVoluntaryContextSwitches: 588 (588) - TotalRawHdfsReadTime(*): 9s390ms - TotalReadThroughput: 1.84 MB/sec Instance b64a3852190d9ac2:412186998b9ee4db (host=dn50.hadoop.trivago.com:22000):(Total: 27s795ms, non-child: 1s291ms, % non-child: 4.65%) Hdfs split stats (:<# splits>/): 3:1/32.43 MB 0:1/36.82 MB 9:1/128.00 MB 2:3/191.64 MB 10:2/157.60 MB 1:1/28.61 MB 6:1/29.76 MB 5:3/384.00 MB 8:2/256.00 MB MemoryUsage(500.000ms): 260.79 KB, 211.06 MB, 573.61 MB, 688.26 MB, 825.76 MB, 837.58 MB, 865.08 MB, 857.47 MB, 833.56 MB, 834.08 MB, 814.46 MB, 801.95 MB, 791.91 MB, 782.17 MB, 770.87 MB, 753.47 MB, 744.28 MB, 734.39 MB, 722.70 MB, 707.37 MB, 685.68 MB, 674.80 MB, 666.89 MB, 657.45 MB, 633.97 MB, 623.83 MB, 605.23 MB, 584.22 MB, 576.19 MB, 558.35 MB, 545.55 MB, 545.55 MB, 534.60 MB, 526.16 MB, 501.25 MB, 480.67 MB, 459.03 MB, 440.50 MB, 419.30 MB, 393.36 MB, 372.76 MB, 354.09 MB, 329.37 MB, 321.36 MB, 299.09 MB, 282.00 MB, 261.32 MB, 242.90 MB, 220.91 MB, 200.88 MB, 186.42 MB, 168.06 MB, 147.84 MB, 129.63 MB, 96.24 MB, 69.23 MB, 56.94 MB, 31.84 MB, 5.00 MB, 4.50 MB ThreadUsage(500.000ms): 1, 15, 12, 9, 4, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.65 - BloomFilterBytes: 0 - PeakMemoryUsage: 866.35 MB (908438608) - PerHostPeakMemUsage: 914.41 MB (958826008) - PrepareTime: 214.643ms - RowsProduced: 204.20K (204200) - TotalCpuTime: 31s975ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s363ms - TotalStorageWaitTime: 19s609ms CodeGen:(Total: 460.209ms, non-child: 460.209ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 71.599ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 179.384ms - PrepareTime: 204.635ms DataStreamSender (dst_id=10):(Total: 164.514ms, non-child: 164.514ms, % non-child: 100.00%) - BytesSent: 8.94 MB (9371198) - NetworkThroughput(*): 148.28 MB/sec - OverallThroughput: 54.32 MB/sec - PeakMemoryUsage: 1.30 MB (1367720) - RowsReturned: 204.20K (204200) - SerializeBatchTime: 103.950ms - TransmitDataRPCTime: 60.271ms - UncompressedRowBatchSize: 24.16 MB (25336736) SUBPLAN_NODE (id=1):(Total: 25s879ms, non-child: 8.524ms, % non-child: 0.03%) - PeakMemoryUsage: 13.55 MB (14213400) - RowsReturned: 204.20K (204200) - RowsReturnedRate: 7.89 K/sec HASH_JOIN_NODE (id=6):(Total: 25s291ms, non-child: 25s171ms, % non-child: 99.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 258.761ms - BuildRows: 2.30M (2296370) - BuildRowsPartitioned: 2.30M (2296370) - BuildTime: 167.194ms - GetNewBlockTime: 2s819ms - HashBuckets: 4.06M (4056442) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.46M (1459168) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 242.90K (242903) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.705ms - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 49.654ms UNNEST_NODE (id=4):(Total: 32.505ms, non-child: 32.505ms, % non-child: 100.00%) - AvgCollectionSize: 25.18 - MaxCollectionSize: 4.21K (4207) - MinCollectionSize: 1 (1) - NumCollections: 91.20K (91198) - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 246.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 166.654ms, non-child: 124.502ms, % non-child: 74.71%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 242.90K (242903) - ProbeTime: 0.000ns - RowsReturned: 892.70K (892698) - RowsReturnedRate: 5.36 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 42.151ms, non-child: 42.151ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 77 (77) - MinCollectionSize: 1 (1) - NumCollections: 91.20K (91198) - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 71.00 /sec HDFS_SCAN_NODE (id=0):(Total: 579.031ms, non-child: 579.031ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 3:1/32.43 MB 0:1/36.82 MB 9:1/128.00 MB 2:3/191.64 MB 10:2/157.60 MB 1:1/28.61 MB 6:1/29.76 MB 5:3/384.00 MB 8:2/256.00 MB Hdfs Read Thread Concurrency Bucket: 0:98.25% 1:0% 2:0% 3:1.754% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 25.40 MB, 39.18 MB, 51.02 MB, 54.84 MB, 56.25 MB, 58.96 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB, 59.13 MB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 0.68 - BytesRead: 59.13 MB (62006195) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.14 MB (60968210) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.14 MB (60968210) - DecompressionTime: 196.055ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 10 (10) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 852.09 MB (893478584) - PerReadThreadRawHdfsThroughput: 17.19 MB/sec - RemoteScanRanges: 10 (10) - RowsRead: 7.60M (7603671) - RowsReturned: 91.20K (91198) - RowsReturnedRate: 157.50 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 203 (203) - ScannerThreadsTotalWallClockTime: 22s895ms - MaterializeTupleTime(*): 1s415ms - ScannerThreadsSysTime: 516.029ms - ScannerThreadsUserTime: 1s268ms - ScannerThreadsVoluntaryContextSwitches: 587 (587) - TotalRawHdfsReadTime(*): 3s440ms - TotalReadThroughput: 2.04 MB/sec Instance b64a3852190d9ac2:412186998b9ee507 (host=dn20.hadoop.trivago.com:22000):(Total: 23s927ms, non-child: 364.038ms, % non-child: 1.52%) Hdfs split stats (:<# splits>/): 9:1/128.00 MB 8:1/128.00 MB 1:3/287.46 MB 4:3/195.38 MB 0:1/30.31 MB 5:1/128.00 MB 3:2/160.23 MB MemoryUsage(500.000ms): 260.79 KB, 200.62 MB, 469.35 MB, 633.31 MB, 767.08 MB, 769.36 MB, 754.96 MB, 753.82 MB, 739.67 MB, 729.48 MB, 722.92 MB, 702.41 MB, 689.01 MB, 679.70 MB, 672.17 MB, 652.82 MB, 640.35 MB, 628.79 MB, 617.25 MB, 610.64 MB, 590.35 MB, 578.19 MB, 562.58 MB, 557.09 MB, 535.41 MB, 526.99 MB, 507.89 MB, 484.28 MB, 464.40 MB, 442.48 MB, 419.70 MB, 388.03 MB, 374.42 MB, 353.57 MB, 338.68 MB, 304.85 MB, 285.13 MB, 265.97 MB, 250.06 MB, 232.87 MB, 211.80 MB, 189.95 MB, 172.11 MB, 154.26 MB, 135.29 MB, 113.51 MB, 96.66 MB, 75.47 MB, 52.98 MB, 29.74 MB, 12.20 MB, 11.60 MB ThreadUsage(500.000ms): 1, 11, 7, 4, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 770.84 MB (808283680) - PerHostPeakMemUsage: 818.95 MB (858728936) - PrepareTime: 210.275ms - RowsProduced: 181.09K (181089) - TotalCpuTime: 27s502ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.039ms - TotalStorageWaitTime: 9s722ms CodeGen:(Total: 463.376ms, non-child: 463.376ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 74.465ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 183.810ms - PrepareTime: 204.313ms DataStreamSender (dst_id=10):(Total: 145.628ms, non-child: 145.628ms, % non-child: 100.00%) - BytesSent: 7.87 MB (8257298) - NetworkThroughput(*): 148.07 MB/sec - OverallThroughput: 54.07 MB/sec - PeakMemoryUsage: 1.30 MB (1367720) - RowsReturned: 181.09K (181089) - SerializeBatchTime: 92.171ms - TransmitDataRPCTime: 53.183ms - UncompressedRowBatchSize: 21.43 MB (22469196) SUBPLAN_NODE (id=1):(Total: 22s954ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 15.58 MB (16338448) - RowsReturned: 181.09K (181089) - RowsReturnedRate: 7.89 K/sec HASH_JOIN_NODE (id=6):(Total: 22s401ms, non-child: 22s281ms, % non-child: 99.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 236.139ms - BuildRows: 2.01M (2010572) - BuildRowsPartitioned: 2.01M (2010572) - BuildTime: 158.283ms - GetNewBlockTime: 2s557ms - HashBuckets: 3.57M (3568758) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.23M (1228384) - PeakMemoryUsage: 2.11 MB (2212992) - PinTime: 0.000ns - ProbeRows: 206.46K (206462) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.230ms - RowsReturned: 13 (13) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 43.714ms UNNEST_NODE (id=4):(Total: 29.751ms, non-child: 29.751ms, % non-child: 100.00%) - AvgCollectionSize: 26.19 - MaxCollectionSize: 2.13K (2127) - MinCollectionSize: 1 (1) - NumCollections: 76.77K (76774) - PeakMemoryUsage: 0 - RowsReturned: 34 (34) - RowsReturnedRate: 1.14 K/sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 158.641ms, non-child: 123.941ms, % non-child: 78.13%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 206.46K (206462) - ProbeTime: 0.000ns - RowsReturned: 799.03K (799030) - RowsReturnedRate: 5.04 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 34.700ms, non-child: 34.700ms, % non-child: 100.00%) - AvgCollectionSize: 2.69 - MaxCollectionSize: 135 (135) - MinCollectionSize: 1 (1) - NumCollections: 76.77K (76774) - PeakMemoryUsage: 0 - RowsReturned: 13 (13) - RowsReturnedRate: 374.00 /sec HDFS_SCAN_NODE (id=0):(Total: 561.796ms, non-child: 561.796ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 12 Hdfs split stats (:<# splits>/): 9:1/128.00 MB 8:1/128.00 MB 1:3/287.46 MB 4:3/195.38 MB 0:1/30.31 MB 5:1/128.00 MB 3:2/160.23 MB Hdfs Read Thread Concurrency Bucket: 0:91.84% 1:4.082% 2:0% 3:2.041% 4:2.041% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:72 BytesRead(500.000ms): 0, 17.12 MB, 33.02 MB, 43.22 MB, 49.67 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB, 50.35 MB - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 0.43 - BytesRead: 50.35 MB (52797281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 49.76 MB (52180182) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 49.76 MB (52180182) - DecompressionTime: 162.321ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 8 (8) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 761.00 MB (797967864) - PerReadThreadRawHdfsThroughput: 12.02 MB/sec - RemoteScanRanges: 6 (6) - RowsRead: 6.54M (6539321) - RowsReturned: 76.77K (76774) - RowsReturnedRate: 136.66 K/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 192 (192) - ScannerThreadsTotalWallClockTime: 11s461ms - MaterializeTupleTime(*): 1s374ms - ScannerThreadsSysTime: 404.020ms - ScannerThreadsUserTime: 1s232ms - ScannerThreadsVoluntaryContextSwitches: 501 (501) - TotalRawHdfsReadTime(*): 4s190ms - TotalReadThroughput: 2.01 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f6 (host=dn36.hadoop.trivago.com:22000):(Total: 26s263ms, non-child: 357.082ms, % non-child: 1.36%) Hdfs split stats (:<# splits>/): 4:1/128.00 MB 5:1/32.50 MB 7:3/384.00 MB 10:1/29.99 MB 1:2/159.84 MB 2:2/158.40 MB 9:2/256.00 MB 8:2/157.92 MB MemoryUsage(500.000ms): 0, 3.36 MB, 620.83 MB, 950.51 MB, 939.93 MB, 925.88 MB, 917.38 MB, 899.14 MB, 887.32 MB, 871.71 MB, 844.62 MB, 829.90 MB, 812.32 MB, 803.88 MB, 782.56 MB, 765.72 MB, 743.84 MB, 724.80 MB, 705.96 MB, 693.96 MB, 680.27 MB, 658.29 MB, 641.32 MB, 621.29 MB, 601.60 MB, 580.84 MB, 558.45 MB, 548.30 MB, 526.66 MB, 506.76 MB, 485.43 MB, 469.99 MB, 459.33 MB, 437.91 MB, 417.76 MB, 396.08 MB, 376.75 MB, 356.51 MB, 347.06 MB, 323.95 MB, 292.32 MB, 282.07 MB, 261.81 MB, 241.55 MB, 225.14 MB, 205.85 MB, 194.11 MB, 175.84 MB, 157.70 MB, 139.94 MB, 128.02 MB, 108.31 MB, 91.54 MB, 73.89 MB, 41.71 MB, 20.17 MB, 4.93 MB ThreadUsage(500.000ms): 1, 15, 10, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 961.93 MB (1008659352) - PerHostPeakMemUsage: 1009.99 MB (1059046752) - PrepareTime: 234.112ms - RowsProduced: 213.32K (213319) - TotalCpuTime: 30s026ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 502.719ms - TotalStorageWaitTime: 7s899ms CodeGen:(Total: 517.464ms, non-child: 517.464ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 76.702ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 212.385ms - PrepareTime: 227.438ms DataStreamSender (dst_id=10):(Total: 159.029ms, non-child: 159.029ms, % non-child: 100.00%) - BytesSent: 9.32 MB (9770511) - NetworkThroughput(*): 150.42 MB/sec - OverallThroughput: 58.59 MB/sec - PeakMemoryUsage: 1.23 MB (1285800) - RowsReturned: 213.32K (213319) - SerializeBatchTime: 96.781ms - TransmitDataRPCTime: 61.947ms - UncompressedRowBatchSize: 25.24 MB (26468128) SUBPLAN_NODE (id=1):(Total: 25s229ms, non-child: 9.392ms, % non-child: 0.04%) - PeakMemoryUsage: 13.60 MB (14260976) - RowsReturned: 213.32K (213319) - RowsReturnedRate: 8.46 K/sec HASH_JOIN_NODE (id=6):(Total: 24s602ms, non-child: 24s435ms, % non-child: 99.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 249.028ms - BuildRows: 2.41M (2411102) - BuildRowsPartitioned: 2.41M (2411102) - BuildTime: 166.734ms - GetNewBlockTime: 2s662ms - HashBuckets: 4.27M (4265475) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.52M (1521808) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 255.44K (255445) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.907ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 45.562ms UNNEST_NODE (id=4):(Total: 31.198ms, non-child: 31.198ms, % non-child: 100.00%) - AvgCollectionSize: 25.35 - MaxCollectionSize: 4.45K (4452) - MinCollectionSize: 1 (1) - NumCollections: 95.11K (95113) - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 128.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 212.677ms, non-child: 169.435ms, % non-child: 79.67%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 255.44K (255445) - ProbeTime: 0.000ns - RowsReturned: 992.66K (992656) - RowsReturnedRate: 4.67 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 43.242ms, non-child: 43.242ms, % non-child: 100.00%) - AvgCollectionSize: 2.69 - MaxCollectionSize: 154 (154) - MinCollectionSize: 1 (1) - NumCollections: 95.11K (95113) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 23.00 /sec HDFS_SCAN_NODE (id=0):(Total: 618.046ms, non-child: 618.046ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 14 Hdfs split stats (:<# splits>/): 4:1/128.00 MB 5:1/32.50 MB 7:3/384.00 MB 10:1/29.99 MB 1:2/159.84 MB 2:2/158.40 MB 9:2/256.00 MB 8:2/157.92 MB Hdfs Read Thread Concurrency Bucket: 0:96.36% 1:0% 2:0% 3:1.818% 4:0% 5:0% 6:1.818% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:84 BytesRead(500.000ms): 400.00 KB, 48.14 MB, 60.72 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB, 61.09 MB - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 0.47 - BytesRead: 61.09 MB (64056649) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.70 MB (63647049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.70 MB (63647049) - DecompressionTime: 194.669ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 40 (40) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 949.44 MB (995563600) - PerReadThreadRawHdfsThroughput: 15.01 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.91M (7907964) - RowsReturned: 95.11K (95113) - RowsReturnedRate: 153.89 K/sec - ScanRangesComplete: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 294 (294) - ScannerThreadsTotalWallClockTime: 9s932ms - MaterializeTupleTime(*): 1s604ms - ScannerThreadsSysTime: 468.025ms - ScannerThreadsUserTime: 1s476ms - ScannerThreadsVoluntaryContextSwitches: 732 (732) - TotalRawHdfsReadTime(*): 4s068ms - TotalReadThroughput: 2.22 MB/sec Instance b64a3852190d9ac2:412186998b9ee506 (host=dn29.hadoop.trivago.com:22000):(Total: 28s218ms, non-child: 133.512ms, % non-child: 0.47%) Hdfs split stats (:<# splits>/): 3:1/33.25 MB 2:1/33.34 MB 10:2/160.71 MB 5:3/287.46 MB 8:1/128.00 MB 9:2/256.00 MB 4:2/61.39 MB 0:3/285.43 MB MemoryUsage(500.000ms): 260.79 KB, 473.75 MB, 546.90 MB, 567.95 MB, 649.03 MB, 859.81 MB, 883.54 MB, 876.96 MB, 862.72 MB, 863.95 MB, 852.31 MB, 833.14 MB, 825.00 MB, 817.60 MB, 805.69 MB, 789.95 MB, 780.23 MB, 760.72 MB, 752.68 MB, 736.00 MB, 725.19 MB, 704.26 MB, 683.31 MB, 673.89 MB, 654.25 MB, 635.40 MB, 623.11 MB, 596.72 MB, 575.23 MB, 558.35 MB, 540.25 MB, 516.15 MB, 488.58 MB, 471.63 MB, 463.08 MB, 432.92 MB, 418.80 MB, 396.04 MB, 375.55 MB, 356.24 MB, 339.48 MB, 331.34 MB, 323.31 MB, 298.08 MB, 278.11 MB, 268.66 MB, 251.34 MB, 225.89 MB, 203.09 MB, 178.78 MB, 172.34 MB, 156.20 MB, 135.34 MB, 125.78 MB, 107.90 MB, 97.95 MB, 78.64 MB, 55.09 MB, 43.09 MB, 17.48 MB, 5.14 MB ThreadUsage(500.000ms): 1, 14, 10, 8, 5, 4, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 894.45 MB (937898808) - PerHostPeakMemUsage: 942.59 MB (988374128) - PrepareTime: 219.317ms - RowsProduced: 201.52K (201518) - TotalCpuTime: 32s446ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.518ms - TotalStorageWaitTime: 19s291ms CodeGen:(Total: 474.151ms, non-child: 474.151ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 66.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 192.763ms - PrepareTime: 213.684ms DataStreamSender (dst_id=10):(Total: 164.936ms, non-child: 164.936ms, % non-child: 100.00%) - BytesSent: 8.80 MB (9227315) - NetworkThroughput(*): 122.96 MB/sec - OverallThroughput: 53.35 MB/sec - PeakMemoryUsage: 1.23 MB (1285800) - RowsReturned: 201.52K (201518) - SerializeBatchTime: 93.093ms - TransmitDataRPCTime: 71.567ms - UncompressedRowBatchSize: 23.85 MB (25004000) SUBPLAN_NODE (id=1):(Total: 27s445ms, non-child: 17.760ms, % non-child: 0.06%) - PeakMemoryUsage: 14.06 MB (14744224) - RowsReturned: 201.52K (201518) - RowsReturnedRate: 7.34 K/sec HASH_JOIN_NODE (id=6):(Total: 26s867ms, non-child: 26s742ms, % non-child: 99.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 242.076ms - BuildRows: 2.28M (2281876) - BuildRowsPartitioned: 2.28M (2281876) - BuildTime: 163.281ms - GetNewBlockTime: 3s045ms - HashBuckets: 4.04M (4036310) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.45M (1449088) - PeakMemoryUsage: 2.11 MB (2212992) - PinTime: 0.000ns - ProbeRows: 242.04K (242044) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.859ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 44.206ms UNNEST_NODE (id=4):(Total: 33.443ms, non-child: 33.443ms, % non-child: 100.00%) - AvgCollectionSize: 25.20 - MaxCollectionSize: 2.38K (2382) - MinCollectionSize: 1 (1) - NumCollections: 90.57K (90568) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 29.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 177.928ms, non-child: 142.017ms, % non-child: 79.82%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 242.04K (242044) - ProbeTime: 0.000ns - RowsReturned: 923.26K (923257) - RowsReturnedRate: 5.19 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 35.911ms, non-child: 35.911ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 139 (139) - MinCollectionSize: 1 (1) - NumCollections: 90.57K (90568) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 27.00 /sec HDFS_SCAN_NODE (id=0):(Total: 560.757ms, non-child: 560.757ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 3:1/33.25 MB 2:1/33.34 MB 10:2/160.71 MB 5:3/287.46 MB 8:1/128.00 MB 9:2/256.00 MB 4:2/61.39 MB 0:3/285.43 MB Hdfs Read Thread Concurrency Bucket: 0:94.92% 1:0% 2:5.085% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 33.17 MB, 37.05 MB, 38.17 MB, 45.12 MB, 55.91 MB, 58.33 MB, 58.53 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB, 58.73 MB - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 0.64 - BytesRead: 58.73 MB (61585235) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.34 MB (61175635) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.34 MB (61175635) - DecompressionTime: 163.646ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 9 (9) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 882.04 MB (924884336) - PerReadThreadRawHdfsThroughput: 14.43 MB/sec - RemoteScanRanges: 4 (4) - RowsRead: 7.58M (7580653) - RowsReturned: 90.57K (90568) - RowsReturnedRate: 161.51 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 260 (260) - ScannerThreadsTotalWallClockTime: 21s197ms - MaterializeTupleTime(*): 1s509ms - ScannerThreadsSysTime: 412.022ms - ScannerThreadsUserTime: 1s340ms - ScannerThreadsVoluntaryContextSwitches: 685 (685) - TotalRawHdfsReadTime(*): 4s068ms - TotalReadThroughput: 1.96 MB/sec Instance b64a3852190d9ac2:412186998b9ee4f7 (host=dn51.hadoop.trivago.com:22000):(Total: 25s475ms, non-child: 1s278ms, % non-child: 5.02%) Hdfs split stats (:<# splits>/): 0:1/36.48 MB 7:1/128.00 MB 4:1/128.00 MB 1:1/34.32 MB 6:1/32.06 MB 5:1/128.00 MB 10:3/200.91 MB 8:1/31.58 MB 3:2/162.14 MB 2:1/128.00 MB 9:2/164.31 MB MemoryUsage(500.000ms): 260.79 KB, 697.88 MB, 735.70 MB, 764.82 MB, 746.11 MB, 726.61 MB, 707.82 MB, 809.51 MB, 804.89 MB, 781.62 MB, 772.46 MB, 743.47 MB, 722.68 MB, 709.89 MB, 696.49 MB, 684.42 MB, 664.79 MB, 655.69 MB, 645.75 MB, 634.96 MB, 626.63 MB, 616.66 MB, 601.02 MB, 587.57 MB, 559.86 MB, 550.19 MB, 530.49 MB, 517.92 MB, 501.67 MB, 483.94 MB, 474.07 MB, 465.13 MB, 438.37 MB, 412.41 MB, 389.36 MB, 364.99 MB, 344.21 MB, 323.74 MB, 298.62 MB, 282.06 MB, 258.16 MB, 237.10 MB, 215.78 MB, 185.62 MB, 177.54 MB, 151.06 MB, 134.91 MB, 113.27 MB, 84.25 MB, 63.68 MB, 45.60 MB, 26.52 MB, 6.85 MB, 6.71 MB, 6.38 MB ThreadUsage(500.000ms): 1, 8, 8, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 811.16 MB (850560312) - PerHostPeakMemUsage: 859.28 MB (901018048) - PrepareTime: 230.177ms - RowsProduced: 197.08K (197079) - TotalCpuTime: 28s521ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 891.055ms - TotalStorageWaitTime: 12s823ms CodeGen:(Total: 414.989ms, non-child: 414.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 58.991ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.12 MB (2220480) - NumFunctions: 87 (87) - NumInstructions: 3.04K (3043) - OptimizationTime: 130.761ms - PrepareTime: 224.398ms DataStreamSender (dst_id=10):(Total: 156.553ms, non-child: 156.553ms, % non-child: 100.00%) - BytesSent: 8.60 MB (9018598) - NetworkThroughput(*): 146.86 MB/sec - OverallThroughput: 54.94 MB/sec - PeakMemoryUsage: 1.29 MB (1351336) - RowsReturned: 197.08K (197079) - SerializeBatchTime: 97.696ms - TransmitDataRPCTime: 58.565ms - UncompressedRowBatchSize: 23.32 MB (24453192) SUBPLAN_NODE (id=1):(Total: 23s625ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 14.92 MB (15649816) - RowsReturned: 197.08K (197079) - RowsReturnedRate: 8.34 K/sec HASH_JOIN_NODE (id=6):(Total: 23s044ms, non-child: 22s935ms, % non-child: 99.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildPartitionTime: 211.706ms - BuildRows: 2.19M (2187497) - BuildRowsPartitioned: 2.19M (2187497) - BuildTime: 156.372ms - GetNewBlockTime: 2s598ms - HashBuckets: 3.88M (3878522) - HashCollisions: 0 (0) - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 1.35M (1353296) - PeakMemoryUsage: 2.17 MB (2274432) - PinTime: 0.000ns - ProbeRows: 225.91K (225912) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.584ms - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 44.801ms UNNEST_NODE (id=4):(Total: 30.038ms, non-child: 30.038ms, % non-child: 100.00%) - AvgCollectionSize: 25.86 - MaxCollectionSize: 3.39K (3394) - MinCollectionSize: 1 (1) - NumCollections: 84.58K (84581) - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 233.00 /sec NESTED_LOOP_JOIN_NODE (id=5):(Total: 151.397ms, non-child: 115.505ms, % non-child: 76.29%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 225.91K (225912) - ProbeTime: 0.000ns - RowsReturned: 857.75K (857748) - RowsReturnedRate: 5.67 M/sec SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3):(Total: 35.891ms, non-child: 35.891ms, % non-child: 100.00%) - AvgCollectionSize: 2.67 - MaxCollectionSize: 86 (86) - MinCollectionSize: 1 (1) - NumCollections: 84.58K (84581) - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 27.00 /sec HDFS_SCAN_NODE (id=0):(Total: 606.539ms, non-child: 606.539ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 15 Hdfs split stats (:<# splits>/): 0:1/36.48 MB 7:1/128.00 MB 4:1/128.00 MB 1:1/34.32 MB 6:1/32.06 MB 5:1/128.00 MB 10:3/200.91 MB 8:1/31.58 MB 3:2/162.14 MB 2:1/128.00 MB 9:2/164.31 MB Hdfs Read Thread Concurrency Bucket: 0:94.12% 1:3.922% 2:1.961% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:90 BytesRead(500.000ms): 0, 44.28 MB, 47.28 MB, 50.77 MB, 50.98 MB, 50.98 MB, 50.98 MB, 56.63 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB, 56.65 MB - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 0.45 - BytesRead: 56.65 MB (59404357) - BytesReadDataNodeCache: 0 - BytesReadLocal: 56.35 MB (59087145) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 56.35 MB (59087145) - DecompressionTime: 192.964ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDisksAccessed: 12 (12) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 802.18 MB (841142640) - PerReadThreadRawHdfsThroughput: 17.68 MB/sec - RemoteScanRanges: 3 (3) - RowsRead: 7.30M (7302791) - RowsReturned: 84.58K (84581) - RowsReturnedRate: 139.45 K/sec - ScanRangesComplete: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 195 (195) - ScannerThreadsTotalWallClockTime: 14s723ms - MaterializeTupleTime(*): 1s432ms - ScannerThreadsSysTime: 492.026ms - ScannerThreadsUserTime: 1s264ms - ScannerThreadsVoluntaryContextSwitches: 568 (568) - TotalRawHdfsReadTime(*): 3s203ms - TotalReadThroughput: 2.18 MB/sec