Query (id=2444893a7dcb3aa7:67d1dfc00000000) Summary Session ID: 564999c6771f8c8d:bf38a19dfa6bfe88 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2017-02-02 19:19:02.216174000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.7.0-cdh5.9.0 RELEASE (build 4b4cf1936bd6cdf34fda5e2f32827e7d60c07a9c) User: adwhuemaster Connected User: adwhuemaster Delegated User: Network Address: 10.132.3.228:16977 Default Db: report Sql Statement: select * from detail.fact_transaction_process_date_detail f where process_date_key in (select date_key from shared.dim_date where date_key = '2016-01-01') Coordinator: ux-reporting-engine-worker-7-prod-us-east-1a:22000 Query Options (non default): MEM_LIMIT=10737418240,QUERY_TIMEOUT_S=600 Plan: ---------------- Estimated Per-Host Requirements: Memory=5.05GB VCores=3 09:EXCHANGE [UNPARTITIONED] | hosts=24 per-host-mem=unavailable | tuple-ids=3,5N row-size=1.40KB cardinality=783401 | 06:HASH JOIN [LEFT SEMI JOIN, BROADCAST] | hash predicates: process_date_key = date_key | runtime filters: RF000 <- date_key | hosts=24 per-host-mem=29B | tuple-ids=3,5N row-size=1.40KB cardinality=783401 | |--08:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=8 row-size=26B cardinality=1 | | | 05:SCAN HDFS [shared.dim_date, RANDOM] | partitions=1/1 files=1 size=270.55KB | predicates: date_key = '2016-01-01' | table stats: 4016 rows total | column stats: all | hosts=1 per-host-mem=16.00MB | tuple-ids=8 row-size=26B cardinality=1 | 04:HASH JOIN [LEFT OUTER JOIN, BROADCAST] | hash predicates: tid = realtime.dim_transaction_process_date_detail_exta.tid, process_date_key = realtime.dim_transaction_process_date_detail_exta.process_date_key | hosts=24 per-host-mem=1.30GB | tuple-ids=3,5N row-size=1.40KB cardinality=1620073457 | |--07:EXCHANGE [BROADCAST] | | hosts=24 per-host-mem=0B | | tuple-ids=5 row-size=254B cardinality=4992822 | | | 03:SCAN HDFS [realtime.dim_transaction_process_date_detail_exta, RANDOM] | partitions=214/214 files=214 size=317.64MB | runtime filters: RF000 -> realtime.dim_transaction_process_date_detail_exta.process_date_key | table stats: 4992822 rows total | column stats: all | hosts=24 per-host-mem=240.00MB | tuple-ids=5 row-size=254B cardinality=4992822 | 00:UNION | hosts=24 per-host-mem=0B | tuple-ids=3 row-size=1.16KB cardinality=1620073457 | |--02:SCAN HDFS [realtime.fact_transaction_process_date_detail_extb, RANDOM] | partitions=214/214 files=214 size=924.85MB | runtime filters: RF000 -> realtime.fact_transaction_process_date_detail_extb.process_date_key | table stats: 4994775 rows total | column stats: all | hosts=24 per-host-mem=768.00MB | tuple-ids=1 row-size=1.11KB cardinality=4994775 | 01:SCAN HDFS [detail.fact_transaction_process_date_detail_extb, RANDOM] partitions=1854/1854 files=3353 size=247.38GB runtime filters: RF000 -> detail.fact_transaction_process_date_detail_extb.process_date_key table stats: 1615078682 rows total column stats: all hosts=24 per-host-mem=3.75GB tuple-ids=0 row-size=1.16KB cardinality=1615078682 ---------------- Estimated Per-Host Mem: 5422267767 Estimated Per-Host VCores: 3 Request Pool: root.default Admission result: Admitted immediately - ComputeScanRangeAssignmentTimer: 7999984 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 13241695 Equivalence classes computed: 20052555 Single node plan created: 34040300 Runtime filters computed: 34209388 Distributed plan created: 41637167 Lineage info computed: 43264903 Planning finished: 47537646 Query Timeline Start execution: 0 Planning finished: 103999774 Submit for admission: 123999732 Completed admission: 123999732 Ready to start 49 remote fragments: 139999696 All 49 remote fragments started: 371999198 First dynamic filter received: 887998084 Rows available: 1267997268 First row fetched: 1919995862 ImpalaServer - ClientFetchWaitTimer: 651998594 - InactiveTotalTime: 0 - RowMaterializationTimer: 11999974 - TotalTime: 0 Execution Profile 2444893a7dcb3aa7:67d1dfc00000000 Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------------------- 0 6 1, 2, 3 24, 24, 24 LOCAL, LOCAL, REMOTE true, true, true 1 (24) N/A N/A true Fragment start latencies: Count: 49, 25th %-ile: 5ms, 50th %-ile: 9ms, 75th %-ile: 31ms, 90th %-ile: 39ms, 95th %-ile: 50ms, 99.9th %-ile: 126ms Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------------------- 0 6 1, 2, 3 24, 24, 24 LOCAL, LOCAL, REMOTE true, true, true 0 (24) 887.998ms 887.998ms false - FiltersReceived: 1 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 1127997572 Coordinator Fragment F05 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 25350728 - PerHostPeakMemUsage: 0 - PrepareTime: 0 - RowsProduced: 1024 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 883998096 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 883998096 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 64 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 EXCHANGE_NODE (id=9) - BytesReceived: 11777519 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 35999922 - FirstBatchArrivalWaitTime: 883998096 - InactiveTotalTime: 883998096 - PeakMemoryUsage: 0 - RowsReturned: 1024 - RowsReturnedRate: 1158 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 883998096 Averaged Fragment F02 split sizes: min: 10.21 GB, max: 10.53 GB, avg: 10.35 GB, stddev: 76.81 MB - AverageThreadTokens: 1.1775085034013606 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 20217147 - PerHostPeakMemUsage: 20347645 - PrepareTime: 50499259 - RowsProduced: 1024 - TotalCpuTime: 5626826367 - TotalNetworkReceiveTime: 91499096 - TotalNetworkSendTime: 166667 - TotalStorageWaitTime: 1833339 - TotalTime: 170331094 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 40 - BlocksRecycled: 23 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 666658 - CompileTime: 277328993 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 449326816 - PrepareTime: 41166048 - TotalTime: 768488518 DataStreamSender (dst_id=9) - BytesSent: 534033 - InactiveTotalTime: 0 - NetworkThroughput(*): 93758952 - OverallThroughput: 9809301 - RowsReturned: 938 - SerializeBatchTime: 3666674 - TotalTime: 4500010 - TransmitDataRPCTime: 1000003 - UncompressedRowBatchSize: 1258080 HASH_JOIN_NODE (id=6) - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 499982 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 57832379 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 1024 - ProbeRowsPartitioned: 0 - ProbeTime: 166667 - RowsReturned: 938 - RowsReturnedRate: 4386 - SpilledPartitions: 0 - TotalTime: 183997759 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 333321 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8499863 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 1024 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 938 - RowsReturnedRate: 5756 - SpilledPartitions: 0 - TotalTime: 126332042 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 91499096 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 91499096 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 84650 - RowsReturned: 1024 - RowsReturnedRate: 6636 - TotalTime: 33499648 HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 833329 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.1060344827586207 - BytesRead: 5220503 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 30000045 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 61 - NumDisksAccessed: 0 - NumRowGroups: 1 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 15728278 - PerReadThreadRawHdfsThroughput: 65086268 - RemoteScanRanges: 0 - RowsRead: 7534 - RowsReturned: 1024 - RowsReturnedRate: 9554 - ScanRangesComplete: 139 - ScannerThreadsInvoluntaryContextSwitches: 27 - ScannerThreadsTotalWallClockTime: 4792839767 - MaterializeTupleTime(*): 3000009 - ScannerThreadsSysTime: 2643976166 - ScannerThreadsUserTime: 1574007833 - ScannerThreadsVoluntaryContextSwitches: 234370 - TotalRawHdfsReadTime(*): 6833349 - TotalReadThroughput: 70846 - TotalTime: 28333002 Filter 0 (1.00 MB) - Files processed: 139 - Files rejected: 139 - Files total: 139 - InactiveTotalTime: 0 - RowGroups processed: 7 - RowGroups rejected: 0 - RowGroups total: 7 - Rows processed: 682 - Rows rejected: 0 - Rows total: 682 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Averaged Fragment F04 split sizes: min: 270.55 KB, max: 270.55 KB, avg: 270.55 KB, stddev: 0 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 361144 - PerHostPeakMemUsage: 614568 - PrepareTime: 35999168 - RowsProduced: 1 - TotalCpuTime: 75998248 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 47998892 - TotalStorageWaitTime: 0 - TotalTime: 91997876 CodeGen - CodegenTime: 0 - CompileTime: 7999816 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 21 - NumInstructions: 333 - OptimizationTime: 19999540 - PrepareTime: 35999168 - TotalTime: 63998524 DataStreamSender (dst_id=8) - BytesSent: 744 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 1 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 1008 HDFS_SCAN_NODE (id=5) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 124266 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124266 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124266 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 1 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 222008 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 4016 - RowsReturned: 1 - RowsReturnedRate: 27 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 375000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 35999168 Averaged Fragment F03 split sizes: min: 191.25 KB, max: 63.06 MB, avg: 13.23 MB, stddev: 21.42 MB - AverageThreadTokens: 1.1041666666666667 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1927693 - PrepareTime: 38332805 - RowsProduced: 0 - TotalCpuTime: 717822292 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 578325424 CodeGen - CodegenTime: 833313 - CompileTime: 5166574 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 9166537 - PrepareTime: 38999478 - TotalTime: 53832585 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.20833333333333334 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 101664322 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 130416 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 6 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 557492215 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F02 Instance 2444893a7dcb3aa7:67d1dfc00000007 (host=ux-reporting-engine-worker-10-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:17/1.31 GB 0:18/1.18 GB 3:22/1.64 GB 5:31/2.45 GB 1:26/2.05 GB 4:21/1.64 GB Filter 0 arrival: 747ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5500400 - PerHostPeakMemUsage: 5500400 - PrepareTime: 47998223 - RowsProduced: 0 - TotalCpuTime: 879967419 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 75997187 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 64 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 251990668 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 439983709 - PrepareTime: 43998370 - TotalTime: 735972747 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 43998371 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 75997187 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999704 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 31998816 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 23999112 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:3/454.20 KB 2:1/9.67 KB 5:1/9.46 KB 1:2/19.56 KB 4:2/35.08 MB 3:1/9.51 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 3999852 Filter 0 (1.00 MB) - Files processed: 10 - Files rejected: 10 - Files total: 10 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:16/1.31 GB 0:15/1.18 GB 3:21/1.64 GB 5:30/2.45 GB 1:24/2.05 GB 4:19/1.61 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 125 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 99996300 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 454000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999260 Filter 0 (1.00 MB) - Files processed: 125 - Files rejected: 125 - Files total: 125 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000005 (host=ux-reporting-engine-worker-15-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:23/1.65 GB 5:26/1.70 GB 4:25/1.84 GB 1:20/999.76 MB 3:28/2.15 GB 0:26/2.04 GB Filter 0 arrival: 744ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 43998780 - RowsProduced: 0 - TotalCpuTime: 887975404 - TotalNetworkReceiveTime: 135996232 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 191994684 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 243993240 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 451987480 - PrepareTime: 35999002 - TotalTime: 731979722 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 43998782 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 191994684 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 11999670 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 147995902 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 135996232 - InactiveTotalTime: 135996232 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 135996232 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/23.06 KB 0:1/11.76 KB 4:2/1.34 MB 2:1/9.45 KB 3:1/9.47 KB 5:2/132.24 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:22/1.65 GB 5:24/1.70 GB 4:23/1.83 GB 1:19/999.74 MB 3:27/2.15 GB 0:25/2.04 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:140 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 140 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 140 - Files rejected: 140 - Files total: 140 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000002 (host=ux-reporting-engine-worker-17-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:14/1.27 GB 5:25/1.37 GB 4:24/1.42 GB 0:32/2.44 GB 2:28/1.98 GB 3:26/1.78 GB Filter 0 arrival: 666ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 43998984 - RowsProduced: 0 - TotalCpuTime: 979977400 - TotalNetworkReceiveTime: 211995108 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 263993908 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 219994928 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 395990868 - PrepareTime: 35999168 - TotalTime: 651984964 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 39999076 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 263993908 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999816 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 223994832 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 211995108 - InactiveTotalTime: 211995108 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 211995108 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 27999352 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:5/814.16 KB 3:2/259.80 KB 2:1/9.48 KB 4:2/1.14 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 10 - Files rejected: 10 - Files total: 10 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:14/1.27 GB 5:20/1.37 GB 4:22/1.42 GB 0:32/2.44 GB 2:27/1.98 GB 3:24/1.78 GB Runtime filters: All filters arrived. Waited 21ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:139 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 139 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 83998068 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 533000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 27999352 Filter 0 (1.00 MB) - Files processed: 139 - Files rejected: 139 - Files total: 139 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000006 (host=ux-reporting-engine-worker-19-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:22/1.54 GB 1:33/2.30 GB 0:23/1.90 GB 4:22/1.70 GB 5:27/1.70 GB 3:22/1.25 GB Filter 0 arrival: 656ms - AverageThreadTokens: 1.5 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 4548288 - PrepareTime: 44000336 - RowsProduced: 0 - TotalCpuTime: 908006928 - TotalNetworkReceiveTime: 244001862 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 300002289 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 212001618 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 396003021 - PrepareTime: 28000214 - TotalTime: 640004883 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 44000335 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 300002289 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000061 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 256001954 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 244001862 - InactiveTotalTime: 244001862 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 244001862 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 4000031 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/189.48 KB 3:1/9.67 KB 2:1/13.86 KB 0:2/117.22 KB 1:3/148.90 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 4000031 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:21/1.54 GB 1:30/2.16 GB 0:21/1.90 GB 4:22/1.70 GB 5:26/1.70 GB 3:21/1.25 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:141 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 141 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 141 - Files rejected: 141 - Files total: 141 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000009 (host=ux-reporting-engine-worker-6-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:12/1.02 GB 4:18/1.53 GB 3:27/1.90 GB 2:26/2.08 GB 1:26/2.13 GB 5:24/1.74 GB Filter 0 arrival: 785ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 63998212 - RowsProduced: 0 - TotalCpuTime: 895974952 - TotalNetworkReceiveTime: 99997204 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 171995192 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 3999888 - CompileTime: 263992620 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 451987364 - PrepareTime: 59998324 - TotalTime: 775978308 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 59998324 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 175995080 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 11999664 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 115996756 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 99997204 - InactiveTotalTime: 99997204 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 99997204 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 3999888 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/157.94 KB 2:3/291.87 KB 5:1/9.49 KB 3:2/145.34 MB 4:1/9.53 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:12/1.02 GB 4:17/1.53 GB 3:25/1.76 GB 2:23/2.08 GB 1:25/2.13 GB 5:23/1.74 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 125 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 3999888 Filter 0 (1.00 MB) - Files processed: 125 - Files rejected: 125 - Files total: 125 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000004 (host=ux-reporting-engine-worker-21-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:17/1.35 GB 3:22/1.19 GB 1:28/2.23 GB 4:30/1.68 GB 5:27/1.90 GB 2:26/1.84 GB Filter 0 arrival: 674ms - AverageThreadTokens: 1.5 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 4486840 - PrepareTime: 44000820 - RowsProduced: 0 - TotalCpuTime: 900016752 - TotalNetworkReceiveTime: 212003948 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 264004916 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 220004096 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 404007520 - PrepareTime: 44000816 - TotalTime: 668012432 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 44000820 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 260004844 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 4000076 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 216004024 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 212003948 - InactiveTotalTime: 212003948 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 212003948 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/9.47 KB 4:4/1.05 MB 2:3/726.35 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:17/1.35 GB 3:22/1.19 GB 1:27/2.23 GB 4:26/1.68 GB 5:27/1.90 GB 2:23/1.84 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:142 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 142 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 142 - Files rejected: 142 - Files total: 142 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000000a (host=ux-reporting-engine-worker-16-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 4:26/1.86 GB 2:29/2.35 GB 3:19/1.13 GB 0:24/1.70 GB 1:24/1.64 GB 5:23/1.69 GB Filter 0 arrival: 685ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 47998874 - RowsProduced: 0 - TotalCpuTime: 963977385 - TotalNetworkReceiveTime: 187995591 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 239994371 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 219994838 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 415990242 - PrepareTime: 39999061 - TotalTime: 675984141 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 47998874 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 243994277 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999812 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 195995403 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 187995591 - InactiveTotalTime: 187995591 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 187995591 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 19999531 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:4/260.96 KB 3:1/9.47 KB 2:2/32.30 KB 4:2/114.25 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:24/1.75 GB 2:27/2.35 GB 3:18/1.13 GB 0:24/1.70 GB 1:20/1.64 GB 5:23/1.69 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:136 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 136 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 79998120 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 528000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 16 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999531 Filter 0 (1.00 MB) - Files processed: 136 - Files rejected: 136 - Files total: 136 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000010 (host=ux-reporting-engine-worker-23-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:24/1.64 GB 3:23/1.59 GB 1:22/1.72 GB 0:22/1.20 GB 2:25/1.82 GB 4:30/2.33 GB Filter 0 arrival: 663ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 43999179 - RowsProduced: 0 - TotalCpuTime: 959982107 - TotalNetworkReceiveTime: 163996944 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 219995900 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 215995974 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 399992546 - PrepareTime: 27999478 - TotalTime: 647987923 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 39999254 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 215995974 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999851 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 175996720 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 163996944 - InactiveTotalTime: 163996944 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 163996944 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 27999477 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:1/977.57 KB 1:1/152.06 KB 3:2/297.83 KB 5:1/9.50 KB 0:2/20.04 KB 4:1/9.47 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:23/1.64 GB 3:21/1.59 GB 1:21/1.72 GB 0:20/1.20 GB 2:24/1.81 GB 4:29/2.33 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:138 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 138 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 119997762 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 473000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 20 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 27999477 Filter 0 (1.00 MB) - Files processed: 138 - Files rejected: 138 - Files total: 138 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000011 (host=ux-reporting-engine-worker-24-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:23/1.79 GB 4:18/1.33 GB 2:27/2.03 GB 1:23/1.56 GB 3:27/1.93 GB 0:23/1.75 GB Filter 0 arrival: 682ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 48000340 - RowsProduced: 0 - TotalCpuTime: 912006446 - TotalNetworkReceiveTime: 136000962 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 192001358 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 228001614 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 408002886 - PrepareTime: 40000282 - TotalTime: 676004782 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 48000340 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 192001358 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000056 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 144001018 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 136000962 - InactiveTotalTime: 136000962 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 136000962 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 20000140 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/69.08 KB 4:3/1.10 MB 0:2/19.70 KB 2:1/9.47 KB 3:1/9.46 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:23/1.79 GB 4:15/1.33 GB 2:26/2.03 GB 1:22/1.56 GB 3:26/1.93 GB 0:21/1.75 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:133 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 133 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 80000560 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 380000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 12 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 20000140 Filter 0 (1.00 MB) - Files processed: 133 - Files rejected: 133 - Files total: 133 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000000b (host=ux-reporting-engine-worker-25-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:26/1.65 GB 2:22/1.29 GB 4:20/1.41 GB 3:26/1.65 GB 5:28/2.26 GB 0:24/2.18 GB Filter 0 arrival: 676ms - AverageThreadTokens: 1.5 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 47998600 - RowsProduced: 0 - TotalCpuTime: 983971278 - TotalNetworkReceiveTime: 219993578 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 271992060 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 223993464 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 403988208 - PrepareTime: 39998834 - TotalTime: 667980506 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 47998600 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 275991944 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999766 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 227993344 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 219993578 - InactiveTotalTime: 219993578 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 219993578 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 19999416 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:3/414.17 KB 3:1/9.48 KB 5:1/9.47 KB 2:1/9.89 KB 1:2/19.65 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:24/1.65 GB 2:21/1.29 GB 4:17/1.41 GB 3:25/1.65 GB 5:27/2.26 GB 0:24/2.18 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:138 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 138 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 79997664 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 493000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999416 Filter 0 (1.00 MB) - Files processed: 138 - Files rejected: 138 - Files total: 138 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000003 (host=ux-reporting-engine-worker-20-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:30/2.20 GB 1:25/1.71 GB 3:16/1.24 GB 2:23/1.54 GB 0:27/1.88 GB 4:24/1.72 GB Filter 0 arrival: 718ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 55998642 - RowsProduced: 0 - TotalCpuTime: 1011975476 - TotalNetworkReceiveTime: 175995734 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 243994084 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 231994376 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 427989628 - PrepareTime: 43998934 - TotalTime: 703982938 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 59998546 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 243994086 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999806 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 187995444 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 175995734 - InactiveTotalTime: 175995734 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 175995734 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 23999420 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:2/1.71 MB 1:1/9.51 KB 0:3/44.93 KB 3:1/9.52 KB 2:2/19.59 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:28/2.20 GB 1:24/1.71 GB 3:15/1.24 GB 2:21/1.54 GB 0:24/1.88 GB 4:24/1.72 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:136 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 136 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 99997580 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 711000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 23999420 Filter 0 (1.00 MB) - Files processed: 136 - Files rejected: 136 - Files total: 136 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000008 (host=ux-reporting-engine-worker-22-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:25/2.18 GB 5:20/1.40 GB 1:16/995.54 MB 4:23/1.78 GB 3:31/2.10 GB 2:30/1.88 GB Filter 0 arrival: 675ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 4486840 - PrepareTime: 44001187 - RowsProduced: 0 - TotalCpuTime: 992026759 - TotalNetworkReceiveTime: 212005719 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 264007121 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 4000108 - CompileTime: 236006365 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 392010573 - PrepareTime: 32000863 - TotalTime: 660017801 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 40001079 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 264007122 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000216 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 224006043 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 212005719 - InactiveTotalTime: 212005719 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 212005719 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 28000756 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:2/1.09 MB 1:1/9.43 KB 2:3/29.03 KB 5:2/22.85 KB 3:2/200.83 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 10 - Files rejected: 10 - Files total: 10 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:25/2.18 GB 5:18/1.40 GB 1:15/995.53 MB 4:21/1.78 GB 3:29/2.10 GB 2:27/1.88 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:135 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 135 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 92002484 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 556000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 28000756 Filter 0 (1.00 MB) - Files processed: 135 - Files rejected: 135 - Files total: 135 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000000f (host=ux-reporting-engine-worker-18-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:23/1.35 GB 4:30/2.09 GB 2:29/1.91 GB 0:20/1.48 GB 3:28/2.05 GB 5:22/1.38 GB Filter 0 arrival: 663ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3468800 - PerHostPeakMemUsage: 3468800 - PrepareTime: 47998936 - RowsProduced: 0 - TotalCpuTime: 847981204 - TotalNetworkReceiveTime: 175996100 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 227994948 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 219995120 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 395991224 - PrepareTime: 35999200 - TotalTime: 651985544 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 47998936 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 231994860 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999824 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 183995924 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 175996100 - InactiveTotalTime: 175996100 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 175996100 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:2/942.03 KB 5:1/11.86 KB 2:2/19.12 KB 0:2/19.93 KB 3:1/9.50 KB 1:1/9.51 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:22/1.35 GB 4:28/2.09 GB 2:27/1.91 GB 0:18/1.48 GB 3:27/2.05 GB 5:21/1.38 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:143 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 143 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 143 - Files rejected: 143 - Files total: 143 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000001 (host=ux-reporting-engine-worker-5-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 4:17/1.21 GB 3:24/1.50 GB 0:28/1.81 GB 5:32/2.25 GB 2:30/1.86 GB 1:24/1.70 GB Filter 0 arrival: 847ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 3599872 - PerHostPeakMemUsage: 3599872 - PrepareTime: 55998102 - RowsProduced: 0 - TotalCpuTime: 967967202 - TotalNetworkReceiveTime: 19999324 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 87997018 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 33 - BlocksRecycled: 31 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 295989968 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 491983326 - PrepareTime: 39998642 - TotalTime: 831971802 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 3999864 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 55998102 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 87997018 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999728 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 31998916 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 19999324 - InactiveTotalTime: 19999324 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 19999324 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 23999188 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:1/833.87 KB 5:2/1.06 MB 3:2/22.91 KB 2:4/43.51 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:17/1.21 GB 3:22/1.50 GB 0:27/1.80 GB 5:30/2.25 GB 2:26/1.86 GB 1:24/1.70 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:146 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 258048 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 146 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 83997160 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 606000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999324 Filter 0 (1.00 MB) - Files processed: 146 - Files rejected: 146 - Files total: 146 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000013 (host=ux-reporting-engine-worker-2-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 4:22/1.40 GB 2:29/2.10 GB 1:20/1.30 GB 3:25/1.85 GB 5:31/2.27 GB 0:26/1.40 GB Filter 0 arrival: 789ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5303792 - PerHostPeakMemUsage: 5303792 - PrepareTime: 52001288 - RowsProduced: 0 - TotalCpuTime: 932023080 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 80001980 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 61 - BlocksRecycled: 3 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 264006538 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 468011588 - PrepareTime: 44001090 - TotalTime: 776019216 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 48001188 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 84002080 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000198 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 36000892 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 28000694 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:1/1020.78 KB 5:3/175.45 KB 4:1/9.50 KB 0:2/18.99 KB 1:1/9.84 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:21/1.40 GB 2:29/2.10 GB 1:19/1.30 GB 3:24/1.85 GB 5:28/2.27 GB 0:24/1.40 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:145 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 145 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 100002480 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 606000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 28000694 Filter 0 (1.00 MB) - Files processed: 145 - Files rejected: 145 - Files total: 145 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000015 (host=ux-reporting-engine-worker-13-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 4:27/1.97 GB 0:24/1.55 GB 3:22/1.43 GB 1:26/1.73 GB 5:27/1.90 GB 2:24/1.80 GB Filter 0 arrival: 764ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5500400 - PerHostPeakMemUsage: 5500400 - PrepareTime: 48001255 - RowsProduced: 0 - TotalCpuTime: 892023330 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 80002092 CodeGen - CodegenTime: 4000106 - CompileTime: 256006695 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 452011823 - PrepareTime: 40001046 - TotalTime: 748019564 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 48001254 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 80002093 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000210 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 32000839 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 24000629 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:2/112.40 KB 1:2/22.96 KB 2:1/9.48 KB 4:1/10.20 KB 3:2/1.15 MB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 4000106 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:26/1.97 GB 0:24/1.55 GB 3:20/1.42 GB 1:24/1.73 GB 5:25/1.90 GB 2:23/1.80 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:142 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 142 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 96002510 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 499000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 20000523 Filter 0 (1.00 MB) - Files processed: 142 - Files rejected: 142 - Files total: 142 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000018 (host=ux-reporting-engine-worker-9-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 4:28/1.68 GB 5:25/1.62 GB 2:31/2.11 GB 3:26/1.98 GB 0:24/1.50 GB 1:28/1.48 GB Filter 0 arrival: 761ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5631472 - PerHostPeakMemUsage: 5631472 - PrepareTime: 51998896 - RowsProduced: 0 - TotalCpuTime: 891981068 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 79998304 CodeGen - CodegenTime: 0 - CompileTime: 271994224 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 435990744 - PrepareTime: 39999148 - TotalTime: 747984116 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 47998980 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 83998220 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 11999748 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 35999240 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 23999492 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:3/1.83 MB 5:2/31.24 KB 0:2/1010.23 KB 4:2/20.20 KB 1:2/23.70 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:11 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 3999916 Filter 0 (1.00 MB) - Files processed: 11 - Files rejected: 11 - Files total: 11 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 4:26/1.68 GB 5:23/1.62 GB 2:28/2.10 GB 3:26/1.98 GB 0:22/1.50 GB 1:26/1.48 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:151 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 258048 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 151 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 99997880 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 520000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999576 Filter 0 (1.00 MB) - Files processed: 151 - Files rejected: 151 - Files total: 151 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000012 (host=ux-reporting-engine-worker-12-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:29/1.80 GB 0:22/1.64 GB 1:20/1.73 GB 2:27/1.80 GB 4:24/1.16 GB 3:30/2.25 GB Filter 0 arrival: 814ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5504496 - PerHostPeakMemUsage: 5504496 - PrepareTime: 47998140 - RowsProduced: 0 - TotalCpuTime: 947963296 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 79996900 CodeGen - CodegenTime: 0 - CompileTime: 291988700 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 471981732 - PrepareTime: 35998608 - TotalTime: 799969040 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 47998140 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 79996896 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999688 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 31998756 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 23999068 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:2/244.38 KB 0:2/772.68 KB 3:3/1.31 MB 5:1/9.47 KB 4:1/10.08 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:28/1.80 GB 0:20/1.64 GB 1:20/1.73 GB 2:25/1.80 GB 4:23/1.16 GB 3:27/2.25 GB Runtime filters: All filters arrived. Waited 21ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:143 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 143 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 95996276 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 558000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999224 Filter 0 (1.00 MB) - Files processed: 143 - Files rejected: 143 - Files total: 143 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000017 (host=ux-reporting-engine-worker-4-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 3:19/1.30 GB 2:21/1.35 GB 1:33/2.47 GB 5:22/1.17 GB 4:28/2.00 GB 0:26/2.08 GB Filter 0 arrival: 807ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5500400 - PerHostPeakMemUsage: 5500400 - PrepareTime: 51996102 - RowsProduced: 0 - TotalCpuTime: 947928930 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 79994002 CodeGen - CodegenTime: 3999700 - CompileTime: 251981108 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 491963122 - PrepareTime: 47996398 - TotalTime: 791940628 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 3999702 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 47996402 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 87993402 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 3999702 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 11999100 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 39997000 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 27997900 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:1/133.53 KB 4:1/10.97 KB 3:2/19.64 KB 5:1/9.51 KB 1:2/94.72 MB 2:3/376.30 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 10 - Files rejected: 10 - Files total: 10 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:17/1.30 GB 2:18/1.35 GB 1:31/2.38 GB 5:21/1.17 GB 4:27/2.00 GB 0:25/2.08 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:139 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 139 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 99992490 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 446000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 15 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 23998198 Filter 0 (1.00 MB) - Files processed: 139 - Files rejected: 139 - Files total: 139 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000014 (host=ux-reporting-engine-worker-14-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 3:26/1.65 GB 2:21/1.51 GB 1:25/1.36 GB 5:24/1.76 GB 0:32/2.44 GB 4:22/1.60 GB Filter 0 arrival: 837ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5500400 - PerHostPeakMemUsage: 5500400 - PrepareTime: 55998758 - RowsProduced: 0 - TotalCpuTime: 967978532 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 87998048 CodeGen - CodegenTime: 0 - CompileTime: 303993257 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 471989530 - PrepareTime: 43999024 - TotalTime: 819981811 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 59998669 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 87998049 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 7999823 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 27999380 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 19999557 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:2/1.02 MB 3:2/22.63 KB 1:3/929.77 KB 4:1/10.06 KB 5:1/9.47 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:24/1.65 GB 2:19/1.51 GB 1:22/1.36 GB 5:23/1.76 GB 0:32/2.44 GB 4:21/1.60 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:141 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 141 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 99997785 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 440000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 19999557 Filter 0 (1.00 MB) - Files processed: 141 - Files rejected: 141 - Files total: 141 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000000e (host=ux-reporting-engine-worker-7-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:21/1.52 GB 0:22/1.42 GB 5:22/1.59 GB 1:24/1.95 GB 4:28/2.05 GB 3:29/1.97 GB Filter 0 arrival: 889ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5500400 - PerHostPeakMemUsage: 5516784 - PrepareTime: 67999854 - RowsProduced: 0 - TotalCpuTime: 987997868 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 103999774 CodeGen - CodegenTime: 0 - CompileTime: 287999380 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 531998854 - PrepareTime: 51999890 - TotalTime: 871998124 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 63999864 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 103999776 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 11999974 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 39999912 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 27999938 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:2/166.02 KB 1:2/184.31 MB 2:2/20.04 KB 5:2/211.44 KB 0:1/9.51 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 3999992 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:19/1.52 GB 0:21/1.42 GB 5:20/1.59 GB 1:22/1.77 GB 4:28/2.05 GB 3:27/1.97 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:137 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 137 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 59999868 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 340000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 23999946 Filter 0 (1.00 MB) - Files processed: 137 - Files rejected: 137 - Files total: 137 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000016 (host=ux-reporting-engine-worker-11-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:29/2.05 GB 5:27/1.95 GB 3:20/1.39 GB 4:22/1.52 GB 1:20/942.08 MB 0:32/2.46 GB Filter 0 arrival: 1s702ms - AverageThreadTokens: 1.25 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 5500400 - PerHostPeakMemUsage: 5500400 - PrepareTime: 55998474 - RowsProduced: 0 - TotalCpuTime: 2215939657 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 371989872 CodeGen - CodegenTime: 0 - CompileTime: 891975712 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 547985078 - PrepareTime: 51998583 - TotalTime: 1491959373 DataStreamSender (dst_id=9) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 259992921 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 363990087 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 3999890 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 103997166 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 99997276 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:1/897.70 KB 3:2/940.01 KB 0:1/12.06 KB 1:2/19.52 KB 5:2/18.97 KB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 12288 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:28/2.05 GB 5:25/1.95 GB 3:18/1.39 GB 4:22/1.52 GB 1:18/942.06 MB 0:31/2.46 GB Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:142 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126976 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 142 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 399989104 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 594000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 17 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 99997276 Filter 0 (1.00 MB) - Files processed: 142 - Files rejected: 142 - Files total: 142 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000000c (host=ux-reporting-engine-worker-3-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:26/1.72 GB 3:29/2.00 GB 2:24/1.73 GB 4:20/1.50 GB 5:33/1.82 GB 0:25/1.50 GB Filter 0 arrival: 860ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 61672344 - PerHostPeakMemUsage: 61672344 - PrepareTime: 48000156 - RowsProduced: 9216 - TotalCpuTime: 668002180 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 4000012 - TotalStorageWaitTime: 40000128 - TotalTime: 52000172 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 64 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 280000920 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 528001728 - PrepareTime: 36000116 - TotalTime: 848002776 DataStreamSender (dst_id=9) - BytesSent: 4769919 - InactiveTotalTime: 0 - NetworkThroughput(*): 238495139 - OverallThroughput: 91728908 - RowsReturned: 8192 - SerializeBatchTime: 36000116 - TotalTime: 52000172 - TransmitDataRPCTime: 20000068 - UncompressedRowBatchSize: 11350794 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 48000160 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 9216 - ProbeRowsPartitioned: 0 - ProbeTime: 4000016 - RowsReturned: 8192 - RowsReturnedRate: 44521 - SpilledPartitions: 0 - TotalTime: 184000604 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 0 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000028 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 9216 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 8192 - RowsReturnedRate: 60235 - SpilledPartitions: 0 - TotalTime: 136000444 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 925696 - RowsReturned: 9216 - RowsReturnedRate: 71999 - TotalTime: 128000416 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled Hdfs split stats (:<# splits>/): 1:2/276.38 KB 0:2/787.46 KB 5:2/1.02 MB 3:2/19.04 KB 4:2/19.16 KB - BytesRead: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12288 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 0 - Files rejected: 0 - Files total: 0 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled Hdfs split stats (:<# splits>/): 1:24/1.72 GB 3:27/2.00 GB 2:24/1.73 GB 4:18/1.50 GB 5:31/1.82 GB 0:23/1.50 GB Runtime filters: All filters arrived. Waited 20ms - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 6851408 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 61 - NumDisksAccessed: 0 - NumRowGroups: 1 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 53611928 - PerReadThreadRawHdfsThroughput: 81564116 - RemoteScanRanges: 0 - RowsRead: 41557 - RowsReturned: 9216 - RowsReturnedRate: 92159 - ScanRangesComplete: 147 - ScannerThreadsInvoluntaryContextSwitches: 5 - ScannerThreadsTotalWallClockTime: 664002168 - MaterializeTupleTime(*): 72000236 - ScannerThreadsSysTime: 351358000 - ScannerThreadsUserTime: 123728000 - ScannerThreadsVoluntaryContextSwitches: 21940 - TotalRawHdfsReadTime(*): 84000272 - TotalReadThroughput: 88975 - TotalTime: 100000324 Filter 0 (1.00 MB) - Files processed: 147 - Files rejected: 146 - Files total: 147 - InactiveTotalTime: 0 - RowGroups processed: 41 - RowGroups rejected: 0 - RowGroups total: 41 - Rows processed: 16383 - Rows rejected: 0 - Rows total: 16384 - Splits processed: 1 - Splits rejected: 0 - Splits total: 1 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000000d (host=ux-reporting-engine-worker-8-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:18/1.04 GB 4:34/2.64 GB 5:25/1.58 GB 1:26/1.93 GB 3:30/1.85 GB 0:26/1.49 GB Filter 0 arrival: 833ms - AverageThreadTokens: 3.510204081632653 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 328871560 - PerHostPeakMemUsage: 328871560 - PrepareTime: 52000082 - RowsProduced: 15360 - TotalCpuTime: 112500188170 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 4000008 - TotalTime: 56000088 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 64 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 16 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 272000428 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 111 - NumInstructions: 5301 - OptimizationTime: 508000804 - PrepareTime: 48000076 - TotalTime: 828001308 DataStreamSender (dst_id=9) - BytesSent: 8046895 - InactiveTotalTime: 0 - NetworkThroughput(*): 2011719726 - OverallThroughput: 143694332 - RowsReturned: 14336 - SerializeBatchTime: 52000078 - TotalTime: 56000086 - TransmitDataRPCTime: 4000008 - UncompressedRowBatchSize: 18843146 HASH_JOIN_NODE (id=6) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 0 - BuildRows: 1 - BuildRowsPartitioned: 1 - BuildTime: 0 - GetNewBlockTime: 4000008 - HashBuckets: 1 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 100 - LocalTime: 52000082 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2147456 - PinTime: 0 - ProbeRows: 15360 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 14336 - RowsReturnedRate: 60745 - SpilledPartitions: 0 - TotalTime: 236000378 - UnpinTime: 0 EXCHANGE_NODE (id=8) - BytesReceived: 31 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 HASH_JOIN_NODE (id=4) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Hash Table Construction Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 0 - BuildRows: 0 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 4000008 - HashBuckets: 0 - HashCollisions: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - LocalTime: 8000014 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 2144384 - PinTime: 0 - ProbeRows: 15360 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 14336 - RowsReturnedRate: 77912 - SpilledPartitions: 0 - TotalTime: 184000296 - UnpinTime: 0 EXCHANGE_NODE (id=7) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 UNION_NODE (id=0) - InactiveTotalTime: 0 - PeakMemoryUsage: 925696 - RowsReturned: 15360 - RowsReturnedRate: 87272 - TotalTime: 176000282 HDFS_SCAN_NODE (id=2) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled Hdfs split stats (:<# splits>/): 1:1/96.76 KB 3:2/120.98 KB 5:2/20.63 KB 4:3/42.19 KB 0:2/171.20 MB - BytesRead: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12288 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalReadThroughput: 0 - TotalTime: 0 Filter 0 (1.00 MB) - Files processed: 0 - Files rejected: 0 - Files total: 0 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 HDFS_SCAN_NODE (id=1) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled Hdfs split stats (:<# splits>/): 2:18/1.04 GB 4:31/2.64 GB 5:23/1.58 GB 1:25/1.93 GB 3:28/1.85 GB 0:24/1.32 GB Runtime filters: All filters arrived. Waited 20ms - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.5448275862068965 - BytesRead: 118440683 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 60000090 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 61 - NumDisksAccessed: 0 - NumRowGroups: 1 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 320811144 - PerReadThreadRawHdfsThroughput: 1480506316 - RemoteScanRanges: 0 - RowsRead: 139264 - RowsReturned: 15360 - RowsReturnedRate: 137142 - ScanRangesComplete: 148 - ScannerThreadsInvoluntaryContextSwitches: 663 - ScannerThreadsTotalWallClockTime: 112492188154 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 63095333000 - ScannerThreadsUserTime: 37652460000 - ScannerThreadsVoluntaryContextSwitches: 5602711 - TotalRawHdfsReadTime(*): 80000120 - TotalReadThroughput: 1611350 - TotalTime: 112000178 Filter 0 (1.00 MB) - Files processed: 149 - Files rejected: 148 - Files total: 149 - InactiveTotalTime: 0 - RowGroups processed: 136 - RowGroups rejected: 0 - RowGroups total: 136 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 1 - Splits rejected: 0 - Splits total: 1 - TotalTime: 0 Fragment F04 Instance 2444893a7dcb3aa7:67d1dfc00000019 (host=ux-reporting-engine-worker-17-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 4:1/270.55 KB - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 361144 - PerHostPeakMemUsage: 614568 - PrepareTime: 35999168 - RowsProduced: 1 - TotalCpuTime: 75998248 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 47998892 - TotalStorageWaitTime: 0 - TotalTime: 91997876 CodeGen - CodegenTime: 0 - CompileTime: 7999816 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 21 - NumInstructions: 333 - OptimizationTime: 19999540 - PrepareTime: 35999168 - TotalTime: 63998524 DataStreamSender (dst_id=8) - BytesSent: 744 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 1 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 1008 HDFS_SCAN_NODE (id=5) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs split stats (:<# splits>/): 4:1/270.55 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 124266 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124266 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124266 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 1 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 222008 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 4016 - RowsReturned: 1 - RowsReturnedRate: 27 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 375000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 35999168 Fragment F03 Instance 2444893a7dcb3aa7:67d1dfc0000001c (host=ux-reporting-engine-worker-20-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:1/55.41 KB 3:3/12.46 MB 0:3/43.24 KB 1:2/5.60 KB 4:2/5.71 KB Filter 0 arrival: 572ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 35999124 - RowsProduced: 0 - TotalCpuTime: 587985748 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 571986134 CodeGen - CodegenTime: 0 - CompileTime: 3999902 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999808 - PrepareTime: 35999124 - TotalTime: 47998834 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:1/55.41 KB 3:3/12.46 MB 0:3/43.24 KB 1:2/5.60 KB 4:2/5.71 KB Runtime filters: All filters arrived. Waited 524ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:11 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 559986422 Filter 0 (1.00 MB) - Files processed: 11 - Files rejected: 11 - Files total: 11 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000001e (host=ux-reporting-engine-worker-10-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:1/2.40 KB 1:1/2.38 KB 0:2/38.37 MB 5:2/89.99 KB 3:1/2.40 KB Filter 0 arrival: 559ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 39998519 - RowsProduced: 0 - TotalCpuTime: 579978524 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 555979414 CodeGen - CodegenTime: 0 - CompileTime: 7999704 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 11999555 - PrepareTime: 39998519 - TotalTime: 59997778 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:1/2.40 KB 1:1/2.38 KB 0:2/38.37 MB 5:2/89.99 KB 3:1/2.40 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 539980005 Filter 0 (1.00 MB) - Files processed: 7 - Files rejected: 7 - Files total: 7 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000020 (host=ux-reporting-engine-worker-8-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:1/46.48 MB 1:1/71.01 KB 2:1/4.26 KB 4:2/4.75 KB 5:3/164.57 KB 3:1/2.39 KB Filter 0 arrival: 573ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1463992 - PrepareTime: 36000056 - RowsProduced: 0 - TotalCpuTime: 588000930 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 572000906 CodeGen - CodegenTime: 0 - CompileTime: 4000006 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 8000012 - PrepareTime: 36000056 - TotalTime: 48000074 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:1/46.48 MB 1:1/71.01 KB 2:1/4.26 KB 4:2/4.75 KB 5:3/164.57 KB 3:1/2.39 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 560000884 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000024 (host=ux-reporting-engine-worker-14-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:2/58.76 MB 3:2/7.32 KB 5:2/7.19 KB 4:2/42.66 KB 1:1/2.39 KB 2:2/5.04 KB Filter 0 arrival: 565ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 39999114 - RowsProduced: 0 - TotalCpuTime: 583987046 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 555987667 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 3999911 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 15999646 - PrepareTime: 39999114 - TotalTime: 59998671 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:2/58.76 MB 3:2/7.32 KB 5:2/7.19 KB 4:2/42.66 KB 1:1/2.39 KB 2:2/5.04 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:11 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 11 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 543987934 Filter 0 (1.00 MB) - Files processed: 11 - Files rejected: 11 - Files total: 11 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000001d (host=ux-reporting-engine-worker-12-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:1/35.20 MB 3:1/338.87 KB 5:1/4.09 KB 4:2/5.87 KB 0:2/4.91 KB 2:1/2.38 KB Filter 0 arrival: 571ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 43998300 - RowsProduced: 0 - TotalCpuTime: 595976932 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 575977708 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 3999844 - CompileTime: 3999844 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999692 - PrepareTime: 43998300 - TotalTime: 55997836 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/35.20 MB 3:1/338.87 KB 5:1/4.09 KB 4:2/5.87 KB 0:2/4.91 KB 2:1/2.38 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 567978020 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000028 (host=ux-reporting-engine-worker-18-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/401.94 KB 4:1/60.05 KB 3:2/78.29 KB 2:1/2.54 KB 0:2/4.78 KB Filter 0 arrival: 550ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 31999288 - RowsProduced: 0 - TotalCpuTime: 563987500 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 547987856 CodeGen - CodegenTime: 0 - CompileTime: 7999820 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999824 - PrepareTime: 31999288 - TotalTime: 47998932 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/401.94 KB 4:1/60.05 KB 3:2/78.29 KB 2:1/2.54 KB 0:2/4.78 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 531988208 Filter 0 (1.00 MB) - Files processed: 7 - Files rejected: 7 - Files total: 7 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000021 (host=ux-reporting-engine-worker-22-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/43.44 KB 1:1/2.54 KB 4:1/2.37 KB 2:1/2.37 KB 3:2/351.07 KB 0:1/2.39 KB Filter 0 arrival: 561ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 4486840 - PrepareTime: 36000971 - RowsProduced: 0 - TotalCpuTime: 584015752 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 568015320 CodeGen - CodegenTime: 0 - CompileTime: 4000108 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 8000216 - PrepareTime: 36000971 - TotalTime: 48001295 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/43.44 KB 1:1/2.54 KB 4:1/2.37 KB 2:1/2.37 KB 3:2/351.07 KB 0:1/2.39 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 560015104 Filter 0 (1.00 MB) - Files processed: 7 - Files rejected: 7 - Files total: 7 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000001b (host=ux-reporting-engine-worker-21-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 3:2/362.83 KB 4:2/157.15 KB 2:2/5.64 KB 1:1/2.54 KB 5:1/2.40 KB 0:2/4.77 KB Filter 0 arrival: 581ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 4486840 - PrepareTime: 40000744 - RowsProduced: 0 - TotalCpuTime: 612011388 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 592011020 CodeGen - CodegenTime: 4000076 - CompileTime: 4000076 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 8000148 - PrepareTime: 44000816 - TotalTime: 56001040 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:2/362.83 KB 4:2/157.15 KB 2:2/5.64 KB 1:1/2.54 KB 5:1/2.40 KB 0:2/4.77 KB Runtime filters: All filters arrived. Waited 543ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:10 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 10 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 584010872 Filter 0 (1.00 MB) - Files processed: 10 - Files rejected: 10 - Files total: 10 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000002c (host=ux-reporting-engine-worker-17-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/336.59 KB 3:1/2.74 KB 2:1/2.94 KB 4:3/408.07 KB 1:3/75.50 KB Filter 0 arrival: 559ms - AverageThreadTokens: 3.5 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 3438264 - PrepareTime: 39999080 - RowsProduced: 0 - TotalCpuTime: 3011930548 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 551987272 CodeGen - CodegenTime: 0 - CompileTime: 3999908 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999816 - PrepareTime: 43998984 - TotalTime: 55998708 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/336.59 KB 3:1/2.74 KB 2:1/2.94 KB 4:3/408.07 KB 1:3/75.50 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2439943740 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 3130000 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 157 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 543987460 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000002a (host=ux-reporting-engine-worker-9-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:1/323.38 KB 3:1/396.15 KB 2:3/86.79 KB 5:2/5.20 KB 1:2/4.76 KB Filter 0 arrival: 557ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1463992 - PrepareTime: 35999236 - RowsProduced: 0 - TotalCpuTime: 575987772 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 555988196 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 3999916 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999828 - PrepareTime: 39999152 - TotalTime: 51998896 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:1/323.38 KB 3:1/396.15 KB 2:3/86.79 KB 5:2/5.20 KB 1:2/4.76 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 539988536 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000027 (host=ux-reporting-engine-worker-15-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:1/389.76 KB 3:2/410.04 KB 4:1/2.95 KB 2:4/321.97 KB 5:3/96.99 KB 0:3/414.36 KB Filter 0 arrival: 568ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 31999114 - RowsProduced: 0 - TotalCpuTime: 587983712 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 571984158 CodeGen - CodegenTime: 0 - CompileTime: 3999888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999778 - PrepareTime: 31999114 - TotalTime: 43998780 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/389.76 KB 3:2/410.04 KB 4:1/2.95 KB 2:4/321.97 KB 5:3/96.99 KB 0:3/414.36 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:14 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 14 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 555984600 Filter 0 (1.00 MB) - Files processed: 14 - Files rejected: 14 - Files total: 14 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000025 (host=ux-reporting-engine-worker-13-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 3:1/62.94 MB 1:2/50.66 KB 0:3/57.39 KB 4:2/9.37 KB 2:2/5.85 KB 5:2/4.76 KB Filter 0 arrival: 572ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 40001046 - RowsProduced: 0 - TotalCpuTime: 588015380 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 572014962 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 4000105 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 8000208 - PrepareTime: 40001046 - TotalTime: 56001464 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:1/62.94 MB 1:2/50.66 KB 0:3/57.39 KB 4:2/9.37 KB 2:2/5.85 KB 5:2/4.76 KB Runtime filters: All filters arrived. Waited 524ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:12 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 12 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 564014752 Filter 0 (1.00 MB) - Files processed: 12 - Files rejected: 12 - Files total: 12 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000002d (host=ux-reporting-engine-worker-6-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/399.26 KB 2:1/98.12 KB 1:2/5.13 KB 4:2/76.16 KB 0:3/291.88 KB Filter 0 arrival: 555ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 35998994 - RowsProduced: 0 - TotalCpuTime: 567984122 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 547984682 CodeGen - CodegenTime: 0 - CompileTime: 7999776 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999776 - PrepareTime: 35998994 - TotalTime: 51998546 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/399.26 KB 2:1/98.12 KB 1:2/5.13 KB 4:2/76.16 KB 0:3/291.88 KB Runtime filters: All filters arrived. Waited 504ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 539984906 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000023 (host=ux-reporting-engine-worker-4-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 0:1/7.92 KB 5:2/303.73 KB 4:1/2.75 KB 2:1/2.39 KB 3:2/440.01 KB 1:1/2.39 KB Filter 0 arrival: 563ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 35997304 - RowsProduced: 0 - TotalCpuTime: 595955328 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 571957126 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 3999700 - CompileTime: 7999400 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999400 - PrepareTime: 35997304 - TotalTime: 51996104 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 0:1/7.92 KB 5:2/303.73 KB 4:1/2.75 KB 2:1/2.39 KB 3:2/440.01 KB 1:1/2.39 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 559958028 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000001a (host=ux-reporting-engine-worker-7-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 2:2/57.59 KB 0:2/10.77 KB 5:3/286.21 KB 1:2/4.73 KB Filter 0 arrival: 566ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1349304 - PrepareTime: 51999888 - RowsProduced: 0 - TotalCpuTime: 619998664 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 587998736 CodeGen - CodegenTime: 0 - CompileTime: 7999982 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999982 - PrepareTime: 55999880 - TotalTime: 71999844 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 2:2/57.59 KB 0:2/10.77 KB 5:3/286.21 KB 1:2/4.73 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 555998804 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000022 (host=ux-reporting-engine-worker-2-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/445.43 KB 4:1/4.03 KB 3:2/6.27 KB 0:1/2.38 KB 2:3/7.14 KB Filter 0 arrival: 564ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 40000992 - RowsProduced: 0 - TotalCpuTime: 604014958 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 584014462 CodeGen - CodegenTime: 0 - CompileTime: 4000098 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 12000298 - PrepareTime: 40000992 - TotalTime: 56001388 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/445.43 KB 4:1/4.03 KB 3:2/6.27 KB 0:1/2.38 KB 2:3/7.14 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 564013966 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000002e (host=ux-reporting-engine-worker-16-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:1/49.85 KB 4:2/394.22 KB 3:1/50.73 KB 5:1/2.38 KB 2:3/75.83 KB 0:1/2.95 KB Filter 0 arrival: 556ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 39999062 - RowsProduced: 0 - TotalCpuTime: 571986582 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 551987053 CodeGen - CodegenTime: 0 - CompileTime: 7999812 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999812 - PrepareTime: 35999155 - TotalTime: 55998686 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/49.85 KB 4:2/394.22 KB 3:1/50.73 KB 5:1/2.38 KB 2:3/75.83 KB 0:1/2.95 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 539987334 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000029 (host=ux-reporting-engine-worker-23-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/3.92 KB 1:1/2.38 KB 3:2/420.58 KB 4:3/7.15 KB 2:2/356.02 KB Filter 0 arrival: 555ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 35999329 - RowsProduced: 0 - TotalCpuTime: 579989190 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 563989489 CodeGen - CodegenTime: 0 - CompileTime: 3999924 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 11999777 - PrepareTime: 35999329 - TotalTime: 51999030 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/3.92 KB 1:1/2.38 KB 3:2/420.58 KB 4:3/7.15 KB 2:2/356.02 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 555989639 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000002b (host=ux-reporting-engine-worker-5-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:1/2.75 KB 5:1/2.55 KB 2:3/389.98 KB 4:1/2.38 KB 3:1/2.34 KB Filter 0 arrival: 560ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1463992 - PrepareTime: 39998644 - RowsProduced: 0 - TotalCpuTime: 579980344 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 563980886 CodeGen - CodegenTime: 0 - CompileTime: 3999864 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999728 - PrepareTime: 39998644 - TotalTime: 51998236 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:1/2.75 KB 5:1/2.55 KB 2:3/389.98 KB 4:1/2.38 KB 3:1/2.34 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 543981564 Filter 0 (1.00 MB) - Files processed: 7 - Files rejected: 7 - Files total: 7 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000030 (host=ux-reporting-engine-worker-3-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 3:1/25.17 KB 1:2/5.42 KB 4:2/291.74 KB 2:1/2.43 KB 0:3/44.75 KB Filter 0 arrival: 557ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1463992 - PrepareTime: 40000132 - RowsProduced: 0 - TotalCpuTime: 572001872 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 548001796 CodeGen - CodegenTime: 4000012 - CompileTime: 4000012 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 12000040 - PrepareTime: 40000132 - TotalTime: 56000184 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:1/25.17 KB 1:2/5.42 KB 4:2/291.74 KB 2:1/2.43 KB 0:3/44.75 KB Runtime filters: All filters arrived. Waited 503ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 544001784 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000002f (host=ux-reporting-engine-worker-25-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 1:2/51.75 MB 2:2/90.89 KB 3:2/5.08 KB 4:1/2.38 KB Filter 0 arrival: 557ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 3438264 - PrepareTime: 35998948 - RowsProduced: 0 - TotalCpuTime: 587982840 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 571983306 CodeGen - CodegenTime: 3999882 - CompileTime: 3999882 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 11999652 - PrepareTime: 35998948 - TotalTime: 51998482 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 1:2/51.75 MB 2:2/90.89 KB 3:2/5.08 KB 4:1/2.38 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:7 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 559983654 Filter 0 (1.00 MB) - Files processed: 7 - Files rejected: 7 - Files total: 7 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000031 (host=ux-reporting-engine-worker-24-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:1/2.53 KB 1:4/126.87 KB 2:3/61.85 KB Filter 0 arrival: 559ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 36000254 - RowsProduced: 0 - TotalCpuTime: 588004160 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 572004046 CodeGen - CodegenTime: 0 - CompileTime: 4000028 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 8000056 - PrepareTime: 40000284 - TotalTime: 52000368 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:1/2.53 KB 1:4/126.87 KB 2:3/61.85 KB Runtime filters: All filters arrived. Waited 524ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 560003962 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc00000026 (host=ux-reporting-engine-worker-19-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 5:3/313.03 KB 3:2/6.79 KB 1:2/402.13 KB 4:2/4.76 KB Filter 0 arrival: 566ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 4548288 - PrepareTime: 36000274 - RowsProduced: 0 - TotalCpuTime: 788006012 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 768005859 CodeGen - CodegenTime: 0 - CompileTime: 4000030 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 8000061 - PrepareTime: 40000305 - TotalTime: 52000396 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 5:3/313.03 KB 3:2/6.79 KB 1:2/402.13 KB 4:2/4.76 KB Runtime filters: All filters arrived. Waited 523ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:9 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 9 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 560004273 Filter 0 (1.00 MB) - Files processed: 9 - Files rejected: 9 - Files total: 9 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0 Instance 2444893a7dcb3aa7:67d1dfc0000001f (host=ux-reporting-engine-worker-11-prod-us-east-1a:22000) Hdfs split stats (:<# splits>/): 3:1/2.69 KB 5:2/563.14 KB 2:3/10.68 KB 0:1/2.40 KB 1:1/2.94 KB Filter 0 arrival: 660ms - AverageThreadTokens: 1.0 - BloomFilterBytes: 1048576 - InactiveTotalTime: 0 - PeakMemoryUsage: 1079488 - PerHostPeakMemUsage: 1332920 - PrepareTime: 39998912 - RowsProduced: 0 - TotalCpuTime: 1111969723 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 655982138 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 8589934592 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 7999782 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1953292 - NumFunctions: 8 - NumInstructions: 142 - OptimizationTime: 7999783 - PrepareTime: 35999021 - TotalTime: 55998477 DataStreamSender (dst_id=7) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 0 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=3) ExecOption: Expr Evaluation Codegen Disabled, PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Hdfs split stats (:<# splits>/): 3:1/2.69 KB 5:2/563.14 KB 2:3/10.68 KB 0:1/2.40 KB 1:1/2.94 KB Runtime filters: All filters arrived. Waited 605ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:8 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 4096 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 643982466 Filter 0 (1.00 MB) - Files processed: 8 - Files rejected: 8 - Files total: 8 - InactiveTotalTime: 0 - RowGroups processed: 0 - RowGroups rejected: 0 - RowGroups total: 0 - Rows processed: 0 - Rows rejected: 0 - Rows total: 0 - Splits processed: 0 - Splits rejected: 0 - Splits total: 0 - TotalTime: 0