Query (id=f74cea27cca1cc70:12e354ae50158e86) Summary Session ID: f247e061de3fd88e:6f06966c92244eb0 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2015-05-05 15:48:14.981308000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.2.0-cdh5 RELEASE (build 2ffd73a4255cefd521362ffe1cfb37463f67f75c) User: hodesi01 Connected User: hodesi01 Delegated User: Network Address: ::ffff:172.29.46.10:37335 Default Db: default Sql Statement: select count(*) from flatbam bam, reference_genome ref where ref.contig = 'chr20' and bam.contig__contigname = '20' and ref.`position` between bam.`start` and bam.`end` Coordinator: demeter-csmau08-1.demeter.hpc.mssm.edu:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=771.20MB VCores=2 F02:PLAN FRAGMENT [UNPARTITIONED] 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=91 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] hosts=91 per-host-mem=unavailable tuple-ids=2 row-size=8B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F02, EXCHANGE=05, UNPARTITIONED] 03:AGGREGATE | output: count(*) | hosts=91 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:CROSS JOIN [BROADCAST] | predicates: ref.position >= bam.start, ref.position <= bam.`end` | hosts=91 per-host-mem=321.20MB | tuple-ids=1,0 row-size=58B cardinality=3513626239162 | |--04:EXCHANGE [BROADCAST] | hosts=91 per-host-mem=0B | tuple-ids=0 row-size=33B cardinality=10079481 | 01:SCAN HDFS [default.reference_genome ref, RANDOM] partitions=1/1 files=91 size=12.63GB predicates: ref.contig = 'chr20' table stats: 3137327831 rows total column stats: all hosts=91 per-host-mem=176.00MB tuple-ids=1 row-size=25B cardinality=34859198 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=04, BROADCAST] 00:SCAN HDFS [default.flatbam bam, RANDOM] partitions=1/1 files=627 size=60.48GB predicates: bam.contig__contigname = '20' table stats: 856755914 rows total column stats: all hosts=91 per-host-mem=264.00MB tuple-ids=0 row-size=33B cardinality=10079481 ---------------- Estimated Per-Host Mem: 808658976 Estimated Per-Host VCores: 2 Admission result: Admitted immediately Request Pool: root.hodesi01 Planner Timeline Analysis finished: 55783490 Equivalence classes computed: 131823417 Single node plan created: 209359410 Distributed plan created: 223604550 Lineage info computed: 255254627 Planning finished: 447192918 Query Timeline Start execution: 77468 Planning finished: 510350783 Submit for admission: 603178523 Completed admission: 603440389 Ready to start remote fragments: 933099564 Remote fragments started: 1487229820 ImpalaServer - AsyncTotalTime: 0 - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile f74cea27cca1cc70:12e354ae50158e86 Fragment start latencies: count: 167, last: 0.062155ns, min: 0.007620ns, max: 0.431683ns, mean: 0.193562ns, stddev: 0.190848ns - AsyncTotalTime: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 881597830 Coordinator Fragment F02 - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 147456 - PerHostPeakMemUsage: 0 - PrepareTime: 326577865 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 8362145697 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 326907164 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 1109703 - CompileTime: 15205489 - InactiveTotalTime: 0 - LoadTime: 141543 - ModuleFileSize: 2309684 - OptimizationTime: 318632760 - PrepareTime: 322454941 - TotalTime: 659411769 AGGREGATION_NODE (id=6) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 84615 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 131072 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 326574104 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 1040 - ConvertRowBatchTime: 101684 - DeserializeRowBatchTimer: 281578 - FirstBatchArrivalWaitTime: 7473234922 - InactiveTotalTime: 8361820981 - PeakMemoryUsage: 0 - RowsReturned: 65 - RowsReturnedRate: 7 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 8134400125 Averaged Fragment F00 split sizes: min: 123.96 MB, max: 305.41 MB, avg: 170.22 MB, stddev: 52.21 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0004965700825212 - InactiveTotalTime: 0 - PeakMemoryUsage: 1101668057 - PerHostPeakMemUsage: 1101668219 - PrepareTime: 398033330 - RowsProduced: 0 - TotalCpuTime: 11174851825 - TotalNetworkReceiveTime: 4909337006 - TotalNetworkSendTime: 375507 - TotalStorageWaitTime: 48993641 - TotalTime: 7239677371 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 541660 - CompileTime: 28414258 - InactiveTotalTime: 0 - LoadTime: 152667 - ModuleFileSize: 2309684 - OptimizationTime: 344961001 - PrepareTime: 348400918 - TotalTime: 725023814 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 13 - InactiveTotalTime: 0 - NetworkThroughput(*): 41991 - OverallThroughput: 217729 - PeakMemoryUsage: 16384 - SerializeBatchTime: 12821 - ThriftTransmitTime(*): 289836 - TotalTime: 60136 - UncompressedRowBatchSize: 13 AGGREGATION_NODE (id=3) - AsyncTotalTime: 0 - BuildTime: 766361 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 126561 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 7238534937 CROSS_JOIN_NODE (id=2) - AsyncTotalTime: 0 - BuildRows: 17378815 - BuildTime: 3203067 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045175817 - ProbeRows: 2721 - ProbeTime: 1239812930047 - RowsReturned: 65257 - RowsReturnedRate: 6 - TotalTime: 1247504099077 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 710704965 - DeserializeRowBatchTimer: 2857544720 - FirstBatchArrivalWaitTime: 1705198 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3020972 - SendersBlockedTimer: 11992337 - SendersBlockedTotalTimer(*): 78887337 - TotalTime: 5755112391 HDFS_SCAN_NODE (id=1) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.036559003129582095 - AverageScannerThreadConcurrency: 0.4629032312882462 - BytesRead: 150103585 - BytesReadDataNodeCache: 0 - BytesReadLocal: 138600846 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138600846 - DecompressionTime: 61605019 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 63717085 - PerReadThreadRawHdfsThroughput: 1295132333 - RemoteScanRanges: 0 - RowsRead: 35730360 - RowsReturned: 2721 - RowsReturnedRate: 33667 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2080979336 - MaterializeTupleTime(*): 1970029612 - ScannerThreadsSysTime: 10274289 - ScannerThreadsUserTime: 2028296368 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 283006945 - TotalReadThroughput: 15786630 - TotalTime: 1852961346 Averaged Fragment F01 split sizes: min: 494.12 MB, max: 791.15 MB, avg: 680.52 MB, stddev: 62.55 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.044061067137996 - InactiveTotalTime: 0 - PeakMemoryUsage: 158700497 - PerHostPeakMemUsage: 339064463 - PrepareTime: 7267840 - RowsProduced: 190975 - TotalCpuTime: 7259404023 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 453687027 - TotalStorageWaitTime: 2550099319 - TotalTime: 1716877107 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 261877821 - InactiveTotalTime: 0 - NetworkThroughput(*): 3028323 - OverallThroughput: 52998128 - PeakMemoryUsage: 311296 - SerializeBatchTime: 63620869 - ThriftTransmitTime(*): 13416692492 - TotalTime: 741281297 - UncompressedRowBatchSize: 667708775 HDFS_SCAN_NODE (id=0) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.04945054945054945 - AverageScannerThreadConcurrency: 5.724259074259075 - BytesRead: 26881608 - BytesReadDataNodeCache: 0 - BytesReadLocal: 26881608 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 26881608 - DecompressionTime: 1545008567 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 158373987 - PerReadThreadRawHdfsThroughput: 351147076 - RemoteScanRanges: 0 - RowsRead: 9414900 - RowsReturned: 190975 - RowsReturnedRate: 490673 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 115 - ScannerThreadsTotalWallClockTime: 7192595977 - MaterializeTupleTime(*): 3057160557 - ScannerThreadsSysTime: 166103186 - ScannerThreadsUserTime: 3846906329 - ScannerThreadsVoluntaryContextSwitches: 389 - TotalRawHdfsReadTime(*): 101955987 - TotalReadThroughput: 22540709 - TotalTime: 964214301 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F00 Instance f74cea27cca1cc70:12e354ae50158e8a (host=demeter-csmaz11-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/151.12 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9444444444444444 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087548904 - PerHostPeakMemUsage: 1087548904 - PrepareTime: 390941925 - RowsProduced: 1 - TotalCpuTime: 12268058713 - TotalNetworkReceiveTime: 5030015048 - TotalNetworkSendTime: 476569 - TotalStorageWaitTime: 23266238 - TotalTime: 8686016807 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 459176 - CompileTime: 26654048 - InactiveTotalTime: 0 - LoadTime: 146952 - ModuleFileSize: 2309684 - OptimizationTime: 345109330 - PrepareTime: 344451125 - TotalTime: 719433375 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 38478 - OverallThroughput: 282665 - PeakMemoryUsage: 16384 - SerializeBatchTime: 11298 - ThriftTransmitTime(*): 415812 - TotalTime: 56604 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1360 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8685004498 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5968878497 - BuildRows: 17378815 - BuildTime: 3090100 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045228280 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8306085468 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 727475012 - DeserializeRowBatchTimer: 2698145834 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3533315398 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2951693 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5887743752 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/151.12 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.29411764705882354 - BytesRead: 147976424 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147976424 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147976424 - DecompressionTime: 52372787 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1651407469 - RemoteScanRanges: 0 - RowsRead: 36920612 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2293757440 - MaterializeTupleTime(*): 2208923573 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 2263655000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 89606246 - TotalReadThroughput: 16441824 - TotalTime: 2334773013 Instance f74cea27cca1cc70:12e354ae50158e88 (host=demeter-csmaz08-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/126.52 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9375 - InactiveTotalTime: 0 - PeakMemoryUsage: 1085779432 - PerHostPeakMemUsage: 1085779432 - PrepareTime: 397130475 - RowsProduced: 1 - TotalCpuTime: 10927360463 - TotalNetworkReceiveTime: 4877642751 - TotalNetworkSendTime: 366809 - TotalStorageWaitTime: 231554460 - TotalTime: 8053517604 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 440108 - CompileTime: 32585176 - InactiveTotalTime: 0 - LoadTime: 143610 - ModuleFileSize: 2309684 - OptimizationTime: 349120233 - PrepareTime: 351175337 - TotalTime: 735999616 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 52314 - OverallThroughput: 249434 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17394 - ThriftTransmitTime(*): 305842 - TotalTime: 64145 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2906 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8052518408 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5702400313 - BuildRows: 17378815 - BuildTime: 2570388 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043475192 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7643562532 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 639256870 - DeserializeRowBatchTimer: 2558655747 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3456296270 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3086142 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5631241738 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 7:1/126.52 MB Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.2 - AverageScannerThreadConcurrency: 0.2 - BytesRead: 122389958 - BytesReadDataNodeCache: 0 - BytesReadLocal: 122389958 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 122389958 - DecompressionTime: 46192387 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 69386667 - RemoteScanRanges: 0 - RowsRead: 30529291 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 1897991675 - MaterializeTupleTime(*): 1612224339 - ScannerThreadsSysTime: 8998000 - ScannerThreadsUserTime: 1657747000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 1763882934 - TotalReadThroughput: 11548873 - TotalTime: 1938607889 Instance f74cea27cca1cc70:12e354ae50158e89 (host=demeter-csmau08-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/154.55 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088605664 - PerHostPeakMemUsage: 1088605664 - PrepareTime: 397866038 - RowsProduced: 1 - TotalCpuTime: 12092495369 - TotalNetworkReceiveTime: 4773029678 - TotalNetworkSendTime: 533532 - TotalStorageWaitTime: 22595412 - TotalTime: 8486068460 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 688718 - CompileTime: 26655517 - InactiveTotalTime: 0 - LoadTime: 142242 - ModuleFileSize: 2309684 - OptimizationTime: 343993187 - PrepareTime: 348969016 - TotalTime: 722839519 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 36448 - OverallThroughput: 218534 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17571 - ThriftTransmitTime(*): 438977 - TotalTime: 73215 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2793 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8484884422 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5720879593 - BuildRows: 17378815 - BuildTime: 3212388 - InactiveTotalTime: 0 - PeakMemoryUsage: 1046285048 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8076195521 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 729195210 - DeserializeRowBatchTimer: 2827980870 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3083374168 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3080533 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5641495425 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/154.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 149523728 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149523728 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149523728 - DecompressionTime: 72200824 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1285533397 - RemoteScanRanges: 0 - RowsRead: 37307607 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2309478287 - MaterializeTupleTime(*): 2203886101 - ScannerThreadsSysTime: 11998000 - ScannerThreadsUserTime: 2276653000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 116312597 - TotalReadThroughput: 17591026 - TotalTime: 2352123090 Instance f74cea27cca1cc70:12e354ae50158ea1 (host=demeter-csmaz11-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/151.97 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087876584 - PerHostPeakMemUsage: 1087876584 - PrepareTime: 393864077 - RowsProduced: 1 - TotalCpuTime: 11908172694 - TotalNetworkReceiveTime: 5020903517 - TotalNetworkSendTime: 530540 - TotalStorageWaitTime: 23124185 - TotalTime: 8517512856 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 458784 - CompileTime: 28441024 - InactiveTotalTime: 0 - LoadTime: 168659 - ModuleFileSize: 2309684 - OptimizationTime: 339821335 - PrepareTime: 347945440 - TotalTime: 719423307 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 37460 - OverallThroughput: 261160 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14104 - ThriftTransmitTime(*): 427114 - TotalTime: 61265 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2494 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8516448655 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5941665933 - BuildRows: 17378815 - BuildTime: 2691700 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045555960 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8108329558 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 711584233 - DeserializeRowBatchTimer: 2791165285 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3280175107 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2962674 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5865922020 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 0:1/151.97 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 149037709 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149037709 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149037709 - DecompressionTime: 57430328 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1719461019 - RemoteScanRanges: 0 - RowsRead: 37185864 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2123701406 - MaterializeTupleTime(*): 2030230556 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 2087682000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 86676992 - TotalReadThroughput: 15804565 - TotalTime: 2163868203 Instance f74cea27cca1cc70:12e354ae50158e8f (host=demeter-csmaz08-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/129.00 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088949736 - PerHostPeakMemUsage: 1088949736 - PrepareTime: 398142560 - RowsProduced: 1 - TotalCpuTime: 11451038852 - TotalNetworkReceiveTime: 5043193142 - TotalNetworkSendTime: 441469 - TotalStorageWaitTime: 140790317 - TotalTime: 8351736119 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 537902 - CompileTime: 33046241 - InactiveTotalTime: 0 - LoadTime: 143485 - ModuleFileSize: 2309684 - OptimizationTime: 352398123 - PrepareTime: 346676800 - TotalTime: 735339867 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 46167 - OverallThroughput: 257715 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14307 - ThriftTransmitTime(*): 346567 - TotalTime: 62084 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2533 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8350545504 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5907724613 - BuildRows: 17378815 - BuildTime: 2897058 - InactiveTotalTime: 0 - PeakMemoryUsage: 1046645496 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7945704471 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 667631571 - DeserializeRowBatchTimer: 2726902854 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3496221350 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2978111 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5835515091 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/129.00 MB Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 124614788 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124614788 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124614788 - DecompressionTime: 54172110 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 102019089 - RemoteScanRanges: 0 - RowsRead: 31085059 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1989057888 - MaterializeTupleTime(*): 1784565502 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 1835720000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 1221485010 - TotalReadThroughput: 13646070 - TotalTime: 2034568532 Instance f74cea27cca1cc70:12e354ae50158e9c (host=demeter-csmau08-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/152.78 MB 1:1/120.17 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.176470588235294 - InactiveTotalTime: 0 - PeakMemoryUsage: 1131078720 - PerHostPeakMemUsage: 1131078720 - PrepareTime: 395433582 - RowsProduced: 1 - TotalCpuTime: 13569514255 - TotalNetworkReceiveTime: 4658836142 - TotalNetworkSendTime: 355544 - TotalStorageWaitTime: 48095402 - TotalTime: 8236333639 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 500362 - CompileTime: 25360220 - InactiveTotalTime: 0 - LoadTime: 213315 - ModuleFileSize: 2309684 - OptimizationTime: 340887583 - PrepareTime: 349785333 - TotalTime: 719504057 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 57309 - OverallThroughput: 346005 - PeakMemoryUsage: 16384 - SerializeBatchTime: 6308 - ThriftTransmitTime(*): 279186 - TotalTime: 46242 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1168 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8235238016 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5723192852 - BuildRows: 17378815 - BuildTime: 3540270 - InactiveTotalTime: 0 - PeakMemoryUsage: 1038732024 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7847006988 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 813082518 - DeserializeRowBatchTimer: 3534435325 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1288929812 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3084870 - SendersBlockedTimer: 206220556 - SendersBlockedTotalTimer(*): 1369061092 - TotalTime: 5633564235 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 3:1/152.78 MB 1:1/120.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.5 - BytesRead: 263753383 - BytesReadDataNodeCache: 0 - BytesReadLocal: 263753383 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 263753383 - DecompressionTime: 99826965 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 100793672 - PerReadThreadRawHdfsThroughput: 1705527612 - RemoteScanRanges: 0 - RowsRead: 65798159 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 3949572693 - MaterializeTupleTime(*): 3778861558 - ScannerThreadsSysTime: 16996000 - ScannerThreadsUserTime: 3885408000 - ScannerThreadsVoluntaryContextSwitches: 23 - TotalRawHdfsReadTime(*): 154646211 - TotalReadThroughput: 32969172 - TotalTime: 2120256948 Instance f74cea27cca1cc70:12e354ae50158e8d (host=demeter-csmau10-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/129.06 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 1092980200 - PerHostPeakMemUsage: 1092980200 - PrepareTime: 403022173 - RowsProduced: 1 - TotalCpuTime: 11633115680 - TotalNetworkReceiveTime: 4605466843 - TotalNetworkSendTime: 345810 - TotalStorageWaitTime: 23662120 - TotalTime: 8133856735 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 544403 - CompileTime: 31674122 - InactiveTotalTime: 0 - LoadTime: 131749 - ModuleFileSize: 2309684 - OptimizationTime: 400059255 - PrepareTime: 349332579 - TotalTime: 784187965 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 76271 - OverallThroughput: 343649 - PeakMemoryUsage: 16384 - SerializeBatchTime: 8146 - ThriftTransmitTime(*): 209778 - TotalTime: 46559 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 924 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8132913154 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5642463451 - BuildRows: 17378815 - BuildTime: 4056122 - InactiveTotalTime: 0 - PeakMemoryUsage: 1050675960 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7746108663 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 788638305 - DeserializeRowBatchTimer: 3515128493 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1135601044 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3135770 - SendersBlockedTimer: 337570308 - SendersBlockedTotalTimer(*): 2264946793 - TotalTime: 5542118979 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/129.06 MB Hdfs Read Thread Concurrency Bucket: 0:86.67% 1:13.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.13333333333333333 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 124102255 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124102255 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124102255 - DecompressionTime: 47964993 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1672085598 - RemoteScanRanges: 0 - RowsRead: 30957045 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 2053001013 - MaterializeTupleTime(*): 1971596763 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2020692000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 74220037 - TotalReadThroughput: 12597471 - TotalTime: 2101608664 Instance f74cea27cca1cc70:12e354ae50158eaa (host=demeter-csmaz08-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/127.19 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1089351144 - PerHostPeakMemUsage: 1089351144 - PrepareTime: 395503065 - RowsProduced: 1 - TotalCpuTime: 11637254938 - TotalNetworkReceiveTime: 5010859809 - TotalNetworkSendTime: 358418 - TotalStorageWaitTime: 24551762 - TotalTime: 8374507639 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 456743 - CompileTime: 26622393 - InactiveTotalTime: 0 - LoadTime: 138168 - ModuleFileSize: 2309684 - OptimizationTime: 351177176 - PrepareTime: 345147631 - TotalTime: 726069068 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 65595 - OverallThroughput: 224832 - PeakMemoryUsage: 16384 - SerializeBatchTime: 12957 - ThriftTransmitTime(*): 243920 - TotalTime: 71164 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2377 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8373262637 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5893191327 - BuildRows: 17378815 - BuildTime: 3053863 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047046904 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7966755653 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 680454657 - DeserializeRowBatchTimer: 2599356295 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3550131498 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2987724 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5816740223 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/127.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 124616507 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124616507 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124616507 - DecompressionTime: 57766193 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1239163769 - RemoteScanRanges: 0 - RowsRead: 31085058 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2026076490 - MaterializeTupleTime(*): 1934656700 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 1990697000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 100565002 - TotalReadThroughput: 14660765 - TotalTime: 2069669520 Instance f74cea27cca1cc70:12e354ae50158eb0 (host=demeter-csmaz11-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/174.60 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1084788200 - PerHostPeakMemUsage: 1084788200 - PrepareTime: 394445333 - RowsProduced: 1 - TotalCpuTime: 12047148437 - TotalNetworkReceiveTime: 4762579080 - TotalNetworkSendTime: 509854 - TotalStorageWaitTime: 23154643 - TotalTime: 8439414012 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 454180 - CompileTime: 28684697 - InactiveTotalTime: 0 - LoadTime: 147352 - ModuleFileSize: 2309684 - OptimizationTime: 374638817 - PrepareTime: 349338156 - TotalTime: 755891251 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 39026 - OverallThroughput: 240572 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17731 - ThriftTransmitTime(*): 409982 - TotalTime: 66508 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2846 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8438263070 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5686875229 - BuildRows: 17378815 - BuildTime: 2985092 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042467576 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8031398578 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 714326303 - DeserializeRowBatchTimer: 2835876835 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3086353257 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3096834 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5611799159 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/174.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 171132489 - BytesReadDataNodeCache: 0 - BytesReadLocal: 171132489 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171132489 - DecompressionTime: 67019079 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1744641346 - RemoteScanRanges: 0 - RowsRead: 42705641 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2302272834 - MaterializeTupleTime(*): 2199908266 - ScannerThreadsSysTime: 11998000 - ScannerThreadsUserTime: 2268655000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 98090355 - TotalReadThroughput: 20133234 - TotalTime: 2341670543 Instance f74cea27cca1cc70:12e354ae50158e9e (host=demeter-csmaz08-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/129.85 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090661856 - PerHostPeakMemUsage: 1090661856 - PrepareTime: 400062516 - RowsProduced: 1 - TotalCpuTime: 10970741506 - TotalNetworkReceiveTime: 4853632561 - TotalNetworkSendTime: 461119 - TotalStorageWaitTime: 22654901 - TotalTime: 7956302836 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 570358 - CompileTime: 29939759 - InactiveTotalTime: 0 - LoadTime: 126482 - ModuleFileSize: 2309684 - OptimizationTime: 361498896 - PrepareTime: 348837246 - TotalTime: 743367609 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 44042 - OverallThroughput: 253044 - PeakMemoryUsage: 16384 - SerializeBatchTime: 18371 - ThriftTransmitTime(*): 363288 - TotalTime: 63230 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2640 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 7955169777 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5677298090 - BuildRows: 17378815 - BuildTime: 2691495 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048357624 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7546807038 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 632854650 - DeserializeRowBatchTimer: 2629330048 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3279680814 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3098549 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5608693254 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 18:1/129.85 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 124730257 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124730257 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124730257 - DecompressionTime: 51498424 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751208 - PerReadThreadRawHdfsThroughput: 1752577275 - RemoteScanRanges: 0 - RowsRead: 31113913 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1821002313 - MaterializeTupleTime(*): 1737715847 - ScannerThreadsSysTime: 8998000 - ScannerThreadsUserTime: 1790727000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 71169619 - TotalReadThroughput: 15591282 - TotalTime: 1866894190 Instance f74cea27cca1cc70:12e354ae50158ea2 (host=demeter-csmaz11-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/126.92 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1086160352 - PerHostPeakMemUsage: 1086160352 - PrepareTime: 399467494 - RowsProduced: 1 - TotalCpuTime: 11780199036 - TotalNetworkReceiveTime: 4937854940 - TotalNetworkSendTime: 404039 - TotalStorageWaitTime: 266994593 - TotalTime: 8530340575 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 527802 - CompileTime: 25908369 - InactiveTotalTime: 0 - LoadTime: 204814 - ModuleFileSize: 2309684 - OptimizationTime: 352364965 - PrepareTime: 344478289 - TotalTime: 726211290 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 52471 - OverallThroughput: 201984 - PeakMemoryUsage: 16384 - SerializeBatchTime: 32080 - ThriftTransmitTime(*): 304925 - TotalTime: 79214 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3044 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8528974950 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5895101585 - BuildRows: 17378815 - BuildTime: 2941247 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043860216 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8126972474 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 735443046 - DeserializeRowBatchTimer: 2893679446 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3151400638 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2989190 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5813886158 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 15:1/126.92 MB Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 124614477 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124614477 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124614477 - DecompressionTime: 51310872 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50747112 - PerReadThreadRawHdfsThroughput: 63564224 - RemoteScanRanges: 0 - RowsRead: 31085059 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 2180176928 - MaterializeTupleTime(*): 1852175246 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 1904710000 - ScannerThreadsVoluntaryContextSwitches: 12 - TotalRawHdfsReadTime(*): 1960449899 - TotalReadThroughput: 12843323 - TotalTime: 2228861095 Instance f74cea27cca1cc70:12e354ae50158ea8 (host=demeter-csmaz10-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/128.13 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1089670632 - PerHostPeakMemUsage: 1089670632 - PrepareTime: 400706907 - RowsProduced: 1 - TotalCpuTime: 11519885518 - TotalNetworkReceiveTime: 4816479535 - TotalNetworkSendTime: 440006 - TotalStorageWaitTime: 139936476 - TotalTime: 8271481384 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 674146 - CompileTime: 29625531 - InactiveTotalTime: 0 - LoadTime: 182670 - ModuleFileSize: 2309684 - OptimizationTime: 342302383 - PrepareTime: 353340412 - TotalTime: 728505766 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 56903 - OverallThroughput: 275510 - PeakMemoryUsage: 16384 - SerializeBatchTime: 7877 - ThriftTransmitTime(*): 281180 - TotalTime: 58074 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1811 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8269627534 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5701528946 - BuildRows: 17378815 - BuildTime: 3069227 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047487552 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7875553260 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 679711496 - DeserializeRowBatchTimer: 2778452634 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3123523729 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3090421 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5623444168 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/128.13 MB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:12.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.125 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 125893586 - BytesReadDataNodeCache: 0 - BytesReadLocal: 125893586 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125893586 - DecompressionTime: 53826768 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 96633646 - RemoteScanRanges: 0 - RowsRead: 31404625 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2129761322 - MaterializeTupleTime(*): 1925785498 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 1982698000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 1302792459 - TotalReadThroughput: 14811010 - TotalTime: 2171726892 Instance f74cea27cca1cc70:12e354ae50158eba (host=demeter-csmaz11-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/152.07 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088761312 - PerHostPeakMemUsage: 1088761312 - PrepareTime: 396533403 - RowsProduced: 1 - TotalCpuTime: 11507452812 - TotalNetworkReceiveTime: 5054381856 - TotalNetworkSendTime: 428151 - TotalStorageWaitTime: 22289195 - TotalTime: 8328268000 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 688809 - CompileTime: 29346031 - InactiveTotalTime: 0 - LoadTime: 150599 - ModuleFileSize: 2309684 - OptimizationTime: 350776038 - PrepareTime: 350116428 - TotalTime: 733544467 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 52849 - OverallThroughput: 223064 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14717 - ThriftTransmitTime(*): 302745 - TotalTime: 71728 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2953 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8327145464 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5906233636 - BuildRows: 17378815 - BuildTime: 2801940 - InactiveTotalTime: 0 - PeakMemoryUsage: 1046440696 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7917648628 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 659276714 - DeserializeRowBatchTimer: 2671069008 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3504186930 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2978341 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5835064035 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 21:1/152.07 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.2 - BytesRead: 147918564 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147918564 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147918564 - DecompressionTime: 65044457 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1285813598 - RemoteScanRanges: 0 - RowsRead: 36906411 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1968381081 - MaterializeTupleTime(*): 1871337416 - ScannerThreadsSysTime: 8998000 - ScannerThreadsUserTime: 1937705000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 115038886 - TotalReadThroughput: 15743694 - TotalTime: 2008307661 Instance f74cea27cca1cc70:12e354ae50158e9d (host=demeter-csmaz10-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/144.17 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087122920 - PerHostPeakMemUsage: 1087122920 - PrepareTime: 405699961 - RowsProduced: 1 - TotalCpuTime: 12026656203 - TotalNetworkReceiveTime: 4924898354 - TotalNetworkSendTime: 556916 - TotalStorageWaitTime: 22484458 - TotalTime: 8527418644 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 504164 - CompileTime: 30006439 - InactiveTotalTime: 0 - LoadTime: 146416 - ModuleFileSize: 2309684 - OptimizationTime: 350522907 - PrepareTime: 348970161 - TotalTime: 732716282 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 34682 - OverallThroughput: 251264 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17214 - ThriftTransmitTime(*): 461329 - TotalTime: 63678 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3263 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8526159373 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5914276284 - BuildRows: 17378815 - BuildTime: 3704370 - InactiveTotalTime: 0 - PeakMemoryUsage: 1044802296 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8118691070 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 759193716 - DeserializeRowBatchTimer: 2898163513 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3186922138 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2983256 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5825451809 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 0:1/144.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 140969463 - BytesReadDataNodeCache: 0 - BytesReadLocal: 140969463 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140969463 - DecompressionTime: 66750093 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1336350629 - RemoteScanRanges: 0 - RowsRead: 35170166 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2150645051 - MaterializeTupleTime(*): 2051063384 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2118677000 - ScannerThreadsVoluntaryContextSwitches: 13 - TotalRawHdfsReadTime(*): 105488380 - TotalReadThroughput: 13830726 - TotalTime: 2201480136 Instance f74cea27cca1cc70:12e354ae50158eb4 (host=demeter-csmaz10-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/125.73 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090555368 - PerHostPeakMemUsage: 1090555368 - PrepareTime: 400788056 - RowsProduced: 1 - TotalCpuTime: 11394911647 - TotalNetworkReceiveTime: 5024294871 - TotalNetworkSendTime: 413584 - TotalStorageWaitTime: 23452900 - TotalTime: 8264685401 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 551577 - CompileTime: 29237150 - InactiveTotalTime: 0 - LoadTime: 149535 - ModuleFileSize: 2309684 - OptimizationTime: 338543692 - PrepareTime: 346924978 - TotalTime: 718020397 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 55846 - OverallThroughput: 258577 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13794 - ThriftTransmitTime(*): 286500 - TotalTime: 61877 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3570 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8263522682 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5893669049 - BuildRows: 17378815 - BuildTime: 2949197 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048251128 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7859663713 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 673298254 - DeserializeRowBatchTimer: 2900069796 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3158959583 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2985443 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5821183930 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 22:1/125.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 123580200 - BytesReadDataNodeCache: 0 - BytesReadLocal: 123580200 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 123580200 - DecompressionTime: 61477346 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1274325470 - RemoteScanRanges: 0 - RowsRead: 30826183 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 1915441554 - MaterializeTupleTime(*): 1821279977 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 1882713000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 96976952 - TotalReadThroughput: 14538847 - TotalTime: 1963439040 Instance f74cea27cca1cc70:12e354ae50158eb5 (host=demeter-csmaz10-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/156.67 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1092390376 - PerHostPeakMemUsage: 1092390376 - PrepareTime: 400993546 - RowsProduced: 1 - TotalCpuTime: 12168121215 - TotalNetworkReceiveTime: 4989634634 - TotalNetworkSendTime: 480854 - TotalStorageWaitTime: 156019303 - TotalTime: 8698033350 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 619556 - CompileTime: 26806199 - InactiveTotalTime: 0 - LoadTime: 152866 - ModuleFileSize: 2309684 - OptimizationTime: 347465694 - PrepareTime: 346270119 - TotalTime: 723804800 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 38297 - OverallThroughput: 240442 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17153 - ThriftTransmitTime(*): 417780 - TotalTime: 66544 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2966 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8696795411 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5889710941 - BuildRows: 17378815 - BuildTime: 3047199 - InactiveTotalTime: 0 - PeakMemoryUsage: 1050069752 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8291886554 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 690786132 - DeserializeRowBatchTimer: 2909725491 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3121534429 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2990450 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5811437116 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/156.67 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 151690752 - BytesReadDataNodeCache: 0 - BytesReadLocal: 151690752 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151690752 - DecompressionTime: 62613147 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 164210690 - RemoteScanRanges: 0 - RowsRead: 37848855 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2350643891 - MaterializeTupleTime(*): 2121958031 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 2188667000 - ScannerThreadsVoluntaryContextSwitches: 12 - TotalRawHdfsReadTime(*): 923756862 - TotalReadThroughput: 16791394 - TotalTime: 2398939643 Instance f74cea27cca1cc70:12e354ae50158ece (host=demeter-csmaz08-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/180.61 MB 5:1/120.04 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.9991540210437266 - InactiveTotalTime: 0 - PeakMemoryUsage: 1198131424 - PerHostPeakMemUsage: 1198131424 - PrepareTime: 396567692 - RowsProduced: 0 - TotalCpuTime: 5891665807 - TotalNetworkReceiveTime: 4945504638 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 48361467 - TotalTime: 397664635 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 697391 - CompileTime: 29030336 - InactiveTotalTime: 0 - LoadTime: 143189 - ModuleFileSize: 2309684 - OptimizationTime: 359405500 - PrepareTime: 349509667 - TotalTime: 741103817 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 39643 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5058609 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 272616 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 396562301 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5891663840 - BuildRows: 17378815 - BuildTime: 3259136 - InactiveTotalTime: 0 - PeakMemoryUsage: 1039429600 - ProbeRows: 18432 - ProbeTime: 9442440392794 - RowsReturned: 448512 - RowsReturnedRate: 47 - TotalTime: 9448408829382 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 734166657 - DeserializeRowBatchTimer: 2786172739 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3294600752 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2991459 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5809477070 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 7:1/180.61 MB 5:1/120.04 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.998730897361324 - BytesRead: 142849914 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 56136253 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 158761440 - PerReadThreadRawHdfsThroughput: 1290346081 - RemoteScanRanges: 0 - RowsRead: 19593216 - RowsReturned: 18432 - RowsReturnedRate: 244401 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 110706667 - TotalReadThroughput: 15106 - TotalTime: 75417000 Instance f74cea27cca1cc70:12e354ae50158ebd (host=demeter-csmau10-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/121.78 MB 11:1/126.54 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.111111111111111 - InactiveTotalTime: 0 - PeakMemoryUsage: 1138353264 - PerHostPeakMemUsage: 1138353264 - PrepareTime: 402244785 - RowsProduced: 1 - TotalCpuTime: 14105545413 - TotalNetworkReceiveTime: 4927164692 - TotalNetworkSendTime: 402712 - TotalStorageWaitTime: 49896906 - TotalTime: 8570490226 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 573352 - CompileTime: 26180511 - InactiveTotalTime: 0 - LoadTime: 167485 - ModuleFileSize: 2309684 - OptimizationTime: 351464230 - PrepareTime: 349689300 - TotalTime: 730633253 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 45905 - OverallThroughput: 313320 - PeakMemoryUsage: 16384 - SerializeBatchTime: 8905 - ThriftTransmitTime(*): 348542 - TotalTime: 51066 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1138 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8569286234 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5898630899 - BuildRows: 17378815 - BuildTime: 3461728 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045727752 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8185177685 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 747140052 - DeserializeRowBatchTimer: 2722040051 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3326136581 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2989762 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5812774782 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 9:1/121.78 MB 11:1/126.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.5625 - BytesRead: 240993047 - BytesReadDataNodeCache: 0 - BytesReadLocal: 240993047 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240993047 - DecompressionTime: 103111310 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 101236088 - PerReadThreadRawHdfsThroughput: 1356799061 - RemoteScanRanges: 0 - RowsRead: 60112627 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 9 - ScannerThreadsTotalWallClockTime: 4234767513 - MaterializeTupleTime(*): 4054373056 - ScannerThreadsSysTime: 22996000 - ScannerThreadsUserTime: 4162366000 - ScannerThreadsVoluntaryContextSwitches: 25 - TotalRawHdfsReadTime(*): 177618819 - TotalReadThroughput: 28352123 - TotalTime: 2282167091 Instance f74cea27cca1cc70:12e354ae50158ed2 (host=demeter-csmaz11-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/156.17 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9998942526304657 - InactiveTotalTime: 0 - PeakMemoryUsage: 1092503216 - PerHostPeakMemUsage: 1092503216 - PrepareTime: 398924374 - RowsProduced: 0 - TotalCpuTime: 5690107241 - TotalNetworkReceiveTime: 4747486762 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21770425 - TotalTime: 399937491 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 509184 - CompileTime: 26904489 - InactiveTotalTime: 0 - LoadTime: 142642 - ModuleFileSize: 2309684 - OptimizationTime: 343327687 - PrepareTime: 353821755 - TotalTime: 727466581 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 32147 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 6216544 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 398918670 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5690104824 - BuildRows: 17378815 - BuildTime: 3137201 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042080288 - ProbeRows: 20480 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 5896788638 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 724544236 - DeserializeRowBatchTimer: 2797405213 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3128257570 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3099272 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5607385506 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/156.17 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9994183279572736 - BytesRead: 42069935 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12421529 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49812600 - PerReadThreadRawHdfsThroughput: 931877810 - RemoteScanRanges: 0 - RowsRead: 2128896 - RowsReturned: 20480 - RowsReturnedRate: 99567 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 45145334 - TotalReadThroughput: 4449 - TotalTime: 205690623 Instance f74cea27cca1cc70:12e354ae50158eb7 (host=demeter-csmau08-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/153.96 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1102949864 - PerHostPeakMemUsage: 1102962152 - PrepareTime: 427345425 - RowsProduced: 1 - TotalCpuTime: 11744639440 - TotalNetworkReceiveTime: 4957849126 - TotalNetworkSendTime: 408343 - TotalStorageWaitTime: 23390201 - TotalTime: 8409743343 CodeGen - AsyncTotalTime: 0 - CodegenTime: 716235 - CompileTime: 28499581 - InactiveTotalTime: 0 - LoadTime: 240831 - ModuleFileSize: 2309684 - OptimizationTime: 370672497 - PrepareTime: 367903501 - TotalTime: 769890981 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 68649 - OverallThroughput: 204600 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14943 - ThriftTransmitTime(*): 233067 - TotalTime: 78201 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2740 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8408380619 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5888942314 - BuildRows: 17378815 - BuildTime: 3443884 - InactiveTotalTime: 0 - PeakMemoryUsage: 1060637432 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7972744200 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 715473866 - DeserializeRowBatchTimer: 2750288517 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3392092191 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2996251 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5800185750 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 15:1/153.96 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 147843883 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147843883 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147843883 - DecompressionTime: 67082140 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1289001576 - RemoteScanRanges: 0 - RowsRead: 36887351 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2027121364 - MaterializeTupleTime(*): 1926784388 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 1994696000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 114696433 - TotalReadThroughput: 16791560 - TotalTime: 2080403058 Instance f74cea27cca1cc70:12e354ae50158e95 (host=demeter-csmau10-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/149.54 MB 14:1/122.30 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.111111111111111 - InactiveTotalTime: 0 - PeakMemoryUsage: 1141564536 - PerHostPeakMemUsage: 1141564536 - PrepareTime: 397299726 - RowsProduced: 1 - TotalCpuTime: 13895335949 - TotalNetworkReceiveTime: 4992835768 - TotalNetworkSendTime: 484089 - TotalStorageWaitTime: 45636441 - TotalTime: 8582634804 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 701715 - CompileTime: 25232939 - InactiveTotalTime: 0 - LoadTime: 167076 - ModuleFileSize: 2309684 - OptimizationTime: 347205077 - PrepareTime: 349452192 - TotalTime: 725273734 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 41383 - OverallThroughput: 233709 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13626 - ThriftTransmitTime(*): 386627 - TotalTime: 68461 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2920 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8581442684 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5949312513 - BuildRows: 17378815 - BuildTime: 3629361 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048775416 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8173108341 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 731649467 - DeserializeRowBatchTimer: 2775673638 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3384858907 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2963466 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5864353411 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 15:1/149.54 MB 14:1/122.30 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.5 - BytesRead: 264397665 - BytesReadDataNodeCache: 0 - BytesReadLocal: 264397665 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 264397665 - DecompressionTime: 116216121 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 101236096 - PerReadThreadRawHdfsThroughput: 1250085914 - RemoteScanRanges: 0 - RowsRead: 65959126 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 4028396079 - MaterializeTupleTime(*): 3844766314 - ScannerThreadsSysTime: 17996000 - ScannerThreadsUserTime: 3964396000 - ScannerThreadsVoluntaryContextSwitches: 23 - TotalRawHdfsReadTime(*): 211503595 - TotalReadThroughput: 28663027 - TotalTime: 2218381472 Instance f74cea27cca1cc70:12e354ae50158e96 (host=demeter-csmaz08-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/153.89 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9444444444444444 - InactiveTotalTime: 0 - PeakMemoryUsage: 1086131688 - PerHostPeakMemUsage: 1086131688 - PrepareTime: 397321922 - RowsProduced: 1 - TotalCpuTime: 11884533546 - TotalNetworkReceiveTime: 5013148640 - TotalNetworkSendTime: 518244 - TotalStorageWaitTime: 23276041 - TotalTime: 8503989233 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 513696 - CompileTime: 25571831 - InactiveTotalTime: 0 - LoadTime: 153229 - ModuleFileSize: 2309684 - OptimizationTime: 337747847 - PrepareTime: 345722507 - TotalTime: 712201352 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 35756 - OverallThroughput: 255224 - PeakMemoryUsage: 16384 - SerializeBatchTime: 16267 - ThriftTransmitTime(*): 447471 - TotalTime: 62690 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2867 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8502791776 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5953049603 - BuildRows: 17378815 - BuildTime: 2848904 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043811064 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8101153180 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 717211856 - DeserializeRowBatchTimer: 2838645778 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3294821600 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2957228 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5876724355 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/153.89 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.29411764705882354 - BytesRead: 149788210 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149788210 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149788210 - DecompressionTime: 60381395 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1673894911 - RemoteScanRanges: 0 - RowsRead: 37373827 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2099568770 - MaterializeTupleTime(*): 2005018289 - ScannerThreadsSysTime: 13997000 - ScannerThreadsUserTime: 2063686000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 89484835 - TotalReadThroughput: 17622142 - TotalTime: 2145311098 Instance f74cea27cca1cc70:12e354ae50158eab (host=demeter-csmau10-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/123.96 MB 21:1/129.46 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.999259846682527 - InactiveTotalTime: 0 - PeakMemoryUsage: 1208413416 - PerHostPeakMemUsage: 1208413416 - PrepareTime: 395462122 - RowsProduced: 0 - TotalCpuTime: 5720860487 - TotalNetworkReceiveTime: 4665642484 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 46336450 - TotalTime: 396588499 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 482361 - CompileTime: 27948741 - InactiveTotalTime: 0 - LoadTime: 144786 - ModuleFileSize: 2309684 - OptimizationTime: 341937706 - PrepareTime: 350293241 - TotalTime: 723426194 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 32884 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 7515774 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 395456889 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5720858591 - BuildRows: 17378815 - BuildTime: 4014965 - InactiveTotalTime: 0 - PeakMemoryUsage: 1041209080 - ProbeRows: 20480 - ProbeTime: 9441910832259 - RowsReturned: 650240 - RowsReturnedRate: 68 - TotalTime: 9447702549998 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 800266990 - DeserializeRowBatchTimer: 3485029448 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1381178550 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3091658 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5621195679 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 20:1/123.96 MB 21:1/129.46 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.9987310986570794 - BytesRead: 151230384 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 76444598 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 167183848 - PerReadThreadRawHdfsThroughput: 1350085082 - RemoteScanRanges: 0 - RowsRead: 21661696 - RowsReturned: 20480 - RowsReturnedRate: 295966 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 112015447 - TotalReadThroughput: 15991 - TotalTime: 69197115 Instance f74cea27cca1cc70:12e354ae50158ec8 (host=demeter-csmau10-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/153.94 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9444444444444444 - InactiveTotalTime: 0 - PeakMemoryUsage: 1086442976 - PerHostPeakMemUsage: 1086442976 - PrepareTime: 387820485 - RowsProduced: 1 - TotalCpuTime: 12411111569 - TotalNetworkReceiveTime: 4914738234 - TotalNetworkSendTime: 494531 - TotalStorageWaitTime: 126990671 - TotalTime: 8765406915 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 464261 - CompileTime: 29360251 - InactiveTotalTime: 0 - LoadTime: 158952 - ModuleFileSize: 2309684 - OptimizationTime: 338381695 - PrepareTime: 342889561 - TotalTime: 713849263 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 39371 - OverallThroughput: 245206 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14047 - ThriftTransmitTime(*): 406387 - TotalTime: 65251 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2704 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8764333617 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5948518078 - BuildRows: 17378815 - BuildTime: 3990912 - InactiveTotalTime: 0 - PeakMemoryUsage: 1044122360 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8360661979 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 779333897 - DeserializeRowBatchTimer: 3505521332 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1703172838 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2966590 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5858177147 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/153.94 MB Hdfs Read Thread Concurrency Bucket: 0:88.24% 1:11.76% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.11764705882352941 - AverageScannerThreadConcurrency: 0.29411764705882354 - BytesRead: 149815142 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149815142 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149815142 - DecompressionTime: 58250474 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 109076097 - RemoteScanRanges: 0 - RowsRead: 37380425 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 2370003299 - MaterializeTupleTime(*): 2173952306 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2233660000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 1373491954 - TotalReadThroughput: 16646126 - TotalTime: 2409034845 Instance f74cea27cca1cc70:12e354ae50158ec2 (host=demeter-csmau10-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/155.81 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1085156832 - PerHostPeakMemUsage: 1085156832 - PrepareTime: 393053096 - RowsProduced: 1 - TotalCpuTime: 11820800917 - TotalNetworkReceiveTime: 5056139602 - TotalNetworkSendTime: 500021 - TotalStorageWaitTime: 22356368 - TotalTime: 8487296224 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 469450 - CompileTime: 26812081 - InactiveTotalTime: 0 - LoadTime: 146453 - ModuleFileSize: 2309684 - OptimizationTime: 351013704 - PrepareTime: 347943522 - TotalTime: 729165984 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 49158 - OverallThroughput: 217666 - PeakMemoryUsage: 16384 - SerializeBatchTime: 24981 - ThriftTransmitTime(*): 325477 - TotalTime: 73507 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2467 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8486194848 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5902527777 - BuildRows: 17378815 - BuildTime: 2975467 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042836216 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8074939606 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 653525109 - DeserializeRowBatchTimer: 2744361685 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3385311534 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2979485 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5832824170 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/155.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 151795266 - BytesReadDataNodeCache: 0 - BytesReadLocal: 151795266 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151795266 - DecompressionTime: 73483199 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1346508337 - RemoteScanRanges: 0 - RowsRead: 37874733 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 2130517074 - MaterializeTupleTime(*): 2024598106 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 2096681000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 112732511 - TotalReadThroughput: 17778396 - TotalTime: 2169500633 Instance f74cea27cca1cc70:12e354ae50158ea9 (host=demeter-csmau10-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/153.72 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1089375720 - PerHostPeakMemUsage: 1089375720 - PrepareTime: 399557941 - RowsProduced: 1 - TotalCpuTime: 11805107056 - TotalNetworkReceiveTime: 5018041223 - TotalNetworkSendTime: 507374 - TotalStorageWaitTime: 24436329 - TotalTime: 8463584884 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 535708 - CompileTime: 33741905 - InactiveTotalTime: 0 - LoadTime: 149045 - ModuleFileSize: 2309684 - OptimizationTime: 340927488 - PrepareTime: 346016214 - TotalTime: 723986417 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 38346 - OverallThroughput: 271766 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13413 - ThriftTransmitTime(*): 417243 - TotalTime: 58874 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3093 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8462428317 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5948815564 - BuildRows: 17378815 - BuildTime: 3798707 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047055096 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8058725984 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 710552645 - DeserializeRowBatchTimer: 2648682881 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3486128832 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2961400 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5868445635 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/153.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 149233134 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149233134 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149233134 - DecompressionTime: 62649069 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1719656795 - RemoteScanRanges: 0 - RowsRead: 37233809 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 2059520629 - MaterializeTupleTime(*): 1961121566 - ScannerThreadsSysTime: 11998000 - ScannerThreadsUserTime: 2023692000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 86780766 - TotalReadThroughput: 17556839 - TotalTime: 2106274941 Instance f74cea27cca1cc70:12e354ae50158ec4 (host=demeter-csmaz10-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/154.52 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1089031656 - PerHostPeakMemUsage: 1089031656 - PrepareTime: 404794100 - RowsProduced: 1 - TotalCpuTime: 11697231350 - TotalNetworkReceiveTime: 5007677414 - TotalNetworkSendTime: 409216 - TotalStorageWaitTime: 24057451 - TotalTime: 8406295783 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 520700 - CompileTime: 33446569 - InactiveTotalTime: 0 - LoadTime: 146355 - ModuleFileSize: 2309684 - OptimizationTime: 340859686 - PrepareTime: 348327337 - TotalTime: 725885235 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 45947 - OverallThroughput: 236078 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17430 - ThriftTransmitTime(*): 348221 - TotalTime: 67774 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2730 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8405156574 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5906655958 - BuildRows: 17378815 - BuildTime: 2875421 - InactiveTotalTime: 0 - PeakMemoryUsage: 1046711032 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8000794413 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 694703770 - DeserializeRowBatchTimer: 2732809986 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3384990529 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2979323 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5833140918 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/154.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 149945479 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149945479 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149945479 - DecompressionTime: 52976644 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1703444306 - RemoteScanRanges: 0 - RowsRead: 37412386 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2040675513 - MaterializeTupleTime(*): 1954076546 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 2014693000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 88024879 - TotalReadThroughput: 16791590 - TotalTime: 2091091681 Instance f74cea27cca1cc70:12e354ae50158ea3 (host=demeter-csmau08-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/154.72 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1086483952 - PerHostPeakMemUsage: 1086483952 - PrepareTime: 391370298 - RowsProduced: 1 - TotalCpuTime: 11515291769 - TotalNetworkReceiveTime: 4840790695 - TotalNetworkSendTime: 322441 - TotalStorageWaitTime: 23735145 - TotalTime: 8232605069 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 450741 - CompileTime: 25330594 - InactiveTotalTime: 0 - LoadTime: 88678 - ModuleFileSize: 2309684 - OptimizationTime: 342160131 - PrepareTime: 347305202 - TotalTime: 717805526 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 71718 - OverallThroughput: 262303 - PeakMemoryUsage: 16384 - SerializeBatchTime: 16844 - ThriftTransmitTime(*): 223096 - TotalTime: 60998 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3207 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8231593249 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5723720053 - BuildRows: 17378815 - BuildTime: 3248870 - InactiveTotalTime: 0 - PeakMemoryUsage: 1044163320 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7820073677 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 683749664 - DeserializeRowBatchTimer: 2818760872 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3151459221 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3075618 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5650510358 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/154.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 149131244 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149131244 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149131244 - DecompressionTime: 52863117 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767608 - PerReadThreadRawHdfsThroughput: 1656926410 - RemoteScanRanges: 0 - RowsRead: 37209337 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2055012513 - MaterializeTupleTime(*): 1968632148 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 2024692000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 90004748 - TotalReadThroughput: 17840874 - TotalTime: 2093597671 Instance f74cea27cca1cc70:12e354ae50158e94 (host=demeter-csmaz11-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/154.21 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1085201888 - PerHostPeakMemUsage: 1085201888 - PrepareTime: 395000456 - RowsProduced: 1 - TotalCpuTime: 11736783231 - TotalNetworkReceiveTime: 5029394712 - TotalNetworkSendTime: 438036 - TotalStorageWaitTime: 23341066 - TotalTime: 8435214277 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 650934 - CompileTime: 25418343 - InactiveTotalTime: 0 - LoadTime: 141725 - ModuleFileSize: 2309684 - OptimizationTime: 344353766 - PrepareTime: 347803685 - TotalTime: 720709615 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 46086 - OverallThroughput: 219295 - PeakMemoryUsage: 16384 - SerializeBatchTime: 16660 - ThriftTransmitTime(*): 347171 - TotalTime: 72961 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 34857 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8434093920 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5922084460 - BuildRows: 17378815 - BuildTime: 2902425 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042914040 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8027491792 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 691937898 - DeserializeRowBatchTimer: 2835410900 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3340859523 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2971705 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5848093847 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/154.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 148044812 - BytesReadDataNodeCache: 0 - BytesReadLocal: 148044812 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 148044812 - DecompressionTime: 60736902 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50779880 - PerReadThreadRawHdfsThroughput: 1668938746 - RemoteScanRanges: 0 - RowsRead: 36935315 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2061385020 - MaterializeTupleTime(*): 1966017412 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 2028691000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 88705959 - TotalReadThroughput: 16792597 - TotalTime: 2102689291 Instance f74cea27cca1cc70:12e354ae50158e8c (host=demeter-csmaz08-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/129.62 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090366952 - PerHostPeakMemUsage: 1090366952 - PrepareTime: 397962322 - RowsProduced: 1 - TotalCpuTime: 11423753738 - TotalNetworkReceiveTime: 4669479508 - TotalNetworkSendTime: 371558 - TotalStorageWaitTime: 24661580 - TotalTime: 8100708024 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 524558 - CompileTime: 30903214 - InactiveTotalTime: 0 - LoadTime: 146056 - ModuleFileSize: 2309684 - OptimizationTime: 342326899 - PrepareTime: 346935763 - TotalTime: 723389727 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 50689 - OverallThroughput: 219187 - PeakMemoryUsage: 16384 - SerializeBatchTime: 11087 - ThriftTransmitTime(*): 315645 - TotalTime: 72997 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2760 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8099517401 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5714826324 - BuildRows: 17378815 - BuildTime: 3919967 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048062712 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7690870370 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 795890823 - DeserializeRowBatchTimer: 3674423192 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 970695000 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3092950 - SendersBlockedTimer: 85379391 - SendersBlockedTotalTimer(*): 526718210 - TotalTime: 5618847494 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/129.62 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 124931626 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124931626 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124931626 - DecompressionTime: 53102322 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1548121727 - RemoteScanRanges: 0 - RowsRead: 31164046 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 1928050197 - MaterializeTupleTime(*): 1840731536 - ScannerThreadsSysTime: 8998000 - ScannerThreadsUserTime: 1895711000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 80698839 - TotalReadThroughput: 15616453 - TotalTime: 1973103952 Instance f74cea27cca1cc70:12e354ae50158e91 (host=demeter-csmaz10-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/123.96 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9999471374953746 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087476272 - PerHostPeakMemUsage: 1087476272 - PrepareTime: 397618553 - RowsProduced: 0 - TotalCpuTime: 5687403060 - TotalNetworkReceiveTime: 4859622362 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 153896147 - TotalTime: 398702312 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 716487 - CompileTime: 27120444 - InactiveTotalTime: 0 - LoadTime: 156469 - ModuleFileSize: 2309684 - OptimizationTime: 364162141 - PrepareTime: 351270829 - TotalTime: 745968200 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 38921 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5830439 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 397612409 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5687400664 - BuildRows: 17378815 - BuildTime: 2687249 - InactiveTotalTime: 0 - PeakMemoryUsage: 1038251768 - ProbeRows: 18432 - ProbeTime: 9439415874699 - RowsReturned: 468329 - RowsReturnedRate: 49 - TotalTime: 9445302346743 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 643947445 - DeserializeRowBatchTimer: 2772779226 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3088746627 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3091882 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5620787095 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 3:1/123.96 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 5.286529921759357E-5 - AverageScannerThreadConcurrency: 0.9993656164093889 - BytesRead: 42059116 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3478538 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49255000 - PerReadThreadRawHdfsThroughput: 87356128 - RemoteScanRanges: 0 - RowsRead: 761856 - RowsReturned: 18432 - RowsReturnedRate: 93289 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 481467262 - TotalReadThroughput: 4446 - TotalTime: 197578485 Instance f74cea27cca1cc70:12e354ae50158e97 (host=demeter-csmaz11-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/126.90 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087770080 - PerHostPeakMemUsage: 1087770080 - PrepareTime: 396187695 - RowsProduced: 1 - TotalCpuTime: 11545501264 - TotalNetworkReceiveTime: 4943825871 - TotalNetworkSendTime: 405514 - TotalStorageWaitTime: 24147072 - TotalTime: 8295930375 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 483449 - CompileTime: 31306430 - InactiveTotalTime: 0 - LoadTime: 147676 - ModuleFileSize: 2309684 - OptimizationTime: 346726173 - PrepareTime: 343673376 - TotalTime: 724846630 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 56081 - OverallThroughput: 267049 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13447 - ThriftTransmitTime(*): 285298 - TotalTime: 59914 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2707 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8294758618 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5912973525 - BuildRows: 17378815 - BuildTime: 3556085 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045465848 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7887806323 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 739856018 - DeserializeRowBatchTimer: 3530043656 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1687083581 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2982244 - SendersBlockedTimer: 127016979 - SendersBlockedTotalTimer(*): 804490360 - TotalTime: 5827428514 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/126.90 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 125287880 - BytesReadDataNodeCache: 0 - BytesReadLocal: 125287880 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125287880 - DecompressionTime: 50791162 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751208 - PerReadThreadRawHdfsThroughput: 1567098583 - RemoteScanRanges: 0 - RowsRead: 31253237 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 1925326395 - MaterializeTupleTime(*): 1840585420 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 1894711000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 79948946 - TotalReadThroughput: 14739750 - TotalTime: 1972361769 Instance f74cea27cca1cc70:12e354ae50158e9b (host=demeter-csmau08-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/155.71 MB 7:1/149.69 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.1666666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 1135871088 - PerHostPeakMemUsage: 1135871088 - PrepareTime: 395695692 - RowsProduced: 1 - TotalCpuTime: 14544160941 - TotalNetworkReceiveTime: 4786235128 - TotalNetworkSendTime: 597704 - TotalStorageWaitTime: 48189718 - TotalTime: 8641362385 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 551342 - CompileTime: 28223652 - InactiveTotalTime: 0 - LoadTime: 155355 - ModuleFileSize: 2309684 - OptimizationTime: 351911162 - PrepareTime: 344361609 - TotalTime: 727646897 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 33758 - OverallThroughput: 257964 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17701 - ThriftTransmitTime(*): 473957 - TotalTime: 62024 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2436 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8640251875 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5712828928 - BuildRows: 17378815 - BuildTime: 3452664 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043114744 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8237121855 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 712427297 - DeserializeRowBatchTimer: 2826972498 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 2994883207 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3084353 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5634508816 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/155.71 MB 7:1/149.69 MB Hdfs Read Thread Concurrency Bucket: 0:94.12% 1:5.882% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.058823529411764705 - AverageScannerThreadConcurrency: 0.5294117647058824 - BytesRead: 294107467 - BytesReadDataNodeCache: 0 - BytesReadLocal: 294107467 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 294107467 - DecompressionTime: 135207861 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 101203320 - PerReadThreadRawHdfsThroughput: 1443527152 - RemoteScanRanges: 0 - RowsRead: 73380456 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 19 - ScannerThreadsTotalWallClockTime: 4643232853 - MaterializeTupleTime(*): 4434752456 - ScannerThreadsSysTime: 19996000 - ScannerThreadsUserTime: 4561306000 - ScannerThreadsVoluntaryContextSwitches: 27 - TotalRawHdfsReadTime(*): 203742248 - TotalReadThroughput: 34600878 - TotalTime: 2518957056 Instance f74cea27cca1cc70:12e354ae50158eb3 (host=demeter-csmaz11-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/128.40 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1086229992 - PerHostPeakMemUsage: 1086229992 - PrepareTime: 393763374 - RowsProduced: 1 - TotalCpuTime: 11422716687 - TotalNetworkReceiveTime: 5030754141 - TotalNetworkSendTime: 441523 - TotalStorageWaitTime: 23182952 - TotalTime: 8276029025 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 465929 - CompileTime: 27828222 - InactiveTotalTime: 0 - LoadTime: 156115 - ModuleFileSize: 2309684 - OptimizationTime: 345552574 - PrepareTime: 347851618 - TotalTime: 724447746 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 50760 - OverallThroughput: 245598 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17627 - ThriftTransmitTime(*): 315208 - TotalTime: 65147 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2827 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8274909890 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5929045530 - BuildRows: 17378815 - BuildTime: 2875896 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043930688 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7869250905 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 690843659 - DeserializeRowBatchTimer: 2805407528 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3290651333 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2970359 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5850745203 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 13:1/128.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 125778781 - BytesReadDataNodeCache: 0 - BytesReadLocal: 125778781 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125778781 - DecompressionTime: 52385028 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1618116537 - RemoteScanRanges: 0 - RowsRead: 31375573 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1897131656 - MaterializeTupleTime(*): 1811263790 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 1864716000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 77731596 - TotalReadThroughput: 14694796 - TotalTime: 1937555565 Instance f74cea27cca1cc70:12e354ae50158e92 (host=demeter-csmaz08-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/157.81 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1089793512 - PerHostPeakMemUsage: 1089793512 - PrepareTime: 403646841 - RowsProduced: 1 - TotalCpuTime: 12183620507 - TotalNetworkReceiveTime: 4853295055 - TotalNetworkSendTime: 549472 - TotalStorageWaitTime: 23329413 - TotalTime: 8571929082 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 768074 - CompileTime: 29099719 - InactiveTotalTime: 0 - LoadTime: 137652 - ModuleFileSize: 2309684 - OptimizationTime: 347358151 - PrepareTime: 344323722 - TotalTime: 724013419 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 37878 - OverallThroughput: 229311 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14550 - ThriftTransmitTime(*): 422403 - TotalTime: 69774 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2850 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8570793802 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5709218569 - BuildRows: 17378815 - BuildTime: 2938579 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047489272 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8166768078 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 662665305 - DeserializeRowBatchTimer: 2687100060 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3276536365 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3082677 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5637571863 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 7:1/157.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 151803230 - BytesReadDataNodeCache: 0 - BytesReadLocal: 151803230 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151803230 - DecompressionTime: 74385286 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1343353445 - RemoteScanRanges: 0 - RowsRead: 37876645 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2401544326 - MaterializeTupleTime(*): 2292653877 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 2371639000 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 113003194 - TotalReadThroughput: 17859203 - TotalTime: 2454093485 Instance f74cea27cca1cc70:12e354ae50158ea7 (host=demeter-csmau10-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/156.44 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088884200 - PerHostPeakMemUsage: 1088884200 - PrepareTime: 401221429 - RowsProduced: 1 - TotalCpuTime: 11788594366 - TotalNetworkReceiveTime: 4992680100 - TotalNetworkSendTime: 490911 - TotalStorageWaitTime: 22642746 - TotalTime: 8448316566 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 539853 - CompileTime: 26027570 - InactiveTotalTime: 0 - LoadTime: 149257 - ModuleFileSize: 2309684 - OptimizationTime: 345052410 - PrepareTime: 347486705 - TotalTime: 721690743 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 41476 - OverallThroughput: 251988 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14874 - ThriftTransmitTime(*): 385763 - TotalTime: 63495 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2510 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8447085892 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5938408860 - BuildRows: 17378815 - BuildTime: 3096349 - InactiveTotalTime: 0 - PeakMemoryUsage: 1046575864 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8034694920 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 729262563 - DeserializeRowBatchTimer: 2761448954 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3376454081 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2966290 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5858770222 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 20:1/156.44 MB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:6.25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0625 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 151494285 - BytesReadDataNodeCache: 0 - BytesReadLocal: 151494285 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151494285 - DecompressionTime: 70594002 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1274307930 - RemoteScanRanges: 0 - RowsRead: 37798849 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2045204516 - MaterializeTupleTime(*): 1942568210 - ScannerThreadsSysTime: 7998000 - ScannerThreadsUserTime: 2014693000 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 118883577 - TotalReadThroughput: 15804931 - TotalTime: 2092822203 Instance f74cea27cca1cc70:12e354ae50158eb8 (host=demeter-csmaz08-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/127.73 MB 1:1/125.74 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0555555555555554 - InactiveTotalTime: 0 - PeakMemoryUsage: 1135354952 - PerHostPeakMemUsage: 1135354952 - PrepareTime: 398437310 - RowsProduced: 1 - TotalCpuTime: 13611380466 - TotalNetworkReceiveTime: 5053573598 - TotalNetworkSendTime: 446714 - TotalStorageWaitTime: 48977197 - TotalTime: 8390907714 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 570277 - CompileTime: 28049346 - InactiveTotalTime: 0 - LoadTime: 149642 - ModuleFileSize: 2309684 - OptimizationTime: 357271460 - PrepareTime: 345553608 - TotalTime: 734243026 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 45969 - OverallThroughput: 296873 - PeakMemoryUsage: 16384 - SerializeBatchTime: 12080 - ThriftTransmitTime(*): 348057 - TotalTime: 53895 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2054 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8389731244 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5915502726 - BuildRows: 17378815 - BuildTime: 2539796 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042893560 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7992967931 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 662305787 - DeserializeRowBatchTimer: 2473494516 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3601000730 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2973448 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5844666556 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 0:1/127.73 MB 1:1/125.74 MB Hdfs Read Thread Concurrency Bucket: 0:80% 1:13.33% 2:6.667% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.26666666666666666 - AverageScannerThreadConcurrency: 0.5333333333333333 - BytesRead: 248039019 - BytesReadDataNodeCache: 0 - BytesReadLocal: 248039019 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 248039019 - DecompressionTime: 96428326 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 100908368 - PerReadThreadRawHdfsThroughput: 1493806847 - RemoteScanRanges: 0 - RowsRead: 61872736 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 4021228350 - MaterializeTupleTime(*): 3854443932 - ScannerThreadsSysTime: 13997000 - ScannerThreadsUserTime: 3959397000 - ScannerThreadsVoluntaryContextSwitches: 21 - TotalRawHdfsReadTime(*): 166044907 - TotalReadThroughput: 26243530 - TotalTime: 2074040441 Instance f74cea27cca1cc70:12e354ae50158ebe (host=demeter-csmaz10-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/126.20 MB 23:1/123.35 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.999259885810954 - InactiveTotalTime: 0 - PeakMemoryUsage: 1194047696 - PerHostPeakMemUsage: 1194047696 - PrepareTime: 396450669 - RowsProduced: 0 - TotalCpuTime: 5930351466 - TotalNetworkReceiveTime: 5053614344 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 52417469 - TotalTime: 397489836 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 546619 - CompileTime: 25089325 - InactiveTotalTime: 0 - LoadTime: 137002 - ModuleFileSize: 2309684 - OptimizationTime: 333889320 - PrepareTime: 342894528 - TotalTime: 705003487 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 40780 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5980438 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 396445370 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5930349422 - BuildRows: 17378815 - BuildTime: 2814782 - InactiveTotalTime: 0 - PeakMemoryUsage: 1035417336 - ProbeRows: 18432 - ProbeTime: 9274824786544 - RowsReturned: 520192 - RowsReturnedRate: 56 - TotalTime: 9280837043796 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 676617136 - DeserializeRowBatchTimer: 2704445100 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3394717472 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2966257 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5858835363 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 21:1/126.20 MB 23:1/123.35 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.998731165741475 - BytesRead: 142839473 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 64536647 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 158609872 - PerReadThreadRawHdfsThroughput: 1246439242 - RemoteScanRanges: 0 - RowsRead: 19511296 - RowsReturned: 18432 - RowsReturnedRate: 228894 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 114598023 - TotalReadThroughput: 15102 - TotalTime: 80526344 Instance f74cea27cca1cc70:12e354ae50158ebc (host=demeter-csmau08-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/131.04 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087311336 - PerHostPeakMemUsage: 1087311336 - PrepareTime: 398755583 - RowsProduced: 1 - TotalCpuTime: 11418979447 - TotalNetworkReceiveTime: 4936284847 - TotalNetworkSendTime: 412439 - TotalStorageWaitTime: 24501330 - TotalTime: 8227906694 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 480411 - CompileTime: 27843732 - InactiveTotalTime: 0 - LoadTime: 115939 - ModuleFileSize: 2309684 - OptimizationTime: 355784894 - PrepareTime: 353587239 - TotalTime: 740505375 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 63862 - OverallThroughput: 250587 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17321 - ThriftTransmitTime(*): 250539 - TotalTime: 63850 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3053 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8226752110 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5881335958 - BuildRows: 17378815 - BuildTime: 3217227 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045007096 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7809477405 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 726559408 - DeserializeRowBatchTimer: 2829720932 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3296775955 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2995775 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5801106474 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/131.04 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 125720720 - BytesReadDataNodeCache: 0 - BytesReadLocal: 125720720 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125720720 - DecompressionTime: 61058733 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50734832 - PerReadThreadRawHdfsThroughput: 1210679608 - RemoteScanRanges: 0 - RowsRead: 31362264 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 1885966699 - MaterializeTupleTime(*): 1791770118 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 1851718000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 103843097 - TotalReadThroughput: 15715090 - TotalTime: 1925534692 Instance f74cea27cca1cc70:12e354ae50158ea4 (host=demeter-csmau10-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/152.56 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088007656 - PerHostPeakMemUsage: 1088007656 - PrepareTime: 407323168 - RowsProduced: 1 - TotalCpuTime: 11475725660 - TotalNetworkReceiveTime: 4730240228 - TotalNetworkSendTime: 334830 - TotalStorageWaitTime: 22539585 - TotalTime: 8149171115 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 509022 - CompileTime: 27909296 - InactiveTotalTime: 0 - LoadTime: 161830 - ModuleFileSize: 2309684 - OptimizationTime: 365971876 - PrepareTime: 348670062 - TotalTime: 745809645 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 64714 - OverallThroughput: 263591 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13474 - ThriftTransmitTime(*): 247239 - TotalTime: 60700 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2863 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8148083378 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5676044097 - BuildRows: 17378815 - BuildTime: 3033000 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045687032 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7740798121 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 730492306 - DeserializeRowBatchTimer: 2747845511 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3179148133 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3105581 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5595994535 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 4:1/152.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 149039093 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149039093 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149039093 - DecompressionTime: 59207058 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1772007316 - RemoteScanRanges: 0 - RowsRead: 37185864 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2008403099 - MaterializeTupleTime(*): 1915050661 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 1975699000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 84107493 - TotalReadThroughput: 17841082 - TotalTime: 2061353838 Instance f74cea27cca1cc70:12e354ae50158ebf (host=demeter-csmau08-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/153.73 MB 15:1/99.09 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0555555555555554 - InactiveTotalTime: 0 - PeakMemoryUsage: 1137386520 - PerHostPeakMemUsage: 1137386520 - PrepareTime: 400588922 - RowsProduced: 1 - TotalCpuTime: 13697829141 - TotalNetworkReceiveTime: 4711427030 - TotalNetworkSendTime: 456367 - TotalStorageWaitTime: 47914235 - TotalTime: 8388067462 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 546398 - CompileTime: 26455860 - InactiveTotalTime: 0 - LoadTime: 152756 - ModuleFileSize: 2309684 - OptimizationTime: 336980136 - PrepareTime: 347487469 - TotalTime: 714317547 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 44392 - OverallThroughput: 248922 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13496 - ThriftTransmitTime(*): 360419 - TotalTime: 64277 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2290 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8386882011 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5697447665 - BuildRows: 17378815 - BuildTime: 3667337 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045383928 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7982151926 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 754509206 - DeserializeRowBatchTimer: 2725220046 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3171770597 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3098048 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5609600273 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 17:1/153.73 MB 15:1/99.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.5333333333333333 - BytesRead: 246904741 - BytesReadDataNodeCache: 0 - BytesReadLocal: 246904741 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 246904741 - DecompressionTime: 98264283 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 100449568 - PerReadThreadRawHdfsThroughput: 1687260745 - RemoteScanRanges: 0 - RowsRead: 61589089 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 11 - ScannerThreadsTotalWallClockTime: 4007198599 - MaterializeTupleTime(*): 3837633714 - ScannerThreadsSysTime: 27995000 - ScannerThreadsUserTime: 3931402000 - ScannerThreadsVoluntaryContextSwitches: 26 - TotalRawHdfsReadTime(*): 146334668 - TotalReadThroughput: 27977145 - TotalTime: 2280520199 Instance f74cea27cca1cc70:12e354ae50158ecd (host=demeter-csmaz11-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/126.66 MB 12:1/132.84 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.1176470588235294 - InactiveTotalTime: 0 - PeakMemoryUsage: 1140876352 - PerHostPeakMemUsage: 1140876352 - PrepareTime: 396727709 - RowsProduced: 1 - TotalCpuTime: 12964252559 - TotalNetworkReceiveTime: 4998898042 - TotalNetworkSendTime: 382923 - TotalStorageWaitTime: 49370445 - TotalTime: 8181756786 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 491566 - CompileTime: 26191869 - InactiveTotalTime: 0 - LoadTime: 211670 - ModuleFileSize: 2309684 - OptimizationTime: 334515765 - PrepareTime: 351291596 - TotalTime: 715356146 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 55375 - OverallThroughput: 327862 - PeakMemoryUsage: 16384 - SerializeBatchTime: 10991 - ThriftTransmitTime(*): 288938 - TotalTime: 48801 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 965 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8180731999 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5909022214 - BuildRows: 17378815 - BuildTime: 3333835 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048562424 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7789784321 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 700365945 - DeserializeRowBatchTimer: 2885421557 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3216171450 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2979865 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5832079597 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/126.66 MB 12:1/132.84 MB Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:6.667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.06666666666666667 - AverageScannerThreadConcurrency: 0.5333333333333333 - BytesRead: 251211130 - BytesReadDataNodeCache: 0 - BytesReadLocal: 251211130 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 251211130 - DecompressionTime: 85748995 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 100760904 - PerReadThreadRawHdfsThroughput: 1653083413 - RemoteScanRanges: 0 - RowsRead: 62666049 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 3560133223 - MaterializeTupleTime(*): 3399043092 - ScannerThreadsSysTime: 17996000 - ScannerThreadsUserTime: 3493467000 - ScannerThreadsVoluntaryContextSwitches: 19 - TotalRawHdfsReadTime(*): 151965187 - TotalReadThroughput: 31174295 - TotalTime: 1876430901 Instance f74cea27cca1cc70:12e354ae50158ed0 (host=demeter-csmaz10-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/151.56 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087942120 - PerHostPeakMemUsage: 1087942120 - PrepareTime: 396075526 - RowsProduced: 1 - TotalCpuTime: 11890904795 - TotalNetworkReceiveTime: 5028552169 - TotalNetworkSendTime: 505355 - TotalStorageWaitTime: 22957407 - TotalTime: 8511168057 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 439796 - CompileTime: 34720183 - InactiveTotalTime: 0 - LoadTime: 197880 - ModuleFileSize: 2309684 - OptimizationTime: 339897600 - PrepareTime: 351109249 - TotalTime: 729008434 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 42153 - OverallThroughput: 258828 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13744 - ThriftTransmitTime(*): 379563 - TotalTime: 61817 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2674 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8510042780 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5938995460 - BuildRows: 17378815 - BuildTime: 3520491 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045621496 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8097571685 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 699506598 - DeserializeRowBatchTimer: 2774162844 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3366858508 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2965024 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5861271479 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/151.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 147657926 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147657926 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147657926 - DecompressionTime: 56467077 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1755099699 - RemoteScanRanges: 0 - RowsRead: 36841009 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2116668312 - MaterializeTupleTime(*): 2025703885 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2083683000 - ScannerThreadsVoluntaryContextSwitches: 11 - TotalRawHdfsReadTime(*): 84130791 - TotalReadThroughput: 15804622 - TotalTime: 2155819854 Instance f74cea27cca1cc70:12e354ae50158ed1 (host=demeter-csmaz10-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/125.22 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088515560 - PerHostPeakMemUsage: 1088515560 - PrepareTime: 397192464 - RowsProduced: 1 - TotalCpuTime: 11073599565 - TotalNetworkReceiveTime: 4785263383 - TotalNetworkSendTime: 381116 - TotalStorageWaitTime: 23383520 - TotalTime: 7978649721 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 681000 - CompileTime: 30940703 - InactiveTotalTime: 0 - LoadTime: 136899 - ModuleFileSize: 2309684 - OptimizationTime: 346465936 - PrepareTime: 350571501 - TotalTime: 731159158 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 57248 - OverallThroughput: 214670 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14884 - ThriftTransmitTime(*): 279484 - TotalTime: 74533 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3057 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 7977476084 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5679767300 - BuildRows: 17378815 - BuildTime: 2872995 - InactiveTotalTime: 0 - PeakMemoryUsage: 1046211320 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7568386886 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 695461312 - DeserializeRowBatchTimer: 2767305991 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3192414900 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3100190 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5605724586 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/125.22 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.2 - BytesRead: 124210542 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124210542 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124210542 - DecompressionTime: 50806166 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1667683800 - RemoteScanRanges: 0 - RowsRead: 30984152 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1845233070 - MaterializeTupleTime(*): 1760875853 - ScannerThreadsSysTime: 11998000 - ScannerThreadsUserTime: 1810724000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 74480871 - TotalReadThroughput: 13437277 - TotalTime: 1886001506 Instance f74cea27cca1cc70:12e354ae50158ea6 (host=demeter-csmau08-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/128.83 MB 2:1/126.28 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.1176470588235294 - InactiveTotalTime: 0 - PeakMemoryUsage: 1137116240 - PerHostPeakMemUsage: 1137116240 - PrepareTime: 386468970 - RowsProduced: 1 - TotalCpuTime: 13198580036 - TotalNetworkReceiveTime: 4817647177 - TotalNetworkSendTime: 308607 - TotalStorageWaitTime: 49738664 - TotalTime: 8168709816 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 457227 - CompileTime: 27085592 - InactiveTotalTime: 0 - LoadTime: 167391 - ModuleFileSize: 2309684 - OptimizationTime: 344087045 - PrepareTime: 340711273 - TotalTime: 715078063 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 62652 - OverallThroughput: 319348 - PeakMemoryUsage: 16384 - SerializeBatchTime: 10961 - ThriftTransmitTime(*): 255376 - TotalTime: 50102 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1195 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8167695279 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5720333056 - BuildRows: 17378815 - BuildTime: 3357430 - InactiveTotalTime: 0 - PeakMemoryUsage: 1044605688 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7792553016 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 697533628 - DeserializeRowBatchTimer: 2737109520 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3223194607 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3078397 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5645409126 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 1:1/128.83 MB 2:1/126.28 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.4375 - BytesRead: 247000548 - BytesReadDataNodeCache: 0 - BytesReadLocal: 247000548 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 247000548 - DecompressionTime: 94790805 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 100957528 - PerReadThreadRawHdfsThroughput: 1536644714 - RemoteScanRanges: 0 - RowsRead: 61614348 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 13 - ScannerThreadsTotalWallClockTime: 3804789203 - MaterializeTupleTime(*): 3634096917 - ScannerThreadsSysTime: 22996000 - ScannerThreadsUserTime: 3730431000 - ScannerThreadsVoluntaryContextSwitches: 27 - TotalRawHdfsReadTime(*): 160740180 - TotalReadThroughput: 30875068 - TotalTime: 2068079412 Instance f74cea27cca1cc70:12e354ae50158e90 (host=demeter-csmau08-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/152.40 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087401448 - PerHostPeakMemUsage: 1087401448 - PrepareTime: 394364689 - RowsProduced: 1 - TotalCpuTime: 11740649889 - TotalNetworkReceiveTime: 5012634468 - TotalNetworkSendTime: 335796 - TotalStorageWaitTime: 22541443 - TotalTime: 8428775008 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 444131 - CompileTime: 26340142 - InactiveTotalTime: 0 - LoadTime: 156016 - ModuleFileSize: 2309684 - OptimizationTime: 341392683 - PrepareTime: 348768344 - TotalTime: 719748008 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 65005 - OverallThroughput: 212215 - PeakMemoryUsage: 16384 - SerializeBatchTime: 27297 - ThriftTransmitTime(*): 246134 - TotalTime: 75395 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2696 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8427656747 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5961199502 - BuildRows: 17378815 - BuildTime: 3380159 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045080824 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8020879748 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 723202237 - DeserializeRowBatchTimer: 2697805702 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3439961969 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2957159 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5876860657 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/152.40 MB Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:6.667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.06666666666666667 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 148318000 - BytesReadDataNodeCache: 0 - BytesReadLocal: 148318000 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 148318000 - DecompressionTime: 61829098 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1557003924 - RemoteScanRanges: 0 - RowsRead: 37006140 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 2017100707 - MaterializeTupleTime(*): 1921970523 - ScannerThreadsSysTime: 13997000 - ScannerThreadsUserTime: 1980698000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 95258591 - TotalReadThroughput: 15743729 - TotalTime: 2056899770 Instance f74cea27cca1cc70:12e354ae50158e99 (host=demeter-csmau10-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/153.79 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087360480 - PerHostPeakMemUsage: 1087360480 - PrepareTime: 397022494 - RowsProduced: 1 - TotalCpuTime: 12147720233 - TotalNetworkReceiveTime: 4969978901 - TotalNetworkSendTime: 438734 - TotalStorageWaitTime: 23289995 - TotalTime: 8607760786 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 480163 - CompileTime: 28489288 - InactiveTotalTime: 0 - LoadTime: 154285 - ModuleFileSize: 2309684 - OptimizationTime: 351346669 - PrepareTime: 350641797 - TotalTime: 733842576 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 42079 - OverallThroughput: 205718 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13597 - ThriftTransmitTime(*): 380232 - TotalTime: 77776 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 17244 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8606628317 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5932293242 - BuildRows: 17378815 - BuildTime: 3276729 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045039864 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8195746234 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 738540888 - DeserializeRowBatchTimer: 2720367437 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3434103864 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2971120 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5849247041 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 18:1/153.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 150200731 - BytesReadDataNodeCache: 0 - BytesReadLocal: 150200731 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 150200731 - DecompressionTime: 58869212 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1773470214 - RemoteScanRanges: 0 - RowsRead: 37476378 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2220054201 - MaterializeTupleTime(*): 2127017760 - ScannerThreadsSysTime: 11998000 - ScannerThreadsUserTime: 2185667000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 84693123 - TotalReadThroughput: 15804595 - TotalTime: 2260668462 Instance f74cea27cca1cc70:12e354ae50158eac (host=demeter-csmau08-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/153.21 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.999894286167345 - InactiveTotalTime: 0 - PeakMemoryUsage: 1086460512 - PerHostPeakMemUsage: 1086460512 - PrepareTime: 393136523 - RowsProduced: 0 - TotalCpuTime: 5913754428 - TotalNetworkReceiveTime: 4941022311 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 23287621 - TotalTime: 394183316 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 491763 - CompileTime: 25861193 - InactiveTotalTime: 0 - LoadTime: 143049 - ModuleFileSize: 2309684 - OptimizationTime: 341068117 - PrepareTime: 348291782 - TotalTime: 718461119 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 33517 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 6121432 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 258192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 393131052 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5913752199 - BuildRows: 17378815 - BuildTime: 3154336 - InactiveTotalTime: 0 - PeakMemoryUsage: 1036760968 - ProbeRows: 18432 - ProbeTime: 9430831163089 - RowsReturned: 499712 - RowsReturnedRate: 52 - TotalTime: 9436818043797 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 722587642 - DeserializeRowBatchTimer: 2767895489 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3362152636 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2980203 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5831418219 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/153.21 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9994185124491198 - BytesRead: 42063904 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4679268 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49734288 - PerReadThreadRawHdfsThroughput: 1084040269 - RemoteScanRanges: 0 - RowsRead: 915456 - RowsReturned: 18432 - RowsReturnedRate: 257223 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38802898 - TotalReadThroughput: 4446 - TotalTime: 71657570 Instance f74cea27cca1cc70:12e354ae50158eb9 (host=demeter-csmaz11-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/156.27 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090379240 - PerHostPeakMemUsage: 1090379240 - PrepareTime: 392629509 - RowsProduced: 1 - TotalCpuTime: 11893395379 - TotalNetworkReceiveTime: 4773658935 - TotalNetworkSendTime: 558498 - TotalStorageWaitTime: 322312175 - TotalTime: 8523128977 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 494789 - CompileTime: 27756076 - InactiveTotalTime: 0 - LoadTime: 174506 - ModuleFileSize: 2309684 - OptimizationTime: 359708349 - PrepareTime: 347091932 - TotalTime: 737869107 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 40900 - OverallThroughput: 250842 - PeakMemoryUsage: 16384 - SerializeBatchTime: 18450 - ThriftTransmitTime(*): 391195 - TotalTime: 63785 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2886 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8522080319 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5690657240 - BuildRows: 17378815 - BuildTime: 3515691 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048062712 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8120322222 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 694097744 - DeserializeRowBatchTimer: 2639345889 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3277778602 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3099511 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5606952720 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 13:1/156.27 MB Hdfs Read Thread Concurrency Bucket: 0:68.75% 1:31.25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.3125 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 150199348 - BytesReadDataNodeCache: 0 - BytesReadLocal: 150199348 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 150199348 - DecompressionTime: 50330401 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50763504 - PerReadThreadRawHdfsThroughput: 73541200 - RemoteScanRanges: 0 - RowsRead: 37476380 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2387004366 - MaterializeTupleTime(*): 2005035334 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 2055687000 - ScannerThreadsVoluntaryContextSwitches: 13 - TotalRawHdfsReadTime(*): 2042383683 - TotalReadThroughput: 14817537 - TotalTime: 2426743714 Instance f74cea27cca1cc70:12e354ae50158eb2 (host=demeter-csmau08-9.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/153.48 MB 5:1/129.08 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0555555555555554 - InactiveTotalTime: 0 - PeakMemoryUsage: 1140278360 - PerHostPeakMemUsage: 1140278360 - PrepareTime: 395521567 - RowsProduced: 1 - TotalCpuTime: 13587734737 - TotalNetworkReceiveTime: 4984542712 - TotalNetworkSendTime: 347032 - TotalStorageWaitTime: 47173585 - TotalTime: 8429866006 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 481370 - CompileTime: 26755464 - InactiveTotalTime: 0 - LoadTime: 134233 - ModuleFileSize: 2309684 - OptimizationTime: 344489440 - PrepareTime: 350666610 - TotalTime: 725244313 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 54125 - OverallThroughput: 334854 - PeakMemoryUsage: 16384 - SerializeBatchTime: 8363 - ThriftTransmitTime(*): 295610 - TotalTime: 47782 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1103 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8428763032 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5942396934 - BuildRows: 17378815 - BuildTime: 3257654 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047669496 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8042507802 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 733037341 - DeserializeRowBatchTimer: 2778505378 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3370984771 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2967435 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5856509253 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 7:1/153.48 MB 5:1/129.08 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.4375 - BytesRead: 273988058 - BytesReadDataNodeCache: 0 - BytesReadLocal: 273988058 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273988058 - DecompressionTime: 105916859 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 101055840 - PerReadThreadRawHdfsThroughput: 1636418479 - RemoteScanRanges: 0 - RowsRead: 68355202 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 9 - ScannerThreadsTotalWallClockTime: 3875025766 - MaterializeTupleTime(*): 3697556737 - ScannerThreadsSysTime: 23996000 - ScannerThreadsUserTime: 3791422000 - ScannerThreadsVoluntaryContextSwitches: 26 - TotalRawHdfsReadTime(*): 167431535 - TotalReadThroughput: 32233889 - TotalTime: 2096625135 Instance f74cea27cca1cc70:12e354ae50158eae (host=demeter-csmau08-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/152.10 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090891232 - PerHostPeakMemUsage: 1090891232 - PrepareTime: 397588853 - RowsProduced: 1 - TotalCpuTime: 11798216003 - TotalNetworkReceiveTime: 5031721891 - TotalNetworkSendTime: 503166 - TotalStorageWaitTime: 22463385 - TotalTime: 8465684555 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 449687 - CompileTime: 30879965 - InactiveTotalTime: 0 - LoadTime: 147304 - ModuleFileSize: 2309684 - OptimizationTime: 343429137 - PrepareTime: 351408773 - TotalTime: 728971354 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 38655 - OverallThroughput: 243401 - PeakMemoryUsage: 16384 - SerializeBatchTime: 16877 - ThriftTransmitTime(*): 413911 - TotalTime: 65735 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2844 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8464663454 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5934551036 - BuildRows: 17378815 - BuildTime: 2972042 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048570616 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8054750792 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 699149504 - DeserializeRowBatchTimer: 2875995437 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3288230471 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2966809 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5857746194 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/152.10 MB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:6.25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0625 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 147976005 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147976005 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147976005 - DecompressionTime: 57029806 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1728895256 - RemoteScanRanges: 0 - RowsRead: 36920613 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2076993989 - MaterializeTupleTime(*): 1987862161 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 2041689000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 85589919 - TotalReadThroughput: 17408941 - TotalTime: 2117465639 Instance f74cea27cca1cc70:12e354ae50158ec6 (host=demeter-csmau08-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 16:1/156.56 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9999471402896711 - InactiveTotalTime: 0 - PeakMemoryUsage: 1092022904 - PerHostPeakMemUsage: 1092022904 - PrepareTime: 391607021 - RowsProduced: 0 - TotalCpuTime: 5697091385 - TotalNetworkReceiveTime: 4685299543 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 24506171 - TotalTime: 392658980 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 662547 - CompileTime: 33712534 - InactiveTotalTime: 0 - LoadTime: 164809 - ModuleFileSize: 2309684 - OptimizationTime: 346398280 - PrepareTime: 344697569 - TotalTime: 728008590 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 39887 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5175099 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 391602108 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5697089469 - BuildRows: 17378815 - BuildTime: 3931117 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042192120 - ProbeRows: 19456 - ProbeTime: 9447346420228 - RowsReturned: 538624 - RowsReturnedRate: 56 - TotalTime: 9453114131738 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 761862085 - DeserializeRowBatchTimer: 3577936252 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1287481797 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3101961 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5602524915 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 16:1/156.56 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9993656499444944 - BytesRead: 42062913 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 5174707 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49810296 - PerReadThreadRawHdfsThroughput: 987385231 - RemoteScanRanges: 0 - RowsRead: 912384 - RowsReturned: 19456 - RowsReturnedRate: 281670 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 42600306 - TotalReadThroughput: 4447 - TotalTime: 69073535 Instance f74cea27cca1cc70:12e354ae50158ea0 (host=demeter-csmaz08-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/152.94 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1096080864 - PerHostPeakMemUsage: 1096080864 - PrepareTime: 402965882 - RowsProduced: 1 - TotalCpuTime: 11820410374 - TotalNetworkReceiveTime: 4689899462 - TotalNetworkSendTime: 462177 - TotalStorageWaitTime: 150615519 - TotalTime: 8376555146 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 559249 - CompileTime: 28230178 - InactiveTotalTime: 0 - LoadTime: 148793 - ModuleFileSize: 2309684 - OptimizationTime: 346257822 - PrepareTime: 350706224 - TotalTime: 728473545 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 43261 - OverallThroughput: 251319 - PeakMemoryUsage: 16384 - SerializeBatchTime: 9827 - ThriftTransmitTime(*): 369842 - TotalTime: 63664 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2593 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8375302173 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5696666414 - BuildRows: 17378815 - BuildTime: 3737642 - InactiveTotalTime: 0 - PeakMemoryUsage: 1053764344 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7958015427 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 758501362 - DeserializeRowBatchTimer: 3577388226 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1291943850 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3104236 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5598417778 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 19:1/152.94 MB Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 149037745 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149037745 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149037745 - DecompressionTime: 53305446 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50763496 - PerReadThreadRawHdfsThroughput: 76040101 - RemoteScanRanges: 0 - RowsRead: 37185863 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2212124322 - MaterializeTupleTime(*): 1997830947 - ScannerThreadsSysTime: 13997000 - ScannerThreadsUserTime: 2048688000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 1959988775 - TotalReadThroughput: 17533852 - TotalTime: 2257937878 Instance f74cea27cca1cc70:12e354ae50158ec7 (host=demeter-csmau10-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/130.80 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1091964392 - PerHostPeakMemUsage: 1091964392 - PrepareTime: 395994896 - RowsProduced: 1 - TotalCpuTime: 11679889244 - TotalNetworkReceiveTime: 4902729060 - TotalNetworkSendTime: 336322 - TotalStorageWaitTime: 23629493 - TotalTime: 8340692303 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 541536 - CompileTime: 33857125 - InactiveTotalTime: 0 - LoadTime: 146039 - ModuleFileSize: 2309684 - OptimizationTime: 345982233 - PrepareTime: 345455774 - TotalTime: 728527283 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 55803 - OverallThroughput: 263574 - PeakMemoryUsage: 16384 - SerializeBatchTime: 10734 - ThriftTransmitTime(*): 286721 - TotalTime: 60704 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2776 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8339498902 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5905146372 - BuildRows: 17378815 - BuildTime: 3702774 - InactiveTotalTime: 0 - PeakMemoryUsage: 1049660152 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7931881831 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 758714918 - DeserializeRowBatchTimer: 3452585238 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1654578402 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2991728 - SendersBlockedTimer: 155230381 - SendersBlockedTotalTimer(*): 1030221181 - TotalTime: 5808953794 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 20:1/130.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 126911995 - BytesReadDataNodeCache: 0 - BytesReadLocal: 126911995 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126911995 - DecompressionTime: 53926555 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1555520178 - RemoteScanRanges: 0 - RowsRead: 31658935 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1979303961 - MaterializeTupleTime(*): 1891024277 - ScannerThreadsSysTime: 6998000 - ScannerThreadsUserTime: 1949703000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 81588138 - TotalReadThroughput: 14694677 - TotalTime: 2023439700 Instance f74cea27cca1cc70:12e354ae50158ecc (host=demeter-csmaz08-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/130.39 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090244072 - PerHostPeakMemUsage: 1090244072 - PrepareTime: 397832130 - RowsProduced: 1 - TotalCpuTime: 12112911157 - TotalNetworkReceiveTime: 4940276155 - TotalNetworkSendTime: 515004 - TotalStorageWaitTime: 22674434 - TotalTime: 8560129170 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 492339 - CompileTime: 30499174 - InactiveTotalTime: 0 - LoadTime: 145252 - ModuleFileSize: 2309684 - OptimizationTime: 359447203 - PrepareTime: 345902895 - TotalTime: 738949251 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 39560 - OverallThroughput: 341807 - PeakMemoryUsage: 16384 - SerializeBatchTime: 8499 - ThriftTransmitTime(*): 404444 - TotalTime: 46810 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1350 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8559027704 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5875779254 - BuildRows: 17378815 - BuildTime: 3071035 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047961136 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8173573078 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 716736726 - DeserializeRowBatchTimer: 2830502532 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3220531902 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2999626 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5793659060 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 20:1/130.39 MB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:6.25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0625 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 125789453 - BytesReadDataNodeCache: 0 - BytesReadLocal: 125789453 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125789453 - DecompressionTime: 53390396 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50734832 - PerReadThreadRawHdfsThroughput: 1524766902 - RemoteScanRanges: 0 - RowsRead: 31379665 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 2248843270 - MaterializeTupleTime(*): 2161654085 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 2216663000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 82497497 - TotalReadThroughput: 14798759 - TotalTime: 2295439238 Instance f74cea27cca1cc70:12e354ae50158ecb (host=demeter-csmaz08-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/131.85 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.999894286167345 - InactiveTotalTime: 0 - PeakMemoryUsage: 1088172584 - PerHostPeakMemUsage: 1088172584 - PrepareTime: 398046143 - RowsProduced: 0 - TotalCpuTime: 5681513235 - TotalNetworkReceiveTime: 4781292930 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 24397675 - TotalTime: 399178532 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 721841 - CompileTime: 30224743 - InactiveTotalTime: 0 - LoadTime: 147812 - ModuleFileSize: 2309684 - OptimizationTime: 360201361 - PrepareTime: 351124331 - TotalTime: 744875505 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 43064 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 4734993 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 398040250 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5681511632 - BuildRows: 17378815 - BuildTime: 2874137 - InactiveTotalTime: 0 - PeakMemoryUsage: 1038882552 - ProbeRows: 17408 - ProbeTime: 9434148167418 - RowsReturned: 374784 - RowsReturnedRate: 39 - TotalTime: 9439901680576 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 676084497 - DeserializeRowBatchTimer: 2678198096 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3201027523 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3099892 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5606263786 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/131.85 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9994185124491198 - BytesRead: 42059841 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3529018 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49269560 - PerReadThreadRawHdfsThroughput: 941317389 - RemoteScanRanges: 0 - RowsRead: 779264 - RowsReturned: 17408 - RowsReturnedRate: 245895 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 44681891 - TotalReadThroughput: 4446 - TotalTime: 70794194 Instance f74cea27cca1cc70:12e354ae50158ec5 (host=demeter-csmau10-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/153.50 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087958504 - PerHostPeakMemUsage: 1087958504 - PrepareTime: 401225063 - RowsProduced: 1 - TotalCpuTime: 11388820489 - TotalNetworkReceiveTime: 4756078694 - TotalNetworkSendTime: 402389 - TotalStorageWaitTime: 22403259 - TotalTime: 8126242209 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 539463 - CompileTime: 34215680 - InactiveTotalTime: 0 - LoadTime: 141753 - ModuleFileSize: 2309684 - OptimizationTime: 341169656 - PrepareTime: 349760671 - TotalTime: 728480075 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 51481 - OverallThroughput: 291290 - PeakMemoryUsage: 16384 - SerializeBatchTime: 9707 - ThriftTransmitTime(*): 310792 - TotalTime: 54928 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2903 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8125029535 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5681478036 - BuildRows: 17378815 - BuildTime: 3954946 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045637880 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7712845475 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 697626369 - DeserializeRowBatchTimer: 3215781939 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 2212328579 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3106921 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5593581176 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/153.50 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 147876128 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147876128 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147876128 - DecompressionTime: 58802120 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1755795651 - RemoteScanRanges: 0 - RowsRead: 36895350 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1983091355 - MaterializeTupleTime(*): 1891408789 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 1950703000 - ScannerThreadsVoluntaryContextSwitches: 6 - TotalRawHdfsReadTime(*): 84221719 - TotalReadThroughput: 15743925 - TotalTime: 2028473195 Instance f74cea27cca1cc70:12e354ae50158ea5 (host=demeter-csmaz10-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/126.00 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1085607392 - PerHostPeakMemUsage: 1085607392 - PrepareTime: 391353532 - RowsProduced: 1 - TotalCpuTime: 11144594572 - TotalNetworkReceiveTime: 4879161582 - TotalNetworkSendTime: 390266 - TotalStorageWaitTime: 23290116 - TotalTime: 8063185418 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 468387 - CompileTime: 24848697 - InactiveTotalTime: 0 - LoadTime: 158503 - ModuleFileSize: 2309684 - OptimizationTime: 342658285 - PrepareTime: 345421222 - TotalTime: 716169087 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 55809 - OverallThroughput: 217897 - PeakMemoryUsage: 16384 - SerializeBatchTime: 22751 - ThriftTransmitTime(*): 286691 - TotalTime: 73429 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 33824 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8062041701 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5727996649 - BuildRows: 17378815 - BuildTime: 2928273 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043303160 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7658252690 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 655444673 - DeserializeRowBatchTimer: 2503307083 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3499314429 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3071196 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5658645758 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 9:1/126.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 123149963 - BytesReadDataNodeCache: 0 - BytesReadLocal: 123149963 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 123149963 - DecompressionTime: 51457636 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751208 - PerReadThreadRawHdfsThroughput: 1619372511 - RemoteScanRanges: 0 - RowsRead: 30719056 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1887341627 - MaterializeTupleTime(*): 1803032378 - ScannerThreadsSysTime: 11998000 - ScannerThreadsUserTime: 1852718000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 76047952 - TotalReadThroughput: 15393745 - TotalTime: 1927710406 Instance f74cea27cca1cc70:12e354ae50158ead (host=demeter-csmaz11-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/148.87 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8823529411764706 - InactiveTotalTime: 0 - PeakMemoryUsage: 1089326568 - PerHostPeakMemUsage: 1089326568 - PrepareTime: 403378545 - RowsProduced: 1 - TotalCpuTime: 11479645108 - TotalNetworkReceiveTime: 4749536786 - TotalNetworkSendTime: 429530 - TotalStorageWaitTime: 12878280 - TotalTime: 8162449054 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 582069 - CompileTime: 30310710 - InactiveTotalTime: 0 - LoadTime: 159323 - ModuleFileSize: 2309684 - OptimizationTime: 344061819 - PrepareTime: 348559212 - TotalTime: 726173780 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 47092 - OverallThroughput: 238659 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17047 - ThriftTransmitTime(*): 339755 - TotalTime: 67041 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2704 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8161215066 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5699344816 - BuildRows: 17378815 - BuildTime: 3234226 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047005944 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7755916337 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 721581363 - DeserializeRowBatchTimer: 2711060585 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3164412576 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3101578 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5603215461 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 19:1/148.87 MB Hdfs Read Thread Concurrency Bucket: 0:86.67% 1:13.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.13333333333333333 - AverageScannerThreadConcurrency: 0.26666666666666666 - BytesRead: 144053935 - BytesReadDataNodeCache: 0 - BytesReadLocal: 144053935 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144053935 - DecompressionTime: 69045479 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1603898193 - RemoteScanRanges: 0 - RowsRead: 35940884 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 2004854181 - MaterializeTupleTime(*): 1912344243 - ScannerThreadsSysTime: 12998000 - ScannerThreadsUserTime: 1979699000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 89814887 - TotalReadThroughput: 15743678 - TotalTime: 2053408878 Instance f74cea27cca1cc70:12e354ae50158ec0 (host=demeter-csmaz11-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/129.77 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 1085763048 - PerHostPeakMemUsage: 1085763048 - PrepareTime: 393739159 - RowsProduced: 1 - TotalCpuTime: 11337720124 - TotalNetworkReceiveTime: 5038913381 - TotalNetworkSendTime: 414658 - TotalStorageWaitTime: 22661544 - TotalTime: 8245407714 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 468152 - CompileTime: 25550512 - InactiveTotalTime: 0 - LoadTime: 151897 - ModuleFileSize: 2309684 - OptimizationTime: 336967223 - PrepareTime: 348307390 - TotalTime: 714080783 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 63889 - OverallThroughput: 245278 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17767 - ThriftTransmitTime(*): 250434 - TotalTime: 65232 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2794 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8244369795 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5928224669 - BuildRows: 17378815 - BuildTime: 2808204 - InactiveTotalTime: 0 - PeakMemoryUsage: 1043458808 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7832770513 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 690296259 - DeserializeRowBatchTimer: 2829165370 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3333323064 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2967062 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5857245347 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/129.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.2 - BytesRead: 124555095 - BytesReadDataNodeCache: 0 - BytesReadLocal: 124555095 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124555095 - DecompressionTime: 48163826 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1637637254 - RemoteScanRanges: 0 - RowsRead: 31070269 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 1862140727 - MaterializeTupleTime(*): 1781067456 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 1829721000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 76057805 - TotalReadThroughput: 12597433 - TotalTime: 1901941948 Instance f74cea27cca1cc70:12e354ae50158e8e (host=demeter-csmaz08-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/153.21 MB 2:1/125.79 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.1176470588235294 - InactiveTotalTime: 0 - PeakMemoryUsage: 1132381280 - PerHostPeakMemUsage: 1132381280 - PrepareTime: 404897739 - RowsProduced: 1 - TotalCpuTime: 13685192196 - TotalNetworkReceiveTime: 4830217613 - TotalNetworkSendTime: 346606 - TotalStorageWaitTime: 49498114 - TotalTime: 8271879412 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 470754 - CompileTime: 26601620 - InactiveTotalTime: 0 - LoadTime: 144963 - ModuleFileSize: 2309684 - OptimizationTime: 346666620 - PrepareTime: 354182840 - TotalTime: 730564220 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 60317 - OverallThroughput: 299614 - PeakMemoryUsage: 16384 - SerializeBatchTime: 12414 - ThriftTransmitTime(*): 265265 - TotalTime: 53402 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1281 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8270742773 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5705473231 - BuildRows: 17378815 - BuildTime: 2786916 - InactiveTotalTime: 0 - PeakMemoryUsage: 1039723256 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7881973407 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 679970967 - DeserializeRowBatchTimer: 2599081963 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3397357581 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3083080 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5636834996 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/153.21 MB 2:1/125.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.5333333333333333 - BytesRead: 272481714 - BytesReadDataNodeCache: 0 - BytesReadLocal: 272481714 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 272481714 - DecompressionTime: 101132128 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 101105000 - PerReadThreadRawHdfsThroughput: 1501098472 - RemoteScanRanges: 0 - RowsRead: 67978254 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 4213371430 - MaterializeTupleTime(*): 4038676060 - ScannerThreadsSysTime: 24995000 - ScannerThreadsUserTime: 4141370000 - ScannerThreadsVoluntaryContextSwitches: 20 - TotalRawHdfsReadTime(*): 181521545 - TotalReadThroughput: 31487077 - TotalTime: 2172195856 Instance f74cea27cca1cc70:12e354ae50158e8b (host=demeter-csmaz11-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/129.26 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090727400 - PerHostPeakMemUsage: 1090727400 - PrepareTime: 397956875 - RowsProduced: 1 - TotalCpuTime: 11461486804 - TotalNetworkReceiveTime: 5047528642 - TotalNetworkSendTime: 348719 - TotalStorageWaitTime: 22085469 - TotalTime: 8307198359 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 446931 - CompileTime: 30060571 - InactiveTotalTime: 0 - LoadTime: 137745 - ModuleFileSize: 2309684 - OptimizationTime: 338961625 - PrepareTime: 351930337 - TotalTime: 724220739 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 55916 - OverallThroughput: 242729 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17080 - ThriftTransmitTime(*): 286142 - TotalTime: 65917 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 3010 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8306120313 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5966453731 - BuildRows: 17378815 - BuildTime: 3094478 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048423160 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7896810593 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 692430823 - DeserializeRowBatchTimer: 2847083726 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3392190548 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2950327 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5890470764 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/129.26 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 126114193 - BytesReadDataNodeCache: 0 - BytesReadLocal: 126114193 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126114193 - DecompressionTime: 47372046 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1479982085 - RemoteScanRanges: 0 - RowsRead: 31459650 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1887421268 - MaterializeTupleTime(*): 1809488830 - ScannerThreadsSysTime: 15997000 - ScannerThreadsUserTime: 1849718000 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 85213324 - TotalReadThroughput: 14836963 - TotalTime: 1927750093 Instance f74cea27cca1cc70:12e354ae50158ecf (host=demeter-csmaz11-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 23:1/155.03 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090547176 - PerHostPeakMemUsage: 1090547176 - PrepareTime: 389874088 - RowsProduced: 1 - TotalCpuTime: 11713912517 - TotalNetworkReceiveTime: 4793255629 - TotalNetworkSendTime: 422115 - TotalStorageWaitTime: 23616333 - TotalTime: 8304742547 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 487997 - CompileTime: 27624697 - InactiveTotalTime: 0 - LoadTime: 147259 - ModuleFileSize: 2309684 - OptimizationTime: 340602578 - PrepareTime: 344683472 - TotalTime: 716240117 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 57581 - OverallThroughput: 209822 - PeakMemoryUsage: 16384 - SerializeBatchTime: 16823 - ThriftTransmitTime(*): 277867 - TotalTime: 76255 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2431 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8303621143 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5705634581 - BuildRows: 17378815 - BuildTime: 2777848 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048464584 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7899144266 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 708182950 - DeserializeRowBatchTimer: 2714372627 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3210202178 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3086789 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5630061009 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 23:1/155.03 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 151112343 - BytesReadDataNodeCache: 0 - BytesReadLocal: 151112343 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151112343 - DecompressionTime: 61463393 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50734832 - PerReadThreadRawHdfsThroughput: 1706583237 - RemoteScanRanges: 0 - RowsRead: 37704818 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2151120814 - MaterializeTupleTime(*): 2055769257 - ScannerThreadsSysTime: 5999000 - ScannerThreadsUserTime: 2122677000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 88546717 - TotalReadThroughput: 17777922 - TotalTime: 2190580979 Instance f74cea27cca1cc70:12e354ae50158ec1 (host=demeter-csmaz08-9.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/150.97 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9411764705882353 - InactiveTotalTime: 0 - PeakMemoryUsage: 1085238752 - PerHostPeakMemUsage: 1085238752 - PrepareTime: 393635896 - RowsProduced: 1 - TotalCpuTime: 11523886016 - TotalNetworkReceiveTime: 5051904378 - TotalNetworkSendTime: 443941 - TotalStorageWaitTime: 24292882 - TotalTime: 8347729274 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 467610 - CompileTime: 25691906 - InactiveTotalTime: 0 - LoadTime: 138106 - ModuleFileSize: 2309684 - OptimizationTime: 331715055 - PrepareTime: 347288622 - TotalTime: 707945807 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 46150 - OverallThroughput: 244618 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17577 - ThriftTransmitTime(*): 346692 - TotalTime: 65408 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2663 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8346643255 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5960751199 - BuildRows: 17378815 - BuildTime: 3012360 - InactiveTotalTime: 0 - PeakMemoryUsage: 1042918136 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7937353472 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 706653158 - DeserializeRowBatchTimer: 2835589583 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3352785371 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2951991 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5887148752 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 17:1/150.97 MB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:6.25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0625 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 149036929 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149036929 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149036929 - DecompressionTime: 69375781 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1258387164 - RemoteScanRanges: 0 - RowsRead: 37185865 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 1933287220 - MaterializeTupleTime(*): 1830346385 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 1899711000 - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 118434877 - TotalReadThroughput: 16791366 - TotalTime: 1973658701 Instance f74cea27cca1cc70:12e354ae50158e93 (host=demeter-csmau10-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/130.10 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1092005352 - PerHostPeakMemUsage: 1092005352 - PrepareTime: 405999234 - RowsProduced: 1 - TotalCpuTime: 11506034308 - TotalNetworkReceiveTime: 5073870048 - TotalNetworkSendTime: 396464 - TotalStorageWaitTime: 24019744 - TotalTime: 8346233628 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 516328 - CompileTime: 26516519 - InactiveTotalTime: 0 - LoadTime: 148817 - ModuleFileSize: 2309684 - OptimizationTime: 347452395 - PrepareTime: 353061812 - TotalTime: 730394371 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 52715 - OverallThroughput: 166052 - PeakMemoryUsage: 16384 - SerializeBatchTime: 24341 - ThriftTransmitTime(*): 303518 - TotalTime: 96355 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2830 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8344946562 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5926005957 - BuildRows: 17378815 - BuildTime: 2950006 - InactiveTotalTime: 0 - PeakMemoryUsage: 1049701112 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 7932325890 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 659182944 - DeserializeRowBatchTimer: 2620930759 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3584929568 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2969097 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5853231864 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/130.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 126932036 - BytesReadDataNodeCache: 0 - BytesReadLocal: 126932036 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126932036 - DecompressionTime: 55557970 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 1610322410 - RemoteScanRanges: 0 - RowsRead: 31663777 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 1956639711 - MaterializeTupleTime(*): 1867026211 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 1923707000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 78823989 - TotalReadThroughput: 14933180 - TotalTime: 2003736209 Instance f74cea27cca1cc70:12e354ae50158e9a (host=demeter-csmau08-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/154.83 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9444444444444444 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087917536 - PerHostPeakMemUsage: 1087917536 - PrepareTime: 394971952 - RowsProduced: 1 - TotalCpuTime: 11788210573 - TotalNetworkReceiveTime: 5050151715 - TotalNetworkSendTime: 493055 - TotalStorageWaitTime: 22883276 - TotalTime: 8483131319 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 521826 - CompileTime: 26528580 - InactiveTotalTime: 0 - LoadTime: 156482 - ModuleFileSize: 2309684 - OptimizationTime: 323764411 - PrepareTime: 348665588 - TotalTime: 702274571 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 47104 - OverallThroughput: 270389 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13947 - ThriftTransmitTime(*): 339667 - TotalTime: 59174 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2777 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8482025100 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5973907669 - BuildRows: 17378815 - BuildTime: 3048949 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045596920 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8069705854 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 711162088 - DeserializeRowBatchTimer: 2792406948 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3395239446 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2949217 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5892686362 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 17:1/154.83 MB Hdfs Read Thread Concurrency Bucket: 0:94.12% 1:5.882% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.058823529411764705 - AverageScannerThreadConcurrency: 0.29411764705882354 - BytesRead: 152526490 - BytesReadDataNodeCache: 0 - BytesReadLocal: 152526490 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 152526490 - DecompressionTime: 68278906 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1642498722 - RemoteScanRanges: 0 - RowsRead: 38057408 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 2052703748 - MaterializeTupleTime(*): 1951916470 - ScannerThreadsSysTime: 2999000 - ScannerThreadsUserTime: 2027691000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 92862471 - TotalReadThroughput: 17944292 - TotalTime: 2092800628 Instance f74cea27cca1cc70:12e354ae50158ec9 (host=demeter-csmaz10-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/151.68 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1092177384 - PerHostPeakMemUsage: 1092177384 - PrepareTime: 404766171 - RowsProduced: 1 - TotalCpuTime: 11761611533 - TotalNetworkReceiveTime: 5068392926 - TotalNetworkSendTime: 559836 - TotalStorageWaitTime: 24760946 - TotalTime: 8467925521 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 517052 - CompileTime: 31422096 - InactiveTotalTime: 0 - LoadTime: 141278 - ModuleFileSize: 2309684 - OptimizationTime: 348986452 - PrepareTime: 346499709 - TotalTime: 730142660 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 37085 - OverallThroughput: 257313 - PeakMemoryUsage: 16384 - SerializeBatchTime: 14080 - ThriftTransmitTime(*): 431430 - TotalTime: 62181 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2747 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8466769406 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5900900051 - BuildRows: 17378815 - BuildTime: 2990466 - InactiveTotalTime: 0 - PeakMemoryUsage: 1049856760 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8060391622 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 638254572 - DeserializeRowBatchTimer: 2570221543 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3624629466 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2984311 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5823391341 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 0:1/151.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 147900661 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147900661 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147900661 - DecompressionTime: 69888921 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1265638662 - RemoteScanRanges: 0 - RowsRead: 36901348 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2104496610 - MaterializeTupleTime(*): 1999330375 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2070685000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 116858520 - TotalReadThroughput: 17400077 - TotalTime: 2156484734 Instance f74cea27cca1cc70:12e354ae50158ed3 (host=demeter-csmaz08-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/153.08 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087917544 - PerHostPeakMemUsage: 1087917544 - PrepareTime: 406754054 - RowsProduced: 1 - TotalCpuTime: 12003515002 - TotalNetworkReceiveTime: 5013624605 - TotalNetworkSendTime: 417961 - TotalStorageWaitTime: 23259889 - TotalTime: 8563909641 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 756900 - CompileTime: 31896402 - InactiveTotalTime: 0 - LoadTime: 133682 - ModuleFileSize: 2309684 - OptimizationTime: 343000934 - PrepareTime: 350583718 - TotalTime: 728666763 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 49226 - OverallThroughput: 225740 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13957 - ThriftTransmitTime(*): 325026 - TotalTime: 70878 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2887 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8562743842 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5868170892 - BuildRows: 17378815 - BuildTime: 2790172 - InactiveTotalTime: 0 - PeakMemoryUsage: 1045596920 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8154444872 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 664680614 - DeserializeRowBatchTimer: 2793679232 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3342471261 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2997232 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5798286330 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 13:1/153.08 MB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:6.25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0625 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 149038549 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149038549 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149038549 - DecompressionTime: 57960830 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1660327645 - RemoteScanRanges: 0 - RowsRead: 37185865 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2232368527 - MaterializeTupleTime(*): 2139696869 - ScannerThreadsSysTime: 4999000 - ScannerThreadsUserTime: 2205664000 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 89764541 - TotalReadThroughput: 17533946 - TotalTime: 2282352656 Instance f74cea27cca1cc70:12e354ae50158ebb (host=demeter-csmaz10-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/154.91 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090629096 - PerHostPeakMemUsage: 1090629096 - PrepareTime: 396232624 - RowsProduced: 1 - TotalCpuTime: 12153375755 - TotalNetworkReceiveTime: 4968728275 - TotalNetworkSendTime: 473953 - TotalStorageWaitTime: 23563147 - TotalTime: 8609715138 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 450035 - CompileTime: 29055873 - InactiveTotalTime: 0 - LoadTime: 159640 - ModuleFileSize: 2309684 - OptimizationTime: 350524432 - PrepareTime: 349470387 - TotalTime: 732252166 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 40847 - OverallThroughput: 236120 - PeakMemoryUsage: 16384 - SerializeBatchTime: 17351 - ThriftTransmitTime(*): 391697 - TotalTime: 67762 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2770 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8608603563 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5925484714 - BuildRows: 17378815 - BuildTime: 3336017 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048308472 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8199058264 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 731584589 - DeserializeRowBatchTimer: 2804051236 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3337864348 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2976250 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5839163127 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/154.91 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.25 - BytesRead: 151419962 - BytesReadDataNodeCache: 0 - BytesReadLocal: 151419962 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 151419962 - DecompressionTime: 74459637 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1255774074 - RemoteScanRanges: 0 - RowsRead: 37780629 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2229849502 - MaterializeTupleTime(*): 2120591037 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 2196666000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 120578984 - TotalReadThroughput: 15804766 - TotalTime: 2270586318 Instance f74cea27cca1cc70:12e354ae50158eca (host=demeter-csmaz10-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/153.12 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9444444444444444 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087229416 - PerHostPeakMemUsage: 1087229416 - PrepareTime: 396331674 - RowsProduced: 1 - TotalCpuTime: 12032959912 - TotalNetworkReceiveTime: 4988233719 - TotalNetworkSendTime: 504423 - TotalStorageWaitTime: 132022004 - TotalTime: 8610396970 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 495634 - CompileTime: 32850333 - InactiveTotalTime: 0 - LoadTime: 155500 - ModuleFileSize: 2309684 - OptimizationTime: 352316129 - PrepareTime: 350588161 - TotalTime: 739082507 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 38811 - OverallThroughput: 261245 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13994 - ThriftTransmitTime(*): 412249 - TotalTime: 61245 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2803 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8609305459 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5887751018 - BuildRows: 17378815 - BuildTime: 2936582 - InactiveTotalTime: 0 - PeakMemoryUsage: 1044925176 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8199223790 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 697607746 - DeserializeRowBatchTimer: 2851923571 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3286190152 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2990146 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5812027063 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/153.12 MB Hdfs Read Thread Concurrency Bucket: 0:88.24% 1:11.76% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.11764705882352941 - AverageScannerThreadConcurrency: 0.29411764705882354 - BytesRead: 149050737 - BytesReadDataNodeCache: 0 - BytesReadLocal: 149050737 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149050737 - DecompressionTime: 56923397 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50751216 - PerReadThreadRawHdfsThroughput: 88976205 - RemoteScanRanges: 0 - RowsRead: 37189814 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2268829412 - MaterializeTupleTime(*): 2068536939 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2127676000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 1675175255 - TotalReadThroughput: 17535380 - TotalTime: 2308766188 Instance f74cea27cca1cc70:12e354ae50158eaf (host=demeter-csmau08-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 23:1/151.62 MB 0:1/152.61 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.1666666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 1140573296 - PerHostPeakMemUsage: 1140573296 - PrepareTime: 390478407 - RowsProduced: 1 - TotalCpuTime: 14568956940 - TotalNetworkReceiveTime: 4783390912 - TotalNetworkSendTime: 408514 - TotalStorageWaitTime: 47192239 - TotalTime: 8631890322 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 439304 - CompileTime: 27201533 - InactiveTotalTime: 0 - LoadTime: 135076 - ModuleFileSize: 2309684 - OptimizationTime: 346053280 - PrepareTime: 345654451 - TotalTime: 722002885 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 45423 - OverallThroughput: 308522 - PeakMemoryUsage: 16384 - SerializeBatchTime: 11851 - ThriftTransmitTime(*): 352241 - TotalTime: 51860 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 1386 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8630886270 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5715519468 - BuildRows: 17378815 - BuildTime: 3510540 - InactiveTotalTime: 0 - PeakMemoryUsage: 1047816952 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8249852633 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 712474010 - DeserializeRowBatchTimer: 2570629473 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3410136799 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3086347 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5630867487 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 23:1/151.62 MB 0:1/152.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.625 - BytesRead: 296400925 - BytesReadDataNodeCache: 0 - BytesReadLocal: 296400925 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 296400925 - DecompressionTime: 128564824 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 101203320 - PerReadThreadRawHdfsThroughput: 1646981968 - RemoteScanRanges: 0 - RowsRead: 73952324 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 4677988078 - MaterializeTupleTime(*): 4468778568 - ScannerThreadsSysTime: 22995000 - ScannerThreadsUserTime: 4593301000 - ScannerThreadsVoluntaryContextSwitches: 20 - TotalRawHdfsReadTime(*): 179966102 - TotalReadThroughput: 33202103 - TotalTime: 2530686917 Instance f74cea27cca1cc70:12e354ae50158e98 (host=demeter-csmau08-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/175.32 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8888888888888888 - InactiveTotalTime: 0 - PeakMemoryUsage: 1090571752 - PerHostPeakMemUsage: 1090571752 - PrepareTime: 426031738 - RowsProduced: 1 - TotalCpuTime: 12594686310 - TotalNetworkReceiveTime: 4620082637 - TotalNetworkSendTime: 406096 - TotalStorageWaitTime: 23644886 - TotalTime: 8669061601 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 778975 - CompileTime: 25794134 - InactiveTotalTime: 0 - LoadTime: 151619 - ModuleFileSize: 2309684 - OptimizationTime: 360863582 - PrepareTime: 348849583 - TotalTime: 738736713 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 50828 - OverallThroughput: 235616 - PeakMemoryUsage: 16384 - SerializeBatchTime: 12090 - ThriftTransmitTime(*): 314781 - TotalTime: 67907 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2570 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8667815283 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5662430840 - BuildRows: 17378815 - BuildTime: 3913469 - InactiveTotalTime: 0 - PeakMemoryUsage: 1048267512 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8255438534 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 793664913 - DeserializeRowBatchTimer: 3508480566 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 1351801913 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3121639 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5567207246 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/175.32 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.3125 - BytesRead: 171266478 - BytesReadDataNodeCache: 0 - BytesReadLocal: 171266478 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171266478 - DecompressionTime: 68825928 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767600 - PerReadThreadRawHdfsThroughput: 1767277361 - RemoteScanRanges: 0 - RowsRead: 42737697 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 5 - ScannerThreadsTotalWallClockTime: 2519117186 - MaterializeTupleTime(*): 2413993962 - ScannerThreadsSysTime: 10998000 - ScannerThreadsUserTime: 2485622000 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 96909790 - TotalReadThroughput: 18766137 - TotalTime: 2589568473 Instance f74cea27cca1cc70:12e354ae50158e9f (host=demeter-csmau08-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/153.39 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.894736842105263 - InactiveTotalTime: 0 - PeakMemoryUsage: 1091653088 - PerHostPeakMemUsage: 1091653088 - PrepareTime: 397597679 - RowsProduced: 1 - TotalCpuTime: 12641568235 - TotalNetworkReceiveTime: 4991289397 - TotalNetworkSendTime: 510084 - TotalStorageWaitTime: 22343464 - TotalTime: 8871680567 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 536061 - CompileTime: 25581090 - InactiveTotalTime: 0 - LoadTime: 151002 - ModuleFileSize: 2309684 - OptimizationTime: 339286679 - PrepareTime: 344477304 - TotalTime: 712634799 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 16 - InactiveTotalTime: 0 - NetworkThroughput(*): 38177 - OverallThroughput: 253385 - PeakMemoryUsage: 16384 - SerializeBatchTime: 13617 - ThriftTransmitTime(*): 419099 - TotalTime: 63145 - UncompressedRowBatchSize: 16 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 2756 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 20480 - RowsRepartitioned: 0 - RowsReturned: 1 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 8870397562 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5902266307 - BuildRows: 17378815 - BuildTime: 3103926 - InactiveTotalTime: 0 - PeakMemoryUsage: 1049348856 - ProbeRows: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - TotalTime: 8468341754 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 697146313 - DeserializeRowBatchTimer: 2590199848 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3570911977 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2985204 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5821649575 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 22:1/153.39 MB Hdfs Read Thread Concurrency Bucket: 0:94.12% 1:5.882% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.058823529411764705 - AverageScannerThreadConcurrency: 0.29411764705882354 - BytesRead: 147607470 - BytesReadDataNodeCache: 0 - BytesReadLocal: 147607470 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147607470 - DecompressionTime: 67532545 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 50767592 - PerReadThreadRawHdfsThroughput: 1255592024 - RemoteScanRanges: 0 - RowsRead: 36828037 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 2515317437 - MaterializeTupleTime(*): 2413612527 - ScannerThreadsSysTime: 9998000 - ScannerThreadsUserTime: 2483622000 - ScannerThreadsVoluntaryContextSwitches: 10 - TotalRawHdfsReadTime(*): 117560057 - TotalReadThroughput: 16400830 - TotalTime: 2562214839 Instance f74cea27cca1cc70:12e354ae50158ec3 (host=demeter-csmau10-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/150.31 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9999471207233885 - InactiveTotalTime: 0 - PeakMemoryUsage: 1083881848 - PerHostPeakMemUsage: 1083881848 - PrepareTime: 387192263 - RowsProduced: 0 - TotalCpuTime: 6125045872 - TotalNetworkReceiveTime: 5193006226 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 22933720 - TotalTime: 388273518 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 505322 - CompileTime: 10208461 - InactiveTotalTime: 0 - LoadTime: 157632 - ModuleFileSize: 2309684 - OptimizationTime: 146533324 - PrepareTime: 341413856 - TotalTime: 501481258 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 28674 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5043275 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 387186259 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 6125044532 - BuildRows: 17378815 - BuildTime: 2978559 - InactiveTotalTime: 0 - PeakMemoryUsage: 1034327800 - ProbeRows: 17408 - ProbeTime: 9430307814891 - RowsReturned: 411648 - RowsReturnedRate: 43 - TotalTime: 9436501642833 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 721238684 - DeserializeRowBatchTimer: 2770054333 - FirstBatchArrivalWaitTime: 129595089 - InactiveTotalTime: 3566341899 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2873464 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 6048035494 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/150.31 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9993125330512956 - BytesRead: 42063822 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 3977725 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49599104 - PerReadThreadRawHdfsThroughput: 1009699289 - RemoteScanRanges: 0 - RowsRead: 814080 - RowsReturned: 17408 - RowsReturnedRate: 257793 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 41659752 - TotalReadThroughput: 4448 - TotalTime: 67526940 Instance f74cea27cca1cc70:12e354ae50158eb6 (host=demeter-csmaz11-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/145.11 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9999471179270227 - InactiveTotalTime: 0 - PeakMemoryUsage: 1087023504 - PerHostPeakMemUsage: 1087023504 - PrepareTime: 393856537 - RowsProduced: 0 - TotalCpuTime: 5928479888 - TotalNetworkReceiveTime: 4963773434 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 22906816 - TotalTime: 394927580 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 476289 - CompileTime: 28931300 - InactiveTotalTime: 0 - LoadTime: 171186 - ModuleFileSize: 2309684 - OptimizationTime: 341286435 - PrepareTime: 348983854 - TotalTime: 722532292 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 32614 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 7380508 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 393850607 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5928478251 - BuildRows: 17378815 - BuildTime: 3392317 - InactiveTotalTime: 0 - PeakMemoryUsage: 1037268728 - ProbeRows: 20480 - ProbeTime: 9443677816049 - RowsReturned: 627712 - RowsReturnedRate: 66 - TotalTime: 9449673671755 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 736590090 - DeserializeRowBatchTimer: 2867877241 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3249966391 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 2974932 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5841750839 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/145.11 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.9993653815643344 - BytesRead: 42063741 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 4188790 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 49734288 - PerReadThreadRawHdfsThroughput: 951197161 - RemoteScanRanges: 0 - RowsRead: 886784 - RowsReturned: 20480 - RowsReturnedRate: 311693 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 44221895 - TotalReadThroughput: 4449 - TotalTime: 65705620 Instance f74cea27cca1cc70:12e354ae50158eb1 (host=demeter-csmau08-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/154.80 MB 18:1/125.47 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.9992070624306177 - InactiveTotalTime: 0 - PeakMemoryUsage: 1191413992 - PerHostPeakMemUsage: 1191413992 - PrepareTime: 396070384 - RowsProduced: 0 - TotalCpuTime: 5697255685 - TotalNetworkReceiveTime: 4783905776 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 46308307 - TotalTime: 397137273 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 687170 - CompileTime: 37120820 - InactiveTotalTime: 0 - LoadTime: 140244 - ModuleFileSize: 2309684 - OptimizationTime: 346353746 - PrepareTime: 349114675 - TotalTime: 736022817 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 41265 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 5161661 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 192512 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 396064311 CROSS_JOIN_NODE (id=2) ExecOption: Join Build-Side Prepared Asynchronously - AsyncTotalTime: 5697253672 - BuildRows: 17378815 - BuildTime: 3239218 - InactiveTotalTime: 0 - PeakMemoryUsage: 1032632056 - ProbeRows: 17408 - ProbeTime: 9440879415624 - RowsReturned: 419840 - RowsReturnedRate: 44 - TotalTime: 9446649828795 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 313564234 - ConvertRowBatchTime: 710580098 - DeserializeRowBatchTimer: 2669133847 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 3319644671 - PeakMemoryUsage: 0 - RowsReturned: 17378815 - RowsReturnedRate: 3090912 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 5622551465 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 20:1/154.80 MB 18:1/125.47 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.9988369019296854 - BytesRead: 142845119 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 83557024 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 158761448 - PerReadThreadRawHdfsThroughput: 1360688598 - RemoteScanRanges: 0 - RowsRead: 19559424 - RowsReturned: 17408 - RowsReturnedRate: 242327 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 104980022 - TotalReadThroughput: 15103 - TotalTime: 71836661 Fragment F01 Instance f74cea27cca1cc70:12e354ae50158ef3 (host=demeter-csmau10-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/98.80 MB 6:1/98.53 MB 3:1/98.88 MB 19:1/98.99 MB 18:1/98.48 MB 14:1/99.19 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 147819600 - PerHostPeakMemUsage: 212118608 - PrepareTime: 117125 - RowsProduced: 0 - TotalCpuTime: 4500229388 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 39944 - TotalStorageWaitTime: 1480842762 - TotalTime: 794614785 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 49335 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/98.80 MB 6:1/98.53 MB 3:1/98.88 MB 19:1/98.99 MB 18:1/98.48 MB 14:1/99.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23128420 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23128420 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23128420 - DecompressionTime: 1252391697 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 147500112 - PerReadThreadRawHdfsThroughput: 143348677 - RemoteScanRanges: 0 - RowsRead: 8166887 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 4500262041 - MaterializeTupleTime(*): 1749107623 - ScannerThreadsSysTime: 117979000 - ScannerThreadsUserTime: 2884559000 - ScannerThreadsVoluntaryContextSwitches: 177 - TotalRawHdfsReadTime(*): 161343798 - TotalReadThroughput: 23128420 - TotalTime: 787693637 Instance f74cea27cca1cc70:12e354ae50158f07 (host=demeter-csmaz08-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/98.90 MB 3:1/99.18 MB 0:1/99.18 MB 1:1/98.46 MB 23:1/98.40 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 127195536 - PerHostPeakMemUsage: 211208592 - PrepareTime: 258012 - RowsProduced: 0 - TotalCpuTime: 4129032702 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 34807 - TotalStorageWaitTime: 1578905533 - TotalTime: 870884949 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 144364 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/98.90 MB 3:1/99.18 MB 0:1/99.18 MB 1:1/98.46 MB 23:1/98.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 19564536 - BytesReadDataNodeCache: 0 - BytesReadLocal: 19564536 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 19564536 - DecompressionTime: 1100503393 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 126876048 - PerReadThreadRawHdfsThroughput: 741767240 - RemoteScanRanges: 0 - RowsRead: 6826488 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 4129053536 - MaterializeTupleTime(*): 1441441651 - ScannerThreadsSysTime: 103982000 - ScannerThreadsUserTime: 2430628000 - ScannerThreadsVoluntaryContextSwitches: 180 - TotalRawHdfsReadTime(*): 26375573 - TotalReadThroughput: 19564536 - TotalTime: 859384927 Instance f74cea27cca1cc70:12e354ae50158eeb (host=demeter-csmaz11-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/98.86 MB 12:1/98.91 MB 7:1/98.85 MB 18:1/99.94 MB 23:1/98.29 MB 19:1/98.59 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 154945568 - PerHostPeakMemUsage: 244856864 - PrepareTime: 303491 - RowsProduced: 0 - TotalCpuTime: 5290692097 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 33753 - TotalStorageWaitTime: 1753821857 - TotalTime: 928341880 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 139623 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/98.86 MB 12:1/98.91 MB 7:1/98.85 MB 18:1/99.94 MB 23:1/98.29 MB 19:1/98.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.5 - BytesRead: 23866394 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23866394 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23866394 - DecompressionTime: 1348693637 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 154626080 - PerReadThreadRawHdfsThroughput: 734552213 - RemoteScanRanges: 0 - RowsRead: 8169703 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 21 - ScannerThreadsTotalWallClockTime: 5290715318 - MaterializeTupleTime(*): 2145970839 - ScannerThreadsSysTime: 132977000 - ScannerThreadsUserTime: 3381483000 - ScannerThreadsVoluntaryContextSwitches: 207 - TotalRawHdfsReadTime(*): 32491079 - TotalReadThroughput: 23866394 - TotalTime: 916990932 Instance f74cea27cca1cc70:12e354ae50158eff (host=demeter-csmau08-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/98.66 MB 23:1/98.48 MB 6:1/98.39 MB 15:1/99.32 MB 2:1/98.77 MB 11:1/98.75 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 151074176 - PerHostPeakMemUsage: 235967872 - PrepareTime: 250089 - RowsProduced: 0 - TotalCpuTime: 5204633489 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 58693 - TotalStorageWaitTime: 1911860826 - TotalTime: 920034143 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 110879 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 21:1/98.66 MB 23:1/98.48 MB 6:1/98.39 MB 15:1/99.32 MB 2:1/98.77 MB 11:1/98.75 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 23449947 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23449947 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23449947 - DecompressionTime: 1340856176 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 150754688 - PerReadThreadRawHdfsThroughput: 677723331 - RemoteScanRanges: 0 - RowsRead: 8199112 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 5204658267 - MaterializeTupleTime(*): 1940861042 - ScannerThreadsSysTime: 110980000 - ScannerThreadsUserTime: 3169516000 - ScannerThreadsVoluntaryContextSwitches: 205 - TotalRawHdfsReadTime(*): 34601062 - TotalReadThroughput: 23449947 - TotalTime: 909847401 Instance f74cea27cca1cc70:12e354ae50158ef6 (host=demeter-csmaz11-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/97.38 MB 2:1/99.11 MB 23:1/98.86 MB 22:1/99.03 MB 20:1/98.47 MB 19:1/98.46 MB 17:1/98.21 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 173823872 - PerHostPeakMemUsage: 261977984 - PrepareTime: 264321 - RowsProduced: 0 - TotalCpuTime: 6244348727 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 33704 - TotalStorageWaitTime: 2129536525 - TotalTime: 940102534 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 109529 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/97.38 MB 2:1/99.11 MB 23:1/98.86 MB 22:1/99.03 MB 20:1/98.47 MB 19:1/98.46 MB 17:1/98.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27278372 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27278372 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27278372 - DecompressionTime: 1597482784 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 173504384 - PerReadThreadRawHdfsThroughput: 652029359 - RemoteScanRanges: 0 - RowsRead: 9540300 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 50 - ScannerThreadsTotalWallClockTime: 6244370465 - MaterializeTupleTime(*): 2483604030 - ScannerThreadsSysTime: 150974000 - ScannerThreadsUserTime: 3949397000 - ScannerThreadsVoluntaryContextSwitches: 201 - TotalRawHdfsReadTime(*): 41836110 - TotalReadThroughput: 54556744 - TotalTime: 929835242 Instance f74cea27cca1cc70:12e354ae50158ede (host=demeter-csmau10-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/98.84 MB 6:1/98.80 MB 3:1/98.43 MB 1:1/98.71 MB 23:1/98.43 MB 21:1/98.55 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 152171136 - PerHostPeakMemUsage: 235469440 - PrepareTime: 239101 - RowsProduced: 0 - TotalCpuTime: 5195878209 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31223 - TotalStorageWaitTime: 2010277459 - TotalTime: 940852609 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 123820 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:1/98.84 MB 6:1/98.80 MB 3:1/98.43 MB 1:1/98.71 MB 23:1/98.43 MB 21:1/98.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23045834 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23045834 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23045834 - DecompressionTime: 1295243074 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 151851648 - PerReadThreadRawHdfsThroughput: 329551627 - RemoteScanRanges: 0 - RowsRead: 8223631 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 5195901514 - MaterializeTupleTime(*): 1876170984 - ScannerThreadsSysTime: 116980000 - ScannerThreadsUserTime: 3050534000 - ScannerThreadsVoluntaryContextSwitches: 205 - TotalRawHdfsReadTime(*): 69930876 - TotalReadThroughput: 23045834 - TotalTime: 930617776 Instance f74cea27cca1cc70:12e354ae50158f0c (host=demeter-csmau08-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/99.51 MB 0:1/98.66 MB 22:1/98.44 MB 20:1/98.49 MB 6:1/99.14 MB 15:1/98.93 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 143288336 - PerHostPeakMemUsage: 235409424 - PrepareTime: 256125 - RowsProduced: 0 - TotalCpuTime: 5372553430 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31082 - TotalStorageWaitTime: 1956769485 - TotalTime: 964657819 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 110175 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:1/99.51 MB 0:1/98.66 MB 22:1/98.44 MB 20:1/98.49 MB 6:1/99.14 MB 15:1/98.93 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23457755 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23457755 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23457755 - DecompressionTime: 1312252637 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 142968848 - PerReadThreadRawHdfsThroughput: 734818776 - RemoteScanRanges: 0 - RowsRead: 8173881 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 5372576949 - MaterializeTupleTime(*): 2085903205 - ScannerThreadsSysTime: 114979000 - ScannerThreadsUserTime: 3287496000 - ScannerThreadsVoluntaryContextSwitches: 182 - TotalRawHdfsReadTime(*): 31923184 - TotalReadThroughput: 23457755 - TotalTime: 954558826 Instance f74cea27cca1cc70:12e354ae50158ee1 (host=demeter-csmaz08-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/99.54 MB 21:1/98.44 MB 17:1/98.70 MB 15:1/98.66 MB 0:1/98.75 MB 5:1/98.73 MB 8:1/98.43 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 130427328 - PerHostPeakMemUsage: 213359024 - PrepareTime: 253590 - RowsProduced: 0 - TotalCpuTime: 6139697725 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 20809 - TotalStorageWaitTime: 2535994925 - TotalTime: 984974718 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 131152 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/99.54 MB 21:1/98.44 MB 17:1/98.70 MB 15:1/98.66 MB 0:1/98.75 MB 5:1/98.73 MB 8:1/98.43 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.5 - BytesRead: 27437191 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27437191 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27437191 - DecompressionTime: 1376047056 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 130107840 - PerReadThreadRawHdfsThroughput: 365348312 - RemoteScanRanges: 0 - RowsRead: 9579295 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 19 - ScannerThreadsTotalWallClockTime: 6139726549 - MaterializeTupleTime(*): 2214539050 - ScannerThreadsSysTime: 152973000 - ScannerThreadsUserTime: 3435475000 - ScannerThreadsVoluntaryContextSwitches: 199 - TotalRawHdfsReadTime(*): 75098721 - TotalReadThroughput: 27437191 - TotalTime: 974577712 Instance f74cea27cca1cc70:12e354ae50158f03 (host=demeter-csmaz08-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/99.60 MB 22:1/99.20 MB 23:1/99.02 MB 17:1/99.20 MB 6:1/99.07 MB 15:1/98.72 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 138818600 - PerHostPeakMemUsage: 138818600 - PrepareTime: 47396135 - RowsProduced: 0 - TotalCpuTime: 4292256797 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27765 - TotalStorageWaitTime: 2225006274 - TotalTime: 942416573 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 156205 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/99.60 MB 22:1/99.20 MB 23:1/99.02 MB 17:1/99.20 MB 6:1/99.07 MB 15:1/98.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23399673 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23399673 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23399673 - DecompressionTime: 834352456 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 138499112 - PerReadThreadRawHdfsThroughput: 668759962 - RemoteScanRanges: 0 - RowsRead: 8107942 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 24 - ScannerThreadsTotalWallClockTime: 4292274773 - MaterializeTupleTime(*): 1219789051 - ScannerThreadsSysTime: 50990000 - ScannerThreadsUserTime: 2002691000 - ScannerThreadsVoluntaryContextSwitches: 107 - TotalRawHdfsReadTime(*): 34989644 - TotalReadThroughput: 23399673 - TotalTime: 932532664 Instance f74cea27cca1cc70:12e354ae50158ee3 (host=demeter-csmaz11-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/98.57 MB 7:1/99.39 MB 21:1/98.87 MB 19:1/99.04 MB 16:1/98.54 MB 18:1/98.12 MB 12:1/98.91 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 163324768 - PerHostPeakMemUsage: 252300128 - PrepareTime: 262471 - RowsProduced: 0 - TotalCpuTime: 6488106796 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 23506 - TotalStorageWaitTime: 2455357091 - TotalTime: 981127145 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 133481 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:1/98.57 MB 7:1/99.39 MB 21:1/98.87 MB 19:1/99.04 MB 16:1/98.54 MB 18:1/98.12 MB 12:1/98.91 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 1.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 27356821 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27356821 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27356821 - DecompressionTime: 1550143456 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 163005280 - PerReadThreadRawHdfsThroughput: 200009260 - RemoteScanRanges: 0 - RowsRead: 9556337 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 6488135680 - MaterializeTupleTime(*): 2468987960 - ScannerThreadsSysTime: 150974000 - ScannerThreadsUserTime: 3871408000 - ScannerThreadsVoluntaryContextSwitches: 195 - TotalRawHdfsReadTime(*): 136777772 - TotalReadThroughput: 27356821 - TotalTime: 970890330 Instance f74cea27cca1cc70:12e354ae50158f28 (host=demeter-csmau08-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/98.87 MB 22:1/98.96 MB 21:1/98.74 MB 18:1/99.18 MB 17:1/98.39 MB 12:1/99.60 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 144753936 - PerHostPeakMemUsage: 247549200 - PrepareTime: 243330 - RowsProduced: 0 - TotalCpuTime: 5561663633 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 21093 - TotalStorageWaitTime: 2360851132 - TotalTime: 966020817 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112667 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:1/98.87 MB 22:1/98.96 MB 21:1/98.74 MB 18:1/99.18 MB 17:1/98.39 MB 12:1/99.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23340514 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23340514 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23340514 - DecompressionTime: 1270014405 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 144434448 - PerReadThreadRawHdfsThroughput: 287572989 - RemoteScanRanges: 0 - RowsRead: 8120929 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 5561687786 - MaterializeTupleTime(*): 1916371458 - ScannerThreadsSysTime: 93983000 - ScannerThreadsUserTime: 3095527000 - ScannerThreadsVoluntaryContextSwitches: 155 - TotalRawHdfsReadTime(*): 81163791 - TotalReadThroughput: 23340514 - TotalTime: 956086505 Instance f74cea27cca1cc70:12e354ae50158ee4 (host=demeter-csmaz08-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/99.03 MB 1:1/99.11 MB 0:1/98.44 MB 21:1/98.60 MB 18:1/99.07 MB 17:1/98.39 MB 14:1/98.57 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 163389600 - PerHostPeakMemUsage: 244963488 - PrepareTime: 206807 - RowsProduced: 0 - TotalCpuTime: 6398901633 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36507 - TotalStorageWaitTime: 2430441854 - TotalTime: 985514029 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 141573 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/99.03 MB 1:1/99.11 MB 0:1/98.44 MB 21:1/98.60 MB 18:1/99.07 MB 17:1/98.39 MB 14:1/98.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27416646 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27416646 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27416646 - DecompressionTime: 1589424262 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 163070112 - PerReadThreadRawHdfsThroughput: 347039795 - RemoteScanRanges: 0 - RowsRead: 9584048 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 12 - ScannerThreadsTotalWallClockTime: 6398930057 - MaterializeTupleTime(*): 2365236257 - ScannerThreadsSysTime: 139976000 - ScannerThreadsUserTime: 3812418000 - ScannerThreadsVoluntaryContextSwitches: 213 - TotalRawHdfsReadTime(*): 79001447 - TotalReadThroughput: 27416646 - TotalTime: 976383028 Instance f74cea27cca1cc70:12e354ae50158f1c (host=demeter-csmau10-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/98.60 MB 14:1/98.21 MB 10:1/99.00 MB 7:1/98.91 MB 6:1/98.41 MB 3:1/99.25 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 154904912 - PerHostPeakMemUsage: 262637904 - PrepareTime: 339573 - RowsProduced: 0 - TotalCpuTime: 5719823352 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 17295 - TotalStorageWaitTime: 2328575138 - TotalTime: 991735308 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112624 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 17:1/98.60 MB 14:1/98.21 MB 10:1/99.00 MB 7:1/98.91 MB 6:1/98.41 MB 3:1/99.25 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23488958 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23488958 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23488958 - DecompressionTime: 1379479772 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 154585424 - PerReadThreadRawHdfsThroughput: 651842787 - RemoteScanRanges: 0 - RowsRead: 8199301 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 32 - ScannerThreadsTotalWallClockTime: 5719869523 - MaterializeTupleTime(*): 1999611387 - ScannerThreadsSysTime: 118979000 - ScannerThreadsUserTime: 3262501000 - ScannerThreadsVoluntaryContextSwitches: 174 - TotalRawHdfsReadTime(*): 36034698 - TotalReadThroughput: 23488958 - TotalTime: 978772702 Instance f74cea27cca1cc70:12e354ae50158ef7 (host=demeter-csmaz11-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/98.44 MB 10:1/98.81 MB 2:1/98.72 MB 11:1/98.17 MB 9:1/98.87 MB 21:1/98.83 MB 7:1/98.55 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 166086192 - PerHostPeakMemUsage: 263631776 - PrepareTime: 343462 - RowsProduced: 0 - TotalCpuTime: 6670264492 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 34335 - TotalStorageWaitTime: 2763464400 - TotalTime: 1001980114 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 153989 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 13:1/98.44 MB 10:1/98.81 MB 2:1/98.72 MB 11:1/98.17 MB 9:1/98.87 MB 21:1/98.83 MB 7:1/98.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27290959 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27290959 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27290959 - DecompressionTime: 1572912910 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 165766704 - PerReadThreadRawHdfsThroughput: 353133625 - RemoteScanRanges: 0 - RowsRead: 9573353 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 75 - ScannerThreadsTotalWallClockTime: 6670288473 - MaterializeTupleTime(*): 2308414465 - ScannerThreadsSysTime: 170971000 - ScannerThreadsUserTime: 3708432000 - ScannerThreadsVoluntaryContextSwitches: 205 - TotalRawHdfsReadTime(*): 77282244 - TotalReadThroughput: 27290959 - TotalTime: 990444971 Instance f74cea27cca1cc70:12e354ae50158eed (host=demeter-csmau10-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/99.13 MB 1:1/98.39 MB 0:1/98.78 MB 22:1/98.27 MB 15:1/98.57 MB 14:1/98.62 MB 13:1/98.17 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 148967344 - PerHostPeakMemUsage: 234527632 - PrepareTime: 242767 - RowsProduced: 0 - TotalCpuTime: 6524063789 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 41293 - TotalStorageWaitTime: 2467366703 - TotalTime: 1018646658 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 135105 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/99.13 MB 1:1/98.39 MB 0:1/98.78 MB 22:1/98.27 MB 15:1/98.57 MB 14:1/98.62 MB 13:1/98.17 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 26905581 - BytesReadDataNodeCache: 0 - BytesReadLocal: 26905581 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 26905581 - DecompressionTime: 1615737852 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 148647856 - PerReadThreadRawHdfsThroughput: 354810732 - RemoteScanRanges: 0 - RowsRead: 9580319 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 75 - ScannerThreadsTotalWallClockTime: 6524088155 - MaterializeTupleTime(*): 2401200890 - ScannerThreadsSysTime: 129977000 - ScannerThreadsUserTime: 3888405000 - ScannerThreadsVoluntaryContextSwitches: 220 - TotalRawHdfsReadTime(*): 75830798 - TotalReadThroughput: 26905581 - TotalTime: 1008456380 Instance f74cea27cca1cc70:12e354ae50158eef (host=demeter-csmaz10-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/99.80 MB 14:1/99.25 MB 13:1/98.45 MB 10:1/98.30 MB 6:1/98.85 MB 0:1/98.99 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 144829120 - PerHostPeakMemUsage: 228893376 - PrepareTime: 245214 - RowsProduced: 0 - TotalCpuTime: 5351233032 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36391 - TotalStorageWaitTime: 1939338182 - TotalTime: 1013592087 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 125513 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 18:1/99.80 MB 14:1/99.25 MB 13:1/98.45 MB 10:1/98.30 MB 6:1/98.85 MB 0:1/98.99 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23473749 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23473749 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23473749 - DecompressionTime: 1358312391 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 144509632 - PerReadThreadRawHdfsThroughput: 637135177 - RemoteScanRanges: 0 - RowsRead: 8168681 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 34 - ScannerThreadsTotalWallClockTime: 5351254859 - MaterializeTupleTime(*): 2040196685 - ScannerThreadsSysTime: 121978000 - ScannerThreadsUserTime: 3276499000 - ScannerThreadsVoluntaryContextSwitches: 174 - TotalRawHdfsReadTime(*): 36842651 - TotalReadThroughput: 23473749 - TotalTime: 1003462838 Instance f74cea27cca1cc70:12e354ae50158f0d (host=demeter-csmaz11-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/99.10 MB 0:1/98.50 MB 17:1/98.69 MB 21:1/98.28 MB 7:1/98.74 MB 16:1/98.67 MB 6:1/98.76 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 176643296 - PerHostPeakMemUsage: 278498528 - PrepareTime: 280912 - RowsProduced: 0 - TotalCpuTime: 6634541548 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 60075 - TotalStorageWaitTime: 2815535099 - TotalTime: 1008586028 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112112 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/99.10 MB 0:1/98.50 MB 17:1/98.69 MB 21:1/98.28 MB 7:1/98.74 MB 16:1/98.67 MB 6:1/98.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27423375 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27423375 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27423375 - DecompressionTime: 1597659264 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 176323808 - PerReadThreadRawHdfsThroughput: 212984394 - RemoteScanRanges: 0 - RowsRead: 9603710 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 22 - ScannerThreadsTotalWallClockTime: 6634566395 - MaterializeTupleTime(*): 2206860195 - ScannerThreadsSysTime: 134976000 - ScannerThreadsUserTime: 3670440000 - ScannerThreadsVoluntaryContextSwitches: 294 - TotalRawHdfsReadTime(*): 128757673 - TotalReadThroughput: 27423375 - TotalTime: 998565588 Instance f74cea27cca1cc70:12e354ae50158f20 (host=demeter-csmaz10-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/98.77 MB 0:1/99.10 MB 7:1/98.86 MB 20:1/98.39 MB 6:1/98.50 MB 15:1/99.21 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 132995288 - PerHostPeakMemUsage: 212025560 - PrepareTime: 248227 - RowsProduced: 0 - TotalCpuTime: 5215832957 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 42184 - TotalStorageWaitTime: 2521023498 - TotalTime: 980266404 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 103005 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/98.77 MB 0:1/99.10 MB 7:1/98.86 MB 20:1/98.39 MB 6:1/98.50 MB 15:1/99.21 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 23618250 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23618250 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23618250 - DecompressionTime: 1111156079 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 132675800 - PerReadThreadRawHdfsThroughput: 296502615 - RemoteScanRanges: 0 - RowsRead: 8151159 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 5 - ScannerThreadsTotalWallClockTime: 5215860042 - MaterializeTupleTime(*): 1553492193 - ScannerThreadsSysTime: 155973000 - ScannerThreadsUserTime: 2529613000 - ScannerThreadsVoluntaryContextSwitches: 182 - TotalRawHdfsReadTime(*): 79656127 - TotalReadThroughput: 23618250 - TotalTime: 970227091 Instance f74cea27cca1cc70:12e354ae50158f1d (host=demeter-csmaz11-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/97.23 MB 2:1/98.93 MB 1:1/98.58 MB 23:1/98.64 MB 18:1/98.57 MB 19:1/98.95 MB 8:1/98.96 MB 14:1/97.54 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 181558768 - PerHostPeakMemUsage: 278920688 - PrepareTime: 248484 - RowsProduced: 0 - TotalCpuTime: 7536592559 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36482 - TotalStorageWaitTime: 3142090566 - TotalTime: 1006156133 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 151764 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:1/97.23 MB 2:1/98.93 MB 1:1/98.58 MB 23:1/98.64 MB 18:1/98.57 MB 19:1/98.95 MB 8:1/98.96 MB 14:1/97.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 8.0 - BytesRead: 29495813 - BytesReadDataNodeCache: 0 - BytesReadLocal: 29495813 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 29495813 - DecompressionTime: 1715556146 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 181239280 - PerReadThreadRawHdfsThroughput: 655553953 - RemoteScanRanges: 0 - RowsRead: 10841927 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 35 - ScannerThreadsTotalWallClockTime: 7536617796 - MaterializeTupleTime(*): 2643815891 - ScannerThreadsSysTime: 247958000 - ScannerThreadsUserTime: 4131368000 - ScannerThreadsVoluntaryContextSwitches: 257 - TotalRawHdfsReadTime(*): 44993723 - TotalReadThroughput: 29495813 - TotalTime: 995963006 Instance f74cea27cca1cc70:12e354ae50158ed4 (host=demeter-csmaz11-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/98.28 MB 8:1/98.44 MB 11:1/98.32 MB 2:1/99.27 MB 1:1/98.58 MB 5:1/98.66 MB 0:1/98.44 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 161251200 - PerHostPeakMemUsage: 245143424 - PrepareTime: 274179 - RowsProduced: 0 - TotalCpuTime: 6499582272 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 77180 - TotalStorageWaitTime: 2583114427 - TotalTime: 1021004093 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 119688 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 13:1/98.28 MB 8:1/98.44 MB 11:1/98.32 MB 2:1/99.27 MB 1:1/98.58 MB 5:1/98.66 MB 0:1/98.44 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27440165 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27440165 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27440165 - DecompressionTime: 1604049163 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 160931712 - PerReadThreadRawHdfsThroughput: 180823483 - RemoteScanRanges: 0 - RowsRead: 9623565 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 50 - ScannerThreadsTotalWallClockTime: 6499608509 - MaterializeTupleTime(*): 2292078769 - ScannerThreadsSysTime: 126978000 - ScannerThreadsUserTime: 3770425000 - ScannerThreadsVoluntaryContextSwitches: 231 - TotalRawHdfsReadTime(*): 151751114 - TotalReadThroughput: 27440165 - TotalTime: 1011097448 Instance f74cea27cca1cc70:12e354ae50158eda (host=demeter-csmau10-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/99.28 MB 8:1/98.87 MB 15:1/98.30 MB 6:1/98.72 MB 5:1/98.24 MB 4:1/98.83 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 145056992 - PerHostPeakMemUsage: 226858208 - PrepareTime: 239464 - RowsProduced: 0 - TotalCpuTime: 5242589438 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36456 - TotalStorageWaitTime: 2053230017 - TotalTime: 1036253070 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 127956 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:1/99.28 MB 8:1/98.87 MB 15:1/98.30 MB 6:1/98.72 MB 5:1/98.24 MB 4:1/98.83 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.5 - BytesRead: 23506116 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23506116 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23506116 - DecompressionTime: 1329553372 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 144737504 - PerReadThreadRawHdfsThroughput: 265723229 - RemoteScanRanges: 0 - RowsRead: 8214224 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 5242614456 - MaterializeTupleTime(*): 1849305545 - ScannerThreadsSysTime: 127977000 - ScannerThreadsUserTime: 3052533000 - ScannerThreadsVoluntaryContextSwitches: 183 - TotalRawHdfsReadTime(*): 88460900 - TotalReadThroughput: 23506116 - TotalTime: 1026088049 Instance f74cea27cca1cc70:12e354ae50158ef8 (host=demeter-csmau08-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/99.11 MB 9:1/99.29 MB 8:1/99.27 MB 23:1/99.26 MB 22:1/98.72 MB 18:1/98.26 MB 17:1/98.14 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 161013712 - PerHostPeakMemUsage: 256038864 - PrepareTime: 344677 - RowsProduced: 0 - TotalCpuTime: 6619301514 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 54811 - TotalStorageWaitTime: 2506056198 - TotalTime: 1032860521 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 172696 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:1/99.11 MB 9:1/99.29 MB 8:1/99.27 MB 23:1/99.26 MB 22:1/98.72 MB 18:1/98.26 MB 17:1/98.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27623010 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27623010 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27623010 - DecompressionTime: 1585142154 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 160694224 - PerReadThreadRawHdfsThroughput: 234836780 - RemoteScanRanges: 0 - RowsRead: 9565087 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 64 - ScannerThreadsTotalWallClockTime: 6619323451 - MaterializeTupleTime(*): 2510123136 - ScannerThreadsSysTime: 153972000 - ScannerThreadsUserTime: 3938398000 - ScannerThreadsVoluntaryContextSwitches: 209 - TotalRawHdfsReadTime(*): 117626421 - TotalReadThroughput: 27623010 - TotalTime: 1021747998 Instance f74cea27cca1cc70:12e354ae50158f1f (host=demeter-csmau08-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/99.92 MB 3:1/98.81 MB 18:1/98.71 MB 2:1/98.86 MB 11:1/98.05 MB 12:1/98.48 MB 4:1/99.56 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 150702656 - PerHostPeakMemUsage: 253232576 - PrepareTime: 253034 - RowsProduced: 0 - TotalCpuTime: 6420021375 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 37446 - TotalStorageWaitTime: 2859824021 - TotalTime: 1015175667 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 151540 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/99.92 MB 3:1/98.81 MB 18:1/98.71 MB 2:1/98.86 MB 11:1/98.05 MB 12:1/98.48 MB 4:1/99.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 26781896 - BytesReadDataNodeCache: 0 - BytesReadLocal: 26781896 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 26781896 - DecompressionTime: 1299136143 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 150383168 - PerReadThreadRawHdfsThroughput: 262501390 - RemoteScanRanges: 0 - RowsRead: 9432195 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 64 - ScannerThreadsTotalWallClockTime: 6420048086 - MaterializeTupleTime(*): 2248425547 - ScannerThreadsSysTime: 96982000 - ScannerThreadsUserTime: 3451471000 - ScannerThreadsVoluntaryContextSwitches: 247 - TotalRawHdfsReadTime(*): 102025730 - TotalReadThroughput: 26781896 - TotalTime: 1004716699 Instance f74cea27cca1cc70:12e354ae50158f11 (host=demeter-csmaz10-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/98.73 MB 3:1/98.83 MB 5:1/99.22 MB 0:1/98.19 MB 20:1/98.49 MB 18:1/98.43 MB 17:1/98.30 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 160067344 - PerHostPeakMemUsage: 263995216 - PrepareTime: 261827 - RowsProduced: 0 - TotalCpuTime: 6767799890 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 33311 - TotalStorageWaitTime: 2675056751 - TotalTime: 1032907178 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 185589 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/98.73 MB 3:1/98.83 MB 5:1/99.22 MB 0:1/98.19 MB 20:1/98.49 MB 18:1/98.43 MB 17:1/98.30 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 27401677 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27401677 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27401677 - DecompressionTime: 1663113411 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 159747856 - PerReadThreadRawHdfsThroughput: 411140755 - RemoteScanRanges: 0 - RowsRead: 9611340 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 12 - ScannerThreadsTotalWallClockTime: 6767827463 - MaterializeTupleTime(*): 2417194376 - ScannerThreadsSysTime: 204966000 - ScannerThreadsUserTime: 3877408000 - ScannerThreadsVoluntaryContextSwitches: 209 - TotalRawHdfsReadTime(*): 66647922 - TotalReadThroughput: 18267784 - TotalTime: 1023807431 Instance f74cea27cca1cc70:12e354ae50158f02 (host=demeter-csmaz08-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/99.18 MB 18:1/98.88 MB 13:1/98.48 MB 14:1/98.44 MB 8:1/98.97 MB 1:1/98.17 MB 2:1/98.76 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 152625312 - PerHostPeakMemUsage: 152625312 - PrepareTime: 46910953 - RowsProduced: 0 - TotalCpuTime: 4998678347 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 23917 - TotalStorageWaitTime: 2889522740 - TotalTime: 961477427 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 161328 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 21:1/99.18 MB 18:1/98.88 MB 13:1/98.48 MB 14:1/98.44 MB 8:1/98.97 MB 1:1/98.17 MB 2:1/98.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.5 - BytesRead: 27430042 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27430042 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27430042 - DecompressionTime: 874442684 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 152305824 - PerReadThreadRawHdfsThroughput: 201585931 - RemoteScanRanges: 0 - RowsRead: 9594872 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 35 - ScannerThreadsTotalWallClockTime: 4998700089 - MaterializeTupleTime(*): 1222768257 - ScannerThreadsSysTime: 61987000 - ScannerThreadsUserTime: 2036688000 - ScannerThreadsVoluntaryContextSwitches: 104 - TotalRawHdfsReadTime(*): 136071212 - TotalReadThroughput: 27430042 - TotalTime: 951582614 Instance f74cea27cca1cc70:12e354ae50158ed8 (host=demeter-csmaz11-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/99.41 MB 10:1/99.08 MB 6:1/98.41 MB 0:1/99.40 MB 2:1/98.16 MB 3:1/98.35 MB 23:1/98.20 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 153091808 - PerHostPeakMemUsage: 235456224 - PrepareTime: 256760 - RowsProduced: 0 - TotalCpuTime: 6677576300 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 19965 - TotalStorageWaitTime: 2580250924 - TotalTime: 1073819812 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 146817 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/99.41 MB 10:1/99.08 MB 6:1/98.41 MB 0:1/99.40 MB 2:1/98.16 MB 3:1/98.35 MB 23:1/98.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.333333333333333 - BytesRead: 27551795 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27551795 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27551795 - DecompressionTime: 1599011429 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 152772320 - PerReadThreadRawHdfsThroughput: 217204715 - RemoteScanRanges: 0 - RowsRead: 9557529 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 17 - ScannerThreadsTotalWallClockTime: 6677607378 - MaterializeTupleTime(*): 2484991377 - ScannerThreadsSysTime: 204967000 - ScannerThreadsUserTime: 3879407000 - ScannerThreadsVoluntaryContextSwitches: 247 - TotalRawHdfsReadTime(*): 126847131 - TotalReadThroughput: 18367863 - TotalTime: 1063938228 Instance f74cea27cca1cc70:12e354ae50158efe (host=demeter-csmaz10-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/98.99 MB 12:1/98.21 MB 10:1/98.93 MB 6:1/99.62 MB 3:1/98.86 MB 0:1/98.86 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 153832128 - PerHostPeakMemUsage: 153832128 - PrepareTime: 39696882 - RowsProduced: 0 - TotalCpuTime: 5493868019 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 26383 - TotalStorageWaitTime: 2356368959 - TotalTime: 996499308 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 146105 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 13:1/98.99 MB 12:1/98.21 MB 10:1/98.93 MB 6:1/99.62 MB 3:1/98.86 MB 0:1/98.86 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23124089 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23124089 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23124089 - DecompressionTime: 1323948854 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 153512640 - PerReadThreadRawHdfsThroughput: 259058620 - RemoteScanRanges: 0 - RowsRead: 8152800 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 16 - ScannerThreadsTotalWallClockTime: 5493895330 - MaterializeTupleTime(*): 1803858646 - ScannerThreadsSysTime: 115979000 - ScannerThreadsUserTime: 3014538000 - ScannerThreadsVoluntaryContextSwitches: 83 - TotalRawHdfsReadTime(*): 89261994 - TotalReadThroughput: 23124089 - TotalTime: 985215477 Instance f74cea27cca1cc70:12e354ae50158ee5 (host=demeter-csmau08-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/99.19 MB 23:1/99.24 MB 11:1/98.44 MB 14:1/98.85 MB 8:1/98.26 MB 7:1/98.93 MB 4:1/98.24 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 159064432 - PerHostPeakMemUsage: 238782832 - PrepareTime: 268077 - RowsProduced: 0 - TotalCpuTime: 6369598095 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 43157 - TotalStorageWaitTime: 2602518065 - TotalTime: 1051092843 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 130338 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:1/99.19 MB 23:1/99.24 MB 11:1/98.44 MB 14:1/98.85 MB 8:1/98.26 MB 7:1/98.93 MB 4:1/98.24 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27421608 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27421608 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27421608 - DecompressionTime: 1551608999 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 158744944 - PerReadThreadRawHdfsThroughput: 133561002 - RemoteScanRanges: 0 - RowsRead: 9586449 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 4 - ScannerThreadsTotalWallClockTime: 6369625999 - MaterializeTupleTime(*): 2201117522 - ScannerThreadsSysTime: 117979000 - ScannerThreadsUserTime: 3634444000 - ScannerThreadsVoluntaryContextSwitches: 202 - TotalRawHdfsReadTime(*): 205311487 - TotalReadThroughput: 27421608 - TotalTime: 1040771213 Instance f74cea27cca1cc70:12e354ae50158f22 (host=demeter-csmau08-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/98.90 MB 20:1/98.52 MB 19:1/98.54 MB 8:1/98.45 MB 16:1/98.69 MB 6:1/98.30 MB 2:1/99.47 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 172759936 - PerHostPeakMemUsage: 287753088 - PrepareTime: 260240 - RowsProduced: 0 - TotalCpuTime: 6956940404 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 51620 - TotalStorageWaitTime: 2900784720 - TotalTime: 1028957943 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 111470 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 22:1/98.90 MB 20:1/98.52 MB 19:1/98.54 MB 8:1/98.45 MB 16:1/98.69 MB 6:1/98.30 MB 2:1/99.47 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 1.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27401049 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27401049 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27401049 - DecompressionTime: 1629894832 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 172440448 - PerReadThreadRawHdfsThroughput: 145120288 - RemoteScanRanges: 0 - RowsRead: 9581689 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 107 - ScannerThreadsTotalWallClockTime: 6956961972 - MaterializeTupleTime(*): 2408727160 - ScannerThreadsSysTime: 148975000 - ScannerThreadsUserTime: 3886406000 - ScannerThreadsVoluntaryContextSwitches: 275 - TotalRawHdfsReadTime(*): 188816115 - TotalReadThroughput: 27401049 - TotalTime: 1018927594 Instance f74cea27cca1cc70:12e354ae50158ef4 (host=demeter-csmaz10-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/99.24 MB 19:1/98.66 MB 8:1/99.01 MB 5:1/98.47 MB 13:1/99.39 MB 4:1/98.23 MB 1:1/99.10 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 165518064 - PerHostPeakMemUsage: 262169328 - PrepareTime: 260203 - RowsProduced: 0 - TotalCpuTime: 6593505299 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 17872 - TotalStorageWaitTime: 2700961519 - TotalTime: 1052424366 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 119325 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 20:1/99.24 MB 19:1/98.66 MB 8:1/99.01 MB 5:1/98.47 MB 13:1/99.39 MB 4:1/98.23 MB 1:1/99.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.5 - BytesRead: 27557558 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27557558 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27557558 - DecompressionTime: 1518191612 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 165198576 - PerReadThreadRawHdfsThroughput: 219323981 - RemoteScanRanges: 0 - RowsRead: 9556417 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 48 - ScannerThreadsTotalWallClockTime: 6593527728 - MaterializeTupleTime(*): 2360812726 - ScannerThreadsSysTime: 220963000 - ScannerThreadsUserTime: 3657439000 - ScannerThreadsVoluntaryContextSwitches: 202 - TotalRawHdfsReadTime(*): 125647719 - TotalReadThroughput: 27557558 - TotalTime: 1041545180 Instance f74cea27cca1cc70:12e354ae50158f18 (host=demeter-csmaz11-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/98.35 MB 6:1/99.66 MB 3:1/99.09 MB 23:1/98.64 MB 22:1/98.32 MB 19:1/98.44 MB 14:1/99.30 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 177844064 - PerHostPeakMemUsage: 298155872 - PrepareTime: 257070 - RowsProduced: 0 - TotalCpuTime: 6987413074 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 46138 - TotalStorageWaitTime: 2887113760 - TotalTime: 1025050312 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 109604 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/98.35 MB 6:1/99.66 MB 3:1/99.09 MB 23:1/98.64 MB 22:1/98.32 MB 19:1/98.44 MB 14:1/99.30 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.5 - BytesRead: 27486714 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27486714 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27486714 - DecompressionTime: 1577573194 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 177524576 - PerReadThreadRawHdfsThroughput: 175866077 - RemoteScanRanges: 0 - RowsRead: 9477606 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 88 - ScannerThreadsTotalWallClockTime: 6987436919 - MaterializeTupleTime(*): 2486177206 - ScannerThreadsSysTime: 119978000 - ScannerThreadsUserTime: 3968392000 - ScannerThreadsVoluntaryContextSwitches: 235 - TotalRawHdfsReadTime(*): 156293439 - TotalReadThroughput: 18324476 - TotalTime: 1015102643 Instance f74cea27cca1cc70:12e354ae50158efa (host=demeter-csmaz11-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/98.86 MB 5:1/98.22 MB 1:1/98.29 MB 21:1/98.81 MB 6:1/98.54 MB 15:1/98.81 MB 17:1/98.65 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 152576272 - PerHostPeakMemUsage: 236525840 - PrepareTime: 268209 - RowsProduced: 0 - TotalCpuTime: 6529420035 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 39808 - TotalStorageWaitTime: 2682054435 - TotalTime: 1052804308 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 129881 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/98.86 MB 5:1/98.22 MB 1:1/98.29 MB 21:1/98.81 MB 6:1/98.54 MB 15:1/98.81 MB 17:1/98.65 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27452911 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27452911 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27452911 - DecompressionTime: 1501302601 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 152256784 - PerReadThreadRawHdfsThroughput: 148527772 - RemoteScanRanges: 0 - RowsRead: 9629338 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 9 - ScannerThreadsTotalWallClockTime: 6529446200 - MaterializeTupleTime(*): 2322666941 - ScannerThreadsSysTime: 116979000 - ScannerThreadsUserTime: 3709433000 - ScannerThreadsVoluntaryContextSwitches: 205 - TotalRawHdfsReadTime(*): 184833520 - TotalReadThroughput: 27452911 - TotalTime: 1042653069 Instance f74cea27cca1cc70:12e354ae50158f00 (host=demeter-csmau08-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/99.97 MB 20:1/98.37 MB 19:1/98.53 MB 17:1/98.10 MB 16:1/98.31 MB 14:1/98.61 MB 9:1/98.39 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 167710080 - PerHostPeakMemUsage: 256931200 - PrepareTime: 254423 - RowsProduced: 0 - TotalCpuTime: 6365311476 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 57465 - TotalStorageWaitTime: 2513968134 - TotalTime: 1047108462 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 116834 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/99.97 MB 20:1/98.37 MB 19:1/98.53 MB 17:1/98.10 MB 16:1/98.31 MB 14:1/98.61 MB 9:1/98.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27447230 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27447230 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27447230 - DecompressionTime: 1583103337 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 167390592 - PerReadThreadRawHdfsThroughput: 110491152 - RemoteScanRanges: 0 - RowsRead: 9615715 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 20 - ScannerThreadsTotalWallClockTime: 6365335732 - MaterializeTupleTime(*): 2253964672 - ScannerThreadsSysTime: 131977000 - ScannerThreadsUserTime: 3705434000 - ScannerThreadsVoluntaryContextSwitches: 218 - TotalRawHdfsReadTime(*): 248411111 - TotalReadThroughput: 27447230 - TotalTime: 1036928362 Instance f74cea27cca1cc70:12e354ae50158f1e (host=demeter-csmau08-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 23:1/98.90 MB 0:1/99.31 MB 13:1/99.50 MB 10:1/98.46 MB 8:1/98.28 MB 16:1/99.82 MB 6:1/98.53 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 174158016 - PerHostPeakMemUsage: 282355904 - PrepareTime: 252454 - RowsProduced: 0 - TotalCpuTime: 6736622988 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 44473 - TotalStorageWaitTime: 2819340517 - TotalTime: 1015113725 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 164659 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 23:1/98.90 MB 0:1/99.31 MB 13:1/99.50 MB 10:1/98.46 MB 8:1/98.28 MB 16:1/99.82 MB 6:1/98.53 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27379213 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27379213 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27379213 - DecompressionTime: 1564667998 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 173838528 - PerReadThreadRawHdfsThroughput: 186264784 - RemoteScanRanges: 0 - RowsRead: 9524075 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 61 - ScannerThreadsTotalWallClockTime: 6736651902 - MaterializeTupleTime(*): 2336264350 - ScannerThreadsSysTime: 159973000 - ScannerThreadsUserTime: 3740428000 - ScannerThreadsVoluntaryContextSwitches: 261 - TotalRawHdfsReadTime(*): 146990818 - TotalReadThroughput: 27379213 - TotalTime: 1004156292 Instance f74cea27cca1cc70:12e354ae50158ee2 (host=demeter-csmaz10-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/99.21 MB 14:1/98.65 MB 7:1/98.21 MB 16:1/98.64 MB 6:1/98.52 MB 2:1/98.28 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 127499760 - PerHostPeakMemUsage: 209376752 - PrepareTime: 259462 - RowsProduced: 0 - TotalCpuTime: 5618947972 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 33384 - TotalStorageWaitTime: 2081555658 - TotalTime: 1058526912 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 160195 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 17:1/99.21 MB 14:1/98.65 MB 7:1/98.21 MB 16:1/98.64 MB 6:1/98.52 MB 2:1/98.28 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 23206777 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23206777 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23206777 - DecompressionTime: 1348948306 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 127180272 - PerReadThreadRawHdfsThroughput: 240277653 - RemoteScanRanges: 0 - RowsRead: 8188897 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 80 - ScannerThreadsTotalWallClockTime: 5618975577 - MaterializeTupleTime(*): 2177365361 - ScannerThreadsSysTime: 97983000 - ScannerThreadsUserTime: 3425477000 - ScannerThreadsVoluntaryContextSwitches: 159 - TotalRawHdfsReadTime(*): 96583168 - TotalReadThroughput: 23206777 - TotalTime: 1047988901 Instance f74cea27cca1cc70:12e354ae50158eec (host=demeter-csmaz10-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/99.26 MB 11:1/98.42 MB 9:1/98.44 MB 1:1/98.19 MB 23:1/98.63 MB 7:1/98.47 MB 20:1/99.10 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 142217616 - PerHostPeakMemUsage: 218886160 - PrepareTime: 268871 - RowsProduced: 0 - TotalCpuTime: 6487593332 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 41715 - TotalStorageWaitTime: 2605471619 - TotalTime: 1075660037 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 144185 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 18:1/99.26 MB 11:1/98.42 MB 9:1/98.44 MB 1:1/98.19 MB 23:1/98.63 MB 7:1/98.47 MB 20:1/99.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.5 - BytesRead: 27646599 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27646599 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27646599 - DecompressionTime: 1550245812 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 141898128 - PerReadThreadRawHdfsThroughput: 143548446 - RemoteScanRanges: 0 - RowsRead: 9606325 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 6487623176 - MaterializeTupleTime(*): 2317028466 - ScannerThreadsSysTime: 139974000 - ScannerThreadsUserTime: 3729430000 - ScannerThreadsVoluntaryContextSwitches: 215 - TotalRawHdfsReadTime(*): 192594206 - TotalReadThroughput: 27646599 - TotalTime: 1065187459 Instance f74cea27cca1cc70:12e354ae50158eea (host=demeter-csmau08-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/99.57 MB 18:1/98.71 MB 8:1/98.91 MB 20:1/99.04 MB 7:1/98.59 MB 6:1/98.31 MB 1:1/99.11 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 155842176 - PerHostPeakMemUsage: 238233216 - PrepareTime: 252164 - RowsProduced: 0 - TotalCpuTime: 6496714927 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 32855 - TotalStorageWaitTime: 2478360237 - TotalTime: 1076340087 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 138095 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 22:1/99.57 MB 18:1/98.71 MB 8:1/98.91 MB 20:1/99.04 MB 7:1/98.59 MB 6:1/98.31 MB 1:1/99.11 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27355219 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27355219 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27355219 - DecompressionTime: 1561868479 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 155522688 - PerReadThreadRawHdfsThroughput: 315833897 - RemoteScanRanges: 0 - RowsRead: 9535851 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 94 - ScannerThreadsTotalWallClockTime: 6496738786 - MaterializeTupleTime(*): 2434801227 - ScannerThreadsSysTime: 115979000 - ScannerThreadsUserTime: 3878407000 - ScannerThreadsVoluntaryContextSwitches: 211 - TotalRawHdfsReadTime(*): 86612676 - TotalReadThroughput: 27355219 - TotalTime: 1064222299 Instance f74cea27cca1cc70:12e354ae50158efb (host=demeter-csmaz10-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/100.50 MB 21:1/98.22 MB 19:1/99.08 MB 14:1/98.92 MB 11:1/98.89 MB 3:1/98.53 MB 1:1/98.91 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 140152232 - PerHostPeakMemUsage: 226919848 - PrepareTime: 332288 - RowsProduced: 0 - TotalCpuTime: 6721592120 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 19262 - TotalStorageWaitTime: 2776607511 - TotalTime: 1071197132 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 129225 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 18:1/100.50 MB 21:1/98.22 MB 19:1/99.08 MB 14:1/98.92 MB 11:1/98.89 MB 3:1/98.53 MB 1:1/98.91 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 25319913 - BytesReadDataNodeCache: 0 - BytesReadLocal: 25319913 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 25319913 - DecompressionTime: 1428206912 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 139832744 - PerReadThreadRawHdfsThroughput: 110449557 - RemoteScanRanges: 0 - RowsRead: 9512678 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 113 - ScannerThreadsTotalWallClockTime: 6721618170 - MaterializeTupleTime(*): 2463438523 - ScannerThreadsSysTime: 101982000 - ScannerThreadsUserTime: 3818417000 - ScannerThreadsVoluntaryContextSwitches: 195 - TotalRawHdfsReadTime(*): 229244132 - TotalReadThroughput: 16879942 - TotalTime: 1059237052 Instance f74cea27cca1cc70:12e354ae50158ed9 (host=demeter-csmaz11-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/98.50 MB 22:1/98.82 MB 18:1/98.90 MB 14:1/99.58 MB 12:1/98.18 MB 13:1/98.30 MB 11:1/98.60 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 157911808 - PerHostPeakMemUsage: 249475840 - PrepareTime: 266424 - RowsProduced: 0 - TotalCpuTime: 6780324934 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28672 - TotalStorageWaitTime: 2511266274 - TotalTime: 1066660526 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 148960 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:1/98.50 MB 22:1/98.82 MB 18:1/98.90 MB 14:1/99.58 MB 12:1/98.18 MB 13:1/98.30 MB 11:1/98.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27410275 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27410275 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27410275 - DecompressionTime: 1702917255 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 157592320 - PerReadThreadRawHdfsThroughput: 224293993 - RemoteScanRanges: 0 - RowsRead: 9578673 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 105 - ScannerThreadsTotalWallClockTime: 6780351929 - MaterializeTupleTime(*): 2551475083 - ScannerThreadsSysTime: 236961000 - ScannerThreadsUserTime: 4012387000 - ScannerThreadsVoluntaryContextSwitches: 199 - TotalRawHdfsReadTime(*): 122206906 - TotalReadThroughput: 27410275 - TotalTime: 1057273023 Instance f74cea27cca1cc70:12e354ae50158f14 (host=demeter-csmau10-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/98.95 MB 20:1/98.45 MB 14:1/98.39 MB 10:2/197.80 MB 0:1/98.67 MB 5:2/198.84 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.6666666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 170532176 - PerHostPeakMemUsage: 170532176 - PrepareTime: 45914984 - RowsProduced: 0 - TotalCpuTime: 7209718030 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 26463 - TotalStorageWaitTime: 2974018215 - TotalTime: 1012888347 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 170910 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 19:1/98.95 MB 20:1/98.45 MB 14:1/98.39 MB 10:2/197.80 MB 0:1/98.67 MB 5:2/198.84 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 8.0 - BytesRead: 31508543 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31508543 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31508543 - DecompressionTime: 1600618642 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 170212688 - PerReadThreadRawHdfsThroughput: 407820363 - RemoteScanRanges: 0 - RowsRead: 10911085 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 128 - ScannerThreadsTotalWallClockTime: 7209741674 - MaterializeTupleTime(*): 2619782738 - ScannerThreadsSysTime: 114979000 - ScannerThreadsUserTime: 4102372000 - ScannerThreadsVoluntaryContextSwitches: 172 - TotalRawHdfsReadTime(*): 77260838 - TotalReadThroughput: 31508543 - TotalTime: 1002986548 Instance f74cea27cca1cc70:12e354ae50158ee6 (host=demeter-csmau10-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/99.20 MB 14:1/98.81 MB 12:1/99.06 MB 3:1/99.36 MB 15:1/98.40 MB 6:1/98.13 MB 0:1/98.68 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 155768784 - PerHostPeakMemUsage: 249681872 - PrepareTime: 262424 - RowsProduced: 0 - TotalCpuTime: 6927335521 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 16610 - TotalStorageWaitTime: 2401590304 - TotalTime: 1080240324 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 117255 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 19:1/99.20 MB 14:1/98.81 MB 12:1/99.06 MB 3:1/99.36 MB 15:1/98.40 MB 6:1/98.13 MB 0:1/98.68 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27597815 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27597815 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27597815 - DecompressionTime: 1677815362 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 155449296 - PerReadThreadRawHdfsThroughput: 624324584 - RemoteScanRanges: 0 - RowsRead: 9550479 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 39 - ScannerThreadsTotalWallClockTime: 6927357841 - MaterializeTupleTime(*): 2834726076 - ScannerThreadsSysTime: 154972000 - ScannerThreadsUserTime: 4357335000 - ScannerThreadsVoluntaryContextSwitches: 207 - TotalRawHdfsReadTime(*): 44204274 - TotalReadThroughput: 27597815 - TotalTime: 1069828605 Instance f74cea27cca1cc70:12e354ae50158f1b (host=demeter-csmaz08-9.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 14:1/98.49 MB 16:1/99.83 MB 15:1/98.30 MB 9:1/98.37 MB 3:1/98.66 MB 4:1/98.53 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 140488920 - PerHostPeakMemUsage: 248947536 - PrepareTime: 240815 - RowsProduced: 0 - TotalCpuTime: 6076397249 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 30727 - TotalStorageWaitTime: 2284667266 - TotalTime: 1065926125 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 141247 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 14:1/98.49 MB 16:1/99.83 MB 15:1/98.30 MB 9:1/98.37 MB 3:1/98.66 MB 4:1/98.53 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 22302477 - BytesReadDataNodeCache: 0 - BytesReadLocal: 22302477 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22302477 - DecompressionTime: 1304754785 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 140169432 - PerReadThreadRawHdfsThroughput: 272076082 - RemoteScanRanges: 0 - RowsRead: 8260408 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 55 - ScannerThreadsTotalWallClockTime: 6076417464 - MaterializeTupleTime(*): 2458744807 - ScannerThreadsSysTime: 206965000 - ScannerThreadsUserTime: 3575454000 - ScannerThreadsVoluntaryContextSwitches: 161 - TotalRawHdfsReadTime(*): 81971472 - TotalReadThroughput: 22302477 - TotalTime: 1056868057 Instance f74cea27cca1cc70:12e354ae50158f2e (host=demeter-csmau10-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/98.79 MB 16:1/98.72 MB 7:1/98.40 MB 4:2/197.92 MB 22:1/98.94 MB 0:1/99.19 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 140271824 - PerHostPeakMemUsage: 237602336 - PrepareTime: 261466 - RowsProduced: 0 - TotalCpuTime: 6587970362 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 41902 - TotalStorageWaitTime: 2596029554 - TotalTime: 1047869142 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112470 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/98.79 MB 16:1/98.72 MB 7:1/98.40 MB 4:2/197.92 MB 22:1/98.94 MB 0:1/99.19 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 25849596 - BytesReadDataNodeCache: 0 - BytesReadLocal: 25849596 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 25849596 - DecompressionTime: 1453067497 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 139952336 - PerReadThreadRawHdfsThroughput: 250127312 - RemoteScanRanges: 0 - RowsRead: 9508741 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 14 - ScannerThreadsTotalWallClockTime: 6587997035 - MaterializeTupleTime(*): 2212464321 - ScannerThreadsSysTime: 192968000 - ScannerThreadsUserTime: 3474467000 - ScannerThreadsVoluntaryContextSwitches: 237 - TotalRawHdfsReadTime(*): 103345755 - TotalReadThroughput: 25849596 - TotalTime: 1037848188 Instance f74cea27cca1cc70:12e354ae50158f25 (host=demeter-csmaz10-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/99.01 MB 23:1/98.35 MB 20:1/98.40 MB 4:1/98.35 MB 3:1/98.46 MB 16:1/99.00 MB 6:1/98.49 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 171706704 - PerHostPeakMemUsage: 280734032 - PrepareTime: 285565 - RowsProduced: 0 - TotalCpuTime: 6957560033 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 35435 - TotalStorageWaitTime: 2848065986 - TotalTime: 1067380611 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 150902 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:1/99.01 MB 23:1/98.35 MB 20:1/98.40 MB 4:1/98.35 MB 3:1/98.46 MB 16:1/99.00 MB 6:1/98.49 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27453804 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27453804 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27453804 - DecompressionTime: 1639028363 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 171387216 - PerReadThreadRawHdfsThroughput: 319492768 - RemoteScanRanges: 0 - RowsRead: 9625632 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 71 - ScannerThreadsTotalWallClockTime: 6957581688 - MaterializeTupleTime(*): 2454524704 - ScannerThreadsSysTime: 154973000 - ScannerThreadsUserTime: 3940398000 - ScannerThreadsVoluntaryContextSwitches: 212 - TotalRawHdfsReadTime(*): 85929344 - TotalReadThroughput: 27453804 - TotalTime: 1055938367 Instance f74cea27cca1cc70:12e354ae50158ef1 (host=demeter-csmaz11-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/104.31 MB 9:1/98.27 MB 1:1/98.86 MB 2:1/99.32 MB 18:1/98.58 MB 17:1/99.14 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 135136312 - PerHostPeakMemUsage: 135136312 - PrepareTime: 40139880 - RowsProduced: 0 - TotalCpuTime: 5926505952 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 15971 - TotalStorageWaitTime: 2464893209 - TotalTime: 1090854863 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 149753 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:1/104.31 MB 9:1/98.27 MB 1:1/98.86 MB 2:1/99.32 MB 18:1/98.58 MB 17:1/99.14 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.5 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 23119581 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23119581 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23119581 - DecompressionTime: 1148743626 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 134816824 - PerReadThreadRawHdfsThroughput: 97544177 - RemoteScanRanges: 0 - RowsRead: 8220482 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 12 - ScannerThreadsTotalWallClockTime: 5926529518 - MaterializeTupleTime(*): 2281186309 - ScannerThreadsSysTime: 99982000 - ScannerThreadsUserTime: 3354486000 - ScannerThreadsVoluntaryContextSwitches: 76 - TotalRawHdfsReadTime(*): 237016515 - TotalReadThroughput: 23119581 - TotalTime: 1081211124 Instance f74cea27cca1cc70:12e354ae50158f0e (host=demeter-csmaz11-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/99.59 MB 17:1/99.41 MB 16:1/98.62 MB 12:1/98.65 MB 9:1/98.15 MB 4:1/98.34 MB 3:1/98.73 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 180647056 - PerHostPeakMemUsage: 180647056 - PrepareTime: 45815898 - RowsProduced: 0 - TotalCpuTime: 6883346337 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28020 - TotalStorageWaitTime: 2713767754 - TotalTime: 1063877738 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 167530 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 21:1/99.59 MB 17:1/99.41 MB 16:1/98.62 MB 12:1/98.65 MB 9:1/98.15 MB 4:1/98.34 MB 3:1/98.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27363960 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27363960 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27363960 - DecompressionTime: 1678880367 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 180327568 - PerReadThreadRawHdfsThroughput: 173007646 - RemoteScanRanges: 0 - RowsRead: 9566786 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 213 - ScannerThreadsTotalWallClockTime: 6883373026 - MaterializeTupleTime(*): 2478442841 - ScannerThreadsSysTime: 137976000 - ScannerThreadsUserTime: 4017385000 - ScannerThreadsVoluntaryContextSwitches: 137 - TotalRawHdfsReadTime(*): 158166188 - TotalReadThroughput: 27363960 - TotalTime: 1053169654 Instance f74cea27cca1cc70:12e354ae50158f12 (host=demeter-csmaz11-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/99.39 MB 17:1/98.14 MB 9:1/98.39 MB 14:1/98.75 MB 8:1/98.29 MB 4:1/98.69 MB 3:1/98.78 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 166675088 - PerHostPeakMemUsage: 268266128 - PrepareTime: 253665 - RowsProduced: 0 - TotalCpuTime: 6718736845 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31978 - TotalStorageWaitTime: 2678380917 - TotalTime: 1071343142 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 129084 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 18:1/99.39 MB 17:1/98.14 MB 9:1/98.39 MB 14:1/98.75 MB 8:1/98.29 MB 4:1/98.69 MB 3:1/98.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27427277 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27427277 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27427277 - DecompressionTime: 1591987705 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 166355600 - PerReadThreadRawHdfsThroughput: 264667325 - RemoteScanRanges: 0 - RowsRead: 9606479 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 19 - ScannerThreadsTotalWallClockTime: 6718763022 - MaterializeTupleTime(*): 2434169439 - ScannerThreadsSysTime: 190967000 - ScannerThreadsUserTime: 3833414000 - ScannerThreadsVoluntaryContextSwitches: 214 - TotalRawHdfsReadTime(*): 103629252 - TotalReadThroughput: 27427277 - TotalTime: 1059963649 Instance f74cea27cca1cc70:12e354ae50158f09 (host=demeter-csmaz10-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/98.71 MB 10:1/98.78 MB 9:1/98.19 MB 20:1/99.16 MB 7:1/98.15 MB 15:1/99.68 MB 16:1/98.13 MB 6:1/98.73 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 181304544 - PerHostPeakMemUsage: 268129504 - PrepareTime: 279162 - RowsProduced: 0 - TotalCpuTime: 7457777796 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 55295 - TotalStorageWaitTime: 2764624098 - TotalTime: 1079171153 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 131625 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/98.71 MB 10:1/98.78 MB 9:1/98.19 MB 20:1/99.16 MB 7:1/98.15 MB 15:1/99.68 MB 16:1/98.13 MB 6:1/98.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.5 - BytesRead: 31579652 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31579652 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31579652 - DecompressionTime: 1868147377 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 180985056 - PerReadThreadRawHdfsThroughput: 371000190 - RemoteScanRanges: 0 - RowsRead: 10972585 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 102 - ScannerThreadsTotalWallClockTime: 7457806914 - MaterializeTupleTime(*): 2773233028 - ScannerThreadsSysTime: 136975000 - ScannerThreadsUserTime: 4503313000 - ScannerThreadsVoluntaryContextSwitches: 240 - TotalRawHdfsReadTime(*): 85120312 - TotalReadThroughput: 31579652 - TotalTime: 1069103778 Instance f74cea27cca1cc70:12e354ae50158ee7 (host=demeter-csmaz08-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/99.46 MB 1:1/98.72 MB 23:1/98.95 MB 21:1/98.67 MB 19:1/98.28 MB 17:1/98.63 MB 14:1/98.64 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 167096096 - PerHostPeakMemUsage: 260071200 - PrepareTime: 335198 - RowsProduced: 0 - TotalCpuTime: 6655557044 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 56691 - TotalStorageWaitTime: 2600796291 - TotalTime: 1096141582 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 134905 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/99.46 MB 1:1/98.72 MB 23:1/98.95 MB 21:1/98.67 MB 19:1/98.28 MB 17:1/98.63 MB 14:1/98.64 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27359267 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27359267 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27359267 - DecompressionTime: 1587760660 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 166776608 - PerReadThreadRawHdfsThroughput: 162896261 - RemoteScanRanges: 0 - RowsRead: 9565656 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 73 - ScannerThreadsTotalWallClockTime: 6655578929 - MaterializeTupleTime(*): 2453234734 - ScannerThreadsSysTime: 120979000 - ScannerThreadsUserTime: 3921401000 - ScannerThreadsVoluntaryContextSwitches: 220 - TotalRawHdfsReadTime(*): 167955156 - TotalReadThroughput: 27359267 - TotalTime: 1086177558 Instance f74cea27cca1cc70:12e354ae50158f10 (host=demeter-csmaz08-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/99.06 MB 14:1/98.75 MB 12:1/98.44 MB 9:1/98.85 MB 5:1/98.55 MB 1:1/98.23 MB 2:1/98.99 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 147002976 - PerHostPeakMemUsage: 256880224 - PrepareTime: 253820 - RowsProduced: 0 - TotalCpuTime: 6999049067 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 34510 - TotalStorageWaitTime: 2812268304 - TotalTime: 1083998651 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 139444 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 17:1/99.06 MB 14:1/98.75 MB 12:1/98.44 MB 9:1/98.85 MB 5:1/98.55 MB 1:1/98.23 MB 2:1/98.99 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27418877 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27418877 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27418877 - DecompressionTime: 1630650422 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 146683488 - PerReadThreadRawHdfsThroughput: 492769152 - RemoteScanRanges: 0 - RowsRead: 9587018 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 84 - ScannerThreadsTotalWallClockTime: 6999078399 - MaterializeTupleTime(*): 2542242756 - ScannerThreadsSysTime: 235962000 - ScannerThreadsUserTime: 3928399000 - ScannerThreadsVoluntaryContextSwitches: 211 - TotalRawHdfsReadTime(*): 55642438 - TotalReadThroughput: 27418877 - TotalTime: 1072285536 Instance f74cea27cca1cc70:12e354ae50158f2b (host=demeter-csmau10-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/98.23 MB 9:1/98.63 MB 14:1/99.67 MB 8:1/99.34 MB 3:1/98.64 MB 1:1/98.75 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 138650272 - PerHostPeakMemUsage: 138650272 - PrepareTime: 48103773 - RowsProduced: 0 - TotalCpuTime: 5473412797 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28771 - TotalStorageWaitTime: 2110641641 - TotalTime: 1043725777 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 162049 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 13:1/98.23 MB 9:1/98.63 MB 14:1/99.67 MB 8:1/99.34 MB 3:1/98.64 MB 1:1/98.75 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 22421062 - BytesReadDataNodeCache: 0 - BytesReadLocal: 22421062 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22421062 - DecompressionTime: 1285418950 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 138330784 - PerReadThreadRawHdfsThroughput: 662617287 - RemoteScanRanges: 0 - RowsRead: 8220505 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 5473429422 - MaterializeTupleTime(*): 2048946857 - ScannerThreadsSysTime: 92983000 - ScannerThreadsUserTime: 3261500000 - ScannerThreadsVoluntaryContextSwitches: 101 - TotalRawHdfsReadTime(*): 33837122 - TotalReadThroughput: 22421062 - TotalTime: 1033300615 Instance f74cea27cca1cc70:12e354ae50158ed7 (host=demeter-csmaz08-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/99.27 MB 11:1/98.95 MB 10:1/98.31 MB 7:1/98.70 MB 3:1/98.47 MB 4:1/98.29 MB 1:1/98.41 MB 0:1/98.38 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 154533224 - PerHostPeakMemUsage: 237479272 - PrepareTime: 291100 - RowsProduced: 0 - TotalCpuTime: 7369826132 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 40400 - TotalStorageWaitTime: 2695917274 - TotalTime: 1112506761 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 129765 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/99.27 MB 11:1/98.95 MB 10:1/98.31 MB 7:1/98.70 MB 3:1/98.47 MB 4:1/98.29 MB 1:1/98.41 MB 0:1/98.38 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.5 - BytesRead: 31382813 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31382813 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31382813 - DecompressionTime: 1854889413 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 154213736 - PerReadThreadRawHdfsThroughput: 598046567 - RemoteScanRanges: 0 - RowsRead: 10989671 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 27 - ScannerThreadsTotalWallClockTime: 7369859090 - MaterializeTupleTime(*): 2797265389 - ScannerThreadsSysTime: 217964000 - ScannerThreadsUserTime: 4426324000 - ScannerThreadsVoluntaryContextSwitches: 213 - TotalRawHdfsReadTime(*): 52475534 - TotalReadThroughput: 31382813 - TotalTime: 1101967993 Instance f74cea27cca1cc70:12e354ae50158f2a (host=demeter-csmau08-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/98.73 MB 11:1/99.46 MB 7:1/98.46 MB 16:1/98.04 MB 6:1/98.43 MB 4:1/98.27 MB 23:1/98.85 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 160260112 - PerHostPeakMemUsage: 251318288 - PrepareTime: 206803 - RowsProduced: 0 - TotalCpuTime: 6545631485 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31851 - TotalStorageWaitTime: 2547885789 - TotalTime: 1080607075 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 131122 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 17:1/98.73 MB 11:1/99.46 MB 7:1/98.46 MB 16:1/98.04 MB 6:1/98.43 MB 4:1/98.27 MB 23:1/98.85 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27447758 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27447758 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27447758 - DecompressionTime: 1667756066 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 159940624 - PerReadThreadRawHdfsThroughput: 174387972 - RemoteScanRanges: 0 - RowsRead: 9611090 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 41 - ScannerThreadsTotalWallClockTime: 6545656861 - MaterializeTupleTime(*): 2316828997 - ScannerThreadsSysTime: 196966000 - ScannerThreadsUserTime: 3787422000 - ScannerThreadsVoluntaryContextSwitches: 205 - TotalRawHdfsReadTime(*): 157394788 - TotalReadThroughput: 27447758 - TotalTime: 1071591687 Instance f74cea27cca1cc70:12e354ae50158ee9 (host=demeter-csmau08-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/99.21 MB 20:1/98.27 MB 14:1/98.76 MB 17:1/98.75 MB 4:1/98.76 MB 13:1/98.59 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 140899232 - PerHostPeakMemUsage: 243120032 - PrepareTime: 329808 - RowsProduced: 0 - TotalCpuTime: 6021175923 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36422 - TotalStorageWaitTime: 2465794564 - TotalTime: 1177077485 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 214377 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:1/99.21 MB 20:1/98.27 MB 14:1/98.76 MB 17:1/98.75 MB 4:1/98.76 MB 13:1/98.59 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.5 - BytesRead: 23508813 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23508813 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23508813 - DecompressionTime: 1323574493 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 140579744 - PerReadThreadRawHdfsThroughput: 197518403 - RemoteScanRanges: 0 - RowsRead: 8214026 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 15 - ScannerThreadsTotalWallClockTime: 6021202048 - MaterializeTupleTime(*): 2220240646 - ScannerThreadsSysTime: 108979000 - ScannerThreadsUserTime: 3434476000 - ScannerThreadsVoluntaryContextSwitches: 178 - TotalRawHdfsReadTime(*): 119020874 - TotalReadThroughput: 15672542 - TotalTime: 1136310994 Instance f74cea27cca1cc70:12e354ae50158f08 (host=demeter-csmaz10-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/98.48 MB 5:1/99.34 MB 4:1/98.47 MB 3:1/98.42 MB 20:1/98.18 MB 19:1/98.57 MB 18:1/98.66 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 148742848 - PerHostPeakMemUsage: 257897152 - PrepareTime: 251430 - RowsProduced: 0 - TotalCpuTime: 6777274070 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 35728 - TotalStorageWaitTime: 2610042123 - TotalTime: 1107837098 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 123582 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:1/98.48 MB 5:1/99.34 MB 4:1/98.47 MB 3:1/98.42 MB 20:1/98.18 MB 19:1/98.57 MB 18:1/98.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27382505 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27382505 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27382505 - DecompressionTime: 1601792408 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 148423360 - PerReadThreadRawHdfsThroughput: 94776117 - RemoteScanRanges: 0 - RowsRead: 9601734 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 82 - ScannerThreadsTotalWallClockTime: 6777303668 - MaterializeTupleTime(*): 2548449906 - ScannerThreadsSysTime: 224961000 - ScannerThreadsUserTime: 3925399000 - ScannerThreadsVoluntaryContextSwitches: 171 - TotalRawHdfsReadTime(*): 288917776 - TotalReadThroughput: 27382505 - TotalTime: 1097663136 Instance f74cea27cca1cc70:12e354ae50158ee0 (host=demeter-csmau08-9.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/98.73 MB 9:1/98.81 MB 23:1/99.62 MB 18:1/98.33 MB 16:1/99.10 MB 10:1/98.80 MB 7:1/99.16 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 164208416 - PerHostPeakMemUsage: 265332512 - PrepareTime: 253178 - RowsProduced: 0 - TotalCpuTime: 7003291726 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 76685 - TotalStorageWaitTime: 2306392207 - TotalTime: 1115856285 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 119527 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/98.73 MB 9:1/98.81 MB 23:1/99.62 MB 18:1/98.33 MB 16:1/99.10 MB 10:1/98.80 MB 7:1/99.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27334781 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27334781 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27334781 - DecompressionTime: 1607264568 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 163888928 - PerReadThreadRawHdfsThroughput: 323134652 - RemoteScanRanges: 0 - RowsRead: 9516515 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 137 - ScannerThreadsTotalWallClockTime: 7003313228 - MaterializeTupleTime(*): 3076958750 - ScannerThreadsSysTime: 119978000 - ScannerThreadsUserTime: 4558303000 - ScannerThreadsVoluntaryContextSwitches: 212 - TotalRawHdfsReadTime(*): 84592540 - TotalReadThroughput: 27334781 - TotalTime: 1105258834 Instance f74cea27cca1cc70:12e354ae50158f26 (host=demeter-csmaz08-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/99.72 MB 22:1/99.38 MB 20:1/98.45 MB 19:1/98.57 MB 6:1/99.73 MB 16:1/98.34 MB 15:1/98.55 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 170842496 - PerHostPeakMemUsage: 283275648 - PrepareTime: 294438 - RowsProduced: 0 - TotalCpuTime: 7156004417 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 45008 - TotalStorageWaitTime: 2790101194 - TotalTime: 1112592413 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 113091 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/99.72 MB 22:1/99.38 MB 20:1/98.45 MB 19:1/98.57 MB 6:1/99.73 MB 16:1/98.34 MB 15:1/98.55 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27288917 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27288917 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27288917 - DecompressionTime: 1648765964 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 170523008 - PerReadThreadRawHdfsThroughput: 312318900 - RemoteScanRanges: 0 - RowsRead: 9506487 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 97 - ScannerThreadsTotalWallClockTime: 7156058490 - MaterializeTupleTime(*): 2698101961 - ScannerThreadsSysTime: 113980000 - ScannerThreadsUserTime: 4236352000 - ScannerThreadsVoluntaryContextSwitches: 184 - TotalRawHdfsReadTime(*): 87375170 - TotalReadThroughput: 27288917 - TotalTime: 1103163356 Instance f74cea27cca1cc70:12e354ae50158f2c (host=demeter-csmaz08-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/99.27 MB 17:1/98.56 MB 16:1/98.55 MB 6:1/98.60 MB 7:1/98.60 MB 13:1/98.67 MB 4:1/98.47 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 160005360 - PerHostPeakMemUsage: 160005360 - PrepareTime: 40720614 - RowsProduced: 0 - TotalCpuTime: 6870652501 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28130 - TotalStorageWaitTime: 2545157499 - TotalTime: 1093780952 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 150005 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 22:1/99.27 MB 17:1/98.56 MB 16:1/98.55 MB 6:1/98.60 MB 7:1/98.60 MB 13:1/98.67 MB 4:1/98.47 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 1.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27404816 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27404816 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27404816 - DecompressionTime: 1676109540 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 159685872 - PerReadThreadRawHdfsThroughput: 281475871 - RemoteScanRanges: 0 - RowsRead: 9604947 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 55 - ScannerThreadsTotalWallClockTime: 6870676294 - MaterializeTupleTime(*): 2637035766 - ScannerThreadsSysTime: 115979000 - ScannerThreadsUserTime: 4198358000 - ScannerThreadsVoluntaryContextSwitches: 110 - TotalRawHdfsReadTime(*): 97361155 - TotalReadThroughput: 27404816 - TotalTime: 1084023008 Instance f74cea27cca1cc70:12e354ae50158edc (host=demeter-csmaz08-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/99.69 MB 15:1/99.17 MB 12:1/98.64 MB 11:1/98.33 MB 4:1/98.57 MB 0:1/98.72 MB 1:1/99.25 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 158188624 - PerHostPeakMemUsage: 257647696 - PrepareTime: 265867 - RowsProduced: 0 - TotalCpuTime: 7112334220 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 23439 - TotalStorageWaitTime: 2718332846 - TotalTime: 1165922697 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 124277 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 20:1/99.69 MB 15:1/99.17 MB 12:1/98.64 MB 11:1/98.33 MB 4:1/98.57 MB 0:1/98.72 MB 1:1/99.25 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27376270 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27376270 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27376270 - DecompressionTime: 1459042607 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 157869136 - PerReadThreadRawHdfsThroughput: 141295195 - RemoteScanRanges: 0 - RowsRead: 9531715 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 38 - ScannerThreadsTotalWallClockTime: 7112358463 - MaterializeTupleTime(*): 2922117564 - ScannerThreadsSysTime: 111979000 - ScannerThreadsUserTime: 4268348000 - ScannerThreadsVoluntaryContextSwitches: 170 - TotalRawHdfsReadTime(*): 193752307 - TotalReadThroughput: 27376270 - TotalTime: 1155424869 Instance f74cea27cca1cc70:12e354ae50158f0f (host=demeter-csmau10-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/99.76 MB 1:1/99.14 MB 5:1/99.39 MB 22:1/98.92 MB 6:1/98.72 MB 16:1/99.03 MB 13:1/98.24 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 165013576 - PerHostPeakMemUsage: 165013576 - PrepareTime: 45720265 - RowsProduced: 0 - TotalCpuTime: 6720646196 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27193 - TotalStorageWaitTime: 2671272194 - TotalTime: 1138556528 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 162769 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/99.76 MB 1:1/99.14 MB 5:1/99.39 MB 22:1/98.92 MB 6:1/98.72 MB 16:1/99.03 MB 13:1/98.24 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27337905 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27337905 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27337905 - DecompressionTime: 1605391056 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 164694088 - PerReadThreadRawHdfsThroughput: 323164342 - RemoteScanRanges: 0 - RowsRead: 9511297 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 127 - ScannerThreadsTotalWallClockTime: 6720665390 - MaterializeTupleTime(*): 2432218515 - ScannerThreadsSysTime: 126977000 - ScannerThreadsUserTime: 3911402000 - ScannerThreadsVoluntaryContextSwitches: 126 - TotalRawHdfsReadTime(*): 84594435 - TotalReadThroughput: 27337905 - TotalTime: 1127875667 Instance f74cea27cca1cc70:12e354ae50158f29 (host=demeter-csmaz11-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/99.37 MB 3:1/98.92 MB 23:1/98.55 MB 18:1/98.40 MB 6:1/99.01 MB 7:2/198.24 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 170564800 - PerHostPeakMemUsage: 290094272 - PrepareTime: 380324 - RowsProduced: 0 - TotalCpuTime: 7347373946 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36545 - TotalStorageWaitTime: 3046852878 - TotalTime: 1146052567 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 140692 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/99.37 MB 3:1/98.92 MB 23:1/98.55 MB 18:1/98.40 MB 6:1/99.01 MB 7:2/198.24 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27538502 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27538502 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27538502 - DecompressionTime: 1686662091 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 170245312 - PerReadThreadRawHdfsThroughput: 168014390 - RemoteScanRanges: 0 - RowsRead: 9513456 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 78 - ScannerThreadsTotalWallClockTime: 7347405004 - MaterializeTupleTime(*): 2597712230 - ScannerThreadsSysTime: 275955000 - ScannerThreadsUserTime: 4011386000 - ScannerThreadsVoluntaryContextSwitches: 236 - TotalRawHdfsReadTime(*): 163905615 - TotalReadThroughput: 27538502 - TotalTime: 1133887741 Instance f74cea27cca1cc70:12e354ae50158edd (host=demeter-csmaz08-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/99.02 MB 8:1/98.63 MB 7:1/98.70 MB 5:1/98.37 MB 6:1/98.23 MB 3:1/98.69 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 142125344 - PerHostPeakMemUsage: 142125344 - PrepareTime: 40769915 - RowsProduced: 0 - TotalCpuTime: 5931070029 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27247 - TotalStorageWaitTime: 2389781761 - TotalTime: 1182872367 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 157116 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/99.02 MB 8:1/98.63 MB 7:1/98.70 MB 5:1/98.37 MB 6:1/98.23 MB 3:1/98.69 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.666666666666667 - BytesRead: 23527965 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23527965 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23527965 - DecompressionTime: 1412489174 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 141805856 - PerReadThreadRawHdfsThroughput: 207207044 - RemoteScanRanges: 0 - RowsRead: 8240545 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 163 - ScannerThreadsTotalWallClockTime: 5931088673 - MaterializeTupleTime(*): 2118949695 - ScannerThreadsSysTime: 111980000 - ScannerThreadsUserTime: 3414477000 - ScannerThreadsVoluntaryContextSwitches: 113 - TotalRawHdfsReadTime(*): 113548094 - TotalReadThroughput: 15685310 - TotalTime: 1172520845 Instance f74cea27cca1cc70:12e354ae50158f0a (host=demeter-csmaz08-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/98.96 MB 20:1/98.99 MB 18:1/98.79 MB 11:1/98.70 MB 9:1/98.41 MB 16:1/98.99 MB 6:1/98.32 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 159721280 - PerHostPeakMemUsage: 263999296 - PrepareTime: 273303 - RowsProduced: 0 - TotalCpuTime: 7147919604 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 64378 - TotalStorageWaitTime: 2827318712 - TotalTime: 1172364136 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 151283 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 22:1/98.96 MB 20:1/98.99 MB 18:1/98.79 MB 11:1/98.70 MB 9:1/98.41 MB 16:1/98.99 MB 6:1/98.32 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27368663 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27368663 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27368663 - DecompressionTime: 1618422900 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 159401792 - PerReadThreadRawHdfsThroughput: 320619532 - RemoteScanRanges: 0 - RowsRead: 9570898 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 78 - ScannerThreadsTotalWallClockTime: 7147948522 - MaterializeTupleTime(*): 2689149778 - ScannerThreadsSysTime: 96981000 - ScannerThreadsUserTime: 4206356000 - ScannerThreadsVoluntaryContextSwitches: 202 - TotalRawHdfsReadTime(*): 85361808 - TotalReadThroughput: 27368663 - TotalTime: 1162198532 Instance f74cea27cca1cc70:12e354ae50158f21 (host=demeter-csmaz11-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/99.25 MB 12:1/99.22 MB 9:1/99.01 MB 2:1/98.89 MB 3:1/98.21 MB 22:1/98.49 MB 23:1/98.65 MB 17:1/99.31 MB - AsyncTotalTime: 0 - AverageThreadTokens: 9.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190305280 - PerHostPeakMemUsage: 298484736 - PrepareTime: 268314 - RowsProduced: 0 - TotalCpuTime: 7947946495 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 41750 - TotalStorageWaitTime: 3165329400 - TotalTime: 1155638914 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112751 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 13:1/99.25 MB 12:1/99.22 MB 9:1/99.01 MB 2:1/98.89 MB 3:1/98.21 MB 22:1/98.49 MB 23:1/98.65 MB 17:1/99.31 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 8.0 - BytesRead: 31469338 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31469338 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31469338 - DecompressionTime: 1798099904 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 189985792 - PerReadThreadRawHdfsThroughput: 341909436 - RemoteScanRanges: 0 - RowsRead: 10884351 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 7947979721 - MaterializeTupleTime(*): 2966258819 - ScannerThreadsSysTime: 164971000 - ScannerThreadsUserTime: 4600297000 - ScannerThreadsVoluntaryContextSwitches: 286 - TotalRawHdfsReadTime(*): 92039981 - TotalReadThroughput: 31469338 - TotalTime: 1145484713 Instance f74cea27cca1cc70:12e354ae50158ed5 (host=demeter-csmaz08-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/99.44 MB 18:1/98.39 MB 21:1/99.52 MB 14:1/98.49 MB 12:1/98.73 MB 15:1/98.35 MB 10:1/98.37 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 144481376 - PerHostPeakMemUsage: 238950368 - PrepareTime: 284765 - RowsProduced: 0 - TotalCpuTime: 7175074763 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 105672 - TotalStorageWaitTime: 2377323215 - TotalTime: 1197770449 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 136586 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/99.44 MB 18:1/98.39 MB 21:1/99.52 MB 14:1/98.49 MB 12:1/98.73 MB 15:1/98.35 MB 10:1/98.37 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.5 - BytesRead: 27469675 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27469675 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27469675 - DecompressionTime: 1669441597 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 144161888 - PerReadThreadRawHdfsThroughput: 345430927 - RemoteScanRanges: 0 - RowsRead: 9570760 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 144 - ScannerThreadsTotalWallClockTime: 7175101151 - MaterializeTupleTime(*): 3113280339 - ScannerThreadsSysTime: 116980000 - ScannerThreadsUserTime: 4666287000 - ScannerThreadsVoluntaryContextSwitches: 219 - TotalRawHdfsReadTime(*): 79522917 - TotalReadThroughput: 18313116 - TotalTime: 1187669007 Instance f74cea27cca1cc70:12e354ae50158f05 (host=demeter-csmaz10-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/99.15 MB 23:1/98.58 MB 21:1/98.91 MB 18:1/98.43 MB 17:1/98.66 MB 16:1/99.34 MB 15:1/98.53 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 172748400 - PerHostPeakMemUsage: 172748400 - PrepareTime: 39705275 - RowsProduced: 0 - TotalCpuTime: 6862608316 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28743 - TotalStorageWaitTime: 2664362777 - TotalTime: 1141041099 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 158369 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/99.15 MB 23:1/98.58 MB 21:1/98.91 MB 18:1/98.43 MB 17:1/98.66 MB 16:1/99.34 MB 15:1/98.53 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 27540332 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27540332 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27540332 - DecompressionTime: 1582981162 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 172428912 - PerReadThreadRawHdfsThroughput: 568165071 - RemoteScanRanges: 0 - RowsRead: 9557969 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 31 - ScannerThreadsTotalWallClockTime: 6862629334 - MaterializeTupleTime(*): 2603353961 - ScannerThreadsSysTime: 108980000 - ScannerThreadsUserTime: 4076377000 - ScannerThreadsVoluntaryContextSwitches: 114 - TotalRawHdfsReadTime(*): 48472413 - TotalReadThroughput: 18360221 - TotalTime: 1130927365 Instance f74cea27cca1cc70:12e354ae50158f16 (host=demeter-csmaz08-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/98.41 MB 2:1/98.53 MB 1:1/98.39 MB 21:1/98.72 MB 20:1/98.55 MB 18:1/98.77 MB 16:1/98.60 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 158032064 - PerHostPeakMemUsage: 276613312 - PrepareTime: 239684 - RowsProduced: 0 - TotalCpuTime: 7603080309 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 41490 - TotalStorageWaitTime: 2816961573 - TotalTime: 1186483613 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 137431 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/98.41 MB 2:1/98.53 MB 1:1/98.39 MB 21:1/98.72 MB 20:1/98.55 MB 18:1/98.77 MB 16:1/98.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27465649 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27465649 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27465649 - DecompressionTime: 1781078129 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 157712576 - PerReadThreadRawHdfsThroughput: 259479328 - RemoteScanRanges: 0 - RowsRead: 9632223 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 169 - ScannerThreadsTotalWallClockTime: 7603100145 - MaterializeTupleTime(*): 2993426427 - ScannerThreadsSysTime: 118978000 - ScannerThreadsUserTime: 4656288000 - ScannerThreadsVoluntaryContextSwitches: 184 - TotalRawHdfsReadTime(*): 105849083 - TotalReadThroughput: 27465649 - TotalTime: 1177501965 Instance f74cea27cca1cc70:12e354ae50158f1a (host=demeter-csmau10-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/99.49 MB 7:1/98.96 MB 3:1/98.33 MB 2:1/98.34 MB 1:1/98.62 MB 5:1/98.71 MB 0:1/98.79 MB 22:1/98.10 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 184437344 - PerHostPeakMemUsage: 300053088 - PrepareTime: 262162 - RowsProduced: 0 - TotalCpuTime: 8526043100 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 20533 - TotalStorageWaitTime: 3161311789 - TotalTime: 1189361410 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 156394 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:1/99.49 MB 7:1/98.96 MB 3:1/98.33 MB 2:1/98.34 MB 1:1/98.62 MB 5:1/98.71 MB 0:1/98.79 MB 22:1/98.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 31338532 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31338532 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31338532 - DecompressionTime: 1833922802 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 184117856 - PerReadThreadRawHdfsThroughput: 471787409 - RemoteScanRanges: 0 - RowsRead: 10957527 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 45 - ScannerThreadsTotalWallClockTime: 8526073887 - MaterializeTupleTime(*): 3514457916 - ScannerThreadsSysTime: 197966000 - ScannerThreadsUserTime: 5152213000 - ScannerThreadsVoluntaryContextSwitches: 268 - TotalRawHdfsReadTime(*): 66425113 - TotalReadThroughput: 20892354 - TotalTime: 1179597919 Instance f74cea27cca1cc70:12e354ae50158f04 (host=demeter-csmaz10-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/99.28 MB 17:1/98.57 MB 16:1/99.20 MB 15:1/98.05 MB 12:1/98.31 MB 11:1/98.73 MB 8:1/98.85 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 136920896 - PerHostPeakMemUsage: 243115856 - PrepareTime: 275765 - RowsProduced: 0 - TotalCpuTime: 7202803923 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 42044 - TotalStorageWaitTime: 2479121543 - TotalTime: 1205035984 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 127773 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 22:1/99.28 MB 17:1/98.57 MB 16:1/99.20 MB 15:1/98.05 MB 12:1/98.31 MB 11:1/98.73 MB 8:1/98.85 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.333333333333333 - BytesRead: 27430467 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27430467 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27430467 - DecompressionTime: 1475171946 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 136601408 - PerReadThreadRawHdfsThroughput: 156256776 - RemoteScanRanges: 0 - RowsRead: 9583107 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 14 - ScannerThreadsTotalWallClockTime: 7202829480 - MaterializeTupleTime(*): 3227212139 - ScannerThreadsSysTime: 133977000 - ScannerThreadsUserTime: 4571302000 - ScannerThreadsVoluntaryContextSwitches: 186 - TotalRawHdfsReadTime(*): 175547375 - TotalReadThroughput: 18286978 - TotalTime: 1194585897 Instance f74cea27cca1cc70:12e354ae50158f13 (host=demeter-csmaz10-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/98.17 MB 20:1/98.43 MB 17:1/99.09 MB 12:1/98.27 MB 9:1/98.33 MB 13:1/98.75 MB 4:2/197.96 MB - AsyncTotalTime: 0 - AverageThreadTokens: 9.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190439720 - PerHostPeakMemUsage: 296859944 - PrepareTime: 288282 - RowsProduced: 0 - TotalCpuTime: 8202820943 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 39097 - TotalStorageWaitTime: 3166265764 - TotalTime: 1204491218 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 137425 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/98.17 MB 20:1/98.43 MB 17:1/99.09 MB 12:1/98.27 MB 9:1/98.33 MB 13:1/98.75 MB 4:2/197.96 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 8.0 - BytesRead: 31552840 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31552840 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31552840 - DecompressionTime: 1927320841 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 190120232 - PerReadThreadRawHdfsThroughput: 708007882 - RemoteScanRanges: 0 - RowsRead: 10984822 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 101 - ScannerThreadsTotalWallClockTime: 8202849320 - MaterializeTupleTime(*): 3091098247 - ScannerThreadsSysTime: 143974000 - ScannerThreadsUserTime: 4875254000 - ScannerThreadsVoluntaryContextSwitches: 253 - TotalRawHdfsReadTime(*): 44565662 - TotalReadThroughput: 31552840 - TotalTime: 1194258972 Instance f74cea27cca1cc70:12e354ae50158f06 (host=demeter-csmau10-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/98.23 MB 3:1/98.77 MB 4:1/98.30 MB 21:1/98.49 MB 20:1/98.81 MB 15:2/196.76 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 152932144 - PerHostPeakMemUsage: 257445680 - PrepareTime: 255979 - RowsProduced: 0 - TotalCpuTime: 7464668874 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 33856 - TotalStorageWaitTime: 2984179009 - TotalTime: 1211981638 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 128546 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/98.23 MB 3:1/98.77 MB 4:1/98.30 MB 21:1/98.49 MB 20:1/98.81 MB 15:2/196.76 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 1.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27482188 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27482188 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27482188 - DecompressionTime: 1680609740 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 152612656 - PerReadThreadRawHdfsThroughput: 140577354 - RemoteScanRanges: 0 - RowsRead: 9648428 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 29 - ScannerThreadsTotalWallClockTime: 7464696700 - MaterializeTupleTime(*): 2453642293 - ScannerThreadsSysTime: 153973000 - ScannerThreadsUserTime: 3977391000 - ScannerThreadsVoluntaryContextSwitches: 209 - TotalRawHdfsReadTime(*): 195495128 - TotalReadThroughput: 27482188 - TotalTime: 1201809815 Instance f74cea27cca1cc70:12e354ae50158ef5 (host=demeter-csmau10-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/98.86 MB 21:1/99.35 MB 18:1/98.36 MB 10:1/98.21 MB 11:1/98.51 MB 15:1/98.79 MB 6:1/98.27 MB - AsyncTotalTime: 0 - AverageThreadTokens: 8.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 161219696 - PerHostPeakMemUsage: 161219696 - PrepareTime: 39586401 - RowsProduced: 0 - TotalCpuTime: 7002984944 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 14048 - TotalStorageWaitTime: 2746606011 - TotalTime: 1189844030 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 158470 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:1/98.86 MB 21:1/99.35 MB 18:1/98.36 MB 10:1/98.21 MB 11:1/98.51 MB 15:1/98.79 MB 6:1/98.27 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27451442 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27451442 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27451442 - DecompressionTime: 1490646872 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 160900208 - PerReadThreadRawHdfsThroughput: 638267405 - RemoteScanRanges: 0 - RowsRead: 9614525 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 5 - ScannerThreadsTotalWallClockTime: 7003017695 - MaterializeTupleTime(*): 2752203292 - ScannerThreadsSysTime: 120978000 - ScannerThreadsUserTime: 4125369000 - ScannerThreadsVoluntaryContextSwitches: 116 - TotalRawHdfsReadTime(*): 43009312 - TotalReadThroughput: 27451442 - TotalTime: 1178574241 Instance f74cea27cca1cc70:12e354ae50158f19 (host=demeter-csmaz08-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/99.24 MB 21:1/99.76 MB 18:1/98.71 MB 16:1/98.80 MB 13:1/98.56 MB 11:1/98.91 MB 2:1/99.53 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 171886480 - PerHostPeakMemUsage: 298868624 - PrepareTime: 252123 - RowsProduced: 0 - TotalCpuTime: 7654704472 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 19993 - TotalStorageWaitTime: 2824354618 - TotalTime: 1245872365 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112164 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/99.24 MB 21:1/99.76 MB 18:1/98.71 MB 16:1/98.80 MB 13:1/98.56 MB 11:1/98.91 MB 2:1/99.53 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 7.0 - BytesRead: 27499602 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27499602 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27499602 - DecompressionTime: 1672007731 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 171566992 - PerReadThreadRawHdfsThroughput: 398814618 - RemoteScanRanges: 0 - RowsRead: 9477176 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 31 - ScannerThreadsTotalWallClockTime: 7654730706 - MaterializeTupleTime(*): 3144103025 - ScannerThreadsSysTime: 233961000 - ScannerThreadsUserTime: 4577301000 - ScannerThreadsVoluntaryContextSwitches: 297 - TotalRawHdfsReadTime(*): 68953345 - TotalReadThroughput: 27499602 - TotalTime: 1236103337 Instance f74cea27cca1cc70:12e354ae50158f2d (host=demeter-csmaz10-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/98.74 MB 11:1/99.17 MB 15:1/99.23 MB 16:1/99.54 MB 6:1/99.42 MB 21:1/99.29 MB 18:1/98.97 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 152680208 - PerHostPeakMemUsage: 269184784 - PrepareTime: 248954 - RowsProduced: 0 - TotalCpuTime: 7660325271 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 69999 - TotalStorageWaitTime: 2810617298 - TotalTime: 1224775592 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 112892 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/98.74 MB 11:1/99.17 MB 15:1/99.23 MB 16:1/99.54 MB 6:1/99.42 MB 21:1/99.29 MB 18:1/98.97 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.333333333333333 - BytesRead: 27171167 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27171167 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27171167 - DecompressionTime: 1496925787 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 152360720 - PerReadThreadRawHdfsThroughput: 259637130 - RemoteScanRanges: 0 - RowsRead: 9504941 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 9 - ScannerThreadsTotalWallClockTime: 7660351970 - MaterializeTupleTime(*): 3329852234 - ScannerThreadsSysTime: 119977000 - ScannerThreadsUserTime: 4718279000 - ScannerThreadsVoluntaryContextSwitches: 235 - TotalRawHdfsReadTime(*): 104650544 - TotalReadThroughput: 18114111 - TotalTime: 1214471470 Instance f74cea27cca1cc70:12e354ae50158ef9 (host=demeter-csmau10-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/99.34 MB 21:1/99.57 MB 19:1/99.23 MB 18:1/98.72 MB 17:1/98.27 MB 12:1/98.62 MB 14:1/98.69 MB 8:1/98.72 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 181278576 - PerHostPeakMemUsage: 181278576 - PrepareTime: 38970299 - RowsProduced: 0 - TotalCpuTime: 9165708015 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29646 - TotalStorageWaitTime: 3178390207 - TotalTime: 1289673902 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 162670 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 20:1/99.34 MB 21:1/99.57 MB 19:1/99.23 MB 18:1/98.72 MB 17:1/98.27 MB 12:1/98.62 MB 14:1/98.69 MB 8:1/98.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.333333333333333 - BytesRead: 31474271 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31474271 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31474271 - DecompressionTime: 1964153486 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 180959088 - PerReadThreadRawHdfsThroughput: 413199188 - RemoteScanRanges: 0 - RowsRead: 10908763 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 375 - ScannerThreadsTotalWallClockTime: 9165736966 - MaterializeTupleTime(*): 4009426739 - ScannerThreadsSysTime: 140974000 - ScannerThreadsUserTime: 5830109000 - ScannerThreadsVoluntaryContextSwitches: 130 - TotalRawHdfsReadTime(*): 76172151 - TotalReadThroughput: 20982847 - TotalTime: 1278380038 Instance f74cea27cca1cc70:12e354ae50158ef0 (host=demeter-csmaz11-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/99.23 MB 5:1/99.21 MB 1:1/98.21 MB 7:1/99.23 MB 20:1/98.25 MB 15:1/98.76 MB 13:1/98.45 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 156215120 - PerHostPeakMemUsage: 244739920 - PrepareTime: 244687 - RowsProduced: 0 - TotalCpuTime: 6968329514 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 23656 - TotalStorageWaitTime: 2358571619 - TotalTime: 1315862493 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 125849 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/99.23 MB 5:1/99.21 MB 1:1/98.21 MB 7:1/99.23 MB 20:1/98.25 MB 15:1/98.76 MB 13:1/98.45 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 27597898 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27597898 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27597898 - DecompressionTime: 1555614027 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 155895632 - PerReadThreadRawHdfsThroughput: 359822863 - RemoteScanRanges: 0 - RowsRead: 9575210 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 55 - ScannerThreadsTotalWallClockTime: 6968353146 - MaterializeTupleTime(*): 3039007983 - ScannerThreadsSysTime: 192967000 - ScannerThreadsUserTime: 4396328000 - ScannerThreadsVoluntaryContextSwitches: 259 - TotalRawHdfsReadTime(*): 76698567 - TotalReadThroughput: 18398598 - TotalTime: 1305725646 Instance f74cea27cca1cc70:12e354ae50158eee (host=demeter-csmau08-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/99.70 MB 9:1/98.64 MB 7:1/98.43 MB 2:1/98.37 MB 1:1/98.40 MB 19:1/99.16 MB 15:1/98.83 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.666666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 159291856 - PerHostPeakMemUsage: 297272912 - PrepareTime: 372631 - RowsProduced: 84404 - TotalCpuTime: 6415528174 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 400305398 - TotalStorageWaitTime: 2465949707 - TotalTime: 1433955177 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 106748004 - InactiveTotalTime: 0 - NetworkThroughput(*): 20769271 - OverallThroughput: 205409283 - PeakMemoryUsage: 311296 - SerializeBatchTime: 18290895 - ThriftTransmitTime(*): 5139708540 - TotalTime: 519684418 - UncompressedRowBatchSize: 295101616 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/99.70 MB 9:1/98.64 MB 7:1/98.43 MB 2:1/98.37 MB 1:1/98.40 MB 19:1/99.16 MB 15:1/98.83 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.666666666666667 - BytesRead: 27417042 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27417042 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27417042 - DecompressionTime: 1567412738 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 158972368 - PerReadThreadRawHdfsThroughput: 217447732 - RemoteScanRanges: 0 - RowsRead: 9579055 - RowsReturned: 84404 - RowsReturnedRate: 93805 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 34 - ScannerThreadsTotalWallClockTime: 6415564905 - MaterializeTupleTime(*): 2363869395 - ScannerThreadsSysTime: 151973000 - ScannerThreadsUserTime: 3771423000 - ScannerThreadsVoluntaryContextSwitches: 228 - TotalRawHdfsReadTime(*): 126085665 - TotalReadThroughput: 18278028 - TotalTime: 899775301 Instance f74cea27cca1cc70:12e354ae50158ed6 (host=demeter-csmau10-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/98.42 MB 22:1/99.14 MB 7:1/99.15 MB 21:1/98.80 MB 20:1/98.19 MB 12:1/98.20 MB 14:1/98.39 MB 8:1/98.58 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.1818181818181817 - InactiveTotalTime: 0 - PeakMemoryUsage: 185554080 - PerHostPeakMemUsage: 1033668696 - PrepareTime: 288089 - RowsProduced: 1351140 - TotalCpuTime: 13011345399 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3346348104 - TotalStorageWaitTime: 2672280811 - TotalTime: 5940254552 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1979515076 - InactiveTotalTime: 0 - NetworkThroughput(*): 21560815 - OverallThroughput: 355720695 - PeakMemoryUsage: 311296 - SerializeBatchTime: 501623389 - ThriftTransmitTime(*): 91810769701 - TotalTime: 5564801539 - UncompressedRowBatchSize: 4723986720 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/98.42 MB 22:1/99.14 MB 7:1/99.15 MB 21:1/98.80 MB 20:1/98.19 MB 12:1/98.20 MB 14:1/98.39 MB 8:1/98.58 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.1818181818181817 - BytesRead: 31364050 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31364050 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31364050 - DecompressionTime: 2099148001 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 185185440 - PerReadThreadRawHdfsThroughput: 457493904 - RemoteScanRanges: 0 - RowsRead: 10990616 - RowsReturned: 1351140 - RowsReturnedRate: 3763878 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 312 - ScannerThreadsTotalWallClockTime: 13011373315 - MaterializeTupleTime(*): 7802182004 - ScannerThreadsSysTime: 203964000 - ScannerThreadsUserTime: 5268195000 - ScannerThreadsVoluntaryContextSwitches: 1592 - TotalRawHdfsReadTime(*): 68556214 - TotalReadThroughput: 5702554 - TotalTime: 358975418 Instance f74cea27cca1cc70:12e354ae50158f15 (host=demeter-csmaz11-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/98.88 MB 16:1/99.87 MB 6:1/98.97 MB 5:1/98.83 MB 21:1/98.65 MB 20:1/98.79 MB 17:1/99.13 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.4166666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 160133568 - PerHostPeakMemUsage: 1037624856 - PrepareTime: 239871 - RowsProduced: 1374448 - TotalCpuTime: 11000930287 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3338571320 - TotalStorageWaitTime: 2836608816 - TotalTime: 5952172529 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1704365284 - InactiveTotalTime: 0 - NetworkThroughput(*): 18824530 - OverallThroughput: 311016486 - PeakMemoryUsage: 311296 - SerializeBatchTime: 443606826 - ThriftTransmitTime(*): 90539591440 - TotalTime: 5479983732 - UncompressedRowBatchSize: 4805478480 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 10:1/98.88 MB 16:1/99.87 MB 6:1/98.97 MB 5:1/98.83 MB 21:1/98.65 MB 20:1/98.79 MB 17:1/99.13 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.5454545454545454 - BytesRead: 27350503 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27350503 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27350503 - DecompressionTime: 1205609343 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 159764928 - PerReadThreadRawHdfsThroughput: 508111134 - RemoteScanRanges: 0 - RowsRead: 9507302 - RowsReturned: 1374448 - RowsReturnedRate: 3019202 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 173 - ScannerThreadsTotalWallClockTime: 11000957702 - MaterializeTupleTime(*): 6529966410 - ScannerThreadsSysTime: 135975000 - ScannerThreadsUserTime: 3080529000 - ScannerThreadsVoluntaryContextSwitches: 1601 - TotalRawHdfsReadTime(*): 53827797 - TotalReadThroughput: 4558417 - TotalTime: 455235441 Instance f74cea27cca1cc70:12e354ae50158f24 (host=demeter-csmau08-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/98.38 MB 5:1/98.51 MB 1:1/98.76 MB 20:1/98.91 MB 14:1/98.22 MB 10:1/98.54 MB 9:1/98.62 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.9166666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 164205856 - PerHostPeakMemUsage: 1031734600 - PrepareTime: 253314 - RowsProduced: 1375715 - TotalCpuTime: 12447400081 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3375105599 - TotalStorageWaitTime: 2813081074 - TotalTime: 5979380316 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1758117652 - InactiveTotalTime: 0 - NetworkThroughput(*): 18987075 - OverallThroughput: 319140822 - PeakMemoryUsage: 311296 - SerializeBatchTime: 429923083 - ThriftTransmitTime(*): 92595495324 - TotalTime: 5508908694 - UncompressedRowBatchSize: 4809908216 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/98.38 MB 5:1/98.51 MB 1:1/98.76 MB 20:1/98.91 MB 14:1/98.22 MB 10:1/98.54 MB 9:1/98.62 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.9166666666666667 - BytesRead: 27350305 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27350305 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27350305 - DecompressionTime: 1876446244 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 163837216 - PerReadThreadRawHdfsThroughput: 595743130 - RemoteScanRanges: 0 - RowsRead: 9629884 - RowsReturned: 1375715 - RowsReturnedRate: 3031028 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 344 - ScannerThreadsTotalWallClockTime: 12447429015 - MaterializeTupleTime(*): 7562449428 - ScannerThreadsSysTime: 312949000 - ScannerThreadsUserTime: 4682285000 - ScannerThreadsVoluntaryContextSwitches: 1619 - TotalRawHdfsReadTime(*): 45909560 - TotalReadThroughput: 4558384 - TotalTime: 453877265 Instance f74cea27cca1cc70:12e354ae50158f17 (host=demeter-csmaz10-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/98.57 MB 16:1/99.70 MB 12:1/98.34 MB 22:1/99.67 MB 5:1/98.81 MB 13:1/98.28 MB 4:1/99.25 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.2 - InactiveTotalTime: 0 - PeakMemoryUsage: 167026272 - PerHostPeakMemUsage: 167026272 - PrepareTime: 40843835 - RowsProduced: 1017679 - TotalCpuTime: 10463569433 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3491379862 - TotalStorageWaitTime: 2735754849 - TotalTime: 5161554421 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1544822512 - InactiveTotalTime: 0 - NetworkThroughput(*): 20396057 - OverallThroughput: 328373502 - PeakMemoryUsage: 311296 - SerializeBatchTime: 368621926 - ThriftTransmitTime(*): 75741232068 - TotalTime: 4704467628 - UncompressedRowBatchSize: 3558107960 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 19:1/98.57 MB 16:1/99.70 MB 12:1/98.34 MB 22:1/99.67 MB 5:1/98.81 MB 13:1/98.28 MB 4:1/99.25 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.2 - BytesRead: 27336856 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27336856 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27336856 - DecompressionTime: 1635129520 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 166657632 - PerReadThreadRawHdfsThroughput: 194473887 - RemoteScanRanges: 0 - RowsRead: 9492896 - RowsReturned: 1017679 - RowsReturnedRate: 2290920 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 295 - ScannerThreadsTotalWallClockTime: 10463593250 - MaterializeTupleTime(*): 6042990237 - ScannerThreadsSysTime: 197966000 - ScannerThreadsUserTime: 3734429000 - ScannerThreadsVoluntaryContextSwitches: 1020 - TotalRawHdfsReadTime(*): 140568260 - TotalReadThroughput: 5467371 - TotalTime: 444222824 Instance f74cea27cca1cc70:12e354ae50158f27 (host=demeter-csmau10-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/98.97 MB 20:1/98.98 MB 7:1/98.80 MB 16:1/98.94 MB 15:1/98.57 MB 6:1/98.30 MB 4:1/98.13 MB 2:1/98.39 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.1818181818181817 - InactiveTotalTime: 0 - PeakMemoryUsage: 186499024 - PerHostPeakMemUsage: 934593680 - PrepareTime: 166408 - RowsProduced: 1364649 - TotalCpuTime: 11114384511 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 2531591857 - TotalStorageWaitTime: 1402498255 - TotalTime: 5105168197 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1978047592 - InactiveTotalTime: 0 - NetworkThroughput(*): 21228827 - OverallThroughput: 405850939 - PeakMemoryUsage: 311296 - SerializeBatchTime: 503724865 - ThriftTransmitTime(*): 93177431274 - TotalTime: 4873827806 - UncompressedRowBatchSize: 4771218136 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 18:1/98.97 MB 20:1/98.98 MB 7:1/98.80 MB 16:1/98.94 MB 15:1/98.57 MB 6:1/98.30 MB 4:1/98.13 MB 2:1/98.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.1818181818181817 - BytesRead: 31353346 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31353346 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31353346 - DecompressionTime: 1803697294 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 186130384 - PerReadThreadRawHdfsThroughput: 423997183 - RemoteScanRanges: 0 - RowsRead: 10987882 - RowsReturned: 1364649 - RowsReturnedRate: 6274818 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 767 - ScannerThreadsTotalWallClockTime: 9895329292 - MaterializeTupleTime(*): 6630491946 - ScannerThreadsSysTime: 264956000 - ScannerThreadsUserTime: 4441320000 - ScannerThreadsVoluntaryContextSwitches: 1433 - TotalRawHdfsReadTime(*): 73947062 - TotalReadThroughput: 5700608 - TotalTime: 217480219 Instance f74cea27cca1cc70:12e354ae50158f01 (host=demeter-csmaz08-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/98.28 MB 5:1/98.58 MB 2:1/98.33 MB 23:1/98.54 MB 7:1/98.14 MB 21:1/98.42 MB 20:1/98.69 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.6363636363636362 - InactiveTotalTime: 0 - PeakMemoryUsage: 154944560 - PerHostPeakMemUsage: 977269600 - PrepareTime: 244788 - RowsProduced: 1339317 - TotalCpuTime: 8840092096 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 2914245662 - TotalStorageWaitTime: 2712915251 - TotalTime: 5322021939 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1662514668 - InactiveTotalTime: 0 - NetworkThroughput(*): 18772293 - OverallThroughput: 341810237 - PeakMemoryUsage: 311296 - SerializeBatchTime: 403166982 - ThriftTransmitTime(*): 88562148881 - TotalTime: 4863852767 - UncompressedRowBatchSize: 4682649864 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/98.28 MB 5:1/98.58 MB 2:1/98.33 MB 23:1/98.54 MB 7:1/98.14 MB 21:1/98.42 MB 20:1/98.69 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.6363636363636365 - BytesRead: 26970210 - BytesReadDataNodeCache: 0 - BytesReadLocal: 26970210 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 26970210 - DecompressionTime: 998142150 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 154575920 - PerReadThreadRawHdfsThroughput: 601675791 - RemoteScanRanges: 0 - RowsRead: 9581961 - RowsReturned: 1339317 - RowsReturnedRate: 3029869 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 150 - ScannerThreadsTotalWallClockTime: 8840117968 - MaterializeTupleTime(*): 5079760338 - ScannerThreadsSysTime: 139975000 - ScannerThreadsUserTime: 2252655000 - ScannerThreadsVoluntaryContextSwitches: 2064 - TotalRawHdfsReadTime(*): 44825154 - TotalReadThroughput: 4903674 - TotalTime: 442037817 Instance f74cea27cca1cc70:12e354ae50158edb (host=demeter-csmau10-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/98.92 MB 2:1/98.90 MB 0:1/98.78 MB 1:1/99.07 MB 23:1/99.42 MB 21:1/98.72 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.727272727272727 - InactiveTotalTime: 0 - PeakMemoryUsage: 141411504 - PerHostPeakMemUsage: 979468296 - PrepareTime: 250794 - RowsProduced: 1357684 - TotalCpuTime: 10038202511 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 2936071653 - TotalStorageWaitTime: 1799828072 - TotalTime: 5372639256 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1970995400 - InactiveTotalTime: 0 - NetworkThroughput(*): 20865698 - OverallThroughput: 394013558 - PeakMemoryUsage: 311296 - SerializeBatchTime: 492299907 - ThriftTransmitTime(*): 94461031872 - TotalTime: 5002354255 - UncompressedRowBatchSize: 4746866368 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:1/98.92 MB 2:1/98.90 MB 0:1/98.78 MB 1:1/99.07 MB 23:1/99.42 MB 21:1/98.72 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.7272727272727273 - BytesRead: 23415477 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23415477 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23415477 - DecompressionTime: 1412637890 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 141042864 - PerReadThreadRawHdfsThroughput: 506146928 - RemoteScanRanges: 0 - RowsRead: 8129347 - RowsReturned: 1357684 - RowsReturnedRate: 3832907 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 103 - ScannerThreadsTotalWallClockTime: 9356774974 - MaterializeTupleTime(*): 6106711283 - ScannerThreadsSysTime: 167971000 - ScannerThreadsUserTime: 3456472000 - ScannerThreadsVoluntaryContextSwitches: 1366 - TotalRawHdfsReadTime(*): 46262213 - TotalReadThroughput: 4257359 - TotalTime: 354217819 Instance f74cea27cca1cc70:12e354ae50158efc (host=demeter-csmaz08-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/98.68 MB 13:1/98.18 MB 16:1/98.61 MB 14:1/98.23 MB 11:1/98.25 MB 10:1/98.65 MB 5:1/98.87 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.2 - InactiveTotalTime: 0 - PeakMemoryUsage: 168228464 - PerHostPeakMemUsage: 168228464 - PrepareTime: 40920134 - RowsProduced: 1372240 - TotalCpuTime: 10809892021 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3174786010 - TotalStorageWaitTime: 2721463087 - TotalTime: 5417108516 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 2014715312 - InactiveTotalTime: 0 - NetworkThroughput(*): 20643460 - OverallThroughput: 409447248 - PeakMemoryUsage: 311296 - SerializeBatchTime: 497374354 - ThriftTransmitTime(*): 97595813334 - TotalTime: 4920573580 - UncompressedRowBatchSize: 4797758704 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 17:1/98.68 MB 13:1/98.18 MB 16:1/98.61 MB 14:1/98.23 MB 11:1/98.25 MB 10:1/98.65 MB 5:1/98.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.2 - BytesRead: 27476180 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27476180 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27476180 - DecompressionTime: 1655140348 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 167859824 - PerReadThreadRawHdfsThroughput: 581790097 - RemoteScanRanges: 0 - RowsRead: 9647609 - RowsReturned: 1372240 - RowsReturnedRate: 2847443 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 114 - ScannerThreadsTotalWallClockTime: 10809917003 - MaterializeTupleTime(*): 6373187743 - ScannerThreadsSysTime: 161972000 - ScannerThreadsUserTime: 3929400000 - ScannerThreadsVoluntaryContextSwitches: 1389 - TotalRawHdfsReadTime(*): 47226964 - TotalReadThroughput: 5495236 - TotalTime: 481920010 Instance f74cea27cca1cc70:12e354ae50158efd (host=demeter-csmau08-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/99.14 MB 14:1/99.19 MB 11:1/98.52 MB 13:1/98.79 MB 9:1/98.17 MB 6:1/99.34 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.8181818181818183 - InactiveTotalTime: 0 - PeakMemoryUsage: 135930448 - PerHostPeakMemUsage: 996476624 - PrepareTime: 266883 - RowsProduced: 1358596 - TotalCpuTime: 10647736914 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3147392209 - TotalStorageWaitTime: 1822769256 - TotalTime: 5482532401 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1959101856 - InactiveTotalTime: 0 - NetworkThroughput(*): 20846071 - OverallThroughput: 383502578 - PeakMemoryUsage: 311296 - SerializeBatchTime: 472104522 - ThriftTransmitTime(*): 93979425734 - TotalTime: 5108445063 - UncompressedRowBatchSize: 4750055024 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 17:1/99.14 MB 14:1/99.19 MB 11:1/98.52 MB 13:1/98.79 MB 9:1/98.17 MB 6:1/99.34 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.8181818181818181 - BytesRead: 23501279 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23501279 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23501279 - DecompressionTime: 1619455829 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 135561808 - PerReadThreadRawHdfsThroughput: 604596872 - RemoteScanRanges: 0 - RowsRead: 8200416 - RowsReturned: 1358596 - RowsReturnedRate: 3793476 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 565 - ScannerThreadsTotalWallClockTime: 10096822762 - MaterializeTupleTime(*): 6618862490 - ScannerThreadsSysTime: 422933000 - ScannerThreadsUserTime: 3685437000 - ScannerThreadsVoluntaryContextSwitches: 1356 - TotalRawHdfsReadTime(*): 38870990 - TotalReadThroughput: 4272959 - TotalTime: 358140116 Instance f74cea27cca1cc70:12e354ae50158edf (host=demeter-csmaz08-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/99.49 MB 17:1/99.15 MB 18:1/98.87 MB 12:1/99.09 MB 8:1/98.44 MB 5:1/98.69 MB 4:1/98.83 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 159763392 - PerHostPeakMemUsage: 1003369328 - PrepareTime: 274756 - RowsProduced: 1338023 - TotalCpuTime: 11213119617 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3305199447 - TotalStorageWaitTime: 2432053910 - TotalTime: 5560348195 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1676151728 - InactiveTotalTime: 0 - NetworkThroughput(*): 17567937 - OverallThroughput: 333400278 - PeakMemoryUsage: 311296 - SerializeBatchTime: 385944094 - ThriftTransmitTime(*): 95409706399 - TotalTime: 5027445500 - UncompressedRowBatchSize: 4678125736 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 19:1/99.49 MB 17:1/99.15 MB 18:1/98.87 MB 12:1/99.09 MB 8:1/98.44 MB 5:1/98.69 MB 4:1/98.83 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 27385791 - BytesReadDataNodeCache: 0 - BytesReadLocal: 27385791 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 27385791 - DecompressionTime: 1853116450 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 159394752 - PerReadThreadRawHdfsThroughput: 251337737 - RemoteScanRanges: 0 - RowsRead: 9539395 - RowsReturned: 1338023 - RowsReturnedRate: 2586798 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 329 - ScannerThreadsTotalWallClockTime: 11213171756 - MaterializeTupleTime(*): 6838251838 - ScannerThreadsSysTime: 331946000 - ScannerThreadsUserTime: 4319340000 - ScannerThreadsVoluntaryContextSwitches: 1722 - TotalRawHdfsReadTime(*): 108960124 - TotalReadThroughput: 4979234 - TotalTime: 517250669 Instance f74cea27cca1cc70:12e354ae50158ee8 (host=demeter-csmau10-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/98.17 MB 2:1/98.54 MB 5:1/99.33 MB 0:1/98.32 MB 7:1/99.25 MB 20:1/98.49 MB 17:1/99.35 MB 16:1/98.73 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 182895232 - PerHostPeakMemUsage: 1008789912 - PrepareTime: 259017 - RowsProduced: 1347124 - TotalCpuTime: 13054820483 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 2967960279 - TotalStorageWaitTime: 2824354761 - TotalTime: 5596953891 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1871545296 - InactiveTotalTime: 0 - NetworkThroughput(*): 20352973 - OverallThroughput: 358921235 - PeakMemoryUsage: 311296 - SerializeBatchTime: 473014815 - ThriftTransmitTime(*): 91954390042 - TotalTime: 5214362121 - UncompressedRowBatchSize: 4709945568 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/98.17 MB 2:1/98.54 MB 5:1/99.33 MB 0:1/98.32 MB 7:1/99.25 MB 20:1/98.49 MB 17:1/99.35 MB 16:1/98.73 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 31310547 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31310547 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31310547 - DecompressionTime: 2110517628 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 7 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 182526592 - PerReadThreadRawHdfsThroughput: 394213795 - RemoteScanRanges: 0 - RowsRead: 10935451 - RowsReturned: 1347124 - RowsReturnedRate: 3692407 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 1859 - ScannerThreadsTotalWallClockTime: 13054851224 - MaterializeTupleTime(*): 8066535010 - ScannerThreadsSysTime: 712887000 - ScannerThreadsUserTime: 5079225000 - ScannerThreadsVoluntaryContextSwitches: 1462 - TotalRawHdfsReadTime(*): 79425295 - TotalReadThroughput: 5692826 - TotalTime: 364836258 Instance f74cea27cca1cc70:12e354ae50158ef2 (host=demeter-csmau10-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/99.52 MB 14:1/99.36 MB 10:1/98.69 MB 20:1/98.62 MB 7:1/98.77 MB 6:1/99.12 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.8333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 129212304 - PerHostPeakMemUsage: 1020340464 - PrepareTime: 235614 - RowsProduced: 1342850 - TotalCpuTime: 10432617370 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3353685449 - TotalStorageWaitTime: 1943454033 - TotalTime: 5759119349 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1867094888 - InactiveTotalTime: 0 - NetworkThroughput(*): 15736164 - OverallThroughput: 347394859 - PeakMemoryUsage: 311296 - SerializeBatchTime: 394659071 - ThriftTransmitTime(*): 118649930826 - TotalTime: 5374561076 - UncompressedRowBatchSize: 4695002448 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 22:1/99.52 MB 14:1/99.36 MB 10:1/98.69 MB 20:1/98.62 MB 7:1/98.77 MB 6:1/99.12 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.8333333333333333 - BytesRead: 23446946 - BytesReadDataNodeCache: 0 - BytesReadLocal: 23446946 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 23446946 - DecompressionTime: 1304050311 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 128843664 - PerReadThreadRawHdfsThroughput: 633334268 - RemoteScanRanges: 0 - RowsRead: 8151488 - RowsReturned: 1342850 - RowsReturnedRate: 3655376 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 256 - ScannerThreadsTotalWallClockTime: 9933415396 - MaterializeTupleTime(*): 6645696462 - ScannerThreadsSysTime: 256958000 - ScannerThreadsUserTime: 3235505000 - ScannerThreadsVoluntaryContextSwitches: 1358 - TotalRawHdfsReadTime(*): 37021439 - TotalReadThroughput: 3907824 - TotalTime: 367362967 Instance f74cea27cca1cc70:12e354ae50158f23 (host=demeter-csmau08-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/98.59 MB 3:1/99.25 MB 18:1/98.70 MB 13:1/98.42 MB 7:1/98.50 MB 22:1/98.78 MB 5:1/99.12 MB 0:1/98.79 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 181093712 - PerHostPeakMemUsage: 1029310704 - PrepareTime: 259821 - RowsProduced: 1354946 - TotalCpuTime: 12860202493 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 3000032990 - TotalStorageWaitTime: 3270708511 - TotalTime: 5793344715 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 1737146516 - InactiveTotalTime: 0 - NetworkThroughput(*): 19026308 - OverallThroughput: 328828017 - PeakMemoryUsage: 311296 - SerializeBatchTime: 405144382 - ThriftTransmitTime(*): 91302341406 - TotalTime: 5282842166 - UncompressedRowBatchSize: 4737293712 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/98.59 MB 3:1/99.25 MB 18:1/98.70 MB 13:1/98.42 MB 7:1/98.50 MB 22:1/98.78 MB 5:1/99.12 MB 0:1/98.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.5 - BytesRead: 31347732 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31347732 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31347732 - DecompressionTime: 1981124183 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 180725072 - PerReadThreadRawHdfsThroughput: 237471396 - RemoteScanRanges: 0 - RowsRead: 10957686 - RowsReturned: 1354946 - RowsReturnedRate: 2739400 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 942 - ScannerThreadsTotalWallClockTime: 12860237032 - MaterializeTupleTime(*): 7532384157 - ScannerThreadsSysTime: 553911000 - ScannerThreadsUserTime: 4582299000 - ScannerThreadsVoluntaryContextSwitches: 2038 - TotalRawHdfsReadTime(*): 132006349 - TotalReadThroughput: 5224622 - TotalTime: 494614056 Instance f74cea27cca1cc70:12e354ae50158f0b (host=demeter-csmau08-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/99.16 MB 19:1/99.01 MB 22:1/98.11 MB 18:1/98.46 MB 16:1/98.90 MB 17:1/98.28 MB 9:1/98.55 MB 12:1/98.31 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.230769230769231 - InactiveTotalTime: 0 - PeakMemoryUsage: 193678640 - PerHostPeakMemUsage: 1131659152 - PrepareTime: 274265 - RowsProduced: 0 - TotalCpuTime: 11108510385 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 30947 - TotalStorageWaitTime: 3136844497 - TotalTime: 1160548295 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 124240 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/99.16 MB 19:1/99.01 MB 22:1/98.11 MB 18:1/98.46 MB 16:1/98.90 MB 17:1/98.28 MB 9:1/98.55 MB 12:1/98.31 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/GZIP:24 ExecOption: Codegen enabled: 0 out of 8 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 8.0 - BytesRead: 31572488 - BytesReadDataNodeCache: 0 - BytesReadLocal: 31572488 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31572488 - DecompressionTime: 1901997643 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 8 - NumScannerThreadsStarted: 8 - PeakMemoryUsage: 193359152 - PerReadThreadRawHdfsThroughput: 213974260 - RemoteScanRanges: 0 - RowsRead: 11004559 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 8 - ScannerThreadsInvoluntaryContextSwitches: 83 - ScannerThreadsTotalWallClockTime: 7977280464 - MaterializeTupleTime(*): 2920060984 - ScannerThreadsSysTime: 164968000 - ScannerThreadsUserTime: 4653288000 - ScannerThreadsVoluntaryContextSwitches: 304 - TotalRawHdfsReadTime(*): 147552738 - TotalReadThroughput: 31572488 - TotalTime: 1150417954