Query (id=6443fe8dab371686:258cc1eb13c0aea8) Summary Session ID: 72442781581a46be:7a588167507bfd94 Session Type: BEESWAX Start Time: 2015-05-13 14:15:03.416549000 End Time: 2015-05-13 14:15:10.541849000 Query Type: QUERY Query State: EXCEPTION Query Status: Memory limit exceeded Impala Version: impalad version 2.2.0-cdh5 RELEASE (build 2ffd73a4255cefd521362ffe1cfb37463f67f75c) User: hodesi01 Connected User: hodesi01 Delegated User: Network Address: ::ffff:172.29.46.14:40902 Default Db: default Sql Statement: select STRAIGHT_JOIN count(*) from reference_genome ref JOIN [BROADCAST] flatbam_snappy bam ON ref.contig = concat('chr', bam.contig__contigname) where ref.contig = 'chr20' and bam.contig__contigname = '20' and ref.`position` between bam.`start` and bam.`end` Coordinator: demeter-csmau08-10.demeter.hpc.mssm.edu:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=617.32MB VCores=2 F02:PLAN FRAGMENT [UNPARTITIONED] 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=91 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] hosts=91 per-host-mem=unavailable tuple-ids=2 row-size=8B cardinality=1 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F02, EXCHANGE=05, UNPARTITIONED] 03:AGGREGATE | output: count(*) | hosts=91 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ref.contig = concat('chr', bam.contig__contigname) | other predicates: ref.position >= bam.start, ref.position <= bam.`end` | hosts=91 per-host-mem=353.32MB | tuple-ids=0,1 row-size=58B cardinality=34859198 | |--04:EXCHANGE [BROADCAST] | hosts=91 per-host-mem=0B | tuple-ids=1 row-size=33B cardinality=10079481 | 00:SCAN HDFS [default.reference_genome ref, RANDOM] partitions=1/1 files=91 size=12.63GB predicates: ref.contig = 'chr20' table stats: 3137327831 rows total column stats: all hosts=91 per-host-mem=176.00MB tuple-ids=0 row-size=25B cardinality=34859198 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=04, BROADCAST] 01:SCAN HDFS [default.flatbam_snappy bam, RANDOM] partitions=1/1 files=470 size=105.58GB predicates: bam.contig__contigname = '20' table stats: 856755914 rows total column stats: all hosts=91 per-host-mem=264.00MB tuple-ids=1 row-size=33B cardinality=10079481 ---------------- Estimated Per-Host Mem: 647303818 Estimated Per-Host VCores: 2 Admission result: Admitted immediately Request Pool: root.hodesi01 ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 380.70ms 380.70ms 0 1 4.00 KB -1.00 B FINALIZE 05:EXCHANGE 1 0ns 0ns 0 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 76 86.210ms 383.397ms 0 1 4.00 KB 10.00 MB 02:HASH JOIN 76 0ns 0ns 0 34.86M 282.59 MB 353.32 MB INNER JOIN, BROADCAST |--04:EXCHANGE 76 13.312ms 69.177ms 635.90K 10.08M 0 0 BROADCAST | 01:SCAN HDFS 91 289.249ms 1s003ms 0 10.08M 267.77 MB 264.00 MB default.flatbam_snappy bam 00:SCAN HDFS 76 204.676us 973.819us 0 34.86M 0 176.00 MB default.reference_genome ref Planner Timeline Analysis finished: 2687919 Equivalence classes computed: 2816344 Single node plan created: 6418141 Distributed plan created: 7936685 Lineage info computed: 8596700 Planning finished: 11242681 Query Timeline Start execution: 77346 Planning finished: 17531166 Submit for admission: 18423018 Completed admission: 18538077 Ready to start remote fragments: 401026337 Remote fragments started: 6720557564 Rows available: 7047107322 Unregister query: 7125265561 ImpalaServer - AsyncTotalTime: 0 - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile 6443fe8dab371686:258cc1eb13c0aea8 Fragment start latencies: count: 167, last: 2.649668ns, min: 0.005794ns, max: 2.649668ns, mean: 0.215364ns, stddev: 0.306077ns Per Node Peak Memory Usage: demeter-csmaz10-3.demeter.hpc.mssm.edu:22000(157.87 MB) demeter-csmaz11-20.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-2.demeter.hpc.mssm.edu:22000(217.21 MB) demeter-csmau10-18.demeter.hpc.mssm.edu:22000(0) demeter-csmaz11-2.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-7.demeter.hpc.mssm.edu:22000(178.70 MB) demeter-csmaz10-4.demeter.hpc.mssm.edu:22000(228.26 MB) demeter-csmau10-14.demeter.hpc.mssm.edu:22000(252.45 MB) demeter-csmaz08-20.demeter.hpc.mssm.edu:22000(495.18 MB) demeter-csmaz11-13.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-5.demeter.hpc.mssm.edu:22000(457.66 MB) demeter-csmaz10-8.demeter.hpc.mssm.edu:22000(456.15 MB) demeter-csmaz11-16.demeter.hpc.mssm.edu:22000(401.65 MB) demeter-csmaz08-15.demeter.hpc.mssm.edu:22000(434.01 MB) demeter-csmaz11-11.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-10.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-11.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-16.demeter.hpc.mssm.edu:22000(465.19 MB) demeter-csmaz10-14.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-8.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-13.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-1.demeter.hpc.mssm.edu:22000(455.32 MB) demeter-csmaz10-10.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-15.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-9.demeter.hpc.mssm.edu:22000(396.17 MB) demeter-csmau10-4.demeter.hpc.mssm.edu:22000(436.92 MB) demeter-csmau08-17.demeter.hpc.mssm.edu:22000(534.70 MB) demeter-csmau10-17.demeter.hpc.mssm.edu:22000(485.56 MB) demeter-csmaz10-12.demeter.hpc.mssm.edu:22000(0) demeter-csmau08-8.demeter.hpc.mssm.edu:22000(0) demeter-csmaz11-12.demeter.hpc.mssm.edu:22000(497.18 MB) demeter-csmaz11-1.demeter.hpc.mssm.edu:22000(474.84 MB) demeter-csmaz10-1.demeter.hpc.mssm.edu:22000(432.08 MB) demeter-csmaz11-17.demeter.hpc.mssm.edu:22000(488.65 MB) demeter-csmaz08-18.demeter.hpc.mssm.edu:22000(529.35 MB) demeter-csmau08-1.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-17.demeter.hpc.mssm.edu:22000(425.95 MB) demeter-csmaz11-6.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-17.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-20.demeter.hpc.mssm.edu:22000(0) demeter-csmaz11-10.demeter.hpc.mssm.edu:22000(488.59 MB) demeter-csmau08-9.demeter.hpc.mssm.edu:22000(447.17 MB) demeter-csmau08-7.demeter.hpc.mssm.edu:22000(0) demeter-csmaz11-14.demeter.hpc.mssm.edu:22000(502.33 MB) demeter-csmau08-3.demeter.hpc.mssm.edu:22000(0) demeter-csmaz11-18.demeter.hpc.mssm.edu:22000(412.99 MB) demeter-csmau08-11.demeter.hpc.mssm.edu:22000(0) demeter-csmau08-5.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-12.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-19.demeter.hpc.mssm.edu:22000(483.27 MB) demeter-csmaz08-14.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-19.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-5.demeter.hpc.mssm.edu:22000(535.35 MB) demeter-csmaz08-19.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-6.demeter.hpc.mssm.edu:22000(537.60 MB) demeter-csmau08-14.demeter.hpc.mssm.edu:22000(444.36 MB) demeter-csmaz11-15.demeter.hpc.mssm.edu:22000(481.11 MB) demeter-csmaz11-5.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-13.demeter.hpc.mssm.edu:22000(465.83 MB) demeter-csmau08-19.demeter.hpc.mssm.edu:22000(0) demeter-csmau08-16.demeter.hpc.mssm.edu:22000(477.15 MB) demeter-csmau08-2.demeter.hpc.mssm.edu:22000(420.69 MB) demeter-csmau08-12.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-20.demeter.hpc.mssm.edu:22000(469.44 MB) demeter-csmaz10-13.demeter.hpc.mssm.edu:22000(0) demeter-csmau08-18.demeter.hpc.mssm.edu:22000(0) demeter-csmau08-15.demeter.hpc.mssm.edu:22000(491.40 MB) demeter-csmau10-11.demeter.hpc.mssm.edu:22000(490.88 MB) demeter-csmaz11-3.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-12.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-2.demeter.hpc.mssm.edu:22000(177.32 MB) demeter-csmaz11-8.demeter.hpc.mssm.edu:22000(480.84 MB) demeter-csmaz08-3.demeter.hpc.mssm.edu:22000(212.50 MB) demeter-csmau10-16.demeter.hpc.mssm.edu:22000(437.91 MB) demeter-csmaz08-16.demeter.hpc.mssm.edu:22000(0) demeter-csmaz10-15.demeter.hpc.mssm.edu:22000(495.42 MB) demeter-csmaz08-8.demeter.hpc.mssm.edu:22000(492.88 MB) demeter-csmau10-10.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-5.demeter.hpc.mssm.edu:22000(479.30 MB) demeter-csmau08-13.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-7.demeter.hpc.mssm.edu:22000(0) demeter-csmau10-3.demeter.hpc.mssm.edu:22000(464.92 MB) demeter-csmaz11-4.demeter.hpc.mssm.edu:22000(485.28 MB) demeter-csmau10-6.demeter.hpc.mssm.edu:22000(178.29 MB) demeter-csmaz11-7.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-1.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-2.demeter.hpc.mssm.edu:22000(0) demeter-csmaz08-6.demeter.hpc.mssm.edu:22000(0) demeter-csmau08-20.demeter.hpc.mssm.edu:22000(482.92 MB) demeter-csmaz08-4.demeter.hpc.mssm.edu:22000(517.96 MB) demeter-csmau08-10.demeter.hpc.mssm.edu:22000(0) - AsyncTotalTime: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 7026288965 Coordinator Fragment F02 - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12288 - PerHostPeakMemUsage: 0 - PrepareTime: 380072663 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 2793 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 380440847 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 982523 - CompileTime: 133551497 - InactiveTotalTime: 0 - LoadTime: 118081306 - ModuleFileSize: 2309684 - OptimizationTime: 189958179 - PrepareTime: 195589189 - TotalTime: 702685850 AGGREGATION_NODE (id=6) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 380083787 EXCHANGE_NODE (id=5) - AsyncTotalTime: 0 - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4440 Averaged Fragment F00 split sizes: min: 123.96 MB, max: 305.41 MB, avg: 170.22 MB, stddev: 52.21 MB completion times: min:4s431ms max:6s215ms mean: 5s546ms stddev:443.817594.817.593922ms execution rates: min:20.32 MB/sec max:61.18 MB/sec mean:30.94 MB/sec stddev:9.96 MB/sec num instances: 76 - AsyncTotalTime: 0 - AverageThreadTokens: 1.8151515151515152 - InactiveTotalTime: 0 - PeakMemoryUsage: 296704568 - PerHostPeakMemUsage: 501211976 - PrepareTime: 376892141 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3909600598 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 89463935 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 67 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293135246 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 343881 - CompileTime: 117825906 - InactiveTotalTime: 0 - LoadTime: 127216 - ModuleFileSize: 2309684 - OptimizationTime: 497800108 - PrepareTime: 362291153 - TotalTime: 980577745 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 33390 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 376889701 HASH_JOIN_NODE (id=2) - AsyncTotalTime: 0 - BuildPartitionTime: 137539664 - BuildRows: 628280 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 476574 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 295852942 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 12888915 - UnpinTime: 4432 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11870571 - ConvertRowBatchTime: 22572663 - DeserializeRowBatchTimer: 76496248 - FirstBatchArrivalWaitTime: 865962918 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 628280 - RowsReturnedRate: 160562 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3934271714 HDFS_SCAN_NODE (id=0) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 864187 Averaged Fragment F01 split sizes: min: 728.19 MB, max: 1.42 GB, avg: 1.16 GB, stddev: 173.16 MB completion times: min:257.506ms max:4s366ms mean: 2s929ms stddev:702.451190.451.189984ms execution rates: min:189.70 MB/sec max:3.68 GB/sec mean:461.44 MB/sec stddev:370.88 MB/sec num instances: 91 - AsyncTotalTime: 0 - AverageThreadTokens: 3.866666666666667 - InactiveTotalTime: 0 - PeakMemoryUsage: 209867107 - PerHostPeakMemUsage: 436680854 - PrepareTime: 285216 - RowsProduced: 0 - TotalCpuTime: 3612398984 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28789 - TotalStorageWaitTime: 182053150 - TotalTime: 294095772 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 146884 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.1375 - AverageScannerThreadConcurrency: 4.0125 - BytesRead: 66258067 - BytesReadDataNodeCache: 0 - BytesReadLocal: 66258067 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 66258067 - DecompressionTime: 504655468 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 209547619 - PerReadThreadRawHdfsThroughput: 900326988 - RemoteScanRanges: 0 - RowsRead: 9272756 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 29 - ScannerThreadsTotalWallClockTime: 2827852325 - MaterializeTupleTime(*): 2099065324 - ScannerThreadsSysTime: 125878275 - ScannerThreadsUserTime: 2504341875 - ScannerThreadsVoluntaryContextSwitches: 62 - TotalRawHdfsReadTime(*): 82734400 - TotalReadThroughput: 102289773 - TotalTime: 658042824 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F00 Instance 6443fe8dab371686:258cc1eb13c0aeda (host=demeter-csmaz08-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 0:1/127.73 MB 1:1/125.74 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.7272727272727273 - InactiveTotalTime: 0 - PeakMemoryUsage: 297013248 - PerHostPeakMemUsage: 555066040 - PrepareTime: 396796249 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3730320837 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 397709148 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 357538 - CompileTime: 151613574 - InactiveTotalTime: 0 - LoadTime: 103509 - ModuleFileSize: 2309684 - OptimizationTime: 541284367 - PrepareTime: 381650400 - TotalTime: 1077253968 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 30647 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 396793909 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 143285937 - BuildRows: 629760 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 568578 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13396158 - UnpinTime: 2049 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11903435 - ConvertRowBatchTime: 23914075 - DeserializeRowBatchTimer: 76065326 - FirstBatchArrivalWaitTime: 547064482 - InactiveTotalTime: 3701976302 - PeakMemoryUsage: 0 - RowsReturned: 629760 - RowsReturnedRate: 167645 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3756504096 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:1/127.73 MB 1:1/125.74 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 875642 Instance 6443fe8dab371686:258cc1eb13c0aeec (host=demeter-csmaz10-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/153.12 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 297013248 - PerHostPeakMemUsage: 487784848 - PrepareTime: 394951174 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3475743926 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 395803890 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 384443 - CompileTime: 114398548 - InactiveTotalTime: 0 - LoadTime: 125519 - ModuleFileSize: 2309684 - OptimizationTime: 533371844 - PrepareTime: 379880044 - TotalTime: 1030336206 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 35544 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 394948794 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 144053752 - BuildRows: 629760 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 462752 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13350833 - UnpinTime: 2012 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11907260 - ConvertRowBatchTime: 22943423 - DeserializeRowBatchTimer: 80556744 - FirstBatchArrivalWaitTime: 295594827 - InactiveTotalTime: 3439783548 - PeakMemoryUsage: 0 - RowsReturned: 629760 - RowsReturnedRate: 179883 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3500928516 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/153.12 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 858554 Instance 6443fe8dab371686:258cc1eb13c0aee4 (host=demeter-csmau10-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/155.81 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 297013248 - PerHostPeakMemUsage: 458143704 - PrepareTime: 393917661 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3468233781 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 394824755 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 363782 - CompileTime: 116890127 - InactiveTotalTime: 0 - LoadTime: 107636 - ModuleFileSize: 2309684 - OptimizationTime: 537813944 - PrepareTime: 378783429 - TotalTime: 1036251493 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 30594 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 393915064 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 145364332 - BuildRows: 630784 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 578339 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13316969 - UnpinTime: 2141 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11917425 - ConvertRowBatchTime: 23572829 - DeserializeRowBatchTimer: 74402343 - FirstBatchArrivalWaitTime: 286128970 - InactiveTotalTime: 3439944240 - PeakMemoryUsage: 0 - RowsReturned: 630784 - RowsReturnedRate: 180534 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3493973240 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/155.81 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 868973 Instance 6443fe8dab371686:258cc1eb13c0aed2 (host=demeter-csmaz11-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/174.60 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 297166848 - PerHostPeakMemUsage: 526726352 - PrepareTime: 393384010 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3983346516 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 394220181 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 346271 - CompileTime: 128895782 - InactiveTotalTime: 0 - LoadTime: 146929 - ModuleFileSize: 2309684 - OptimizationTime: 524674283 - PrepareTime: 378423041 - TotalTime: 1034727152 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 34698 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 393381660 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 151136143 - BuildRows: 632832 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 486714 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13220345 - UnpinTime: 45155 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11948926 - ConvertRowBatchTime: 25487865 - DeserializeRowBatchTimer: 77251271 - FirstBatchArrivalWaitTime: 808250408 - InactiveTotalTime: 3952943535 - PeakMemoryUsage: 0 - RowsReturned: 632832 - RowsReturnedRate: 157771 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4011075891 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:1/174.60 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 879957 Instance 6443fe8dab371686:258cc1eb13c0aeb4 (host=demeter-csmaz08-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/157.81 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 297115648 - PerHostPeakMemUsage: 516823040 - PrepareTime: 392635180 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4105170642 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 393405226 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 372059 - CompileTime: 123407257 - InactiveTotalTime: 0 - LoadTime: 124979 - ModuleFileSize: 2309684 - OptimizationTime: 534852408 - PrepareTime: 377417476 - TotalTime: 1038337524 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 35827 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 392632537 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 156679906 - BuildRows: 627712 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 539795 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13497679 - UnpinTime: 2423 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11858554 - ConvertRowBatchTime: 24479072 - DeserializeRowBatchTimer: 76904357 - FirstBatchArrivalWaitTime: 1264197248 - InactiveTotalTime: 4074082847 - PeakMemoryUsage: 0 - RowsReturned: 627712 - RowsReturnedRate: 151920 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4131843071 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/157.81 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 872222 Instance 6443fe8dab371686:258cc1eb13c0aee2 (host=demeter-csmaz11-12.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/129.77 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 297064448 - PerHostPeakMemUsage: 521330336 - PrepareTime: 391270982 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3431135574 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 392167566 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 342277 - CompileTime: 151777672 - InactiveTotalTime: 0 - LoadTime: 142899 - ModuleFileSize: 2309684 - OptimizationTime: 541192670 - PrepareTime: 376163107 - TotalTime: 1071923928 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 34388 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 391268629 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 147168216 - BuildRows: 630784 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 503181 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13283916 - UnpinTime: 1954 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11918689 - ConvertRowBatchTime: 23527097 - DeserializeRowBatchTimer: 84870439 - FirstBatchArrivalWaitTime: 255602089 - InactiveTotalTime: 3387688556 - PeakMemoryUsage: 0 - RowsReturned: 630784 - RowsReturnedRate: 182472 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3456866173 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/129.77 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 895914 Instance 6443fe8dab371686:258cc1eb13c0aec8 (host=demeter-csmau08-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/128.83 MB 2:1/126.28 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 297072640 - PerHostPeakMemUsage: 441126968 - PrepareTime: 390396209 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3958963671 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 391338203 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 368013 - CompileTime: 150163813 - InactiveTotalTime: 0 - LoadTime: 159307 - ModuleFileSize: 2309684 - OptimizationTime: 531340228 - PrepareTime: 375113300 - TotalTime: 1059417357 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 33281 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 390393598 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 152737579 - BuildRows: 631808 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 486685 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13514422 - UnpinTime: 2097 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11934701 - ConvertRowBatchTime: 24634093 - DeserializeRowBatchTimer: 81072631 - FirstBatchArrivalWaitTime: 787172741 - InactiveTotalTime: 3928185039 - PeakMemoryUsage: 0 - RowsReturned: 631808 - RowsReturnedRate: 158511 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3985887839 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:1/128.83 MB 2:1/126.28 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 973819 Instance 6443fe8dab371686:258cc1eb13c0aecf (host=demeter-csmaz11-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/148.87 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 297064448 - PerHostPeakMemUsage: 433048280 - PrepareTime: 389929696 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4054444919 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 390902035 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 358536 - CompileTime: 60495157 - InactiveTotalTime: 0 - LoadTime: 123175 - ModuleFileSize: 2309684 - OptimizationTime: 523421389 - PrepareTime: 374721638 - TotalTime: 961467081 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 29687 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 389927080 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 153709669 - BuildRows: 630784 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 565315 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13361327 - UnpinTime: 2454 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11918576 - ConvertRowBatchTime: 25240210 - DeserializeRowBatchTimer: 77082129 - FirstBatchArrivalWaitTime: 884877970 - InactiveTotalTime: 4026396927 - PeakMemoryUsage: 0 - RowsReturned: 630784 - RowsReturnedRate: 154534 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4081841112 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 19:1/148.87 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 915973 Instance 6443fe8dab371686:258cc1eb13c0aec4 (host=demeter-csmaz11-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/126.92 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 296910848 - PerHostPeakMemUsage: 504483432 - PrepareTime: 389459358 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3858955358 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 390273269 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 351425 - CompileTime: 152000770 - InactiveTotalTime: 0 - LoadTime: 164736 - ModuleFileSize: 2309684 - OptimizationTime: 537022724 - PrepareTime: 374496842 - TotalTime: 1066362521 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 35377 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 389457181 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 144029447 - BuildRows: 624640 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 467676 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13029663 - UnpinTime: 1900 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11804182 - ConvertRowBatchTime: 23770954 - DeserializeRowBatchTimer: 81992165 - FirstBatchArrivalWaitTime: 1001186852 - InactiveTotalTime: 3821580101 - PeakMemoryUsage: 0 - RowsReturned: 624640 - RowsReturnedRate: 160787 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3884871734 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 15:1/126.92 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 843984 Instance 6443fe8dab371686:258cc1eb13c0aecb (host=demeter-csmau10-19.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/153.72 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 296910848 - PerHostPeakMemUsage: 506744232 - PrepareTime: 389327335 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3988719054 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 390158204 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 333038 - CompileTime: 129324233 - InactiveTotalTime: 0 - LoadTime: 124442 - ModuleFileSize: 2309684 - OptimizationTime: 526092454 - PrepareTime: 374395723 - TotalTime: 1032527881 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 36697 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 389324981 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 149663995 - BuildRows: 627712 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 476797 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13172575 - UnpinTime: 1933 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11861347 - ConvertRowBatchTime: 24256875 - DeserializeRowBatchTimer: 79834664 - FirstBatchArrivalWaitTime: 815350426 - InactiveTotalTime: 3952778705 - PeakMemoryUsage: 0 - RowsReturned: 627712 - RowsReturnedRate: 156330 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4015282629 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 11:1/153.72 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 880655 Instance 6443fe8dab371686:258cc1eb13c0aebd (host=demeter-csmau08-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/155.71 MB 7:1/149.69 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 297269248 - PerHostPeakMemUsage: 500325960 - PrepareTime: 389145924 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3891650102 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 390044843 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 354430 - CompileTime: 117524070 - InactiveTotalTime: 0 - LoadTime: 125810 - ModuleFileSize: 2309684 - OptimizationTime: 536648045 - PrepareTime: 373815831 - TotalTime: 1030740283 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 43305 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 389143457 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 149512419 - BuildRows: 631808 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 496822 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13628974 - UnpinTime: 2143 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11939130 - ConvertRowBatchTime: 24319699 - DeserializeRowBatchTimer: 76977817 - FirstBatchArrivalWaitTime: 1044008095 - InactiveTotalTime: 3858943690 - PeakMemoryUsage: 0 - RowsReturned: 631808 - RowsReturnedRate: 161251 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3918151432 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 8:1/155.71 MB 7:1/149.69 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 943864 Instance 6443fe8dab371686:258cc1eb13c0aeaa (host=demeter-csmaz08-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/126.52 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8181818181818181 - InactiveTotalTime: 0 - PeakMemoryUsage: 290680832 - PerHostPeakMemUsage: 543118480 - PrepareTime: 388688270 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3888044433 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 389614745 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 67 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 285212672 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 363378 - CompileTime: 128913042 - InactiveTotalTime: 0 - LoadTime: 113442 - ModuleFileSize: 2309684 - OptimizationTime: 528313601 - PrepareTime: 373458732 - TotalTime: 1033512666 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 30500 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 388685870 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 139091192 - BuildRows: 592896 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 523370 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 287930368 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13417277 - UnpinTime: 2361 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11202237 - ConvertRowBatchTime: 22845690 - DeserializeRowBatchTimer: 75002961 - FirstBatchArrivalWaitTime: 1375241701 - InactiveTotalTime: 3858311795 - PeakMemoryUsage: 0 - RowsReturned: 592896 - RowsReturnedRate: 151514 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3913117911 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:1/126.52 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 916185 Instance 6443fe8dab371686:258cc1eb13c0aedf (host=demeter-csmau10-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/121.78 MB 11:1/126.54 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 297218048 - PerHostPeakMemUsage: 509150376 - PrepareTime: 386062099 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3475238422 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 386900559 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 329919 - CompileTime: 129961060 - InactiveTotalTime: 0 - LoadTime: 147109 - ModuleFileSize: 2309684 - OptimizationTime: 528734546 - PrepareTime: 370986866 - TotalTime: 1032427297 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 29983 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 386059679 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 142851338 - BuildRows: 633856 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 472815 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13342939 - UnpinTime: 2011 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11970342 - ConvertRowBatchTime: 24038431 - DeserializeRowBatchTimer: 79998115 - FirstBatchArrivalWaitTime: 294237607 - InactiveTotalTime: 3440741225 - PeakMemoryUsage: 0 - RowsReturned: 633856 - RowsReturnedRate: 181024 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3501492302 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 9:1/121.78 MB 11:1/126.54 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 882170 Instance 6443fe8dab371686:258cc1eb13c0aec9 (host=demeter-csmau10-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/156.44 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 296962048 - PerHostPeakMemUsage: 487505088 - PrepareTime: 385603609 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4063640017 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 386452896 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 349165 - CompileTime: 60650513 - InactiveTotalTime: 0 - LoadTime: 102932 - ModuleFileSize: 2309684 - OptimizationTime: 535501117 - PrepareTime: 370510484 - TotalTime: 969376426 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 34317 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 385600952 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 139065073 - BuildRows: 628736 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 500582 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13405700 - UnpinTime: 2392 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11882398 - ConvertRowBatchTime: 24175321 - DeserializeRowBatchTimer: 79722661 - FirstBatchArrivalWaitTime: 881670817 - InactiveTotalTime: 4025250675 - PeakMemoryUsage: 0 - RowsReturned: 628736 - RowsReturnedRate: 153722 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4090060162 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 20:1/156.44 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 883098 Instance 6443fe8dab371686:258cc1eb13c0aead (host=demeter-csmaz11-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/129.26 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9090909090909092 - InactiveTotalTime: 0 - PeakMemoryUsage: 297269248 - PerHostPeakMemUsage: 508848816 - PrepareTime: 385325382 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4480614890 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 386192153 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 380311 - CompileTime: 62392300 - InactiveTotalTime: 0 - LoadTime: 119282 - ModuleFileSize: 2309684 - OptimizationTime: 231319325 - PrepareTime: 370239853 - TotalTime: 666633390 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 35180 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 385322069 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 153050654 - BuildRows: 631808 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 482324 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13364732 - UnpinTime: 2045 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11930371 - ConvertRowBatchTime: 23422718 - DeserializeRowBatchTimer: 79115807 - FirstBatchArrivalWaitTime: 1630127169 - InactiveTotalTime: 4451497129 - PeakMemoryUsage: 0 - RowsReturned: 631808 - RowsReturnedRate: 140206 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4506256138 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:1/129.26 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 937473 Instance 6443fe8dab371686:258cc1eb13c0aeb9 (host=demeter-csmaz11-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/126.90 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 297064448 - PerHostPeakMemUsage: 504200432 - PrepareTime: 378292408 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4148632184 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 379143434 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 346589 - CompileTime: 128405371 - InactiveTotalTime: 0 - LoadTime: 135425 - ModuleFileSize: 2309684 - OptimizationTime: 519380071 - PrepareTime: 363282631 - TotalTime: 1013928961 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 45381 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 378289912 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 137111335 - BuildRows: 627712 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 449738 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 13116603 - UnpinTime: 2403 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11859452 - ConvertRowBatchTime: 24471502 - DeserializeRowBatchTimer: 82522328 - FirstBatchArrivalWaitTime: 1285287912 - InactiveTotalTime: 4116042911 - PeakMemoryUsage: 0 - RowsReturned: 627712 - RowsReturnedRate: 150344 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4175170290 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 12:1/126.90 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 876583 Instance 6443fe8dab371686:258cc1eb13c0aeb3 (host=demeter-csmaz10-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/123.96 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.8 - InactiveTotalTime: 0 - PeakMemoryUsage: 297115648 - PerHostPeakMemUsage: 519480928 - PrepareTime: 362320241 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4251492748 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 363038885 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 318401 - CompileTime: 148410505 - InactiveTotalTime: 0 - LoadTime: 131402 - ModuleFileSize: 2309684 - OptimizationTime: 511890794 - PrepareTime: 348462753 - TotalTime: 1011277383 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 29294 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 362318261 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 54650367 - BuildRows: 629760 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 242984 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 12246788 - UnpinTime: 1178 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 11897410 - ConvertRowBatchTime: 9895201 - DeserializeRowBatchTimer: 77153323 - FirstBatchArrivalWaitTime: 1285927336 - InactiveTotalTime: 4217926589 - PeakMemoryUsage: 0 - RowsReturned: 629760 - RowsReturnedRate: 147736 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4262714545 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:1/123.96 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 821293 Instance 6443fe8dab371686:258cc1eb13c0aedc (host=demeter-csmaz11-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/152.07 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.9090909090909092 - InactiveTotalTime: 0 - PeakMemoryUsage: 296757248 - PerHostPeakMemUsage: 497908272 - PrepareTime: 186552763 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 4118463698 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 187069123 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 68 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 293601280 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - AsyncTotalTime: 0 - CodegenTime: 170300 - CompileTime: 65642519 - InactiveTotalTime: 0 - LoadTime: 91358 - ModuleFileSize: 2309684 - OptimizationTime: 237548149 - PrepareTime: 179438617 - TotalTime: 483897893 DataStreamSender (dst_id=5) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 16384 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 16323 - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3) ExecOption: Codegen Enabled - AsyncTotalTime: 0 - BuildTime: 0 - GetResultsTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 4096 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 186551000 HASH_JOIN_NODE (id=2) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - AsyncTotalTime: 0 - BuildPartitionTime: 72552607 - BuildRows: 635904 - BuildRowsPartitioned: 0 - BuildTime: 0 - GetNewBlockTime: 273867 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 296318976 - PinTime: 0 - ProbeRows: 0 - ProbeRowsPartitioned: 0 - ProbeTime: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 6333583 - UnpinTime: 1128 EXCHANGE_NODE (id=4) - AsyncTotalTime: 0 - BytesReceived: 12015849 - ConvertRowBatchTime: 11312884 - DeserializeRowBatchTimer: 36407383 - FirstBatchArrivalWaitTime: 845405891 - InactiveTotalTime: 4111033368 - PeakMemoryUsage: 0 - RowsReturned: 635904 - RowsReturnedRate: 153940 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 4130853784 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 21:1/152.07 MB - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 0 - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 429021 Instance 6443fe8dab371686:258cc1eb13c0aee5 (host=demeter-csmau10-1.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee3 (host=demeter-csmaz08-9.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee1 (host=demeter-csmau08-8.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee0 (host=demeter-csmaz10-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aede (host=demeter-csmau08-17.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aedd (host=demeter-csmaz10-1.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aedb (host=demeter-csmaz11-17.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed9 (host=demeter-csmau08-1.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed8 (host=demeter-csmaz11-6.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed7 (host=demeter-csmaz10-17.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed6 (host=demeter-csmaz10-20.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed5 (host=demeter-csmaz11-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed4 (host=demeter-csmau08-9.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed3 (host=demeter-csmau08-3.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee6 (host=demeter-csmaz10-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee7 (host=demeter-csmau10-15.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee8 (host=demeter-csmau08-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aee9 (host=demeter-csmau10-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeea (host=demeter-csmau10-8.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeeb (host=demeter-csmaz10-14.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeed (host=demeter-csmaz08-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeee (host=demeter-csmaz08-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeef (host=demeter-csmaz11-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef0 (host=demeter-csmaz08-15.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef1 (host=demeter-csmaz11-16.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef2 (host=demeter-csmaz10-8.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef3 (host=demeter-csmaz10-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef4 (host=demeter-csmaz11-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef5 (host=demeter-csmaz08-20.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeab (host=demeter-csmau08-20.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeac (host=demeter-csmaz11-7.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeae (host=demeter-csmaz08-7.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeaf (host=demeter-csmau10-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb0 (host=demeter-csmaz08-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb1 (host=demeter-csmaz08-16.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb2 (host=demeter-csmau08-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb5 (host=demeter-csmau10-16.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb6 (host=demeter-csmaz11-3.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb7 (host=demeter-csmau10-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeb8 (host=demeter-csmaz08-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeba (host=demeter-csmau08-15.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aebb (host=demeter-csmau10-20.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aebc (host=demeter-csmau08-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aebe (host=demeter-csmau08-18.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aebf (host=demeter-csmaz10-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec0 (host=demeter-csmaz08-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec1 (host=demeter-csmau08-19.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec2 (host=demeter-csmaz08-6.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec3 (host=demeter-csmaz11-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec5 (host=demeter-csmau08-14.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec6 (host=demeter-csmau10-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aec7 (host=demeter-csmaz10-6.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeca (host=demeter-csmaz10-19.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aecc (host=demeter-csmaz08-14.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aecd (host=demeter-csmau10-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aece (host=demeter-csmau08-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed0 (host=demeter-csmau08-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aed1 (host=demeter-csmau08-7.demeter.hpc.mssm.edu:22000) Fragment F01 Instance 6443fe8dab371686:258cc1eb13c0aefe (host=demeter-csmau08-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/242.43 MB 20:1/234.13 MB 12:1/242.94 MB 19:1/242.86 MB 10:1/242.75 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.333333333333333 - InactiveTotalTime: 0 - PeakMemoryUsage: 226804080 - PerHostPeakMemUsage: 506382704 - PrepareTime: 200360 - RowsProduced: 0 - TotalCpuTime: 5349516126 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 37160 - TotalStorageWaitTime: 193930934 - TotalTime: 1016395661 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 132125 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 13:1/242.43 MB 20:1/234.13 MB 12:1/242.94 MB 19:1/242.86 MB 10:1/242.75 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 67058714 - BytesReadDataNodeCache: 0 - BytesReadLocal: 67058714 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 67058714 - DecompressionTime: 521299816 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 226484592 - PerReadThreadRawHdfsThroughput: 607445473 - RemoteScanRanges: 0 - RowsRead: 9517028 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 11 - ScannerThreadsTotalWallClockTime: 4434273278 - MaterializeTupleTime(*): 3672396975 - ScannerThreadsSysTime: 156973000 - ScannerThreadsUserTime: 4079377000 - ScannerThreadsVoluntaryContextSwitches: 63 - TotalRawHdfsReadTime(*): 110394623 - TotalReadThroughput: 67058714 - TotalTime: 1003351482 Instance 6443fe8dab371686:258cc1eb13c0af3a (host=demeter-csmaz10-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 22:1/242.78 MB 0:1/233.74 MB 19:1/242.84 MB 17:1/242.72 MB 18:1/242.82 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.6666666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 165538408 - PerHostPeakMemUsage: 165538408 - PrepareTime: 243597 - RowsProduced: 0 - TotalCpuTime: 5495511104 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 41805 - TotalStorageWaitTime: 214325851 - TotalTime: 983396306 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 154288 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 22:1/242.78 MB 0:1/233.74 MB 19:1/242.84 MB 17:1/242.72 MB 18:1/242.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.5 - BytesRead: 68965186 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68965186 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68965186 - DecompressionTime: 1530639727 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 165218920 - PerReadThreadRawHdfsThroughput: 788753202 - RemoteScanRanges: 0 - RowsRead: 9582388 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 50 - ScannerThreadsTotalWallClockTime: 3943896995 - MaterializeTupleTime(*): 2160013768 - ScannerThreadsSysTime: 1034839000 - ScannerThreadsUserTime: 2299649000 - ScannerThreadsVoluntaryContextSwitches: 52 - TotalRawHdfsReadTime(*): 87435697 - TotalReadThroughput: 68965186 - TotalTime: 973830497 Instance 6443fe8dab371686:258cc1eb13c0af39 (host=demeter-csmau10-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/235.77 MB 0:1/242.81 MB 23:1/242.85 MB 19:1/242.80 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.6666666666666665 - InactiveTotalTime: 0 - PeakMemoryUsage: 171216232 - PerHostPeakMemUsage: 459183464 - PrepareTime: 332386 - RowsProduced: 0 - TotalCpuTime: 4508049747 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31866 - TotalStorageWaitTime: 180664631 - TotalTime: 919295603 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 165451 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/235.77 MB 0:1/242.81 MB 23:1/242.85 MB 19:1/242.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.5 - BytesRead: 55239450 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55239450 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55239450 - DecompressionTime: 436815487 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 170896744 - PerReadThreadRawHdfsThroughput: 679995758 - RemoteScanRanges: 0 - RowsRead: 7638588 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 9 - ScannerThreadsTotalWallClockTime: 2915606388 - MaterializeTupleTime(*): 2261976733 - ScannerThreadsSysTime: 82986000 - ScannerThreadsUserTime: 2649595000 - ScannerThreadsVoluntaryContextSwitches: 41 - TotalRawHdfsReadTime(*): 81234992 - TotalReadThroughput: 55239450 - TotalTime: 907193048 Instance 6443fe8dab371686:258cc1eb13c0af46 (host=demeter-csmaz08-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/242.92 MB 19:1/242.74 MB 6:1/235.02 MB 1:1/242.45 MB 23:1/242.46 MB 2:1/242.86 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 267098808 - PerHostPeakMemUsage: 555066040 - PrepareTime: 312714 - RowsProduced: 0 - TotalCpuTime: 5391926621 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27986 - TotalStorageWaitTime: 269988972 - TotalTime: 866318534 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 148096 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 4:1/242.92 MB 19:1/242.74 MB 6:1/235.02 MB 1:1/242.45 MB 23:1/242.46 MB 2:1/242.86 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.5 - BytesRead: 80826256 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80826256 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80826256 - DecompressionTime: 666455097 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 266779320 - PerReadThreadRawHdfsThroughput: 638507076 - RemoteScanRanges: 0 - RowsRead: 11505717 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 18 - ScannerThreadsTotalWallClockTime: 3892296651 - MaterializeTupleTime(*): 2894453987 - ScannerThreadsSysTime: 172971000 - ScannerThreadsUserTime: 3443475000 - ScannerThreadsVoluntaryContextSwitches: 73 - TotalRawHdfsReadTime(*): 126586312 - TotalReadThroughput: 80826256 - TotalTime: 854023309 Instance 6443fe8dab371686:258cc1eb13c0af42 (host=demeter-csmau08-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/242.66 MB 0:1/242.74 MB 22:1/242.71 MB 4:1/242.82 MB 7:1/234.52 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 227256672 - PerHostPeakMemUsage: 515275104 - PrepareTime: 470288 - RowsProduced: 0 - TotalCpuTime: 4161020196 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 25682 - TotalStorageWaitTime: 224763635 - TotalTime: 817585690 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 147549 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 3:1/242.66 MB 0:1/242.74 MB 22:1/242.71 MB 4:1/242.82 MB 7:1/234.52 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 68851915 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68851915 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68851915 - DecompressionTime: 585879874 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 226937184 - PerReadThreadRawHdfsThroughput: 697747806 - RemoteScanRanges: 0 - RowsRead: 9575923 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 27 - ScannerThreadsTotalWallClockTime: 3517040908 - MaterializeTupleTime(*): 2660557794 - ScannerThreadsSysTime: 132977000 - ScannerThreadsUserTime: 3152518000 - ScannerThreadsVoluntaryContextSwitches: 63 - TotalRawHdfsReadTime(*): 98677365 - TotalReadThroughput: 68851915 - TotalTime: 805198249 Instance 6443fe8dab371686:258cc1eb13c0af03 (host=demeter-csmau08-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 14:1/242.82 MB 18:1/243.06 MB 17:1/242.95 MB 20:1/242.81 MB 15:1/242.78 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 220747336 - PerHostPeakMemUsage: 500325960 - PrepareTime: 222313 - RowsProduced: 0 - TotalCpuTime: 4136573305 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 18474 - TotalStorageWaitTime: 201702861 - TotalTime: 806095976 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 145508 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 14:1/242.82 MB 18:1/243.06 MB 17:1/242.95 MB 20:1/242.81 MB 15:1/242.78 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 69402293 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69402293 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69402293 - DecompressionTime: 548335900 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 220427848 - PerReadThreadRawHdfsThroughput: 568116148 - RemoteScanRanges: 0 - RowsRead: 9642680 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 39 - ScannerThreadsTotalWallClockTime: 3375423309 - MaterializeTupleTime(*): 2578183148 - ScannerThreadsSysTime: 141976000 - ScannerThreadsUserTime: 3025538000 - ScannerThreadsVoluntaryContextSwitches: 64 - TotalRawHdfsReadTime(*): 122162155 - TotalReadThroughput: 69402293 - TotalTime: 793897932 Instance 6443fe8dab371686:258cc1eb13c0af38 (host=demeter-csmaz08-3.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/242.69 MB 10:1/242.83 MB 11:1/238.71 MB 2:1/242.76 MB 5:1/242.88 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 222826936 - PerHostPeakMemUsage: 222826936 - PrepareTime: 221510 - RowsProduced: 0 - TotalCpuTime: 3966830164 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29109 - TotalStorageWaitTime: 253280754 - TotalTime: 789230559 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 166949 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/242.69 MB 10:1/242.83 MB 11:1/238.71 MB 2:1/242.76 MB 5:1/242.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 68931251 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68931251 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68931251 - DecompressionTime: 524962183 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 222507448 - PerReadThreadRawHdfsThroughput: 585362616 - RemoteScanRanges: 0 - RowsRead: 9586911 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 13 - ScannerThreadsTotalWallClockTime: 3350101905 - MaterializeTupleTime(*): 2528721279 - ScannerThreadsSysTime: 98982000 - ScannerThreadsUserTime: 2993542000 - ScannerThreadsVoluntaryContextSwitches: 67 - TotalRawHdfsReadTime(*): 117758205 - TotalReadThroughput: 137862502 - TotalTime: 778621860 Instance 6443fe8dab371686:258cc1eb13c0af44 (host=demeter-csmau10-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 23:1/243.03 MB 9:1/234.27 MB 2:1/242.87 MB 5:1/242.68 MB 10:1/234.48 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 204276968 - PerHostPeakMemUsage: 492244200 - PrepareTime: 220606 - RowsProduced: 0 - TotalCpuTime: 2872003096 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27940 - TotalStorageWaitTime: 147633259 - TotalTime: 780785646 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 109838 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 23:1/243.03 MB 9:1/234.27 MB 2:1/242.87 MB 5:1/242.68 MB 10:1/234.48 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 68467248 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68467248 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68467248 - DecompressionTime: 331215698 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 203957480 - PerReadThreadRawHdfsThroughput: 1550537728 - RemoteScanRanges: 0 - RowsRead: 9511953 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 177 - ScannerThreadsTotalWallClockTime: 2144035761 - MaterializeTupleTime(*): 1636313006 - ScannerThreadsSysTime: 44990000 - ScannerThreadsUserTime: 1937703000 - ScannerThreadsVoluntaryContextSwitches: 57 - TotalRawHdfsReadTime(*): 44157099 - TotalReadThroughput: 68467248 - TotalTime: 774994047 Instance 6443fe8dab371686:258cc1eb13c0aefb (host=demeter-csmaz10-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/242.89 MB 4:1/242.95 MB 13:1/242.64 MB 6:1/242.97 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 173487056 - PerHostPeakMemUsage: 453065680 - PrepareTime: 198408 - RowsProduced: 0 - TotalCpuTime: 3682472360 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 35475 - TotalStorageWaitTime: 103664451 - TotalTime: 774136666 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 160845 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 10:1/242.89 MB 4:1/242.95 MB 13:1/242.64 MB 6:1/242.97 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 55433216 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55433216 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55433216 - DecompressionTime: 433808745 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 173167568 - PerReadThreadRawHdfsThroughput: 1015294674 - RemoteScanRanges: 0 - RowsRead: 7696731 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 12 - ScannerThreadsTotalWallClockTime: 2668006698 - MaterializeTupleTime(*): 2094197429 - ScannerThreadsSysTime: 99983000 - ScannerThreadsUserTime: 2459624000 - ScannerThreadsVoluntaryContextSwitches: 49 - TotalRawHdfsReadTime(*): 54598155 - TotalReadThroughput: 110866432 - TotalTime: 762496911 Instance 6443fe8dab371686:258cc1eb13c0af33 (host=demeter-csmaz10-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/242.66 MB 10:1/242.47 MB 11:1/243.12 MB 19:1/242.86 MB 15:1/242.45 MB 14:1/242.82 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 275749512 - PerHostPeakMemUsage: 563716744 - PrepareTime: 255027 - RowsProduced: 0 - TotalCpuTime: 4275854798 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29861 - TotalStorageWaitTime: 314854523 - TotalTime: 735686221 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 190453 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 13:1/242.66 MB 10:1/242.47 MB 11:1/243.12 MB 19:1/242.86 MB 15:1/242.45 MB 14:1/242.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 81459556 - BytesReadDataNodeCache: 0 - BytesReadLocal: 81459556 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81459556 - DecompressionTime: 650545108 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 275430024 - PerReadThreadRawHdfsThroughput: 499518758 - RemoteScanRanges: 0 - RowsRead: 11543766 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 3712082407 - MaterializeTupleTime(*): 2693538446 - ScannerThreadsSysTime: 134976000 - ScannerThreadsUserTime: 3256502000 - ScannerThreadsVoluntaryContextSwitches: 73 - TotalRawHdfsReadTime(*): 163076070 - TotalReadThroughput: 162919112 - TotalTime: 722612328 Instance 6443fe8dab371686:258cc1eb13c0af48 (host=demeter-csmaz11-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/242.67 MB 23:1/165.08 MB 22:1/164.47 MB 3:1/243.04 MB 4:1/242.79 MB 13:1/242.41 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 220881584 - PerHostPeakMemUsage: 508848816 - PrepareTime: 256809 - RowsProduced: 0 - TotalCpuTime: 4038578906 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27725 - TotalStorageWaitTime: 247850011 - TotalTime: 717376123 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 136875 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/242.67 MB 23:1/165.08 MB 22:1/164.47 MB 3:1/243.04 MB 4:1/242.79 MB 13:1/242.41 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 74528438 - BytesReadDataNodeCache: 0 - BytesReadLocal: 74528438 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74528438 - DecompressionTime: 575377983 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 220562096 - PerReadThreadRawHdfsThroughput: 770468530 - RemoteScanRanges: 0 - RowsRead: 10322580 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 37 - ScannerThreadsTotalWallClockTime: 3418826093 - MaterializeTupleTime(*): 2541340747 - ScannerThreadsSysTime: 113979000 - ScannerThreadsUserTime: 3045534000 - ScannerThreadsVoluntaryContextSwitches: 79 - TotalRawHdfsReadTime(*): 96731320 - TotalReadThroughput: 149056876 - TotalTime: 707260699 Instance 6443fe8dab371686:258cc1eb13c0af0d (host=demeter-csmau08-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 13:1/242.92 MB 15:1/242.92 MB 19:1/242.72 MB 22:1/63.11 MB 11:1/242.93 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186366544 - PerHostPeakMemUsage: 465945168 - PrepareTime: 370788 - RowsProduced: 0 - TotalCpuTime: 3976000311 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 47459 - TotalStorageWaitTime: 179822479 - TotalTime: 713697239 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 150438 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 13:1/242.92 MB 15:1/242.92 MB 19:1/242.72 MB 22:1/63.11 MB 11:1/242.93 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:50% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.5 - AverageScannerThreadConcurrency: 4.5 - BytesRead: 59402365 - BytesReadDataNodeCache: 0 - BytesReadLocal: 59402365 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59402365 - DecompressionTime: 500061184 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 186047056 - PerReadThreadRawHdfsThroughput: 655964979 - RemoteScanRanges: 0 - RowsRead: 8233733 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 53 - ScannerThreadsTotalWallClockTime: 2791271913 - MaterializeTupleTime(*): 2066134287 - ScannerThreadsSysTime: 121980000 - ScannerThreadsUserTime: 2486621000 - ScannerThreadsVoluntaryContextSwitches: 57 - TotalRawHdfsReadTime(*): 90557220 - TotalReadThroughput: 59402365 - TotalTime: 700163948 Instance 6443fe8dab371686:258cc1eb13c0af4f (host=demeter-csmaz08-13.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/237.35 MB 16:1/242.87 MB 7:1/242.66 MB 9:1/242.82 MB 10:1/242.97 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 200486656 - PerHostPeakMemUsage: 488453888 - PrepareTime: 403057 - RowsProduced: 0 - TotalCpuTime: 3044701342 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 26034 - TotalStorageWaitTime: 105435003 - TotalTime: 701121370 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 87082 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/237.35 MB 16:1/242.87 MB 7:1/242.66 MB 9:1/242.82 MB 10:1/242.97 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 68804721 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68804721 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68804721 - DecompressionTime: 321455333 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 200167168 - PerReadThreadRawHdfsThroughput: 1320486843 - RemoteScanRanges: 0 - RowsRead: 9572594 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 54 - ScannerThreadsTotalWallClockTime: 2003754305 - MaterializeTupleTime(*): 1550498956 - ScannerThreadsSysTime: 62988000 - ScannerThreadsUserTime: 1829720000 - ScannerThreadsVoluntaryContextSwitches: 73 - TotalRawHdfsReadTime(*): 52105571 - TotalReadThroughput: 137609442 - TotalTime: 694706324 Instance 6443fe8dab371686:258cc1eb13c0af4b (host=demeter-csmaz08-20.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 21:1/242.91 MB 23:1/234.35 MB 11:1/242.86 MB 16:1/242.51 MB 0:1/164.06 MB 22:1/63.67 MB 19:1/242.36 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 231267400 - PerHostPeakMemUsage: 519234632 - PrepareTime: 383403 - RowsProduced: 0 - TotalCpuTime: 4293637669 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 30302 - TotalStorageWaitTime: 296576277 - TotalTime: 674451722 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 145896 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 21:1/242.91 MB 23:1/234.35 MB 11:1/242.86 MB 16:1/242.51 MB 0:1/164.06 MB 22:1/63.67 MB 19:1/242.36 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:21 ExecOption: Codegen enabled: 0 out of 7 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 80634873 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80634873 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80634873 - DecompressionTime: 644080861 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 7 - PeakMemoryUsage: 230947912 - PerReadThreadRawHdfsThroughput: 927067629 - RemoteScanRanges: 0 - RowsRead: 11384102 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 7 - ScannerThreadsInvoluntaryContextSwitches: 24 - ScannerThreadsTotalWallClockTime: 3718778453 - MaterializeTupleTime(*): 2715235762 - ScannerThreadsSysTime: 122977000 - ScannerThreadsUserTime: 3290496000 - ScannerThreadsVoluntaryContextSwitches: 88 - TotalRawHdfsReadTime(*): 86978415 - TotalReadThroughput: 161269746 - TotalTime: 661119735 Instance 6443fe8dab371686:258cc1eb13c0af2d (host=demeter-csmaz10-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/242.35 MB 10:1/242.87 MB 11:1/243.01 MB 19:1/242.71 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 158674184 - PerHostPeakMemUsage: 446641416 - PrepareTime: 394920 - RowsProduced: 0 - TotalCpuTime: 2475239951 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 26292 - TotalStorageWaitTime: 94285184 - TotalTime: 663749570 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 93985 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 17:1/242.35 MB 10:1/242.87 MB 11:1/243.01 MB 19:1/242.71 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.5 - BytesRead: 53633173 - BytesReadDataNodeCache: 0 - BytesReadLocal: 53633173 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53633173 - DecompressionTime: 260651395 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 158354696 - PerReadThreadRawHdfsThroughput: 1587133192 - RemoteScanRanges: 0 - RowsRead: 7673930 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 56 - ScannerThreadsTotalWallClockTime: 1688328045 - MaterializeTupleTime(*): 1308715718 - ScannerThreadsSysTime: 47991000 - ScannerThreadsUserTime: 1540764000 - ScannerThreadsVoluntaryContextSwitches: 50 - TotalRawHdfsReadTime(*): 33792484 - TotalReadThroughput: 53633173 - TotalTime: 656835460 Instance 6443fe8dab371686:258cc1eb13c0af2f (host=demeter-csmaz08-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/234.44 MB 10:1/242.71 MB 6:1/242.68 MB 5:1/242.88 MB 0:1/243.02 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 228855808 - PerHostPeakMemUsage: 516823040 - PrepareTime: 365866 - RowsProduced: 0 - TotalCpuTime: 3756084356 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29233 - TotalStorageWaitTime: 223377855 - TotalTime: 663185256 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 147779 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/234.44 MB 10:1/242.71 MB 6:1/242.68 MB 5:1/242.88 MB 0:1/243.02 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 69073881 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69073881 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69073881 - DecompressionTime: 549181875 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 228536320 - PerReadThreadRawHdfsThroughput: 702747428 - RemoteScanRanges: 0 - RowsRead: 9557252 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 3105140561 - MaterializeTupleTime(*): 2285740171 - ScannerThreadsSysTime: 113980000 - ScannerThreadsUserTime: 2762577000 - ScannerThreadsVoluntaryContextSwitches: 61 - TotalRawHdfsReadTime(*): 98291190 - TotalReadThroughput: 138147762 - TotalTime: 651318466 Instance 6443fe8dab371686:258cc1eb13c0af4a (host=demeter-csmau10-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/242.94 MB 13:1/242.80 MB 7:1/242.69 MB 15:1/234.17 MB 6:1/242.72 MB 5:1/242.70 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 264715232 - PerHostPeakMemUsage: 264715232 - PrepareTime: 194875 - RowsProduced: 0 - TotalCpuTime: 3773118484 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 25007 - TotalStorageWaitTime: 166177417 - TotalTime: 657791878 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 133185 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/242.94 MB 13:1/242.80 MB 7:1/242.69 MB 15:1/234.17 MB 6:1/242.72 MB 5:1/242.70 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 2.0 - BytesRead: 82698912 - BytesReadDataNodeCache: 0 - BytesReadLocal: 82698912 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 82698912 - DecompressionTime: 415154694 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 264395744 - PerReadThreadRawHdfsThroughput: 1304560399 - RemoteScanRanges: 0 - RowsRead: 11440175 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 17 - ScannerThreadsTotalWallClockTime: 3074585949 - MaterializeTupleTime(*): 2460150649 - ScannerThreadsSysTime: 93983000 - ScannerThreadsUserTime: 2809570000 - ScannerThreadsVoluntaryContextSwitches: 78 - TotalRawHdfsReadTime(*): 63392168 - TotalReadThroughput: 165397824 - TotalTime: 652487097 Instance 6443fe8dab371686:258cc1eb13c0af24 (host=demeter-csmaz10-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 6:1/242.99 MB 5:1/242.87 MB 7:1/243.04 MB 12:1/242.88 MB 14:1/242.89 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 227761328 - PerHostPeakMemUsage: 227761328 - PrepareTime: 233521 - RowsProduced: 0 - TotalCpuTime: 3869996070 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 19114 - TotalStorageWaitTime: 189048072 - TotalTime: 654232428 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 170186 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 6:1/242.99 MB 5:1/242.87 MB 7:1/243.04 MB 12:1/242.88 MB 14:1/242.89 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.5 - BytesRead: 69548251 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69548251 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69548251 - DecompressionTime: 530223100 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 227441840 - PerReadThreadRawHdfsThroughput: 611927354 - RemoteScanRanges: 0 - RowsRead: 9704592 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 3049181247 - MaterializeTupleTime(*): 2284290517 - ScannerThreadsSysTime: 89984000 - ScannerThreadsUserTime: 2763577000 - ScannerThreadsVoluntaryContextSwitches: 69 - TotalRawHdfsReadTime(*): 113654424 - TotalReadThroughput: 69548251 - TotalTime: 643960484 Instance 6443fe8dab371686:258cc1eb13c0af4d (host=demeter-csmaz10-8.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 4:1/242.84 MB 20:1/242.83 MB 8:1/62.68 MB 3:1/242.67 MB 22:1/242.97 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 190341888 - PerHostPeakMemUsage: 478309120 - PrepareTime: 278867 - RowsProduced: 0 - TotalCpuTime: 3615084490 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29047 - TotalStorageWaitTime: 169680766 - TotalTime: 653241063 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 148125 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 4:1/242.84 MB 20:1/242.83 MB 8:1/62.68 MB 3:1/242.67 MB 22:1/242.97 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 59277682 - BytesReadDataNodeCache: 0 - BytesReadLocal: 59277682 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59277682 - DecompressionTime: 481881399 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 190022400 - PerReadThreadRawHdfsThroughput: 846834311 - RemoteScanRanges: 0 - RowsRead: 8220500 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 16 - ScannerThreadsTotalWallClockTime: 2650034361 - MaterializeTupleTime(*): 1952706367 - ScannerThreadsSysTime: 118980000 - ScannerThreadsUserTime: 2357639000 - ScannerThreadsVoluntaryContextSwitches: 54 - TotalRawHdfsReadTime(*): 69999150 - TotalReadThroughput: 59277682 - TotalTime: 639599216 Instance 6443fe8dab371686:258cc1eb13c0af04 (host=demeter-csmaz08-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/242.77 MB 11:1/242.91 MB 8:1/242.76 MB 14:1/242.43 MB 12:1/242.84 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 223007816 - PerHostPeakMemUsage: 502586440 - PrepareTime: 217807 - RowsProduced: 0 - TotalCpuTime: 3753713221 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 18316 - TotalStorageWaitTime: 183552881 - TotalTime: 646756507 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 143356 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 15:1/242.77 MB 11:1/242.91 MB 8:1/242.76 MB 14:1/242.43 MB 12:1/242.84 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 68468349 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68468349 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68468349 - DecompressionTime: 516501596 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 222688328 - PerReadThreadRawHdfsThroughput: 579861817 - RemoteScanRanges: 0 - RowsRead: 9591189 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 2 - ScannerThreadsTotalWallClockTime: 2972698853 - MaterializeTupleTime(*): 2223409726 - ScannerThreadsSysTime: 127977000 - ScannerThreadsUserTime: 2654593000 - ScannerThreadsVoluntaryContextSwitches: 60 - TotalRawHdfsReadTime(*): 118077009 - TotalReadThroughput: 68468349 - TotalTime: 634985292 Instance 6443fe8dab371686:258cc1eb13c0aefc (host=demeter-csmaz11-10.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 18:1/242.38 MB 20:1/242.57 MB 21:1/242.79 MB 16:1/242.70 MB 1:1/242.82 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 232749424 - PerHostPeakMemUsage: 512328048 - PrepareTime: 195815 - RowsProduced: 0 - TotalCpuTime: 3568573429 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29656 - TotalStorageWaitTime: 185924043 - TotalTime: 645023324 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 161130 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 18:1/242.38 MB 20:1/242.57 MB 21:1/242.79 MB 16:1/242.70 MB 1:1/242.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 66906010 - BytesReadDataNodeCache: 0 - BytesReadLocal: 66906010 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 66906010 - DecompressionTime: 563755742 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 232429936 - PerReadThreadRawHdfsThroughput: 638280600 - RemoteScanRanges: 0 - RowsRead: 9561527 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 5 - ScannerThreadsTotalWallClockTime: 3019724951 - MaterializeTupleTime(*): 2224913036 - ScannerThreadsSysTime: 155974000 - ScannerThreadsUserTime: 2672592000 - ScannerThreadsVoluntaryContextSwitches: 64 - TotalRawHdfsReadTime(*): 104822252 - TotalReadThroughput: 133812020 - TotalTime: 634058651 Instance 6443fe8dab371686:258cc1eb13c0aef7 (host=demeter-csmaz08-9.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 10:1/65.19 MB 7:1/242.48 MB 4:1/242.34 MB 11:1/242.87 MB 9:1/242.77 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 144221672 - PerHostPeakMemUsage: 415411688 - PrepareTime: 246207 - RowsProduced: 0 - TotalCpuTime: 3257718848 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 29110 - TotalStorageWaitTime: 109962273 - TotalTime: 638945364 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 155033 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 10:1/65.19 MB 7:1/242.48 MB 4:1/242.34 MB 11:1/242.87 MB 9:1/242.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 55921565 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55921565 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55921565 - DecompressionTime: 382263132 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 143902184 - PerReadThreadRawHdfsThroughput: 1142578181 - RemoteScanRanges: 0 - RowsRead: 8247086 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 2259549089 - MaterializeTupleTime(*): 1723852332 - ScannerThreadsSysTime: 80985000 - ScannerThreadsUserTime: 2063685000 - ScannerThreadsVoluntaryContextSwitches: 60 - TotalRawHdfsReadTime(*): 48943316 - TotalReadThroughput: 111843130 - TotalTime: 627187749 Instance 6443fe8dab371686:258cc1eb13c0af13 (host=demeter-csmaz11-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 16:1/64.37 MB 6:1/242.65 MB 7:1/242.97 MB 2:1/242.89 MB 17:1/233.89 MB 14:1/242.86 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 232808904 - PerHostPeakMemUsage: 512387528 - PrepareTime: 250702 - RowsProduced: 0 - TotalCpuTime: 3720741912 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28745 - TotalStorageWaitTime: 219712555 - TotalTime: 635371033 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 176160 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 16:1/64.37 MB 6:1/242.65 MB 7:1/242.97 MB 2:1/242.89 MB 17:1/233.89 MB 14:1/242.86 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 72738435 - BytesReadDataNodeCache: 0 - BytesReadLocal: 72738435 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 72738435 - DecompressionTime: 593049794 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 232489416 - PerReadThreadRawHdfsThroughput: 829301281 - RemoteScanRanges: 0 - RowsRead: 10085001 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 13 - ScannerThreadsTotalWallClockTime: 3205811835 - MaterializeTupleTime(*): 2333747922 - ScannerThreadsSysTime: 132976000 - ScannerThreadsUserTime: 2842567000 - ScannerThreadsVoluntaryContextSwitches: 74 - TotalRawHdfsReadTime(*): 87710506 - TotalReadThroughput: 145476870 - TotalTime: 622497602 Instance 6443fe8dab371686:258cc1eb13c0af34 (host=demeter-csmau10-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 17:1/242.66 MB 2:1/242.26 MB 5:1/242.49 MB 19:1/242.98 MB 20:1/242.51 MB 4:1/234.85 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 273390248 - PerHostPeakMemUsage: 561357480 - PrepareTime: 495667 - RowsProduced: 0 - TotalCpuTime: 4239265287 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 24498 - TotalStorageWaitTime: 300240131 - TotalTime: 634213272 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 144551 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 17:1/242.66 MB 2:1/242.26 MB 5:1/242.49 MB 19:1/242.98 MB 20:1/242.51 MB 4:1/234.85 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 79582732 - BytesReadDataNodeCache: 0 - BytesReadLocal: 79582732 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 79582732 - DecompressionTime: 654495798 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 273070760 - PerReadThreadRawHdfsThroughput: 705468013 - RemoteScanRanges: 0 - RowsRead: 11379455 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 3657139082 - MaterializeTupleTime(*): 2648915339 - ScannerThreadsSysTime: 157973000 - ScannerThreadsUserTime: 3194511000 - ScannerThreadsVoluntaryContextSwitches: 77 - TotalRawHdfsReadTime(*): 112808420 - TotalReadThroughput: 159165464 - TotalTime: 621662707 Instance 6443fe8dab371686:258cc1eb13c0af30 (host=demeter-csmaz10-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 16:1/242.38 MB 2:1/242.79 MB 3:1/234.32 MB 22:1/242.90 MB 19:1/242.73 MB 14:1/243.12 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 231513696 - PerHostPeakMemUsage: 519480928 - PrepareTime: 411928 - RowsProduced: 0 - TotalCpuTime: 3767874998 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 28933 - TotalStorageWaitTime: 242069902 - TotalTime: 632700515 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 132943 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 16:1/242.38 MB 2:1/242.79 MB 3:1/234.32 MB 22:1/242.90 MB 19:1/242.73 MB 14:1/243.12 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 82689848 - BytesReadDataNodeCache: 0 - BytesReadLocal: 82689848 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 82689848 - DecompressionTime: 487499044 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 231194208 - PerReadThreadRawHdfsThroughput: 1181292638 - RemoteScanRanges: 0 - RowsRead: 11485917 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 3143234909 - MaterializeTupleTime(*): 2370281052 - ScannerThreadsSysTime: 7995000 - ScannerThreadsUserTime: 2887558000 - ScannerThreadsVoluntaryContextSwitches: 69 - TotalRawHdfsReadTime(*): 69999461 - TotalReadThroughput: 82689848 - TotalTime: 619314157 Instance 6443fe8dab371686:258cc1eb13c0af16 (host=demeter-csmau10-11.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 8:1/242.78 MB 6:1/242.89 MB 12:1/233.98 MB 2:1/242.42 MB 0:1/242.88 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 235147312 - PerHostPeakMemUsage: 514725936 - PrepareTime: 371154 - RowsProduced: 0 - TotalCpuTime: 3499774727 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31025 - TotalStorageWaitTime: 211413110 - TotalTime: 627933258 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 162713 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 8:1/242.78 MB 6:1/242.89 MB 12:1/233.98 MB 2:1/242.42 MB 0:1/242.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 68284840 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68284840 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68284840 - DecompressionTime: 577366313 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 234827824 - PerReadThreadRawHdfsThroughput: 790327036 - RemoteScanRanges: 0 - RowsRead: 9561891 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 15 - ScannerThreadsTotalWallClockTime: 2987247520 - MaterializeTupleTime(*): 2153371117 - ScannerThreadsSysTime: 145976000 - ScannerThreadsUserTime: 2625598000 - ScannerThreadsVoluntaryContextSwitches: 61 - TotalRawHdfsReadTime(*): 86400739 - TotalReadThroughput: 136569680 - TotalTime: 612585479 Instance 6443fe8dab371686:258cc1eb13c0af01 (host=demeter-csmaz11-16.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/242.44 MB 10:1/242.86 MB 11:1/242.89 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 141477968 - PerHostPeakMemUsage: 421158992 - PrepareTime: 212604 - RowsProduced: 0 - TotalCpuTime: 3008922417 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31525 - TotalStorageWaitTime: 85830135 - TotalTime: 627015803 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 156853 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 15:1/242.44 MB 10:1/242.86 MB 11:1/242.89 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:9 ExecOption: Codegen enabled: 0 out of 3 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 40715056 - BytesReadDataNodeCache: 0 - BytesReadLocal: 40715056 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 40715056 - DecompressionTime: 345211629 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 3 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 141158480 - PerReadThreadRawHdfsThroughput: 900732112 - RemoteScanRanges: 0 - RowsRead: 5787795 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3 - ScannerThreadsInvoluntaryContextSwitches: 8 - ScannerThreadsTotalWallClockTime: 1791178819 - MaterializeTupleTime(*): 1329197335 - ScannerThreadsSysTime: 98984000 - ScannerThreadsUserTime: 1604755000 - ScannerThreadsVoluntaryContextSwitches: 35 - TotalRawHdfsReadTime(*): 45202181 - TotalReadThroughput: 81430112 - TotalTime: 614645237 Instance 6443fe8dab371686:258cc1eb13c0af1b (host=demeter-csmau08-17.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 5:1/242.93 MB 3:1/242.42 MB 12:1/235.56 MB 21:1/242.89 MB 23:1/242.69 MB 11:1/234.71 MB - AsyncTotalTime: 0 - AverageThreadTokens: 7.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 281094176 - PerHostPeakMemUsage: 560672800 - PrepareTime: 324888 - RowsProduced: 0 - TotalCpuTime: 4058810406 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 33335 - TotalStorageWaitTime: 252059518 - TotalTime: 621823366 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 144342 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 5:1/242.93 MB 3:1/242.42 MB 12:1/235.56 MB 21:1/242.89 MB 23:1/242.69 MB 11:1/234.71 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 80108590 - BytesReadDataNodeCache: 0 - BytesReadLocal: 80108590 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80108590 - DecompressionTime: 683092015 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 280774688 - PerReadThreadRawHdfsThroughput: 780093612 - RemoteScanRanges: 0 - RowsRead: 11412009 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 20 - ScannerThreadsTotalWallClockTime: 3580547214 - MaterializeTupleTime(*): 2588574563 - ScannerThreadsSysTime: 178969000 - ScannerThreadsUserTime: 3140520000 - ScannerThreadsVoluntaryContextSwitches: 73 - TotalRawHdfsReadTime(*): 102690996 - TotalReadThroughput: 160217180 - TotalTime: 609206526 Instance 6443fe8dab371686:258cc1eb13c0aefd (host=demeter-csmau10-7.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/242.52 MB 9:1/63.86 MB 12:1/233.79 MB 23:1/242.41 MB 13:1/163.52 MB 4:1/242.74 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187381416 - PerHostPeakMemUsage: 187381416 - PrepareTime: 258032 - RowsProduced: 0 - TotalCpuTime: 3402820730 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 37658 - TotalStorageWaitTime: 211177809 - TotalTime: 613434737 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 172854 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/242.52 MB 9:1/63.86 MB 12:1/233.79 MB 23:1/242.41 MB 13:1/163.52 MB 4:1/242.74 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 6.0 - BytesRead: 66674466 - BytesReadDataNodeCache: 0 - BytesReadLocal: 66674466 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 66674466 - DecompressionTime: 505861845 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 187061928 - PerReadThreadRawHdfsThroughput: 834906794 - RemoteScanRanges: 0 - RowsRead: 9387575 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 17 - ScannerThreadsTotalWallClockTime: 2869076080 - MaterializeTupleTime(*): 2103137079 - ScannerThreadsSysTime: 73986000 - ScannerThreadsUserTime: 2577605000 - ScannerThreadsVoluntaryContextSwitches: 77 - TotalRawHdfsReadTime(*): 79858574 - TotalReadThroughput: 133348932 - TotalTime: 602827486 Instance 6443fe8dab371686:258cc1eb13c0aef6 (host=demeter-csmaz10-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 9:1/242.97 MB 7:1/242.86 MB 14:1/242.89 MB 13:1/243.02 MB 4:1/243.01 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 239344704 - PerHostPeakMemUsage: 239344704 - PrepareTime: 240397 - RowsProduced: 0 - TotalCpuTime: 3430650918 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 32551 - TotalStorageWaitTime: 205784859 - TotalTime: 612583031 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 189537 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 9:1/242.97 MB 7:1/242.86 MB 14:1/242.89 MB 13:1/243.02 MB 4:1/243.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 69544730 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69544730 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69544730 - DecompressionTime: 572575783 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 239025216 - PerReadThreadRawHdfsThroughput: 571659561 - RemoteScanRanges: 0 - RowsRead: 9636467 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 2992466774 - MaterializeTupleTime(*): 2164864389 - ScannerThreadsSysTime: 126979000 - ScannerThreadsUserTime: 2653593000 - ScannerThreadsVoluntaryContextSwitches: 65 - TotalRawHdfsReadTime(*): 121654101 - TotalReadThroughput: 69544730 - TotalTime: 601953344 Instance 6443fe8dab371686:258cc1eb13c0af29 (host=demeter-csmaz11-14.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 11:1/242.60 MB 10:1/242.80 MB 0:1/242.82 MB 14:1/242.86 MB 9:1/243.05 MB 13:1/65.44 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 238759120 - PerHostPeakMemUsage: 526726352 - PrepareTime: 374039 - RowsProduced: 0 - TotalCpuTime: 3916410214 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31352 - TotalStorageWaitTime: 227019985 - TotalTime: 611706354 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 162153 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 11:1/242.60 MB 10:1/242.80 MB 0:1/242.82 MB 14:1/242.86 MB 9:1/243.05 MB 13:1/65.44 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 73392362 - BytesReadDataNodeCache: 0 - BytesReadLocal: 73392362 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 73392362 - DecompressionTime: 611464357 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 238439632 - PerReadThreadRawHdfsThroughput: 562297104 - RemoteScanRanges: 0 - RowsRead: 10119466 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 9 - ScannerThreadsTotalWallClockTime: 3150033475 - MaterializeTupleTime(*): 2252632110 - ScannerThreadsSysTime: 150973000 - ScannerThreadsUserTime: 2765576000 - ScannerThreadsVoluntaryContextSwitches: 76 - TotalRawHdfsReadTime(*): 130522390 - TotalReadThroughput: 146784724 - TotalTime: 600333766 Instance 6443fe8dab371686:258cc1eb13c0af36 (host=demeter-csmaz11-18.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 12:1/242.90 MB 7:1/243.12 MB 9:1/242.81 MB - AsyncTotalTime: 0 - AverageThreadTokens: 4.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 145081048 - PerHostPeakMemUsage: 433048280 - PrepareTime: 344639 - RowsProduced: 0 - TotalCpuTime: 2293073368 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31874 - TotalStorageWaitTime: 112827645 - TotalTime: 604600753 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 145199 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 12:1/242.90 MB 7:1/243.12 MB 9:1/242.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:9 ExecOption: Codegen enabled: 0 out of 3 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 3.0 - BytesRead: 41767569 - BytesReadDataNodeCache: 0 - BytesReadLocal: 41767569 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41767569 - DecompressionTime: 348138462 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 3 - NumScannerThreadsStarted: 3 - PeakMemoryUsage: 144761560 - PerReadThreadRawHdfsThroughput: 1056722776 - RemoteScanRanges: 0 - RowsRead: 5819481 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 3 - ScannerThreadsInvoluntaryContextSwitches: 3 - ScannerThreadsTotalWallClockTime: 1759441646 - MaterializeTupleTime(*): 1272492305 - ScannerThreadsSysTime: 84986000 - ScannerThreadsUserTime: 1559761000 - ScannerThreadsVoluntaryContextSwitches: 31 - TotalRawHdfsReadTime(*): 39525569 - TotalReadThroughput: 41767569 - TotalTime: 592365963 Instance 6443fe8dab371686:258cc1eb13c0af06 (host=demeter-csmau10-6.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 1:1/63.22 MB 0:1/242.42 MB 15:1/242.82 MB 2:1/242.44 MB 10:1/242.79 MB - AsyncTotalTime: 0 - AverageThreadTokens: 5.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 186953968 - PerHostPeakMemUsage: 186953968 - PrepareTime: 233892 - RowsProduced: 0 - TotalCpuTime: 3255824209 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 17701 - TotalStorageWaitTime: 157243531 - TotalTime: 596471197 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 182057 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 1:1/63.22 MB 0:1/242.42 MB 15:1/242.82 MB 2:1/242.44 MB 10:1/242.79 MB Hdfs Read Thread Concurrency Bucket: 0:50% 1:0% 2:0% 3:0% 4:50% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 2.0 - AverageScannerThreadConcurrency: 4.5 - BytesRead: 57967668 - BytesReadDataNodeCache: 0 - BytesReadLocal: 57967668 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 57967668 - DecompressionTime: 451265743 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 186634480 - PerReadThreadRawHdfsThroughput: 790483143 - RemoteScanRanges: 0 - RowsRead: 8145893 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 2468309174 - MaterializeTupleTime(*): 1820496957 - ScannerThreadsSysTime: 81985000 - ScannerThreadsUserTime: 2223660000 - ScannerThreadsVoluntaryContextSwitches: 64 - TotalRawHdfsReadTime(*): 73331947 - TotalReadThroughput: 57967668 - TotalTime: 585267617 Instance 6443fe8dab371686:258cc1eb13c0af10 (host=demeter-csmau08-9.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 3:1/242.55 MB 19:1/242.97 MB 20:1/242.55 MB 18:1/242.83 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189314496 - PerHostPeakMemUsage: 468893120 - PrepareTime: 268449 - RowsProduced: 0 - TotalCpuTime: 2870253599 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 23496 - TotalStorageWaitTime: 146461673 - TotalTime: 592457680 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 167726 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 3:1/242.55 MB 19:1/242.97 MB 20:1/242.55 MB 18:1/242.83 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 55091184 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55091184 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55091184 - DecompressionTime: 453349260 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 188995008 - PerReadThreadRawHdfsThroughput: 732099252 - RemoteScanRanges: 0 - RowsRead: 7674394 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 10 - ScannerThreadsTotalWallClockTime: 2285138183 - MaterializeTupleTime(*): 1649721697 - ScannerThreadsSysTime: 111981000 - ScannerThreadsUserTime: 2023690000 - ScannerThreadsVoluntaryContextSwitches: 50 - TotalRawHdfsReadTime(*): 75250977 - TotalReadThroughput: 110182368 - TotalTime: 578872170 Instance 6443fe8dab371686:258cc1eb13c0af4c (host=demeter-csmaz10-5.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 19:1/242.92 MB 14:1/242.91 MB 0:1/242.88 MB 22:1/242.89 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 191925208 - PerHostPeakMemUsage: 479892440 - PrepareTime: 371766 - RowsProduced: 0 - TotalCpuTime: 3288128198 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 31202 - TotalStorageWaitTime: 125027320 - TotalTime: 586745123 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 170347 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 19:1/242.92 MB 14:1/242.91 MB 0:1/242.88 MB 22:1/242.89 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 55717752 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55717752 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55717752 - DecompressionTime: 458371751 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 191605720 - PerReadThreadRawHdfsThroughput: 911119890 - RemoteScanRanges: 0 - RowsRead: 7726943 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 7 - ScannerThreadsTotalWallClockTime: 2267312135 - MaterializeTupleTime(*): 1648719009 - ScannerThreadsSysTime: 125978000 - ScannerThreadsUserTime: 2014692000 - ScannerThreadsVoluntaryContextSwitches: 46 - TotalRawHdfsReadTime(*): 61153041 - TotalReadThroughput: 111435504 - TotalTime: 573763489 Instance 6443fe8dab371686:258cc1eb13c0af00 (host=demeter-csmaz08-15.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 7:1/234.56 MB 23:1/242.81 MB 1:1/242.74 MB 5:1/242.80 MB 16:1/242.89 MB - AsyncTotalTime: 0 - AverageThreadTokens: 6.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 175518272 - PerHostPeakMemUsage: 455096896 - PrepareTime: 206221 - RowsProduced: 0 - TotalCpuTime: 3000908895 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 25501 - TotalStorageWaitTime: 123248782 - TotalTime: 569819500 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 125628 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 7:1/234.56 MB 23:1/242.81 MB 1:1/242.74 MB 5:1/242.80 MB 16:1/242.89 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 68530904 - BytesReadDataNodeCache: 0 - BytesReadLocal: 68530904 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68530904 - DecompressionTime: 379868110 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 175198784 - PerReadThreadRawHdfsThroughput: 1085232872 - RemoteScanRanges: 0 - RowsRead: 9583652 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 12 - ScannerThreadsTotalWallClockTime: 2378459314 - MaterializeTupleTime(*): 1834580664 - ScannerThreadsSysTime: 31992000 - ScannerThreadsUserTime: 2216660000 - ScannerThreadsVoluntaryContextSwitches: 62 - TotalRawHdfsReadTime(*): 63148570 - TotalReadThroughput: 137061808 - TotalTime: 561628396 Instance 6443fe8dab371686:258cc1eb13c0af21 (host=demeter-csmau10-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 15:1/242.88 MB 17:1/243.04 MB 10:1/242.94 MB 7:1/242.60 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.3333333333333335 - InactiveTotalTime: 0 - PeakMemoryUsage: 189474232 - PerHostPeakMemUsage: 477441464 - PrepareTime: 304194 - RowsProduced: 0 - TotalCpuTime: 3266444033 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 27964 - TotalStorageWaitTime: 102001601 - TotalTime: 554969573 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 143506 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 15:1/242.88 MB 17:1/243.04 MB 10:1/242.94 MB 7:1/242.60 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 4.0 - BytesRead: 55636709 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55636709 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55636709 - DecompressionTime: 340954801 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 189154744 - PerReadThreadRawHdfsThroughput: 1154958372 - RemoteScanRanges: 0 - RowsRead: 7722028 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 11 - ScannerThreadsTotalWallClockTime: 2160596004 - MaterializeTupleTime(*): 1686081355 - ScannerThreadsSysTime: 4998000 - ScannerThreadsUserTime: 2049687000 - ScannerThreadsVoluntaryContextSwitches: 45 - TotalRawHdfsReadTime(*): 48172047 - TotalReadThroughput: 111273418 - TotalTime: 545574120 Instance 6443fe8dab371686:258cc1eb13c0af18 (host=demeter-csmau10-2.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 2:1/242.91 MB 0:1/242.68 MB 3:1/242.82 MB 1:1/243.09 MB - AsyncTotalTime: 0 - AverageThreadTokens: 2.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 185935832 - PerHostPeakMemUsage: 185935832 - PrepareTime: 172835 - RowsProduced: 0 - TotalCpuTime: 2164951498 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 18380 - TotalStorageWaitTime: 88972696 - TotalTime: 415117640 BlockMgr - AsyncTotalTime: 0 - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 68719476736 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 132487 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/242.91 MB 0:1/242.68 MB 3:1/242.82 MB 1:1/243.09 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:12 ExecOption: Codegen enabled: 0 out of 4 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 1.0 - BytesRead: 55760189 - BytesReadDataNodeCache: 0 - BytesReadLocal: 55760189 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55760189 - DecompressionTime: 229616641 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 4 - NumScannerThreadsStarted: 4 - PeakMemoryUsage: 185616344 - PerReadThreadRawHdfsThroughput: 1369461375 - RemoteScanRanges: 0 - RowsRead: 7724756 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 4 - ScannerThreadsInvoluntaryContextSwitches: 66 - ScannerThreadsTotalWallClockTime: 1525098972 - MaterializeTupleTime(*): 1190091669 - ScannerThreadsSysTime: 48991000 - ScannerThreadsUserTime: 1381788000 - ScannerThreadsVoluntaryContextSwitches: 46 - TotalRawHdfsReadTime(*): 40716876 - TotalReadThroughput: 111520378 - TotalTime: 410163829 Instance 6443fe8dab371686:258cc1eb13c0aefa (host=demeter-csmaz11-1.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 20:1/242.95 MB 21:1/242.77 MB 19:1/242.56 MB 0:1/242.81 MB 16:1/243.08 MB - AsyncTotalTime: 0 - AverageThreadTokens: 3.5 - InactiveTotalTime: 0 - PeakMemoryUsage: 218329648 - PerHostPeakMemUsage: 497908272 - PrepareTime: 128523 - RowsProduced: 0 - TotalCpuTime: 2571013637 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 16215 - TotalStorageWaitTime: 94773900 - TotalTime: 408582746 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 84194 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 20:1/242.95 MB 21:1/242.77 MB 19:1/242.56 MB 0:1/242.81 MB 16:1/243.08 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:100% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:15 ExecOption: Codegen enabled: 0 out of 5 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 3.0 - AverageScannerThreadConcurrency: 5.0 - BytesRead: 69420489 - BytesReadDataNodeCache: 0 - BytesReadLocal: 69420489 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69420489 - DecompressionTime: 297717393 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 5 - NumScannerThreadsStarted: 5 - PeakMemoryUsage: 218010160 - PerReadThreadRawHdfsThroughput: 1433212785 - RemoteScanRanges: 0 - RowsRead: 9619554 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 5 - ScannerThreadsInvoluntaryContextSwitches: 312 - ScannerThreadsTotalWallClockTime: 1921157988 - MaterializeTupleTime(*): 1500606082 - ScannerThreadsSysTime: 56989000 - ScannerThreadsUserTime: 1754731000 - ScannerThreadsVoluntaryContextSwitches: 69 - TotalRawHdfsReadTime(*): 48436973 - TotalReadThroughput: 97228952 - TotalTime: 403400791 Instance 6443fe8dab371686:258cc1eb13c0aef8 (host=demeter-csmau10-4.demeter.hpc.mssm.edu:22000) Hdfs split stats (:<# splits>/): 16:1/242.76 MB 11:1/242.94 MB 14:1/242.83 MB 19:1/62.18 MB 12:1/242.87 MB 20:1/62.23 MB - AsyncTotalTime: 0 - AverageThreadTokens: 1.0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186902488 - PerHostPeakMemUsage: 458143704 - PrepareTime: 219588 - RowsProduced: 0 - TotalCpuTime: 1477885749 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 36952 - TotalStorageWaitTime: 119758722 - TotalTime: 298670995 DataStreamSender (dst_id=4) - AsyncTotalTime: 0 - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 311296 - SerializeBatchTime: 0 - ThriftTransmitTime(*): 0 - TotalTime: 87973 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 16:1/242.76 MB 11:1/242.94 MB 14:1/242.83 MB 19:1/62.18 MB 12:1/242.87 MB 20:1/62.23 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:18 ExecOption: Codegen enabled: 0 out of 6 - AsyncTotalTime: 0 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 63165880 - BytesReadDataNodeCache: 0 - BytesReadLocal: 63165880 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 63165880 - DecompressionTime: 225774071 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 6 - NumScannerThreadsStarted: 6 - PeakMemoryUsage: 186583000 - PerReadThreadRawHdfsThroughput: 1604520404 - RemoteScanRanges: 0 - RowsRead: 8727019 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 6 - ScannerThreadsInvoluntaryContextSwitches: 6 - ScannerThreadsTotalWallClockTime: 1267205758 - MaterializeTupleTime(*): 897761494 - ScannerThreadsSysTime: 58989000 - ScannerThreadsUserTime: 1081832000 - ScannerThreadsVoluntaryContextSwitches: 81 - TotalRawHdfsReadTime(*): 39367452 - TotalReadThroughput: 0 - TotalTime: 285747498 Instance 6443fe8dab371686:258cc1eb13c0af25 (host=demeter-csmaz10-16.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af26 (host=demeter-csmaz08-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af27 (host=demeter-csmaz10-14.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af28 (host=demeter-csmau08-3.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af2a (host=demeter-csmau08-7.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af2b (host=demeter-csmaz11-20.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af2c (host=demeter-csmau10-8.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af2e (host=demeter-csmaz11-6.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af31 (host=demeter-csmaz08-16.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af32 (host=demeter-csmaz08-19.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af35 (host=demeter-csmau08-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af37 (host=demeter-csmau08-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af3b (host=demeter-csmaz08-2.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af3c (host=demeter-csmaz08-6.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af3d (host=demeter-csmaz08-1.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af3e (host=demeter-csmaz08-4.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af3f (host=demeter-csmau08-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af40 (host=demeter-csmaz10-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af41 (host=demeter-csmau08-18.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af43 (host=demeter-csmau08-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af45 (host=demeter-csmau08-2.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af47 (host=demeter-csmau10-3.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af49 (host=demeter-csmaz11-11.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af4e (host=demeter-csmaz11-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af50 (host=demeter-csmau08-19.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aef9 (host=demeter-csmaz08-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0aeff (host=demeter-csmaz11-2.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af02 (host=demeter-csmaz08-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af05 (host=demeter-csmau10-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af07 (host=demeter-csmaz11-7.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af08 (host=demeter-csmau10-13.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af09 (host=demeter-csmaz08-7.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af0a (host=demeter-csmau08-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af0b (host=demeter-csmau10-18.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af0c (host=demeter-csmaz11-15.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af0e (host=demeter-csmaz08-14.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af0f (host=demeter-csmau10-19.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af11 (host=demeter-csmaz11-3.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af12 (host=demeter-csmau10-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af14 (host=demeter-csmaz08-17.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af15 (host=demeter-csmaz10-20.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af17 (host=demeter-csmaz11-8.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af19 (host=demeter-csmaz10-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af1a (host=demeter-csmaz11-12.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af1c (host=demeter-csmau08-8.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af1d (host=demeter-csmau10-17.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af1e (host=demeter-csmau08-1.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af1f (host=demeter-csmau10-15.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af20 (host=demeter-csmaz10-10.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af22 (host=demeter-csmaz11-5.demeter.hpc.mssm.edu:22000) Instance 6443fe8dab371686:258cc1eb13c0af23 (host=demeter-csmaz10-19.demeter.hpc.mssm.edu:22000)