Query 124b576fcc163695:b093f1d100000000
Query (id=124b576fcc163695:b093f1d100000000):
DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance.
Summary:
Session ID: b24c068fd6b90d35:d09cd40d7f1b0d82
Session Type: BEESWAX
Start Time: 2017-10-12 12:27:51.756601000
End Time: 2017-10-12 12:27:54.737189000
Query Type: QUERY
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 2.11.0-SNAPSHOT DEBUG (build ecea383af782bd0cec45a05dc2bd5f112c9bbf24)
User: twood
Connected User: twood
Delegated User:
Network Address: ::ffff:127.0.0.1:38222
Default Db: tpcds_parquet
Sql Statement: select sum (ss_quantity)
from store_sales, store, customer_demographics, customer_address, date_dim
where s_store_sk = ss_store_sk
and ss_sold_date_sk = d_date_sk and d_year = 2000
and
(
(
cd_demo_sk = ss_cdemo_sk
and
cd_marital_status = 'm'
and
cd_education_status = '4 yr Degree'
and
ss_sales_price between 100.00 and 150.00
)
or
(
cd_demo_sk = ss_cdemo_sk
and
cd_marital_status = 'D'
and
cd_education_status = '2 yr Degree'
and
ss_sales_price between 50.00 and 100.00
)
or
(
cd_demo_sk = ss_cdemo_sk
and
cd_marital_status = 'S'
and
cd_education_status = 'College'
and
ss_sales_price between 150.00 and 200.00
)
)
and
(
(
ss_addr_sk = ca_address_sk
and
ca_country = 'United States'
and
ca_state in ('CO', 'OH', 'TX')
and ss_net_profit between 0 and 2000
)
or
(ss_addr_sk = ca_address_sk
and
ca_country = 'United States'
and
ca_state in ('OR', 'MN', 'KY')
and ss_net_profit between 150 and 3000
)
or
(ss_addr_sk = ca_address_sk
and
ca_country = 'United States'
and
ca_state in ('VA', 'CA', 'MS')
and ss_net_profit between 50 and 25000
)
)
Coordinator: twood-OptiPlex-7040:22000
Query Options (set by configuration):
Query Options (set by configuration and planner): MT_DOP=0
Plan:
----------------
Max Per-Host Resource Reservation: Memory=136.00MB
Per-Host Resource Estimates: Memory=8.25GB
WARNING: The following tables are missing relevant table and/or column statistics.
tpcds_parquet.customer_address, tpcds_parquet.customer_demographics, tpcds_parquet.date_dim, tpcds_parquet.store, tpcds_parquet.store_sales
F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B
PLAN-ROOT SINK
| mem-estimate=0B mem-reservation=0B
|
15:AGGREGATE [FINALIZE]
| output: sum:merge(ss_quantity)
| mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB
| tuple-ids=5 row-size=8B cardinality=1
|
14:EXCHANGE [UNPARTITIONED]
| mem-estimate=0B mem-reservation=0B
| tuple-ids=5 row-size=8B cardinality=1
|
F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=8.10GB mem-reservation=136.00MB
09:AGGREGATE
| output: sum(ss_quantity)
| mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB
| tuple-ids=5 row-size=8B cardinality=1
|
08:HASH JOIN [INNER JOIN, BROADCAST]
| hash predicates: ss_sold_date_sk = d_date_sk
| fk/pk conjuncts: assumed fk/pk
| runtime filters: RF000 <- d_date_sk
| mem-estimate=2.00GB mem-reservation=34.00MB spill-buffer=2.00MB
| tuple-ids=0,1,2,3,4 row-size=108B cardinality=unavailable
|
|--13:EXCHANGE [BROADCAST]
| | mem-estimate=0B mem-reservation=0B
| | tuple-ids=4 row-size=8B cardinality=unavailable
| |
| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Resources: mem-estimate=32.00MB mem-reservation=0B
| 04:SCAN HDFS [tpcds_parquet.date_dim, RANDOM]
| partitions=1/1 files=1 size=2.15MB
| predicates: d_year = 2000
| stats-rows=unavailable extrapolated-rows=disabled
| table stats: rows=unavailable size=unavailable
| column stats: unavailable
| parquet statistics predicates: d_year = 2000
| parquet dictionary predicates: d_year = 2000
| mem-estimate=32.00MB mem-reservation=0B
| tuple-ids=4 row-size=8B cardinality=unavailable
|
07:HASH JOIN [INNER JOIN, BROADCAST]
| hash predicates: ss_addr_sk = ca_address_sk
| fk/pk conjuncts: assumed fk/pk
| other predicates: ((ca_state IN ('CO', 'OH', 'TX') AND ss_net_profit >= 0 AND ss_net_profit <= 2000) OR (ca_state IN ('OR', 'MN', 'KY') AND ss_net_profit >= 150 AND ss_net_profit <= 3000) OR (ca_state IN ('VA', 'CA', 'MS') AND ss_net_profit >= 50 AND ss_net_profit <= 25000))
| runtime filters: RF001 <- ca_address_sk
| mem-estimate=2.00GB mem-reservation=34.00MB spill-buffer=2.00MB
| tuple-ids=0,1,2,3 row-size=100B cardinality=unavailable
|
|--12:EXCHANGE [BROADCAST]
| | mem-estimate=0B mem-reservation=0B
| | tuple-ids=3 row-size=34B cardinality=unavailable
| |
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Resources: mem-estimate=48.00MB mem-reservation=0B
| 03:SCAN HDFS [tpcds_parquet.customer_address, RANDOM]
| partitions=1/1 files=1 size=1.16MB
| predicates: ca_country = 'United States'
| stats-rows=unavailable extrapolated-rows=disabled
| table stats: rows=unavailable size=unavailable
| column stats: unavailable
| parquet statistics predicates: ca_country = 'United States'
| parquet dictionary predicates: ca_country = 'United States'
| mem-estimate=48.00MB mem-reservation=0B
| tuple-ids=3 row-size=34B cardinality=unavailable
|
06:HASH JOIN [INNER JOIN, BROADCAST]
| hash predicates: ss_cdemo_sk = cd_demo_sk
| fk/pk conjuncts: assumed fk/pk
| other predicates: ((cd_marital_status = 'm' AND cd_education_status = '4 yr Degree' AND ss_sales_price >= 100.00 AND ss_sales_price <= 150.00) OR (cd_marital_status = 'D' AND cd_education_status = '2 yr Degree' AND ss_sales_price >= 50.00 AND ss_sales_price <= 100.00) OR (cd_marital_status = 'S' AND cd_education_status = 'College' AND ss_sales_price >= 150.00 AND ss_sales_price <= 200.00))
| runtime filters: RF002 <- cd_demo_sk
| mem-estimate=2.00GB mem-reservation=34.00MB spill-buffer=2.00MB
| tuple-ids=0,1,2 row-size=66B cardinality=unavailable
|
|--11:EXCHANGE [BROADCAST]
| | mem-estimate=0B mem-reservation=0B
| | tuple-ids=2 row-size=34B cardinality=unavailable
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Resources: mem-estimate=48.00MB mem-reservation=0B
| 02:SCAN HDFS [tpcds_parquet.customer_demographics, RANDOM]
| partitions=1/1 files=1 size=7.48MB
| stats-rows=unavailable extrapolated-rows=disabled
| table stats: rows=unavailable size=unavailable
| column stats: unavailable
| mem-estimate=48.00MB mem-reservation=0B
| tuple-ids=2 row-size=34B cardinality=unavailable
|
05:HASH JOIN [INNER JOIN, BROADCAST]
| hash predicates: ss_store_sk = s_store_sk
| fk/pk conjuncts: assumed fk/pk
| runtime filters: RF003 <- s_store_sk
| mem-estimate=2.00GB mem-reservation=34.00MB spill-buffer=2.00MB
| tuple-ids=0,1 row-size=32B cardinality=unavailable
|
|--10:EXCHANGE [BROADCAST]
| | mem-estimate=0B mem-reservation=0B
| | tuple-ids=1 row-size=4B cardinality=unavailable
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Resources: mem-estimate=16.00MB mem-reservation=0B
| 01:SCAN HDFS [tpcds_parquet.store, RANDOM]
| partitions=1/1 files=1 size=8.37KB
| stats-rows=unavailable extrapolated-rows=disabled
| table stats: rows=unavailable size=unavailable
| column stats: unavailable
| mem-estimate=16.00MB mem-reservation=0B
| tuple-ids=1 row-size=4B cardinality=unavailable
|
00:SCAN HDFS [tpcds_parquet.store_sales, RANDOM]
partitions=1824/1824 files=1824 size=189.81MB
runtime filters: RF000 -> ss_sold_date_sk, RF001 -> ss_addr_sk, RF002 -> ss_cdemo_sk, RF003 -> ss_store_sk
stats-rows=unavailable extrapolated-rows=disabled
table stats: rows=unavailable size=unavailable
columns missing stats: ss_quantity, ss_store_sk, ss_cdemo_sk, ss_sales_price, ss_addr_sk, ss_net_profit
mem-estimate=96.00MB mem-reservation=0B
tuple-ids=0 row-size=28B cardinality=unavailable
----------------
Estimated Per-Host Mem: 8862564352
Tables Missing Stats: tpcds_parquet.customer_address,tpcds_parquet.customer_demographics,tpcds_parquet.date_dim,tpcds_parquet.store,tpcds_parquet.store_sales
Per Host Min Reservation: twood-OptiPlex-7040:22000(136.00 MB) twood-OptiPlex-7040:22001(136.00 MB) twood-OptiPlex-7040:22002(136.00 MB)
Request Pool: default-pool
Admission result: Admitted immediately
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
-----------------------------------------------------------------------------------------------------------------------------------
15:AGGREGATE 1 165.379us 165.379us 1 1 28.00 KB 10.00 MB FINALIZE
14:EXCHANGE 1 2s736ms 2s736ms 3 1 0 0 UNPARTITIONED
09:AGGREGATE 3 0.000ns 0.000ns 3 1 9.14 MB 10.00 MB
08:HASH JOIN 3 691.054us 753.758us 350 -1 43.15 MB 2.00 GB INNER JOIN, BROADCAST
|--13:EXCHANGE 3 44.656us 60.760us 366 -1 0 0 BROADCAST
| 04:SCAN HDFS 1 21.149ms 21.149ms 366 -1 842.28 KB 32.00 MB tpcds_parquet.date_dim
07:HASH JOIN 3 2.107ms 2.549ms 350 -1 42.86 MB 2.00 GB INNER JOIN, BROADCAST
|--12:EXCHANGE 3 5.839ms 6.690ms 48.48K -1 0 0 BROADCAST
| 03:SCAN HDFS 1 27.487ms 27.487ms 48.48K -1 2.62 MB 48.00 MB tpcds_parquet.customer_address
06:HASH JOIN 3 924.802ms 978.883ms 3.23K -1 160.21 MB 2.00 GB INNER JOIN, BROADCAST
|--11:EXCHANGE 3 682.507ms 727.461ms 1.92M -1 0 0 BROADCAST
| 02:SCAN HDFS 1 75.438ms 75.438ms 1.92M -1 11.48 MB 48.00 MB tpcds_parquet.customer_demographics
05:HASH JOIN 3 18.207ms 22.900ms 514.88K -1 34.10 MB 2.00 GB INNER JOIN, BROADCAST
|--10:EXCHANGE 3 11.031us 11.786us 12 -1 0 0 BROADCAST
| 01:SCAN HDFS 1 1.929ms 1.929ms 12 -1 89.00 KB 16.00 MB tpcds_parquet.store
00:SCAN HDFS 3 162.842ms 230.081ms 514.88K -1 5.60 MB 96.00 MB tpcds_parquet.store_sales
Errors:
Planner Timeline: 27.392ms
- Analysis finished: 2.213ms (2.213ms)
- Equivalence classes computed: 2.376ms (163.285us)
- Single node plan created: 21.369ms (18.992ms)
- Runtime filters computed: 21.527ms (158.395us)
- Distributed plan created: 21.754ms (226.707us)
- Planning finished: 27.392ms (5.638ms)
Query Timeline: 2s986ms
- Query submitted: 49.911us (49.911us)
- Planning finished: 64.246ms (64.197ms)
- Submit for admission: 83.940ms (19.694ms)
- Completed admission: 84.007ms (66.707us)
- Ready to start on 3 backends: 92.883ms (8.875ms)
- All 3 execution backends (8 fragment instances) started: 133.548ms (40.664ms)
- Rows available: 2s888ms (2s755ms)
- First row fetched: 2s974ms (85.072ms)
- Unregister query: 2s980ms (6.523ms)
- ComputeScanRangeAssignmentTimer: 14.017ms
ImpalaServer:
- ClientFetchWaitTimer: 87.845ms
- RowMaterializationTimer: 3.730ms
Execution Profile 124b576fcc163695:b093f1d100000000:(Total: 2s800ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 4
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
-------------------------------------------------------------------------------------------------------------------
3 5 0 LOCAL false 0 (3) N/A N/A true
2 6 0 LOCAL false 0 (3) N/A N/A true
1 7 0 LOCAL false 0 (3) N/A N/A true
0 8 0 LOCAL true 0 (3) N/A N/A true
Backend startup latencies: Count: 3, min / max: 25ms / 32ms, 25th %-ile: 25ms, 50th %-ile: 25ms, 75th %-ile: 25ms, 90th %-ile: 32ms, 95th %-ile: 32ms, 99.9th %-ile: 32ms
Final filter table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
-------------------------------------------------------------------------------------------------------------------
3 5 0 LOCAL false 0 (3) N/A N/A true
2 6 0 LOCAL false 0 (3) N/A N/A true
1 7 0 LOCAL false 0 (3) N/A N/A true
0 8 0 LOCAL true 0 (3) N/A N/A true
Per Node Peak Memory Usage: twood-OptiPlex-7040:22000(277.77 MB) twood-OptiPlex-7040:22001(277.75 MB) twood-OptiPlex-7040:22002(277.63 MB)
- FiltersReceived: 0 (0)
- FinalizationTimer: 0.000ns
Averaged Fragment F05:(Total: 2s837ms, non-child: 86.464ms, % non-child: 3.05%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:2s844ms max:2s844ms mean: 2s844ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 36.02 KB (36880)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 277.77 MB (291263538)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 2s736ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 2s822ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 0.000ns
- TotalThreadsVoluntaryContextSwitches: 5 (5)
Fragment Instance Lifecycle Timings:
- ExecTime: 85.145ms
- ExecTreeExecTime: 4.297us
- OpenTime: 2s736ms
- ExecTreeOpenTime: 2s736ms
- PrepareTime: 15.602ms
- ExecTreePrepareTime: 88.820us
PLAN_ROOT_SINK:
- PeakMemoryUsage: 0
CodeGen:(Total: 14.259ms, non-child: 14.259ms, % non-child: 100.00%)
- CodegenTime: 0.000ns
- CompileTime: 0.000ns
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 0 (0)
- NumInstructions: 0 (0)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 0
- PrepareTime: 13.780ms
AGGREGATION_NODE (id=15):(Total: 2s737ms, non-child: 165.379us, % non-child: 0.01%)
- BuildTime: 10.794us
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 0 (0)
- PeakMemoryUsage: 28.00 KB (28672)
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=14):(Total: 2s736ms, non-child: 2s736ms, % non-child: 100.00%)
- ConvertRowBatchTime: 6.214us
- PeakMemoryUsage: 0
- RowsReturned: 3 (3)
- RowsReturnedRate: 1.00 /sec
DataStreamReceiver:
- BytesReceived: 51.00 B (51)
- DeserializeRowBatchTimer: 16.334us
- FirstBatchArrivalWaitTime: 2s505ms
- PeakMemoryUsage: 4.02 KB (4112)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Coordinator Fragment F05:
Instance 124b576fcc163695:b093f1d100000000 (host=twood-OptiPlex-7040:22000):(Total: 2s837ms, non-child: 86.464ms, % non-child: 3.05%)
MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 36.02 KB (36880)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 277.77 MB (291263538)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 2s736ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 2s822ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 0.000ns
- TotalThreadsVoluntaryContextSwitches: 5 (5)
Fragment Instance Lifecycle Timings:
- ExecTime: 85.145ms
- ExecTreeExecTime: 4.297us
- OpenTime: 2s736ms
- ExecTreeOpenTime: 2s736ms
- PrepareTime: 15.602ms
- ExecTreePrepareTime: 88.820us
PLAN_ROOT_SINK:
- PeakMemoryUsage: 0
CodeGen:(Total: 14.259ms, non-child: 14.259ms, % non-child: 100.00%)
- CodegenTime: 0.000ns
- CompileTime: 0.000ns
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 0 (0)
- NumInstructions: 0 (0)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 0
- PrepareTime: 13.780ms
AGGREGATION_NODE (id=15):(Total: 2s737ms, non-child: 165.379us, % non-child: 0.01%)
- BuildTime: 10.794us
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 0 (0)
- PeakMemoryUsage: 28.00 KB (28672)
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=14):(Total: 2s736ms, non-child: 2s736ms, % non-child: 100.00%)
- ConvertRowBatchTime: 6.214us
- PeakMemoryUsage: 0
- RowsReturned: 3 (3)
- RowsReturnedRate: 1.00 /sec
DataStreamReceiver:
BytesReceived(500.000ms): 0, 0, 0, 0, 0
- BytesReceived: 51.00 B (51)
- DeserializeRowBatchTimer: 16.334us
- FirstBatchArrivalWaitTime: 2s505ms
- PeakMemoryUsage: 4.02 KB (4112)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F00:(Total: 2s668ms, non-child: 56.856ms, % non-child: 2.13%)
split sizes: min: 61.36 MB, max: 66.84 MB, avg: 63.27 MB, stddev: 2.52 MB
completion times: min:2s528ms max:2s766ms mean: 2s678ms stddev:106.534ms
execution rates: min:22.27 MB/sec max:24.39 MB/sec mean:23.64 MB/sec stddev:995.77 KB/sec
num instances: 3
- AverageThreadTokens: 6.10
- BloomFilterBytes: 4.00 MB (4194304)
- PeakMemoryUsage: 277.71 MB (291201387)
- PeakReservation: 262.00 MB (274726912)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 277.72 MB (291205483)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 459.324ms
- TotalNetworkSendTime: 115.046us
- TotalStorageWaitTime: 376.753ms
- TotalThreadsInvoluntaryContextSwitches: 999 (999)
- TotalThreadsTotalWallClockTime: 16s836ms
- TotalThreadsSysTime: 21.333ms
- TotalThreadsUserTime: 2s286ms
- TotalThreadsVoluntaryContextSwitches: 4.53K (4527)
Fragment Instance Lifecycle Timings:
- ExecTime: 285.451us
- ExecTreeExecTime: 6.414us
- OpenTime: 2s585ms
- ExecTreeOpenTime: 1s743ms
- PrepareTime: 82.815ms
- ExecTreePrepareTime: 4.461ms
DataStreamSender (dst_id=14):(Total: 423.391us, non-child: 423.391us, % non-child: 100.00%)
- BytesSent: 17.00 B (17)
- NetworkThroughput(*): 515.38 KB/sec
- OverallThroughput: 84.88 KB/sec
- PeakMemoryUsage: 14.22 KB (14560)
- RowsReturned: 1 (1)
- SerializeBatchTime: 9.349us
- TransmitDataRPCTime: 32.280us
- UncompressedRowBatchSize: 17.00 B (17)
CodeGen:(Total: 863.736ms, non-child: 863.736ms, % non-child: 100.00%)
- CodegenTime: 3.487ms
- CompileTime: 59.580ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 324 (324)
- NumInstructions: 14.78K (14782)
- OptimizationTime: 780.773ms
- PeakMemoryUsage: 7.22 MB (7568384)
- PrepareTime: 22.810ms
AGGREGATION_NODE (id=9):(Total: 1s747ms, non-child: 0.000ns, % non-child: 0.00%)
- BuildTime: 982.759us
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 0 (0)
- PeakMemoryUsage: 9.03 MB (9466705)
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
HASH_JOIN_NODE (id=8):(Total: 1s750ms, non-child: 691.054us, % non-child: 0.04%)
- BuildRows: 366 (366)
- BuildTime: 1.713ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 43.04 MB (45128785)
- ProbeRows: 116 (116)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 21.699us
- RowsReturned: 116 (116)
- RowsReturnedRate: 66.00 /sec
Buffer pool:
- AllocTime: 388.807us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=8):
- BuildRowsPartitionTime: 520.655us
- BuildRowsPartitioned: 366 (366)
- HashBuckets: 1.02K (1024)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 357.334us
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=13):(Total: 44.656us, non-child: 44.656us, % non-child: 100.00%)
- ConvertRowBatchTime: 35.651us
- PeakMemoryUsage: 0
- RowsReturned: 366 (366)
- RowsReturnedRate: 8.68 M/sec
DataStreamReceiver:
- BytesReceived: 2.88 KB (2944)
- DeserializeRowBatchTimer: 16.129us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 6.86 KB (7024)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=7):(Total: 1s750ms, non-child: 2.107ms, % non-child: 0.12%)
- BuildRows: 48.48K (48475)
- BuildTime: 23.188ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 42.27 MB (44327230)
- ProbeRows: 1.08K (1078)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 481.890us
- RowsReturned: 116 (116)
- RowsReturnedRate: 66.00 /sec
Buffer pool:
- AllocTime: 226.286us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=7):
- BuildRowsPartitionTime: 13.046ms
- BuildRowsPartitioned: 48.48K (48475)
- HashBuckets: 131.07K (131072)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 9.131ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=12):(Total: 5.839ms, non-child: 5.839ms, % non-child: 100.00%)
- ConvertRowBatchTime: 5.429ms
- PeakMemoryUsage: 0
- RowsReturned: 48.48K (48475)
- RowsReturnedRate: 8.52 M/sec
DataStreamReceiver:
- BytesReceived: 1.10 MB (1148510)
- DeserializeRowBatchTimer: 13.380ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 2.77 MB (2906962)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=6):(Total: 1s748ms, non-child: 924.802ms, % non-child: 52.90%)
- BuildRows: 1.92M (1920800)
- BuildTime: 886.731ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 160.19 MB (167972590)
- ProbeRows: 171.62K (171625)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 76.247ms
- RowsReturned: 1.08K (1078)
- RowsReturnedRate: 623.00 /sec
Buffer pool:
- AllocTime: 1.111ms
- CumulativeAllocationBytes: 160.00 MB (167772160)
- CumulativeAllocations: 64 (64)
- PeakReservation: 160.00 MB (167772160)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 160.00 MB (167772160)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=6):
- BuildRowsPartitionTime: 518.674ms
- BuildRowsPartitioned: 1.92M (1920800)
- HashBuckets: 4.19M (4194304)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 366.123ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=11):(Total: 682.507ms, non-child: 682.507ms, % non-child: 100.00%)
- ConvertRowBatchTime: 213.521ms
- PeakMemoryUsage: 0
- RowsReturned: 1.92M (1920800)
- RowsReturnedRate: 2.82 M/sec
DataStreamReceiver:
- BytesReceived: 42.88 MB (44967110)
- DeserializeRowBatchTimer: 419.201ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 10.80 MB (11324124)
- SendersBlockedTimer: 630.087ms
- SendersBlockedTotalTimer(*): 630.090ms
HASH_JOIN_NODE (id=5):(Total: 181.051ms, non-child: 18.207ms, % non-child: 10.06%)
- BuildRows: 12 (12)
- BuildTime: 1.655ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 34.10 MB (35754388)
- ProbeRows: 171.62K (171625)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 11.642ms
- RowsReturned: 171.62K (171625)
- RowsReturnedRate: 1.05 M/sec
Buffer pool:
- AllocTime: 164.432us
- CumulativeAllocationBytes: 26.00 MB (27262976)
- CumulativeAllocations: 13 (13)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 26.00 MB (27262976)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=5):
- BuildRowsPartitionTime: 272.801us
- BuildRowsPartitioned: 12 (12)
- HashBuckets: 12 (12)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 214.872us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=10):(Total: 11.031us, non-child: 11.031us, % non-child: 100.00%)
- ConvertRowBatchTime: 2.421us
- PeakMemoryUsage: 0
- RowsReturned: 12 (12)
- RowsReturnedRate: 1.10 M/sec
DataStreamReceiver:
- BytesReceived: 104.00 B (104)
- DeserializeRowBatchTimer: 9.941us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 4.09 KB (4192)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 162.842ms, non-child: 162.842ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.33
- BytesRead: 11.62 MB (12184526)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 11.62 MB (12184526)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 11.62 MB (12184526)
- CachedFileHandlesHitCount: 814 (814)
- CachedFileHandlesMissCount: 40 (40)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 2.013ms
- MaxCompressedTextFileLength: 0
- NumColumns: 6 (6)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 122 (122)
- NumScannerThreadsStarted: 7 (7)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 5.10 MB (5344718)
- PerReadThreadRawHdfsThroughput: 38.18 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 23.416ms
- RowBatchQueuePutWaitTime: 11s327ms
- RowsRead: 184.62K (184620)
- RowsReturned: 171.62K (171625)
- RowsReturnedRate: 1.20 M/sec
- ScanRangesComplete: 608 (608)
- ScannerThreadsInvoluntaryContextSwitches: 364 (364)
- ScannerThreadsTotalWallClockTime: 12s640ms
- MaterializeTupleTime(*): 190.820ms
- ScannerThreadsSysTime: 2.666ms
- ScannerThreadsUserTime: 290.666ms
- ScannerThreadsVoluntaryContextSwitches: 3.02K (3018)
- TotalRawHdfsReadTime(*): 308.964ms
- TotalReadThroughput: 2.14 MB/sec
Filter 0 (1.00 MB):
- Files processed: 608 (608)
- Files rejected: 486 (486)
- Files total: 608 (608)
- RowGroups processed: 160 (160)
- RowGroups rejected: 0 (0)
- RowGroups total: 160 (160)
- Rows processed: 184.62K (184620)
- Rows rejected: 0 (0)
- Rows total: 184.62K (184620)
- Splits processed: 122 (122)
- Splits rejected: 0 (0)
- Splits total: 122 (122)
Filter 1 (1.00 MB):
- Rows processed: 184.62K (184620)
- Rows rejected: 9.99K (9990)
- Rows total: 184.62K (184620)
Filter 2 (1.00 MB):
- Rows processed: 143.68K (143682)
- Rows rejected: 1.75K (1745)
- Rows total: 174.63K (174629)
Filter 3 (1.00 MB):
- Rows processed: 172.88K (172884)
- Rows rejected: 1.26K (1258)
- Rows total: 172.88K (172884)
Fragment F00:
Instance 124b576fcc163695:b093f1d100000006 (host=twood-OptiPlex-7040:22001):(Total: 2s756ms, non-child: 41.796ms, % non-child: 1.52%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:608/61.62 MB
Filter 0 arrival: 893ms
Filter 3 arrival: 894ms
Filter 1 arrival: 915ms
Filter 2 arrival: 2s137ms
MemoryUsage(500.000ms): 17.86 MB, 20.95 MB, 145.72 MB, 175.77 MB, 223.62 MB, 266.37 MB
ThreadUsage(500.000ms): 1, 1, 10, 10, 10, 1
- AverageThreadTokens: 5.50
- BloomFilterBytes: 4.00 MB (4194304)
- PeakMemoryUsage: 277.75 MB (291239164)
- PeakReservation: 262.00 MB (274726912)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 277.75 MB (291239164)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 509.128ms
- TotalNetworkSendTime: 195.922us
- TotalStorageWaitTime: 348.557ms
- TotalThreadsInvoluntaryContextSwitches: 958 (958)
- TotalThreadsTotalWallClockTime: 18s954ms
- TotalThreadsSysTime: 28.000ms
- TotalThreadsUserTime: 2s300ms
- TotalThreadsVoluntaryContextSwitches: 8.75K (8748)
Fragment Instance Lifecycle Timings:
- ExecTime: 297.507us
- ExecTreeExecTime: 4.897us
- OpenTime: 2s689ms
- ExecTreeOpenTime: 1s864ms
- PrepareTime: 66.012ms
- ExecTreePrepareTime: 3.515ms
DataStreamSender (dst_id=14):(Total: 984.196us, non-child: 984.196us, % non-child: 100.00%)
- BytesSent: 17.00 B (17)
- NetworkThroughput(*): 523.56 KB/sec
- OverallThroughput: 16.87 KB/sec
- PeakMemoryUsage: 14.22 KB (14560)
- RowsReturned: 1 (1)
- SerializeBatchTime: 8.350us
- TransmitDataRPCTime: 31.709us
- UncompressedRowBatchSize: 17.00 B (17)
CodeGen:(Total: 845.206ms, non-child: 845.206ms, % non-child: 100.00%)
- CodegenTime: 3.275ms
- CompileTime: 59.273ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 324 (324)
- NumInstructions: 14.78K (14782)
- OptimizationTime: 764.219ms
- PeakMemoryUsage: 7.22 MB (7568384)
- PrepareTime: 21.153ms
AGGREGATION_NODE (id=9):(Total: 1s868ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Codegen Enabled
- BuildTime: 608.125us
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 0 (0)
- PeakMemoryUsage: 8.86 MB (9286036)
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
HASH_JOIN_NODE (id=8):(Total: 1s870ms, non-child: 598.123us, % non-child: 0.03%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 366 (366)
- BuildTime: 1.307ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 42.87 MB (44948116)
- ProbeRows: 119 (119)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 13.511us
- RowsReturned: 119 (119)
- RowsReturnedRate: 63.00 /sec
Buffer pool:
- AllocTime: 301.799us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=8):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 431.146us
- BuildRowsPartitioned: 366 (366)
- HashBuckets: 1.02K (1024)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 276.964us
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=13):(Total: 37.740us, non-child: 37.740us, % non-child: 100.00%)
- ConvertRowBatchTime: 27.382us
- PeakMemoryUsage: 0
- RowsReturned: 366 (366)
- RowsReturnedRate: 9.70 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 2.88 KB, 2.88 KB
- BytesReceived: 2.88 KB (2944)
- DeserializeRowBatchTimer: 13.907us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 6.86 KB (7024)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=7):(Total: 1s870ms, non-child: 2.342ms, % non-child: 0.13%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 48.48K (48475)
- BuildTime: 27.269ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 42.86 MB (44944020)
- ProbeRows: 983 (983)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 303.638us
- RowsReturned: 119 (119)
- RowsReturnedRate: 63.00 /sec
Buffer pool:
- AllocTime: 276.407us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 15.079ms
- BuildRowsPartitioned: 48.48K (48475)
- HashBuckets: 131.07K (131072)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 11.361ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=12):(Total: 6.690ms, non-child: 6.690ms, % non-child: 100.00%)
- ConvertRowBatchTime: 6.230ms
- PeakMemoryUsage: 0
- RowsReturned: 48.48K (48475)
- RowsReturnedRate: 7.25 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 1.10 MB, 1.10 MB
- BytesReceived: 1.10 MB (1148510)
- DeserializeRowBatchTimer: 14.186ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 2.77 MB (2906962)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=6):(Total: 1s867ms, non-child: 966.868ms, % non-child: 51.77%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.92M (1920800)
- BuildTime: 925.760ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 160.21 MB (167992680)
- ProbeRows: 170.46K (170455)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 90.397ms
- RowsReturned: 983 (983)
- RowsReturnedRate: 526.00 /sec
Buffer pool:
- AllocTime: 1.417ms
- CumulativeAllocationBytes: 160.00 MB (167772160)
- CumulativeAllocations: 64 (64)
- PeakReservation: 160.00 MB (167772160)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 160.00 MB (167772160)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=6):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 507.832ms
- BuildRowsPartitioned: 1.92M (1920800)
- HashBuckets: 4.19M (4194304)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 415.548ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=11):(Total: 727.461ms, non-child: 727.461ms, % non-child: 100.00%)
- ConvertRowBatchTime: 208.765ms
- PeakMemoryUsage: 0
- RowsReturned: 1.92M (1920800)
- RowsReturnedRate: 2.64 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 3.23 MB, 4.55 MB, 13.10 MB, 30.41 MB, 42.88 MB
- BytesReceived: 42.88 MB (44967110)
- DeserializeRowBatchTimer: 415.793ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 10.80 MB (11324132)
- SendersBlockedTimer: 597.448ms
- SendersBlockedTotalTimer(*): 597.451ms
HASH_JOIN_NODE (id=5):(Total: 245.325ms, non-child: 15.246ms, % non-child: 6.21%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 12 (12)
- BuildTime: 1.440ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 34.10 MB (35752116)
- ProbeRows: 170.46K (170455)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 11.732ms
- RowsReturned: 170.46K (170455)
- RowsReturnedRate: 694.81 K/sec
Buffer pool:
- AllocTime: 175.975us
- CumulativeAllocationBytes: 26.00 MB (27262976)
- CumulativeAllocations: 13 (13)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 26.00 MB (27262976)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=5):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 262.684us
- BuildRowsPartitioned: 12 (12)
- HashBuckets: 12 (12)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 193.117us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=10):(Total: 11.709us, non-child: 11.709us, % non-child: 100.00%)
- ConvertRowBatchTime: 2.475us
- PeakMemoryUsage: 0
- RowsReturned: 12 (12)
- RowsReturnedRate: 1.02 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 104.00 B, 104.00 B
- BytesReceived: 104.00 B (104)
- DeserializeRowBatchTimer: 6.262us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 4.09 KB (4192)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 230.081ms, non-child: 230.081ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:608/61.62 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 122 out of 122
Runtime filters: Not all filters arrived (arrived: [0, 1, 3], missing [2]), waited for 121ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:732 PARQUET/Unknown(Skipped):486
BytesRead(500.000ms): 0, 0, 2.66 MB, 2.66 MB, 2.66 MB
- FooterProcessingTime: (Avg: 1.213ms ; Min: 158.298us ; Max: 15.393ms ; Number of samples: 122)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.00
- BytesRead: 11.59 MB (12156325)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 11.59 MB (12156325)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 11.59 MB (12156325)
- CachedFileHandlesHitCount: 826 (826)
- CachedFileHandlesMissCount: 28 (28)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 1.787ms
- MaxCompressedTextFileLength: 0
- NumColumns: 6 (6)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 122 (122)
- NumScannerThreadsStarted: 8 (8)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 5.50 MB (5762724)
- PerReadThreadRawHdfsThroughput: 39.23 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 6.850ms
- RowBatchQueuePutWaitTime: 13s000ms
- RowsRead: 183.20K (183201)
- RowsReturned: 170.46K (170455)
- RowsReturnedRate: 740.85 K/sec
- ScanRangesComplete: 608 (608)
- ScannerThreadsInvoluntaryContextSwitches: 285 (285)
- ScannerThreadsTotalWallClockTime: 14s566ms
- MaterializeTupleTime(*): 158.562ms
- ScannerThreadsSysTime: 8.000ms
- ScannerThreadsUserTime: 288.000ms
- ScannerThreadsVoluntaryContextSwitches: 7.25K (7245)
- TotalRawHdfsReadTime(*): 295.536ms
- TotalReadThroughput: 1.06 MB/sec
Filter 0 (1.00 MB):
- Files processed: 608 (608)
- Files rejected: 486 (486)
- Files total: 608 (608)
- RowGroups processed: 157 (157)
- RowGroups rejected: 0 (0)
- RowGroups total: 157 (157)
- Rows processed: 183.20K (183201)
- Rows rejected: 0 (0)
- Rows total: 183.20K (183201)
- Splits processed: 122 (122)
- Splits rejected: 0 (0)
- Splits total: 122 (122)
Filter 1 (1.00 MB):
- Rows processed: 183.20K (183201)
- Rows rejected: 9.75K (9751)
- Rows total: 183.20K (183201)
Filter 2 (1.00 MB):
- Rows processed: 138.38K (138377)
- Rows rejected: 1.68K (1679)
- Rows total: 173.45K (173450)
Filter 3 (1.00 MB):
- Rows processed: 171.77K (171771)
- Rows rejected: 1.32K (1316)
- Rows total: 171.77K (171771)
Instance 124b576fcc163695:b093f1d100000005 (host=twood-OptiPlex-7040:22002):(Total: 2s731ms, non-child: 43.830ms, % non-child: 1.60%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:608/66.84 MB
Filter 0 arrival: 919ms
Filter 3 arrival: 921ms
Filter 1 arrival: 941ms
Filter 2 arrival: 2s140ms
MemoryUsage(500.000ms): 20.74 MB, 20.95 MB, 145.43 MB, 207.43 MB, 231.34 MB
ThreadUsage(500.000ms): 1, 1, 10, 10, 10
- AverageThreadTokens: 6.40
- BloomFilterBytes: 4.00 MB (4194304)
- PeakMemoryUsage: 277.63 MB (291113748)
- PeakReservation: 262.00 MB (274726912)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 277.63 MB (291113748)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 456.873ms
- TotalNetworkSendTime: 577.000ns
- TotalStorageWaitTime: 533.450ms
- TotalThreadsInvoluntaryContextSwitches: 670 (670)
- TotalThreadsTotalWallClockTime: 18s556ms
- TotalThreadsSysTime: 20.000ms
- TotalThreadsUserTime: 2s356ms
- TotalThreadsVoluntaryContextSwitches: 2.26K (2260)
Fragment Instance Lifecycle Timings:
- ExecTime: 305.815us
- ExecTreeExecTime: 7.174us
- OpenTime: 2s660ms
- ExecTreeOpenTime: 1s813ms
- PrepareTime: 70.541ms
- ExecTreePrepareTime: 5.019ms
DataStreamSender (dst_id=14):(Total: 121.084us, non-child: 121.084us, % non-child: 100.00%)
- BytesSent: 17.00 B (17)
- NetworkThroughput(*): 539.20 KB/sec
- OverallThroughput: 137.11 KB/sec
- PeakMemoryUsage: 14.22 KB (14560)
- RowsReturned: 1 (1)
- SerializeBatchTime: 8.235us
- TransmitDataRPCTime: 30.789us
- UncompressedRowBatchSize: 17.00 B (17)
CodeGen:(Total: 869.485ms, non-child: 869.485ms, % non-child: 100.00%)
- CodegenTime: 3.619ms
- CompileTime: 59.344ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 324 (324)
- NumInstructions: 14.78K (14782)
- OptimizationTime: 786.530ms
- PeakMemoryUsage: 7.22 MB (7568384)
- PrepareTime: 23.041ms
AGGREGATION_NODE (id=9):(Total: 1s818ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Codegen Enabled
- BuildTime: 1.194ms
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 0 (0)
- PeakMemoryUsage: 9.09 MB (9530644)
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
HASH_JOIN_NODE (id=8):(Total: 1s821ms, non-child: 721.282us, % non-child: 0.04%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 366 (366)
- BuildTime: 1.284ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 43.10 MB (45192724)
- ProbeRows: 120 (120)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 27.178us
- RowsReturned: 120 (120)
- RowsReturnedRate: 65.00 /sec
Buffer pool:
- AllocTime: 267.001us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=8):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 402.421us
- BuildRowsPartitioned: 366 (366)
- HashBuckets: 1.02K (1024)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 341.534us
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=13):(Total: 35.469us, non-child: 35.469us, % non-child: 100.00%)
- ConvertRowBatchTime: 27.628us
- PeakMemoryUsage: 0
- RowsReturned: 366 (366)
- RowsReturnedRate: 10.32 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 2.88 KB, 2.88 KB
- BytesReceived: 2.88 KB (2944)
- DeserializeRowBatchTimer: 16.904us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 6.86 KB (7024)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=7):(Total: 1s820ms, non-child: 2.549ms, % non-child: 0.14%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 48.48K (48475)
- BuildTime: 22.374ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 42.12 MB (44163828)
- ProbeRows: 1.11K (1111)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 573.677us
- RowsReturned: 120 (120)
- RowsReturnedRate: 65.00 /sec
Buffer pool:
- AllocTime: 280.508us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 14.067ms
- BuildRowsPartitioned: 48.48K (48475)
- HashBuckets: 131.07K (131072)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 7.528ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=12):(Total: 6.207ms, non-child: 6.207ms, % non-child: 100.00%)
- ConvertRowBatchTime: 5.805ms
- PeakMemoryUsage: 0
- RowsReturned: 48.48K (48475)
- RowsReturnedRate: 7.81 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 1.10 MB, 1.10 MB
- BytesReceived: 1.10 MB (1148510)
- DeserializeRowBatchTimer: 12.825ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 2.77 MB (2906962)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=6):(Total: 1s818ms, non-child: 978.883ms, % non-child: 53.84%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.92M (1920800)
- BuildTime: 934.627ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 160.18 MB (167961296)
- ProbeRows: 173.27K (173269)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 87.088ms
- RowsReturned: 1.11K (1111)
- RowsReturnedRate: 611.00 /sec
Buffer pool:
- AllocTime: 1.339ms
- CumulativeAllocationBytes: 160.00 MB (167772160)
- CumulativeAllocations: 64 (64)
- PeakReservation: 160.00 MB (167772160)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 160.00 MB (167772160)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=6):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 526.020ms
- BuildRowsPartitioned: 1.92M (1920800)
- HashBuckets: 4.19M (4194304)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 407.334ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=11):(Total: 685.946ms, non-child: 685.946ms, % non-child: 100.00%)
- ConvertRowBatchTime: 219.967ms
- PeakMemoryUsage: 0
- RowsReturned: 1.92M (1920800)
- RowsReturnedRate: 2.80 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 4.44 MB, 4.55 MB, 14.56 MB, 31.69 MB, 42.88 MB
- BytesReceived: 42.88 MB (44967110)
- DeserializeRowBatchTimer: 423.495ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 10.80 MB (11324108)
- SendersBlockedTimer: 618.110ms
- SendersBlockedTotalTimer(*): 618.111ms
HASH_JOIN_NODE (id=5):(Total: 186.597ms, non-child: 22.900ms, % non-child: 12.27%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 12 (12)
- BuildTime: 1.299ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 34.10 MB (35758164)
- ProbeRows: 173.27K (173269)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 11.098ms
- RowsReturned: 173.27K (173269)
- RowsReturnedRate: 928.57 K/sec
Buffer pool:
- AllocTime: 127.406us
- CumulativeAllocationBytes: 26.00 MB (27262976)
- CumulativeAllocations: 13 (13)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 26.00 MB (27262976)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=5):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 279.360us
- BuildRowsPartitioned: 12 (12)
- HashBuckets: 12 (12)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 187.668us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=10):(Total: 9.600us, non-child: 9.600us, % non-child: 100.00%)
- ConvertRowBatchTime: 2.096us
- PeakMemoryUsage: 0
- RowsReturned: 12 (12)
- RowsReturnedRate: 1.25 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 104.00 B, 104.00 B
- BytesReceived: 104.00 B (104)
- DeserializeRowBatchTimer: 17.872us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 4.09 KB (4192)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 163.700ms, non-child: 163.700ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:608/66.84 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 122 out of 122
Runtime filters: Not all filters arrived (arrived: [0, 1, 3], missing [2]), waited for 80ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:732 PARQUET/Unknown(Skipped):486
BytesRead(500.000ms): 0, 0, 2.41 MB, 2.41 MB, 2.41 MB
- FooterProcessingTime: (Avg: 1.815ms ; Min: 169.115us ; Max: 14.161ms ; Number of samples: 122)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.00
- BytesRead: 11.64 MB (12207008)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 11.64 MB (12207008)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 11.64 MB (12207008)
- CachedFileHandlesHitCount: 821 (821)
- CachedFileHandlesMissCount: 33 (33)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 1.906ms
- MaxCompressedTextFileLength: 0
- NumColumns: 6 (6)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 122 (122)
- NumScannerThreadsStarted: 8 (8)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 5.60 MB (5869328)
- PerReadThreadRawHdfsThroughput: 32.16 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 23.119ms
- RowBatchQueuePutWaitTime: 12s657ms
- RowsRead: 186.32K (186324)
- RowsReturned: 173.27K (173269)
- RowsReturnedRate: 1.06 M/sec
- ScanRangesComplete: 608 (608)
- ScannerThreadsInvoluntaryContextSwitches: 190 (190)
- ScannerThreadsTotalWallClockTime: 14s235ms
- MaterializeTupleTime(*): 223.378ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 292.000ms
- ScannerThreadsVoluntaryContextSwitches: 707 (707)
- TotalRawHdfsReadTime(*): 361.974ms
- TotalReadThroughput: 986.96 KB/sec
Filter 0 (1.00 MB):
- Files processed: 608 (608)
- Files rejected: 486 (486)
- Files total: 608 (608)
- RowGroups processed: 161 (161)
- RowGroups rejected: 0 (0)
- RowGroups total: 161 (161)
- Rows processed: 186.32K (186324)
- Rows rejected: 0 (0)
- Rows total: 186.32K (186324)
- Splits processed: 122 (122)
- Splits rejected: 0 (0)
- Splits total: 122 (122)
Filter 1 (1.00 MB):
- Rows processed: 186.32K (186324)
- Rows rejected: 10.08K (10077)
- Rows total: 186.32K (186324)
Filter 2 (1.00 MB):
- Rows processed: 147.46K (147459)
- Rows rejected: 1.76K (1759)
- Rows total: 176.25K (176247)
Filter 3 (1.00 MB):
- Rows processed: 174.49K (174488)
- Rows rejected: 1.22K (1219)
- Rows total: 174.49K (174488)
Instance 124b576fcc163695:b093f1d100000007 (host=twood-OptiPlex-7040:22000):(Total: 2s519ms, non-child: 84.943ms, % non-child: 3.37%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:608/61.36 MB
Filter 0 arrival: 968ms
Filter 3 arrival: 968ms
Filter 1 arrival: 982ms
Filter 2 arrival: 2s132ms
MemoryUsage(500.000ms): 20.95 MB, 148.90 MB, 174.51 MB, 206.56 MB, 277.38 MB
ThreadUsage(500.000ms): 1, 8, 8, 8, 7
- AverageThreadTokens: 6.40
- BloomFilterBytes: 4.00 MB (4194304)
- PeakMemoryUsage: 277.76 MB (291251250)
- PeakReservation: 262.00 MB (274726912)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 277.77 MB (291263538)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 411.972ms
- TotalNetworkSendTime: 148.639us
- TotalStorageWaitTime: 248.251ms
- TotalThreadsInvoluntaryContextSwitches: 1.37K (1370)
- TotalThreadsTotalWallClockTime: 12s998ms
- TotalThreadsSysTime: 16.000ms
- TotalThreadsUserTime: 2s204ms
- TotalThreadsVoluntaryContextSwitches: 2.57K (2573)
Fragment Instance Lifecycle Timings:
- ExecTime: 253.031us
- ExecTreeExecTime: 7.172us
- OpenTime: 2s406ms
- ExecTreeOpenTime: 1s552ms
- PrepareTime: 111.891ms
- ExecTreePrepareTime: 4.850ms
DataStreamSender (dst_id=14):(Total: 164.894us, non-child: 164.894us, % non-child: 100.00%)
- BytesSent: 17.00 B (17)
- NetworkThroughput(*): 483.39 KB/sec
- OverallThroughput: 100.68 KB/sec
- PeakMemoryUsage: 14.22 KB (14560)
- RowsReturned: 1 (1)
- SerializeBatchTime: 11.464us
- TransmitDataRPCTime: 34.344us
- UncompressedRowBatchSize: 17.00 B (17)
CodeGen:(Total: 876.518ms, non-child: 876.518ms, % non-child: 100.00%)
- CodegenTime: 3.568ms
- CompileTime: 60.122ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 324 (324)
- NumInstructions: 14.78K (14782)
- OptimizationTime: 791.570ms
- PeakMemoryUsage: 7.22 MB (7568384)
- PrepareTime: 24.235ms
AGGREGATION_NODE (id=9):(Total: 1s557ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Codegen Enabled
- BuildTime: 1.145ms
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 0 (0)
- PeakMemoryUsage: 9.14 MB (9583436)
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
HASH_JOIN_NODE (id=8):(Total: 1s560ms, non-child: 753.758us, % non-child: 0.05%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 366 (366)
- BuildTime: 2.548ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 43.15 MB (45245516)
- ProbeRows: 111 (111)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 24.409us
- RowsReturned: 111 (111)
- RowsReturnedRate: 71.00 /sec
Buffer pool:
- AllocTime: 597.622us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=8):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 728.401us
- BuildRowsPartitioned: 366 (366)
- HashBuckets: 1.02K (1024)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 453.506us
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=13):(Total: 60.760us, non-child: 60.760us, % non-child: 100.00%)
- ConvertRowBatchTime: 51.945us
- PeakMemoryUsage: 0
- RowsReturned: 366 (366)
- RowsReturnedRate: 6.02 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 2.88 KB
- BytesReceived: 2.88 KB (2944)
- DeserializeRowBatchTimer: 17.578us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 6.86 KB (7024)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=7):(Total: 1s559ms, non-child: 1.429ms, % non-child: 0.09%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 48.48K (48475)
- BuildTime: 19.921ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 41.84 MB (43873844)
- ProbeRows: 1.14K (1141)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 568.356us
- RowsReturned: 111 (111)
- RowsReturnedRate: 71.00 /sec
Buffer pool:
- AllocTime: 121.943us
- CumulativeAllocationBytes: 34.00 MB (35651584)
- CumulativeAllocations: 17 (17)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 34.00 MB (35651584)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 9.993ms
- BuildRowsPartitioned: 48.48K (48475)
- HashBuckets: 131.07K (131072)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 8.504ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=12):(Total: 4.620ms, non-child: 4.620ms, % non-child: 100.00%)
- ConvertRowBatchTime: 4.253ms
- PeakMemoryUsage: 0
- RowsReturned: 48.48K (48475)
- RowsReturnedRate: 10.49 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 1.10 MB
- BytesReceived: 1.10 MB (1148510)
- DeserializeRowBatchTimer: 13.129ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 2.77 MB (2906962)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=6):(Total: 1s558ms, non-child: 828.656ms, % non-child: 53.17%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.92M (1920800)
- BuildTime: 799.806ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 160.18 MB (167963796)
- ProbeRows: 171.15K (171153)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 51.256ms
- RowsReturned: 1.14K (1141)
- RowsReturnedRate: 732.00 /sec
Buffer pool:
- AllocTime: 578.966us
- CumulativeAllocationBytes: 160.00 MB (167772160)
- CumulativeAllocations: 64 (64)
- PeakReservation: 160.00 MB (167772160)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 160.00 MB (167772160)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=6):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 522.169ms
- BuildRowsPartitioned: 1.92M (1920800)
- HashBuckets: 4.19M (4194304)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 275.486ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=11):(Total: 634.113ms, non-child: 634.113ms, % non-child: 100.00%)
- ConvertRowBatchTime: 211.830ms
- PeakMemoryUsage: 0
- RowsReturned: 1.92M (1920800)
- RowsReturnedRate: 3.03 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 4.55 MB, 5.15 MB, 21.74 MB, 38.16 MB
- BytesReceived: 42.88 MB (44967110)
- DeserializeRowBatchTimer: 418.315ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 10.80 MB (11324132)
- SendersBlockedTimer: 674.704ms
- SendersBlockedTotalTimer(*): 674.707ms
HASH_JOIN_NODE (id=5):(Total: 111.231ms, non-child: 16.476ms, % non-child: 14.81%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 12 (12)
- BuildTime: 2.225ms
- NumHashTableBuildsSkipped: 0 (0)
- PeakMemoryUsage: 34.10 MB (35752884)
- ProbeRows: 171.15K (171153)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 12.096ms
- RowsReturned: 171.15K (171153)
- RowsReturnedRate: 1.54 M/sec
Buffer pool:
- AllocTime: 189.916us
- CumulativeAllocationBytes: 26.00 MB (27262976)
- CumulativeAllocations: 13 (13)
- PeakReservation: 34.00 MB (35651584)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 26.00 MB (27262976)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Hash Join Builder (join_node_id=5):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 276.361us
- BuildRowsPartitioned: 12 (12)
- HashBuckets: 12 (12)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 263.832us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 17.12 KB (17536)
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
EXCHANGE_NODE (id=10):(Total: 11.786us, non-child: 11.786us, % non-child: 100.00%)
- ConvertRowBatchTime: 2.694us
- PeakMemoryUsage: 0
- RowsReturned: 12 (12)
- RowsReturnedRate: 1.02 M/sec
DataStreamReceiver:
BytesReceived(500.000ms): 104.00 B
- BytesReceived: 104.00 B (104)
- DeserializeRowBatchTimer: 5.690us
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 4.09 KB (4192)
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 94.745ms, non-child: 94.745ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:608/61.36 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 122 out of 122
Runtime filters: Not all filters arrived (arrived: [0, 1, 3], missing [2]), waited for 40ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:732 PARQUET/Unknown(Skipped):486
BytesRead(500.000ms): 0, 0, 2.11 MB, 2.11 MB, 11.01 MB
- FooterProcessingTime: (Avg: 842.921us ; Min: 152.943us ; Max: 5.730ms ; Number of samples: 122)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.00
- BytesRead: 11.63 MB (12190246)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 11.63 MB (12190246)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 11.63 MB (12190246)
- CachedFileHandlesHitCount: 795 (795)
- CachedFileHandlesMissCount: 59 (59)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 2.347ms
- MaxCompressedTextFileLength: 0
- NumColumns: 6 (6)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 122 (122)
- NumScannerThreadsStarted: 6 (6)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 4.20 MB (4402102)
- PerReadThreadRawHdfsThroughput: 43.16 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 40.279ms
- RowBatchQueuePutWaitTime: 8s323ms
- RowsRead: 184.34K (184336)
- RowsReturned: 171.15K (171153)
- RowsReturnedRate: 1.81 M/sec
- ScanRangesComplete: 608 (608)
- ScannerThreadsInvoluntaryContextSwitches: 618 (618)
- ScannerThreadsTotalWallClockTime: 9s120ms
- MaterializeTupleTime(*): 190.521ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 292.000ms
- ScannerThreadsVoluntaryContextSwitches: 1.10K (1102)
- TotalRawHdfsReadTime(*): 269.381ms
- TotalReadThroughput: 4.40 MB/sec
Filter 0 (1.00 MB):
- Files processed: 608 (608)
- Files rejected: 486 (486)
- Files total: 608 (608)
- RowGroups processed: 162 (162)
- RowGroups rejected: 0 (0)
- RowGroups total: 162 (162)
- Rows processed: 184.34K (184336)
- Rows rejected: 0 (0)
- Rows total: 184.34K (184336)
- Splits processed: 122 (122)
- Splits rejected: 0 (0)
- Splits total: 122 (122)
Filter 1 (1.00 MB):
- Rows processed: 184.34K (184336)
- Rows rejected: 10.14K (10144)
- Rows total: 184.34K (184336)
Filter 2 (1.00 MB):
- Rows processed: 145.21K (145211)
- Rows rejected: 1.80K (1798)
- Rows total: 174.19K (174192)
Filter 3 (1.00 MB):
- Rows processed: 172.39K (172394)
- Rows rejected: 1.24K (1241)
- Rows total: 172.39K (172394)
Averaged Fragment F01:(Total: 28.818ms, non-child: 636.479us, % non-child: 2.21%)
split sizes: min: 8.37 KB, max: 8.37 KB, avg: 8.37 KB, stddev: 0
completion times: min:50.293ms max:50.293ms mean: 50.293ms stddev:0.000ns
execution rates: min:166.50 KB/sec max:166.50 KB/sec mean:166.50 KB/sec stddev:0.72 B/sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 174.19 KB (178372)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 136.43 MB (143055428)
- RowsProduced: 12 (12)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 954.000ns
- TotalStorageWaitTime: 4.233us
- TotalThreadsInvoluntaryContextSwitches: 33 (33)
- TotalThreadsTotalWallClockTime: 14.205ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 12.000ms
- TotalThreadsVoluntaryContextSwitches: 12 (12)
Fragment Instance Lifecycle Timings:
- ExecTime: 1.613ms
- ExecTreeExecTime: 1.384ms
- OpenTime: 11.448ms
- ExecTreeOpenTime: 81.480us
- PrepareTime: 15.697ms
- ExecTreePrepareTime: 186.169us
DataStreamSender (dst_id=10):(Total: 761.217us, non-child: 761.217us, % non-child: 100.00%)
- BytesSent: 312.00 B (312)
- NetworkThroughput(*): 5.80 MB/sec
- OverallThroughput: 400.26 KB/sec
- PeakMemoryUsage: 76.78 KB (78624)
- RowsReturned: 12 (12)
- SerializeBatchTime: 14.253us
- TransmitDataRPCTime: 51.286us
- UncompressedRowBatchSize: 336.00 B (336)
CodeGen:(Total: 25.491ms, non-child: 25.491ms, % non-child: 100.00%)
- CodegenTime: 611.771us
- CompileTime: 1.606ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 7 (7)
- NumInstructions: 105 (105)
- OptimizationTime: 8.798ms
- PeakMemoryUsage: 52.50 KB (53760)
- PrepareTime: 14.541ms
HDFS_SCAN_NODE (id=1):(Total: 1.929ms, non-child: 1.929ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 8.47 KB (8673)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 8.47 KB (8673)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 8.47 KB (8673)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 6.366us
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 89.00 KB (91141)
- PerReadThreadRawHdfsThroughput: 47.81 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 946.252us
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 12 (12)
- RowsReturned: 12 (12)
- RowsReturnedRate: 6.22 K/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 16 (16)
- ScannerThreadsTotalWallClockTime: 1.153ms
- MaterializeTupleTime(*): 8.249us
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 0.000ns
- ScannerThreadsVoluntaryContextSwitches: 0 (0)
- TotalRawHdfsReadTime(*): 173.010us
- TotalReadThroughput: 0.00 /sec
Fragment F01:
Instance 124b576fcc163695:b093f1d100000001 (host=twood-OptiPlex-7040:22000):(Total: 28.818ms, non-child: 636.479us, % non-child: 2.21%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/8.37 KB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 174.19 KB (178372)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 136.43 MB (143055428)
- RowsProduced: 12 (12)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 954.000ns
- TotalStorageWaitTime: 4.233us
- TotalThreadsInvoluntaryContextSwitches: 33 (33)
- TotalThreadsTotalWallClockTime: 14.205ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 12.000ms
- TotalThreadsVoluntaryContextSwitches: 12 (12)
Fragment Instance Lifecycle Timings:
- ExecTime: 1.613ms
- ExecTreeExecTime: 1.384ms
- OpenTime: 11.448ms
- ExecTreeOpenTime: 81.480us
- PrepareTime: 15.697ms
- ExecTreePrepareTime: 186.169us
DataStreamSender (dst_id=10):(Total: 761.217us, non-child: 761.217us, % non-child: 100.00%)
- BytesSent: 312.00 B (312)
- NetworkThroughput(*): 5.80 MB/sec
- OverallThroughput: 400.26 KB/sec
- PeakMemoryUsage: 76.78 KB (78624)
- RowsReturned: 12 (12)
- SerializeBatchTime: 14.253us
- TransmitDataRPCTime: 51.286us
- UncompressedRowBatchSize: 336.00 B (336)
CodeGen:(Total: 25.491ms, non-child: 25.491ms, % non-child: 100.00%)
- CodegenTime: 611.771us
- CompileTime: 1.606ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 7 (7)
- NumInstructions: 105 (105)
- OptimizationTime: 8.798ms
- PeakMemoryUsage: 52.50 KB (53760)
- PrepareTime: 14.541ms
HDFS_SCAN_NODE (id=1):(Total: 1.929ms, non-child: 1.929ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/8.37 KB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:1
- FooterProcessingTime: (Avg: 230.852us ; Min: 230.852us ; Max: 230.852us ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 8.47 KB (8673)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 8.47 KB (8673)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 8.47 KB (8673)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 6.366us
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 89.00 KB (91141)
- PerReadThreadRawHdfsThroughput: 47.81 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 946.252us
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 12 (12)
- RowsReturned: 12 (12)
- RowsReturnedRate: 6.22 K/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 16 (16)
- ScannerThreadsTotalWallClockTime: 1.153ms
- MaterializeTupleTime(*): 8.249us
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 0.000ns
- ScannerThreadsVoluntaryContextSwitches: 0 (0)
- TotalRawHdfsReadTime(*): 173.010us
- TotalReadThroughput: 0.00 /sec
Averaged Fragment F02:(Total: 2s118ms, non-child: 354.539ms, % non-child: 16.73%)
split sizes: min: 7.48 MB, max: 7.48 MB, avg: 7.48 MB, stddev: 0
completion times: min:2s140ms max:2s140ms mean: 2s140ms stddev:0.000ns
execution rates: min:3.49 MB/sec max:3.49 MB/sec mean:3.49 MB/sec stddev:0.99 B/sec
num instances: 1
- AverageThreadTokens: 2.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.50 MB (12053907)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 218.22 MB (228824001)
- RowsProduced: 1.92M (1920800)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 767.686ms
- TotalStorageWaitTime: 21.592us
- TotalThreadsInvoluntaryContextSwitches: 1.01K (1013)
- TotalThreadsTotalWallClockTime: 4s085ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 1s680ms
- TotalThreadsVoluntaryContextSwitches: 2.00K (1996)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s056ms
- ExecTreeExecTime: 77.003ms
- OpenTime: 11.506ms
- ExecTreeOpenTime: 80.888us
- PrepareTime: 50.834ms
- ExecTreePrepareTime: 190.119us
DataStreamSender (dst_id=11):(Total: 1s651ms, non-child: 1s651ms, % non-child: 100.00%)
- BytesSent: 128.65 MB (134901330)
- NetworkThroughput(*): 237.68 MB/sec
- OverallThroughput: 77.88 MB/sec
- PeakMemoryUsage: 10.36 KB (10608)
- RowsReturned: 1.92M (1920800)
- SerializeBatchTime: 1s095ms
- TransmitDataRPCTime: 541.271ms
- UncompressedRowBatchSize: 283.43 MB (297197712)
CodeGen:(Total: 36.745ms, non-child: 36.745ms, % non-child: 100.00%)
- CodegenTime: 600.219us
- CompileTime: 1.695ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 7 (7)
- NumInstructions: 105 (105)
- OptimizationTime: 8.637ms
- PeakMemoryUsage: 52.50 KB (53760)
- PrepareTime: 25.875ms
HDFS_SCAN_NODE (id=2):(Total: 75.438ms, non-child: 75.438ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 1.00
- BytesRead: 7.56 MB (7923770)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 7.56 MB (7923770)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 7.56 MB (7923770)
- CachedFileHandlesHitCount: 4 (4)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 1.564ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 11.48 MB (12034692)
- PerReadThreadRawHdfsThroughput: 2.38 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 7.751ms
- RowBatchQueuePutWaitTime: 1s425ms
- RowsRead: 1.92M (1920800)
- RowsReturned: 1.92M (1920800)
- RowsReturnedRate: 25.46 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 253 (253)
- ScannerThreadsTotalWallClockTime: 2s017ms
- MaterializeTupleTime(*): 566.354ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 564.000ms
- ScannerThreadsVoluntaryContextSwitches: 1.54K (1538)
- TotalRawHdfsReadTime(*): 3.105ms
- TotalReadThroughput: 3.78 MB/sec
Fragment F02:
Instance 124b576fcc163695:b093f1d100000002 (host=twood-OptiPlex-7040:22000):(Total: 2s118ms, non-child: 354.539ms, % non-child: 16.73%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/7.48 MB
MemoryUsage(500.000ms): 11.49 MB, 11.49 MB, 11.49 MB, 11.49 MB
ThreadUsage(500.000ms): 2, 2, 2, 2
- AverageThreadTokens: 2.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.50 MB (12053907)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 218.22 MB (228824001)
- RowsProduced: 1.92M (1920800)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 767.686ms
- TotalStorageWaitTime: 21.592us
- TotalThreadsInvoluntaryContextSwitches: 1.01K (1013)
- TotalThreadsTotalWallClockTime: 4s085ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 1s680ms
- TotalThreadsVoluntaryContextSwitches: 2.00K (1996)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s056ms
- ExecTreeExecTime: 77.003ms
- OpenTime: 11.506ms
- ExecTreeOpenTime: 80.888us
- PrepareTime: 50.834ms
- ExecTreePrepareTime: 190.119us
DataStreamSender (dst_id=11):(Total: 1s651ms, non-child: 1s651ms, % non-child: 100.00%)
- BytesSent: 128.65 MB (134901330)
- NetworkThroughput(*): 237.68 MB/sec
- OverallThroughput: 77.88 MB/sec
- PeakMemoryUsage: 10.36 KB (10608)
- RowsReturned: 1.92M (1920800)
- SerializeBatchTime: 1s095ms
- TransmitDataRPCTime: 541.271ms
- UncompressedRowBatchSize: 283.43 MB (297197712)
CodeGen:(Total: 36.745ms, non-child: 36.745ms, % non-child: 100.00%)
- CodegenTime: 600.219us
- CompileTime: 1.695ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 7 (7)
- NumInstructions: 105 (105)
- OptimizationTime: 8.637ms
- PeakMemoryUsage: 52.50 KB (53760)
- PrepareTime: 25.875ms
HDFS_SCAN_NODE (id=2):(Total: 75.438ms, non-child: 75.438ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/7.48 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:3
BytesRead(500.000ms): 7.56 MB, 7.56 MB, 7.56 MB, 7.56 MB
- FooterProcessingTime: (Avg: 132.586us ; Min: 132.586us ; Max: 132.586us ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 1.00
- BytesRead: 7.56 MB (7923770)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 7.56 MB (7923770)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 7.56 MB (7923770)
- CachedFileHandlesHitCount: 4 (4)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 1.564ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 11.48 MB (12034692)
- PerReadThreadRawHdfsThroughput: 2.38 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 7.751ms
- RowBatchQueuePutWaitTime: 1s425ms
- RowsRead: 1.92M (1920800)
- RowsReturned: 1.92M (1920800)
- RowsReturnedRate: 25.46 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 253 (253)
- ScannerThreadsTotalWallClockTime: 2s017ms
- MaterializeTupleTime(*): 566.354ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 564.000ms
- ScannerThreadsVoluntaryContextSwitches: 1.54K (1538)
- TotalRawHdfsReadTime(*): 3.105ms
- TotalReadThroughput: 3.78 MB/sec
Averaged Fragment F03:(Total: 165.681ms, non-child: 24.259ms, % non-child: 14.64%)
split sizes: min: 1.16 MB, max: 1.16 MB, avg: 1.16 MB, stddev: 0
completion times: min:187.846ms max:187.846ms mean: 187.846ms stddev:0.000ns
execution rates: min:6.18 MB/sec max:6.18 MB/sec mean:6.18 MB/sec stddev:0.51 B/sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.67 MB (2803659)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 161.41 MB (169255602)
- RowsProduced: 48.48K (48475)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 15.719ms
- TotalStorageWaitTime: 12.701us
- TotalThreadsInvoluntaryContextSwitches: 101 (101)
- TotalThreadsTotalWallClockTime: 158.256ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 88.000ms
- TotalThreadsVoluntaryContextSwitches: 35 (35)
Fragment Instance Lifecycle Timings:
- ExecTime: 85.960ms
- ExecTreeExecTime: 27.161ms
- OpenTime: 44.120ms
- ExecTreeOpenTime: 127.465us
- PrepareTime: 35.548ms
- ExecTreePrepareTime: 116.619us
DataStreamSender (dst_id=12):(Total: 52.072ms, non-child: 52.072ms, % non-child: 100.00%)
- BytesSent: 3.29 MB (3445530)
- NetworkThroughput(*): 502.42 MB/sec
- OverallThroughput: 63.10 MB/sec
- PeakMemoryUsage: 10.36 KB (10608)
- RowsReturned: 48.48K (48475)
- SerializeBatchTime: 29.710ms
- TransmitDataRPCTime: 6.540ms
- UncompressedRowBatchSize: 7.76 MB (8139762)
CodeGen:(Total: 61.861ms, non-child: 61.861ms, % non-child: 100.00%)
- CodegenTime: 1.306ms
- CompileTime: 4.152ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 32 (32)
- NumInstructions: 483 (483)
- OptimizationTime: 38.821ms
- PeakMemoryUsage: 241.50 KB (247296)
- PrepareTime: 16.329ms
HDFS_SCAN_NODE (id=3):(Total: 27.487ms, non-child: 27.487ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 415.72 KB (425699)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 415.72 KB (425699)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 415.72 KB (425699)
- CachedFileHandlesHitCount: 4 (4)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 80.980us
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 2.62 MB (2745542)
- PerReadThreadRawHdfsThroughput: 633.69 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 7.821ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 50.00K (50000)
- RowsReturned: 48.48K (48475)
- RowsReturnedRate: 1.76 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 22 (22)
- ScannerThreadsTotalWallClockTime: 28.188ms
- MaterializeTupleTime(*): 20.396ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 20.000ms
- ScannerThreadsVoluntaryContextSwitches: 1 (1)
- TotalRawHdfsReadTime(*): 640.661us
- TotalReadThroughput: 0.00 /sec
Fragment F03:
Instance 124b576fcc163695:b093f1d100000003 (host=twood-OptiPlex-7040:22000):(Total: 165.681ms, non-child: 24.259ms, % non-child: 14.64%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/1.16 MB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.67 MB (2803659)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 161.41 MB (169255602)
- RowsProduced: 48.48K (48475)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 15.719ms
- TotalStorageWaitTime: 12.701us
- TotalThreadsInvoluntaryContextSwitches: 101 (101)
- TotalThreadsTotalWallClockTime: 158.256ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 88.000ms
- TotalThreadsVoluntaryContextSwitches: 35 (35)
Fragment Instance Lifecycle Timings:
- ExecTime: 85.960ms
- ExecTreeExecTime: 27.161ms
- OpenTime: 44.120ms
- ExecTreeOpenTime: 127.465us
- PrepareTime: 35.548ms
- ExecTreePrepareTime: 116.619us
DataStreamSender (dst_id=12):(Total: 52.072ms, non-child: 52.072ms, % non-child: 100.00%)
- BytesSent: 3.29 MB (3445530)
- NetworkThroughput(*): 502.42 MB/sec
- OverallThroughput: 63.10 MB/sec
- PeakMemoryUsage: 10.36 KB (10608)
- RowsReturned: 48.48K (48475)
- SerializeBatchTime: 29.710ms
- TransmitDataRPCTime: 6.540ms
- UncompressedRowBatchSize: 7.76 MB (8139762)
CodeGen:(Total: 61.861ms, non-child: 61.861ms, % non-child: 100.00%)
- CodegenTime: 1.306ms
- CompileTime: 4.152ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 32 (32)
- NumInstructions: 483 (483)
- OptimizationTime: 38.821ms
- PeakMemoryUsage: 241.50 KB (247296)
- PrepareTime: 16.329ms
HDFS_SCAN_NODE (id=3):(Total: 27.487ms, non-child: 27.487ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/1.16 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:3
- FooterProcessingTime: (Avg: 164.041us ; Min: 164.041us ; Max: 164.041us ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 415.72 KB (425699)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 415.72 KB (425699)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 415.72 KB (425699)
- CachedFileHandlesHitCount: 4 (4)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 80.980us
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 2.62 MB (2745542)
- PerReadThreadRawHdfsThroughput: 633.69 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 7.821ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 50.00K (50000)
- RowsReturned: 48.48K (48475)
- RowsReturnedRate: 1.76 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 22 (22)
- ScannerThreadsTotalWallClockTime: 28.188ms
- MaterializeTupleTime(*): 20.396ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 20.000ms
- ScannerThreadsVoluntaryContextSwitches: 1 (1)
- TotalRawHdfsReadTime(*): 640.661us
- TotalReadThroughput: 0.00 /sec
Averaged Fragment F04:(Total: 112.182ms, non-child: 13.774ms, % non-child: 12.28%)
split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0
completion times: min:134.270ms max:134.270ms mean: 134.270ms stddev:0.000ns
execution rates: min:16.02 MB/sec max:16.02 MB/sec mean:16.02 MB/sec stddev:0.58 B/sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 893.97 KB (915423)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 151.24 MB (158584114)
- RowsProduced: 366 (366)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 516.884us
- TotalStorageWaitTime: 833.445us
- TotalThreadsInvoluntaryContextSwitches: 26 (26)
- TotalThreadsTotalWallClockTime: 71.084ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 48.000ms
- TotalThreadsVoluntaryContextSwitches: 16 (16)
Fragment Instance Lifecycle Timings:
- ExecTime: 21.662ms
- ExecTreeExecTime: 20.788ms
- OpenTime: 28.522ms
- ExecTreeOpenTime: 94.674us
- PrepareTime: 61.949ms
- ExecTreePrepareTime: 117.169us
DataStreamSender (dst_id=13):(Total: 29.763ms, non-child: 29.763ms, % non-child: 100.00%)
- BytesSent: 8.62 KB (8832)
- NetworkThroughput(*): 99.97 MB/sec
- OverallThroughput: 289.79 KB/sec
- PeakMemoryUsage: 42.66 KB (43680)
- RowsReturned: 366 (366)
- SerializeBatchTime: 108.902us
- TransmitDataRPCTime: 84.250us
- UncompressedRowBatchSize: 13.95 KB (14286)
CodeGen:(Total: 47.496ms, non-child: 47.496ms, % non-child: 100.00%)
- CodegenTime: 995.073us
- CompileTime: 2.862ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 20 (20)
- NumInstructions: 319 (319)
- OptimizationTime: 24.407ms
- PeakMemoryUsage: 159.50 KB (163328)
- PrepareTime: 19.645ms
HDFS_SCAN_NODE (id=4):(Total: 21.149ms, non-child: 21.149ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 465.22 KB (476387)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 465.22 KB (476387)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 465.22 KB (476387)
- CachedFileHandlesHitCount: 3 (3)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 60.262us
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 842.28 KB (862490)
- PerReadThreadRawHdfsThroughput: 597.08 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 20.410ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 73.05K (73049)
- RowsReturned: 366 (366)
- RowsReturnedRate: 17.30 K/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 21 (21)
- ScannerThreadsTotalWallClockTime: 20.919ms
- MaterializeTupleTime(*): 15.856ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 16.000ms
- ScannerThreadsVoluntaryContextSwitches: 5 (5)
- TotalRawHdfsReadTime(*): 760.902us
- TotalReadThroughput: 0.00 /sec
Fragment F04:
Instance 124b576fcc163695:b093f1d100000004 (host=twood-OptiPlex-7040:22000):(Total: 112.182ms, non-child: 13.774ms, % non-child: 12.28%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/2.15 MB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 893.97 KB (915423)
- PeakReservation: 0
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 151.24 MB (158584114)
- RowsProduced: 366 (366)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 516.884us
- TotalStorageWaitTime: 833.445us
- TotalThreadsInvoluntaryContextSwitches: 26 (26)
- TotalThreadsTotalWallClockTime: 71.084ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 48.000ms
- TotalThreadsVoluntaryContextSwitches: 16 (16)
Fragment Instance Lifecycle Timings:
- ExecTime: 21.662ms
- ExecTreeExecTime: 20.788ms
- OpenTime: 28.522ms
- ExecTreeOpenTime: 94.674us
- PrepareTime: 61.949ms
- ExecTreePrepareTime: 117.169us
DataStreamSender (dst_id=13):(Total: 29.763ms, non-child: 29.763ms, % non-child: 100.00%)
- BytesSent: 8.62 KB (8832)
- NetworkThroughput(*): 99.97 MB/sec
- OverallThroughput: 289.79 KB/sec
- PeakMemoryUsage: 42.66 KB (43680)
- RowsReturned: 366 (366)
- SerializeBatchTime: 108.902us
- TransmitDataRPCTime: 84.250us
- UncompressedRowBatchSize: 13.95 KB (14286)
CodeGen:(Total: 47.496ms, non-child: 47.496ms, % non-child: 100.00%)
- CodegenTime: 995.073us
- CompileTime: 2.862ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.85 MB (1941540)
- NumFunctions: 20 (20)
- NumInstructions: 319 (319)
- OptimizationTime: 24.407ms
- PeakMemoryUsage: 159.50 KB (163328)
- PrepareTime: 19.645ms
HDFS_SCAN_NODE (id=4):(Total: 21.149ms, non-child: 21.149ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/2.15 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:2
- FooterProcessingTime: (Avg: 353.429us ; Min: 353.429us ; Max: 353.429us ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 465.22 KB (476387)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 465.22 KB (476387)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 465.22 KB (476387)
- CachedFileHandlesHitCount: 3 (3)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DecompressionTime: 60.262us
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 842.28 KB (862490)
- PerReadThreadRawHdfsThroughput: 597.08 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 20.410ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 73.05K (73049)
- RowsReturned: 366 (366)
- RowsReturnedRate: 17.30 K/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 21 (21)
- ScannerThreadsTotalWallClockTime: 20.919ms
- MaterializeTupleTime(*): 15.856ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 16.000ms
- ScannerThreadsVoluntaryContextSwitches: 5 (5)
- TotalRawHdfsReadTime(*): 760.902us
- TotalReadThroughput: 0.00 /sec