[DRILL-6140] Operators listed in Profiles Page doesn't always correspond with operator specified in Physical Plan - ASF JIRA

Attach files

Attach Screenshot

Voters

Stop watching

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 1.12.0
Fix Version/s: 1.13.0
Component/s: Web Server
Labels:
- ready-to-commit

Description

A query's physical plan correctly shows

 00-00 Screen : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
   00-01 Project(EXPR$0=[$0]) : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
     00-02 StreamAgg(group=[{}], EXPR$0=[$SUM0($0)]) : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
       00-03 UnionExchange : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
         01-01 StreamAgg(group=[{}], EXPR$0=[COUNT()]) : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
           01-02 Project($f0=[0]) : rowType = RecordType(INTEGER $f0): rowcount = 1.79279253E7, cumulative cost = ...
             01-03 Flatten(flattenField=[$1]) : rowType = RecordType(ANY rfsSpecCode, ...
               01-04 Project(rfsSpecCode=[$1], PUResultsArray=[$2]) : rowType = ...
                 01-05 SelectionVectorRemover : rowType = RecordType(ANY schemaName, ...
                   01-06 Filter(condition=[=($0, 'OnyxBlue')]) : rowType = ...
                     01-07 Project(schemaName=[$0], ITEM=[ITEM($1, 'rfsSpecCode')], ...
                       01-08 Scan(groupscan=[ParquetGroupScan [entries=[ReadEntryWithPath [

However, the profile page shows the operators as...

Operator ID	Type	Metrics
00-xx-00	SCREEN	...
00-xx-01	PROJECT	...
00-xx-02	STREAMING_AGGREGATE	...
00-xx-03	UNORDERED_RECEIVER	...
01-xx-00	SINGLE_SENDER	...
01-xx-01	STREAMING_AGGREGATE	...
01-xx-02	PROJECT	...
01-xx-03	SINGLE_SENDER	...
01-xx-04	PROJECT	...
01-xx-05	SELECTION_VECTOR_REMOVER	...
01-xx-06	FILTER	...
01-xx-07	PROJECT	...
01-xx-08	PARQUET_ROW_GROUP_SCAN	...