[DRILL-6140] Operators listed in Profiles Page doesn't always correspond with operator specified in Physical Plan

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.12.0
• Fix Version/s: 1.13.0
• Component/s: Web Server
• Labels: ready-to-commit
• Assignee: Kunal Khatua
• Reporter: Kunal Khatua
• Reviewer: Aman Sinha
• Created: 06/Feb/18 23:52
• Updated: 26/Feb/18 13:23
• Resolved: 19/Feb/18 09:39

Description

A query's physical plan correctly shows

 00-00 Screen : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
   00-01 Project(EXPR$0=[$0]) : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
     00-02 StreamAgg(group=[{}], EXPR$0=[$SUM0($0)]) : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
       00-03 UnionExchange : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
         01-01 StreamAgg(group=[{}], EXPR$0=[COUNT()]) : rowType = RecordType(BIGINT EXPR$0): rowcount = 1.0, cumulative cost = { ...
           01-02 Project($f0=[0]) : rowType = RecordType(INTEGER $f0): rowcount = 1.79279253E7, cumulative cost = ...
             01-03 Flatten(flattenField=[$1]) : rowType = RecordType(ANY rfsSpecCode, ...
               01-04 Project(rfsSpecCode=[$1], PUResultsArray=[$2]) : rowType = ...
                 01-05 SelectionVectorRemover : rowType = RecordType(ANY schemaName, ...
                   01-06 Filter(condition=[=($0, 'OnyxBlue')]) : rowType = ...
                     01-07 Project(schemaName=[$0], ITEM=[ITEM($1, 'rfsSpecCode')], ...
                       01-08 Scan(groupscan=[ParquetGroupScan [entries=[ReadEntryWithPath [

However, the profile page shows the operators as...

Operator ID	Type	Metrics
00-xx-00	SCREEN	...
00-xx-01	PROJECT	...
00-xx-02	STREAMING_AGGREGATE	...
00-xx-03	UNORDERED_RECEIVER	...
01-xx-00	SINGLE_SENDER	...
01-xx-01	STREAMING_AGGREGATE	...
01-xx-02	PROJECT	...
01-xx-03	SINGLE_SENDER	...
01-xx-04	PROJECT	...
01-xx-05	SELECTION_VECTOR_REMOVER	...
01-xx-06	FILTER	...
01-xx-07	PROJECT	...
01-xx-08	PARQUET_ROW_GROUP_SCAN	...

As you can see ... FLATTEN operator appears as a SINGLE_SENDER making the profile hard to interpret.

Issue Links

• causes: DRILL-6185 Error is displaying while accessing query profiles via the Web-UI
• links to: GitHub Pull Request #1116