Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
With the changes for ReduceSinkDedup it is no longer true that a non Map-side PTF Operator is preceded by an ExtractOp. For e.g. following query can produce the issue:
create view IF NOT EXISTS mfgr_price_view as select p_mfgr, p_brand, sum(p_retailprice) as s from part group by p_mfgr, p_brand; select p_mfgr, p_brand, s, sum(s) over w1 as s1 from mfgr_price_view window w1 as (distribute by p_mfgr sort by p_brand rows between 2 preceding and current row);
Fix is to add an explicit flag to PTFDesc