[PIG-3410] LimitOptimizer is applied before PartitionFilterOptimizer

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.1
• Fix Version/s: 0.12.0
• Assignee: Aniket Namadeo Mokashi
• Reporter: Aniket Namadeo Mokashi
• Created: 02/Aug/13 21:27
• Updated: 14/Oct/13 16:46
• Resolved: 16/Aug/13 21:52

Description

Consider following script-

hcat_load = LOAD 'X' using org.apache.hcatalog.pig.HCatLoader();
hcat_filter = FILTER hcat_load BY (part='Y');
hcat_limited = limit hcat_filter 5;
dump hcat_limited;                     

This script is not benefited from LimitOptimizer (pushing limit to loadfunc) because LimitOptimizer is applied before PartitionFilterOptimizer.