[PIG-2864] LOAD with FILTER should read data without MapReduce

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.13.0
• Release Note: Implemented in PIG-3642
• Assignee: Lorand Bendig
• Reporter: William W. Graham Jr
• Created: 08/Aug/12 22:50
• Updated: 10/Feb/14 10:51
• Resolved: 10/Feb/14 10:51

Description

A script like this should be able to read data directly from the LoadFunc and serve it without kicking off a MapReduce job:

a = LOAD 'data.txt';
b = LIMIT a 10;
DUMP b;

Hive has similar functionality which is handy.

Issue Links

• relates to: PIG-3642 Direct HDFS access for small jobs (fetch)