[CRUNCH-58] Implement PObject in Crunch/Scrunch

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3.0
• Fix Version/s: 0.4.0
• Assignee: Kiyan Ahmadizadeh
• Reporter: Kiyan Ahmadizadeh
• Created: 06/Sep/12 19:37
• Updated: 16/Nov/12 20:06
• Resolved: 13/Sep/12 14:15

Description

FlumeJava has the concept of a PObject<T>, a container for a singleton of type T. It is meant represent the result of a distributed computation that yields a singleton value (for example max, min, and length methods on PCollection<T>). Generally speaking, the result of any computation that combines/reduces a PCollection into a singleton value could be represented by a PObject.

Like PCollection, a PObject defers distributed computation until its value is actually used.

Issue Links

• relates to: CRUNCH-57 Add a length function to PCollection