[PIG-450] PERFORMANCE: Distinct should make use of combiner to remove duplicate values from keys.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.2.0
• Fix Version/s: 0.2.0
• Component/s: impl
• Assignee: Alan Gates
• Reporter: Alan Gates
• Created: 23/Sep/08 19:31
• Updated: 24/Mar/10 22:04
• Resolved: 24/Sep/08 18:14

Description

In 2.0 distinct was improved by removing values in the map and just passing an empty tuple along with the key. This can be further improved by adding a combiner step that passes along only the first empty tuple instead of all of them.