[PIG-2888] Improve performance of POPartialAgg - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.11
Component/s: None
Labels:
None

Description

During performance testing, we found that POPartialAgg can cause performance degradation for Pig jobs when the Algebraic UDFs it's being applied to aren't well suited to the operator's assumptions. Changing the implementation to a more flexible hash-based model can provide significant performance improvements.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

partialagg_patch_1.patch
22/Aug/12 22:18
29 kB
Dmitriy V. Ryaboy
partialagg_patch_2.patch
26/Aug/12 23:09
39 kB
Dmitriy V. Ryaboy
partialagg_patch_3.patch
27/Aug/12 05:30
40 kB
Dmitriy V. Ryaboy
partialagg_patch_4.patch
28/Aug/12 03:41
42 kB
Dmitriy V. Ryaboy
partialagg_patch_5.patch
29/Aug/12 04:30
43 kB
Dmitriy V. Ryaboy
partialagg_patch_6.patch
29/Aug/12 19:06
44 kB
Dmitriy V. Ryaboy
PIG-2888.final.patch
30/Aug/12 05:10
97 kB
Dmitriy V. Ryaboy

Activity

People

Assignee:: Dmitriy V. Ryaboy

Reporter:: Dmitriy V. Ryaboy

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 22/Aug/12 22:04

Updated:: 22/Feb/13 04:53

Resolved:: 02/Sep/12 22:49