Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
Fix how reducers are estimated for skew join and order operators.
Description
If neither PARALLEL, default parallel or mapred.reduce.tasks are set, the number of reducers is not estimated based on input size for skew joins or order by. Instead, these jobs get only 1 reducer.
Attachments
Attachments
Issue Links
- relates to
-
PIG-2779 Refactoring the code for setting number of reducers
- Closed