[PIG-5043] Slowstart not applied in Tez with PARALLEL clause - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.17.0, 0.16.1
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

We enable auto parallelism only if there is no custom partiioner, but in case of UnorderedPartitioned it always had RoundRobinPartitioner.

VertexManager plugin configuration is not overridden if there is no auto parallelism. So slow start settings are not applied.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-5043-1.patch
17/Oct/16 20:57
18 kB
Rohini Palaniswamy
PIG-5043-2.patch
06/Jan/17 20:05
17 kB
Rohini Palaniswamy

Issue Links

is related to

PIG-5301 Enable autoreduce for unordered shuffle input

Open

Activity

People

Assignee:: Rohini Palaniswamy

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 13/Oct/16 20:08

Updated:: 13/Sep/17 18:58

Resolved:: 11/Jan/17 15:43