[TEZ-3271] Provide mapreduce failures.maxpercent equivalent - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.9.0
Component/s: None
Labels:
None

Target Version/s:

0.9.0

Description

There is a certain category of work that need not have 100% of tasks succeed to cause the work to be considered a success. To meet that end, I propose we provide a tez equivalent of mapreduce.map.failures.maxpercent and mapreduce.reduce.failures.maxpercent. In this way a vertex will be considered a success if the number of failures is below a configured threshold.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

Succeeded with Failures.png
01/Jun/16 22:23
247 kB
Jonathan Turner Eagles
TEZ-3271.1.patch
25/May/16 05:27
8 kB
Jonathan Turner Eagles
TEZ-3271.10.patch
27/Oct/16 20:44
21 kB
Jonathan Turner Eagles
TEZ-3271.2.patch
26/May/16 19:53
10 kB
Jonathan Turner Eagles
TEZ-3271.3.patch
31/May/16 22:26
10 kB
Jonathan Turner Eagles
TEZ-3271.4.patch
01/Jun/16 22:50
11 kB
Jonathan Turner Eagles
TEZ-3271.5.patch
09/Sep/16 20:03
10 kB
Jonathan Turner Eagles
TEZ-3271.6.patch
12/Oct/16 20:32
30 kB
Jonathan Turner Eagles
TEZ-3271.7.patch
12/Oct/16 22:05
29 kB
Jonathan Turner Eagles
TEZ-3271.8.patch
25/Oct/16 17:59
12 kB
Jonathan Turner Eagles
TEZ-3271.9.patch
26/Oct/16 03:13
18 kB
Jonathan Turner Eagles

Issue Links

relates to

PIG-4924 Translate failures.maxpercent MR setting to Tez

Closed

Activity

People

Assignee:: Jonathan Turner Eagles

Reporter:: Jonathan Turner Eagles

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 25/May/16 03:25

Updated:: 22/Aug/17 00:02

Resolved:: 05/Dec/16 19:22