[HADOOP-3829] Narrown down skipped records based on user acceptable value - ASF JIRA

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.19.0
Fix Version/s: 0.19.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed
Release Note:
Introduced new config parameter org.apache.hadoop.mapred.SkipBadRecords.setMapperMaxSkipRecords to set range of records to be skipped in the neighborhood of a failed record.

Description

This is an incremental step over ~~HADOOP-153~~.
If the number of skipped records in the neighborhood of a bad record are not acceptable to the user, then narrow down the skipped range to the user acceptable value.

Attachments

Options
- Sort By Name
- Sort By Date
- Ascending
- Descending

Attachments

3829_v1.153_7.patch
08/Aug/08 12:14
19 kB
Sharad Agarwal
3829_v1.patch
21/Aug/08 12:50
23 kB
Sharad Agarwal
3829_v2.patch
04/Sep/08 06:42
36 kB
Sharad Agarwal
3829_v3.patch
08/Sep/08 06:02
36 kB
Sharad Agarwal
3829_v4.patch
17/Sep/08 10:13
45 kB
Sharad Agarwal

Issue Links

depends upon

HADOOP-153 skip records that fail Task

Closed

Activity

People

Assignee:

Sharad Agarwal

Reporter:

Sharad Agarwal

Votes:

0 Vote for this issue

Watchers:

2 Start watching this issue

Dates

Created:

25/Jul/08 11:15

Updated:

02/May/13 02:29

Resolved:

18/Sep/08 11:48