[HADOOP-3829] Narrown down skipped records based on user acceptable value - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.19.0
Fix Version/s: 0.19.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed
Release Note:
Introduced new config parameter org.apache.hadoop.mapred.SkipBadRecords.setMapperMaxSkipRecords to set range of records to be skipped in the neighborhood of a failed record.

Description

This is an incremental step over ~~HADOOP-153~~.
If the number of skipped records in the neighborhood of a bad record are not acceptable to the user, then narrow down the skipped range to the user acceptable value.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

3829_v1.153_7.patch
08/Aug/08 12:14
19 kB
Sharad Agarwal
3829_v1.patch
21/Aug/08 12:50
23 kB
Sharad Agarwal
3829_v2.patch
04/Sep/08 06:42
36 kB
Sharad Agarwal
3829_v3.patch
08/Sep/08 06:02
36 kB
Sharad Agarwal
3829_v4.patch
17/Sep/08 10:13
45 kB
Sharad Agarwal

Issue Links

depends upon

HADOOP-153 skip records that fail Task

Closed

Activity

People

Assignee:: Sharad Agarwal

Reporter:: Sharad Agarwal

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 25/Jul/08 11:15

Updated:: 02/May/13 02:29

Resolved:: 18/Sep/08 11:48