[FLUME-1779] Backoff returned from HDFSEventSink after IOException - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Description

Status.Backoff is returned from HdfsEventSink.process() in case of IOException. This behavior prevents FailoverSinkProcessor from pushing event to next sink in queue.

In my test case, IOException is caused by serious hdfs failure, for example all DataNodes in cluster are dead. After such failure BucketWriter throws IOException and becomes unavailable - it probably should be removed from sfWriters map.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

st
13/Dec/12 12:53
10 kB
Jaroslaw Grabowski
FLUME-1799.patch
19/Jan/13 11:20
0.8 kB
Connor Woodson

Activity

People

Assignee:: Unassigned

Reporter:: Jaroslaw Grabowski

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 13/Dec/12 12:45

Updated:: 19/Jan/13 11:20