[FLUME-2586] HDFS Sink should have an option to try rename even if close fails - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.6.0
Component/s: None
Labels:
None

Description

"The issue is that the file close fails, but the stream on the Flume side is considered closed by HDFS. So retrying the close, is failing - which causes the rename never to be attempted. Since the rename is never attempted the file sticks around with the ".tmp" file name. "
We should try attempting rename even if the close fails and possibly log information that the user need to run lease recovery

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

FLUME-2586.patch
27/Jan/15 01:58
15 kB
Johny Rufus

Issue Links

relates to

FLUME-2566 BucketWriter tries to close file endlessly

Closed

Activity

People

Assignee:: Johny Rufus

Reporter:: Johny Rufus

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 08/Jan/15 23:31

Updated:: 15/Apr/15 00:46

Resolved:: 28/Jan/15 21:06