[FLUME-3242] Deprecate and remove hdfs.callTimeout from HDFS Sink - ASF JIRA

Attach files

Attach Screenshot

Add vote

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: Sinks+Sources
Labels:
None

Description

timeout handling in hdfs sink can cause problems when timeout happens and flume shuts down the thread in the middle of writing. Since the callTimeout has been introduced hdfs client got better and provides its own timeout handling.

We should use the timeout mechanism inside the hdfs client.

Attachments

Sub-Tasks

Create Sub-Task

1.	Increase the default of hdfs.callTimeout and document it's deprecation		Resolved	Endre Major	Actions
2.	remove callTimeout mechanism from hdfs sink		Open	Unassigned	Actions