Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
timeout handling in hdfs sink can cause problems when timeout happens and flume shuts down the thread in the middle of writing. Since the callTimeout has been introduced hdfs client got better and provides its own timeout handling.
We should use the timeout mechanism inside the hdfs client.
Attachments
1.
|
Increase the default of hdfs.callTimeout and document it's deprecation |
|
Resolved | Endre Major |
2.
|
remove callTimeout mechanism from hdfs sink |
|
Open | Unassigned |