[FLUME-3348] TailDirSource will write an empty position when

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9.0
• Component/s: Sinks+Sources

Environment

jdk 1.8

flume 1.9.0 

centos 7 

Number of files generated during reading that are larger than the system limit

 

• Assignee: Unassigned
• Reporter: wangjianda
• Created: 26/Dec/19 09:45
• Updated: 11/Apr/24 08:32

Description

When the number of files exceeds the maximum number of files allowed by the system.

taildirSource throw Exception:

java.io.FileNotFoundException: position/taildir_position.json (Too many open files)

the reason:

If an exception occurs while FileWriter writing to the file, whereafter call FileWriter close method ,the file will be cleared. This is FileWriter characteristic.

 

Issue Links

• links to: GitHub Pull Request #313