[FLUME-3191] When flume collected files are linked file, and the link file points to a real file, it will lead to open the file too much exception.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.7.0
• Component/s: Sinks+Sources

Environment

centos6.7

• Assignee: Unassigned
• Reporter: Rui Pan
• Created: 07/Nov/17 07:04
• Updated: 07/Nov/17 07:04

Description

When flume collected files are linked file, and the link file points to a real file, it will lead to open the file too much exception.
The following codes in ReliableTaildirEventReader.java, will create unmanaged object which contain file handle.

 long inode = getInode(f);
        TailFile tf = tailFiles.get(inode);
        if (tf == null || !tf.getPath().equals(f.getAbsolutePath())) {
          long startPos = skipToEnd ? f.length() : 0;
          tf = openFile(f, headers, inode, startPos);
        }