[KAFKA-6271] FileInputStream.skip function can return 0 when the file is corrupted, causing an infinite loop

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0.0
• Component/s: connect
• Assignee: Unassigned
• Reporter: John Doe
• Created: 27/Nov/17 01:55
• Updated: 29/Nov/17 00:33

Description

When file is corrupted, the FileInputStream can return 0, causing the while loop in FileStreamSourceTask.poll() become infinite.

   public List<SourceRecord> poll() throws InterruptedException {
       ...
       stream = new FileInputStream(filename);
       long skipLeft = (Long) lastRecordedOffset;
       while (skipLeft > 0) {
         try {
           long skipped = stream.skip(skipLeft);
           skipLeft -= skipped;
         } catch (IOException e) {
            log.error("Error while trying to seek to previous offset in file: ", e);
            throw new ConnectException(e);
         }
       }
    }

Similar bugs are like Cassandra-7330, Hadoop-8614, Mapreduce-6990, Yarn-163, Yarn-2905 etc.