[FLUME-2513] testConsumeFileRandomlyNewFile fails

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Labels: test-fail
• Assignee: Unassigned
• Reporter: Santiago M. Mola
• Created: 22/Oct/14 10:47
• Updated: 16/Jun/16 19:01
• Resolved: 23/Oct/14 07:23

Description

TestReliableSpoolingFileEventReader.testConsumeFileRandomlyNewFile fails.

This test is producing different errors on different environments and codebase versions. Here's the test output running on vanilla latest trunk with Hadoop 1 profile:

2014-10-22 12:41:25,897 (main) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.<init>(ReliableSpoolingFileEventReader.java:138)] Initializing ReliableSpoolingFileEventReader with directory=target/test/work/TestReliableSpoolingFileEventReader, metaDir=.flumespool, deserializer=LINE
2014-10-22 12:41:25,930 (main) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.<init>(ReliableSpoolingFileEventReader.java:160)] Successfully created and deleted canary file: target/test/work/TestReliableSpoolingFileEventReader/flume-spooldir-perm-check-2042181446777183717.canary
2014-10-22 12:41:26,180 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2fileSuffix
2014-10-22 12:41:26,181 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2fileSuffix
2014-10-22 12:41:26,183 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0fileSuffix
2014-10-22 12:41:26,184 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0fileSuffix
2014-10-22 12:41:26,186 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-file to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-filefileSuffix
2014-10-22 12:41:26,187 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-file to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-filefileSuffix
2014-10-22 12:41:26,189 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1fileSuffix
2014-10-22 12:41:26,189 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1fileSuffix
2014-10-22 12:41:26,191 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3fileSuffix
2014-10-22 12:41:26,192 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3fileSuffix

junit.framework.AssertionFailedError:
Expected :2
Actual :1
at org.apache.flume.client.avro.TestReliableSpoolingFileEventReader.testConsumeFileRandomlyNewFile(TestReliableSpoolingFileEventReader.java:267)

Issue Links

• duplicates: FLUME-2505 Test added in FLUME-2502 is flaky