Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2513

testConsumeFileRandomlyNewFile fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Duplicate
    • 1.6.0
    • 1.6.0
    • None

    Description

      TestReliableSpoolingFileEventReader.testConsumeFileRandomlyNewFile fails.

      This test is producing different errors on different environments and codebase versions. Here's the test output running on vanilla latest trunk with Hadoop 1 profile:

      2014-10-22 12:41:25,897 (main) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.<init>(ReliableSpoolingFileEventReader.java:138)] Initializing ReliableSpoolingFileEventReader with directory=target/test/work/TestReliableSpoolingFileEventReader, metaDir=.flumespool, deserializer=LINE
      2014-10-22 12:41:25,930 (main) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.<init>(ReliableSpoolingFileEventReader.java:160)] Successfully created and deleted canary file: target/test/work/TestReliableSpoolingFileEventReader/flume-spooldir-perm-check-2042181446777183717.canary
      2014-10-22 12:41:26,180 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2fileSuffix
      2014-10-22 12:41:26,181 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file2fileSuffix
      2014-10-22 12:41:26,183 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0fileSuffix
      2014-10-22 12:41:26,184 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file0fileSuffix
      2014-10-22 12:41:26,186 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-file to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-filefileSuffix
      2014-10-22 12:41:26,187 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-file to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/new-filefileSuffix
      2014-10-22 12:41:26,189 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1fileSuffix
      2014-10-22 12:41:26,189 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file1fileSuffix
      2014-10-22 12:41:26,191 (pool-1-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:343)] Preparing to move file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3fileSuffix
      2014-10-22 12:41:26,192 (pool-1-thread-1) [DEBUG - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:379)] Successfully rolled file /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3 to /home/smola/dev/repos/stratio-ingestion/target/test/work/TestReliableSpoolingFileEventReader/file3fileSuffix

      junit.framework.AssertionFailedError:
      Expected :2
      Actual :1
      at org.apache.flume.client.avro.TestReliableSpoolingFileEventReader.testConsumeFileRandomlyNewFile(TestReliableSpoolingFileEventReader.java:267)

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              smolav Santiago M. Mola
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: