Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2482

Race condition in File Channels' Log.removeOldLogs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.5.0.1
    • 1.6.0
    • File Channel

    Description

      TestFileChannelRestart.testToggleCheckpointCompressionFromFalseToTrue sometimes produces a race condition at Log.removeOldLogs.

      https://travis-ci.org/Stratio/flume/jobs/36782318#L6193

      testToggleCheckpointCompressionFromFalseToTrue(org.apache.flume.channel.file.TestFileChannelRestart) Time elapsed: 144362 sec <<< ERROR!

      java.util.ConcurrentModificationException

      at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:859)

      at java.util.ArrayList$Itr.next(ArrayList.java:831)

      at org.apache.flume.channel.file.Log.removeOldLogs(Log.java:1070)

      at org.apache.flume.channel.file.Log.writeCheckpoint(Log.java:1055)

      at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      at java.lang.reflect.Method.invoke(Method.java:606)

      at org.fest.reflect.method.Invoker.invoke(Invoker.java:110)

      at org.apache.flume.channel.file.TestUtils.forceCheckpoint(TestUtils.java:134)

      at org.apache.flume.channel.file.TestFileChannelRestart.restartToggleCompression(TestFileChannelRestart.java:930)

      at org.apache.flume.channel.file.TestFileChannelRestart.testToggleCheckpointCompressionFromFalseToTrue(TestFileChannelRestart.java:896)

      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      at java.lang.reflect.Method.invoke(Method.java:606)

      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)

      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)

      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)

      at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)

      at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)

      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)

      at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)

      at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)

      at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)

      at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)

      at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)

      at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)

      at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)

      at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)

      at org.junit.runners.ParentRunner.run(ParentRunner.java:300)

      at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)

      at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)

      at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)

      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      at java.lang.reflect.Method.invoke(Method.java:606)

      at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)

      at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)

      at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)

      at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)

      at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)

      Attachments

        1. FLUME-2482.patch
          1 kB
          Johny Rufus

        Activity

          People

            jrufus Johny Rufus
            smolav Santiago M. Mola
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: