[FLUME-416] CollectorSink hangs due to ConcurrentModificationException in RollSink

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.9.0, 0.9.1, 0.9.1u1, 0.9.2
• Fix Version/s: 0.9.3
• Component/s: Sinks+Sources
• Assignee: Jonathan Hsieh
• Reporter: Jonathan Hsieh
• Created: 20/Dec/10 17:08
• Updated: 31/Jan/11 22:06
• Resolved: 28/Dec/10 21:49

Description

Apparently, there can be a race on the collector ack manager's. It seems that the collector hangs after this happens.

10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: initial checksum is 12ce79b3c59
10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: Finishing checksum group called 'log.00001136.20101215-114127844-0500.6785369377806000.seq'
10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: Checksum succeeded 12ceae86624
Exception in thread "Roll-TriggerThread-1" java.util.ConcurrentModificationException
at java.util.HashMap$HashIterator.nextEntry(HashMap.java:793)
at java.util.HashMap$KeyIterator.next(HashMap.java:828)
at com.google.common.collect.StandardMultimap$WrappedCollection$WrappedIterator.next(StandardMultimap.java:491)
at com.cloudera.flume.collector.CollectorSink$RollDetectDeco.close(CollectorSink.java:154)
at com.cloudera.flume.handlers.rolling.RollSink.rotate(RollSink.java:181)
at com.cloudera.flume.handlers.rolling.RollSink$TriggerThread.run(RollSink.java:122)
10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: moved from partial to complete log.00001136.20101215-114127844-0500.6785369377806000.seq

Issue Links

• is duplicated by: FLUME-477 Collector unexpectedly closes