[FLUME-3209] deadlock at HDFSEventSink stop

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.0
• Assignee: Unassigned
• Reporter: jacky.chen
• Created: 10/Jan/18 10:06
• Updated: 10/Jan/18 10:06

Description

when i kill flume, the flume process is not killed, i find the deadlock in java jstack

"hdfs-sink1-roll-timer-0" #50 prio=5 os_prio=0 tid=0x00007f947c00aba0 nid=0x40df waiting for monitor entry [0x00007f94b4294000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.flume.sink.hdfs.HDFSEventSink$1.run(HDFSEventSink.java:383)

• waiting to lock <0x00000006801476a0> (a java.lang.Object)
  at org.apache.flume.sink.hdfs.BucketWriter.runCloseAction(BucketWriter.java:474)
  at org.apache.flume.sink.hdfs.BucketWriter.close(BucketWriter.java:435)
• locked <0x000000068a07ee28> (a org.apache.flume.sink.hdfs.BucketWriter)
  at org.apache.flume.sink.hdfs.BucketWriter$2.call(BucketWriter.java:295)
  at org.apache.flume.sink.hdfs.BucketWriter$2.call(BucketWriter.java:289)
  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
  at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  at java.lang.Thread.run(Thread.java:748)

"agent-shutdown-hook" #21 prio=5 os_prio=0 tid=0x00007f94100b3d10 nid=0x6d9c waiting for monitor entry [0x00007f949cc73000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.flume.sink.hdfs.BucketWriter.close(BucketWriter.java:319)

• waiting to lock <0x000000068a07ee28> (a org.apache.flume.sink.hdfs.BucketWriter)
  at org.apache.flume.sink.hdfs.HDFSEventSink.stop(HDFSEventSink.java:484)
• locked <0x00000006801476a0> (a java.lang.Object)
  at org.apache.flume.sink.DefaultSinkProcessor.stop(DefaultSinkProcessor.java:52)
  at org.apache.flume.SinkRunner.stop(SinkRunner.java:113)
  at org.apache.flume.lifecycle.LifecycleSupervisor.stop(LifecycleSupervisor.java:104)
• locked <0x00000006801ce790> (a org.apache.flume.lifecycle.LifecycleSupervisor)
  at org.apache.flume.node.Application.stop(Application.java:92)
• locked <0x000000068000cd00> (a org.apache.flume.node.Application)
  at org.apache.flume.node.Application$1.run(Application.java:343)