[HDFS-10429] DataStreamer interrupted warning always appears when using CLI upload file

• Type: Bug
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.7.3
• Target Version/s: 3.5.0
• Assignee: Unassigned
• Reporter: Zhiyuan Yang
• Created: 18/May/16 21:01
• Updated: 04/Jan/24 07:49

Description

Every time I use 'hdfs dfs -put' upload file, this warning is printed:

16/05/18 20:57:56 WARN hdfs.DataStreamer: Caught exception
java.lang.InterruptedException
	at java.lang.Object.wait(Native Method)
	at java.lang.Thread.join(Thread.java:1245)
	at java.lang.Thread.join(Thread.java:1319)
	at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:871)
	at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:519)
	at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:696)

The reason is this: originally, DataStreamer::closeResponder always prints a warning about InterruptedException; since HDFS-9812, DFSOutputStream::closeImpl always forces threads to close, which causes InterruptedException.

A simple fix is to use debug level log instead of warning level.

Issue Links

• is related to: HDFS-14395 Remove WARN Logging From Interrupts in DataStreamer