[HDFS-8220] Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HDFS-7285
• Target Version/s: HDFS-7285
• Hadoop Flags: Reviewed
• Assignee: Rakesh Radhakrishnan
• Reporter: Rakesh Radhakrishnan
• Created: 22/Apr/15 09:31
• Updated: 30/Sep/15 19:38
• Resolved: 14/Aug/15 22:20

Description

During write operations StripedDataStreamer#locateFollowingBlock fails to validate the available datanodes against the BlockGroupSize. Please see the exception to understand more:

2015-04-22 14:56:11,313 WARN  hdfs.DFSClient (DataStreamer.java:run(538)) - DataStreamer Exception
java.lang.NullPointerException
	at java.util.concurrent.LinkedBlockingQueue.offer(LinkedBlockingQueue.java:374)
	at org.apache.hadoop.hdfs.StripedDataStreamer.locateFollowingBlock(StripedDataStreamer.java:157)
	at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1332)
	at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:424)
	at org.apache.hadoop.hdfs.StripedDataStreamer.run(StripedDataStreamer.java:1)
2015-04-22 14:56:11,313 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdown(1718)) - Shutting down the Mini HDFS Cluster
2015-04-22 14:56:11,313 ERROR hdfs.DFSClient (DFSClient.java:closeAllFilesBeingWritten(608)) - Failed to close inode 16387
java.io.IOException: DataStreamer Exception: 
	at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:544)
	at org.apache.hadoop.hdfs.StripedDataStreamer.run(StripedDataStreamer.java:1)
Caused by: java.lang.NullPointerException
	at java.util.concurrent.LinkedBlockingQueue.offer(LinkedBlockingQueue.java:374)
	at org.apache.hadoop.hdfs.StripedDataStreamer.locateFollowingBlock(StripedDataStreamer.java:157)
	at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1332)
	at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:424)
	... 1 more

Issue Links

• is duplicated by: HDFS-8365 Erasure Coding: Badly treated when short of Datanode in StripedDataStreamer
• is duplicated by: HDFS-8699 DFSClient hang up when there are not sufficient DataNodes in EC cluster.
• is duplicated by: HDFS-8839 Erasure Coding: client occasionally gets less block locations when some datanodes fail