[HADOOP-13566] NPE in S3AFastOutputStream.write

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.7.3
• Component/s: fs/s3
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 31/Aug/16 12:51
• Updated: 18/Oct/16 22:07
• Resolved: 01/Oct/16 13:13

Description

During scale tests, managed to create an NPE

test_001_CreateHugeFile(org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFileCreate)  Time elapsed: 2.258 sec  <<< ERROR!
java.lang.NullPointerException: null
	at org.apache.hadoop.fs.s3a.S3AFastOutputStream.write(S3AFastOutputStream.java:191)
	at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:58)
	at java.io.DataOutputStream.write(DataOutputStream.java:107)
	at java.io.FilterOutputStream.write(FilterOutputStream.java:97)
	at org.apache.hadoop.fs.s3a.scale.ITestS3AHugeFileCreate.test_001_CreateHugeFile(ITestS3AHugeFileCreate.java:132)

trace implies that buffer == null

Issue Links

• is superceded by: HADOOP-13560 S3ABlockOutputStream to support huge (many GB) file writes