[HBASE-19289] CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1

• Type: Test
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.0.0-beta-1, 2.0.0
• Assignee: Mike Drob
• Reporter: Ted Yu
• Created: 16/Nov/17 23:10
• Updated: 23/Jun/22 19:29
• Resolved: 14/Dec/17 18:20

Description

As of commit d8fb10c8329b19223c91d3cda6ef149382ad4ea0 , I encountered the following exception when running unit test against hadoop3 beta1:

testRefreshStoreFiles(org.apache.hadoop.hbase.regionserver.TestHStore)  Time elapsed: 0.061 sec  <<< ERROR!
java.io.IOException: cannot get log writer
	at org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
	at org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
Caused by: org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException: hflush
	at org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
	at org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
	at org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)

Issue Links

• relates to: HBASE-19369 HBase Should use Builder Pattern to Create Log Files while using WAL on Erasure Coding
• relates to: HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
• relates to: HADOOP-15051 FSDataOutputStream returned by LocalFileSystem#createNonRecursive doesn't have hflush capability