[HBASE-19841] Tests against hadoop3 fail with StreamLacksCapabilityException

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0-beta-2, 2.0.0
• Release Note: HBaseTestingUtility now assumes that all clusters will use local storage until a MiniDFSCluster is started or assigned.
• Assignee: Mike Drob
• Reporter: Ted Yu
• Created: 22/Jan/18 22:45
• Updated: 23/Jun/22 19:30
• Resolved: 06/Feb/18 20:06

Description

The following can be observed running against hadoop3:

java.io.IOException: cannot get log writer
	at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:107)
	at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.setUp(TestCompactingMemStore.java:89)
Caused by: org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException: hflush and hsync
	at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.compactingSetUp(TestCompactingMemStore.java:107)
	at org.apache.hadoop.hbase.regionserver.TestCompactingMemStore.setUp(TestCompactingMemStore.java:89)

This was due to hbase-server/src/test/resources/hbase-site.xml not being picked up by Configuration object. Among the configs from this file, the value for "hbase.unsafe.stream.capability.enforce" relaxes check for presence of hflush and hsync. Without this config entry, StreamLacksCapabilityException is thrown.

Issue Links

• relates to: HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1