[HBASE-27746] Check if the file system supports storage policy before invoking setStoragePolicy() - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 4.0.0-alpha-1, 3.0.0-beta-2
Component/s: None
Labels:
- pull-request-available

Description

Found these messages on an Ozone cluster:

2023-03-20 12:27:09,185 WARN org.apache.hadoop.hbase.util.CommonFSUtils: Unable to set storagePolicy=HOT for path=ofs://ozone1/vol1/bucket1/hbase/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc. DEBUG log level might have more details.
java.lang.UnsupportedOperationException: RootedOzoneFileSystem doesn't support setStoragePolicy
        at org.apache.hadoop.fs.FileSystem.setStoragePolicy(FileSystem.java:3227)
        at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:521)
        at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:504)
        at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:477)
        at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:225)
        at org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:275)
        at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:6387)
        at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1115)
        at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1112)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

Ozone does not support storage policy. If we use FileSystem.hasPathCapability() API to check before invoking the API, these warning messages can be avoided.