Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-24858

Default storage policy Hbase for OneFS

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: trunk
    • Fix Version/s: None
    • Component/s: ambari-trunk
    • Labels:
    • Environment:

      Deployed HDP3.0.1 on OneFS8.2.1

      Description

      OneFS does not support the "setStoragePolicy" RPC.

      Default storage policy for HBase is has been changed to "HOT". This means when HBase attempts to change the storage policy of the underlying HDFS which causes errors when using OneFS:

      ```

      > 2018-11-02 05:07:21,027 WARN [StoreOpener-1588230740-1] util.CommonFSUtils: Unable to set storagePolicy=HOT for path=hdfs://kb-hdp-1.west.isilon.com:8020/atsv2/hbase/data/data/hbase/meta/1588230740/info. DEBUG log level might have more details.

      ```

      Setting below two properties in yarn-hbase-site.xml to NONE fixes the issue.
      set 'hbase.wal.storage.policy' to "NONE"
      set `hbase.hstore.block.storage.policy` to `NONE`.

       

      The 'NONE' storage policy was reintroduced in the following Jira and defers the storage policy to the underlying HDFS. This alleviates the issue as the YARN process does not attempt to set the storage policy. 

      https://issues.apache.org/jira/browse/HBASE-20691

      We'd like to update the OneFS configuration to include these as default values.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              andrew.huff@isilon.com Andrew Huff
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: