Details
-
Improvement
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
trunk, 2.7.0
-
HDP versions started from "2.6"
Ambari started from version "2.7"
Description
This issue is going under the direction of Dell Technologies.
We are going to change the code of isilon-onefs-mpack (https://github.com/apache/ambari/tree/trunk/contrib/management-packs/isilon-onefs-mpack).
The problem is that a new feature of HBase 2 (AsyncFSWAL) causes worse performance with OneFS. We need to disable this in the Ambari management pack by setting the property name: "hbase.wal.provider" with value: "filesystem" for HBASE. The way to change the property has been already introduced at:
https://jira.apache.org/jira/browse/HBASE-15536
In section about how to disable AsyncFSWAL:
> ...add this in hbase-site.xml
> {code}
> <property>
> <name>hbase.wal.provider</name>
> <value>filesystem</value>
> </property>
> {code}
We are going to issue a new version of isilon-onefs-mpack (1.0.3) where we will have some code lines which add this property to HBASE settings. Change of property is applied automatically after installation of HBASE service and installing a new version of mpack.
Now our code change relates to one file of code: service_advisor.py, other changes are cosmetic (version numbering and comments).
As well we are going to port the code to all necessary branches of Ambari of older versions which support isilon-onefs-mpack.
Business Justification: The problem we are working on is that a new feature of HBase 2 (AsyncFSWAL) causes worse performance with OneFS.
Some Isilon customers which use HBASE with Ambari with OneFS suffer from this problem. The fix should help these customers.
Available Maintenance Resources: HDFS team of Dell Isilon supports Ambari mpack project.
Impact: Improve interaction of Isilon with Hadoop
