[HDFS-12864] Ozone: Turn off full synced write in RocksDB MetadataStore

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HDFS-7240
• Component/s: ozone
• Target Version/s: HDFS-7240
• Hadoop Flags: Reviewed
• Tags: ozone
• Assignee: Marton Elek
• Reporter: Marton Elek
• Created: 28/Nov/17 15:19
• Updated: 26/Apr/18 21:55
• Resolved: 28/Nov/17 19:46

Description

Based on the suggestion from xyao I created the patch to turn off fully synced write in the rocksdb.

With this patch we measured about 10x performance gain (200 nodes cluster + 30 corona instance).

1. We don't need fully synced rocksdb writing, as HA will cover the few cases when a node would be lost

2. Long term (IMHO) we need to add a possibility to configure any settings in rocksdb, so it could be turned off, but the setSync(false) is a reasonable default.