[HBASE-5954] Allow proper fsync support for HBase

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Won't Fix
• Component/s: HFile, wal
• Assignee: Unassigned
• Reporter: Lars Hofhansl
• Created: 08/May/12 01:03
• Updated: 13/Jun/22 16:33
• Resolved: 18/Jul/16 09:22

Description

At least get recommendation into 0.96 doc and some numbers running w/ this hdfs feature enabled.

Issue Links

• duplicates: HBASE-7652 Flag in the mutations to indicate asynchronous write to WAL
• is blocked by: HBASE-7215 Put, Delete, Increment, Result, all all HBase M/R classes still implement/use Writable
• is blocked by: HDFS-3979 Fix hsync semantics
• is related to: HBASE-14004 [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin
• is related to: HDFS-744 Support hsync in HDFS
• is related to: HBASE-19024 Configurable default durability for synchronous WAL
• is related to: HBASE-20471 Recheck the design and implementation of FSYNC_WAL durability for WAL
• relates to: HBASE-6116 Allow parallel HDFS writes for HLogs.
• relates to: HBASE-6492 Remove Reflection based Hadoop abstractions

Sub-Tasks

• Allow a deferred sync option per Mutation.: Closed
• Durability setting per table: Closed