[HBASE-20520] Failed effort upping default HDFS blocksize, hbase.regionserver.hlog.blocksize

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 2.1.0, 2.0.1
• Component/s: conf
• Hadoop Flags: Reviewed
• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 02/May/18 17:51
• Updated: 10/Dec/24 02:15
• Resolved: 16/May/18 16:22

Description

Good one found by our mdrob. Problem in the parent issue where failed attempt doubling default block size but halving the size at which roll – so we end up in roughly same place only we make less small WALs in those cases where we are writing furiously and fail to roll before starting a new block.

From Drob: ".../we drop default log roll to 0.5, but we don't actually increase the block size... AbstractProtobufLogWriter.java:164 still uses default HDFS block sizing and AbstractFSWAL.java:408 block size is only used in a log message, never actually makes it to files...".

Issue Links

• links to: Review Board (branch-2.0)