[HBASE-22532] There's still too much cpu wasting on validating checksum even if buffer.size=65KB

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Assignee: Unassigned
• Reporter: Zheng Hu
• Created: 03/Jun/19 13:08
• Updated: 01/Jul/22 21:46
• Resolved: 05/Jun/19 10:22

Description

After disabled the block cache, and with the following config:

    # Disable the block cache
    hfile.block.cache.size=0
    hbase.ipc.server.allocator.buffer.size=66560
    hbase.ipc.server.reservoir.minimal.allocating.size=0

The ByteBuff for block should be expected to be a SingleByteBuff, which will use the hadoop native lib to validate the checksum, while in the cpu flame graph async-prof-pid-27827-cpu-3.svg, we can still see that about 32% CPU wasted on PureJavaCrc32#update, which means it's not using the faster hadoop native lib.