[HDFS-12651] Ozone: SCM: avoid synchronously loading all the keys from containers upon SCM datanode start

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: HDFS-7240
• Assignee: Xiaoyu Yao
• Reporter: Xiaoyu Yao
• Created: 12/Oct/17 23:18
• Updated: 12/Oct/17 23:18

Description

This is based on code review feedback from HDFS-12411 to avoid slow SCM datanode restart when there are large amount of keys and containers.

E.g., 5 GB per container / 4 KB per key = 1.25 Million keys per container.

The proposed solution is async loading containers/key size info and update the containerStatus once done.