[HBASE-23095] Reuse FileStatus in StoreFileInfo

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.2, 1.2.1, 2.0.0, 2.2.1
• Fix Version/s: 3.0.0-alpha-1, 2.3.0, 2.2.2, 2.1.8
• Component/s: mob, snapshots
• Labels: performance
• Hadoop Flags: Reviewed
• Assignee: Karthik Palanisamy
• Reporter: Karthik Palanisamy
• Created: 30/Sep/19 05:07
• Updated: 09/Oct/19 01:05
• Resolved: 08/Oct/19 08:42

Description

The performance of create snapshot on large MOB table reasonably slow because there are two unnecessary calls to namenode on each Hfile, this while we create snapshot manifest. The first namenode call for getting StoreFile modification time link which used for metrics and another namenode call for getting StoreFile size link which used in snapshot manifest. Both calls can be avoided and this info can be fetched from existing FileStatus link.

 

PFA. 2x performance is seen after reusing existing FileStatus.

Issue Links

• links to: GitHub Pull Request #674