[HDFS-12504] Ozone: Improve SQLCLI performance

• Type: Sub-task
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: ozone
• Labels: performance
• Target Version/s: HDFS-7240
• Assignee: Yuanbo Liu
• Reporter: Weiwei Yang
• Created: 20/Sep/17 06:27
• Updated: 31/Jan/18 13:51

Description

In my test, my ksm.db has 3017660 entries with total size of 128mb, SQLCLI tool runs over 2 hours but still not finish exporting the DB. This is because it iterates each entry and inserts that to another sqllite DB file, which is not efficient. We need to improve this to be running more efficiently on large DB files.