[OAK-6672] Store index blobs in BlobStore directory to speed up index import

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: indexing, run
• Epic Link: Index Tooling 1.10
• Assignee: Chetan Mehrotra
• Reporter: Chetan Mehrotra
• Created: 15/Sep/17 05:53
• Updated: 08/Mar/18 15:05

Description

Currently oak-run index would dump the index files on file system which are later imported to the target setup. [e-mail] suggested that for large indexes which are created when indexing is performed on a different instance would take quite a bit of time for copying.

To speed up such cases oak-run index command should write back the blobs to BlobStore and import logic reuses the same blobs i.e. copy blobs by reference

Issue Links

• relates to: OAK-6387 Building an index (new index + reindex): temporarily store blob references