[MARMOTTA-245] Possible solutions for improving triple store's storage and retrieve performance.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0-incubating
• Fix Version/s: 3.2.0
• Component/s: KiWi Triple Store
• Assignee: Raffaele Palmieri
• Reporter: Sergio Fernández
• Created: 21/May/13 21:33
• Updated: 17/Apr/14 09:08
• Resolved: 07/Jan/14 14:43

Description

This issue was born by an initial idea about improvement for triples storage and collects all subsequent ideas about the same argument.
In the order:
1)Use db native methods for bulk import
2)Jena storage
3)Triple store on top of a NoSQL database
For the point 1, for retaining record transactionality and integrity, it would require a ploy(e.g. maintenaince mode), on the other hand a lot of improvements of codebase have been with introduction of JDBC Batch API and there are significant results.
The point 2 depend on MARMOTTA-85, 88 and 89.
The point 3 is an unexplored path , and could mean adopting an approach close to that described in "Rya: A Scalable RDF Triple Store for the Clouds"; however, that could be the most difficult path to explore for the impacts on actual codebase.

Issue Links

• incorporates: MARMOTTA-352 Implement RDFHandler for bulk imports
• relates to: MARMOTTA-328 Implement marmotta-backend-bigdata
• relates to: MARMOTTA-88 Implement marmotta-backend-tdb
• relates to: MARMOTTA-89 Implement marmotta-backend-sdb
• relates to: MARMOTTA-310 Create kiwi-loader module