[TRAFODION-2949] LOB: Address performance issues related to inserts/extracts in tables containing LOB columns

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: taian.wei
• Reporter: Sandhya Sundaresan
• Created: 02/Feb/18 21:04
• Updated: 05/Jun/18 16:24

Description

1. Investigate bottlenecks in the insert and update code paths.

A couple of bottlenecks identified initially were hdfsWrite and the LOBCLi call.

1. Investigate if lib hdfs write operation is signifincantly slower than a direct JNI call. If so  consider refactoring code being done for hive inserts and reuse for LOB writes as well. Also investigate use of libhdfs3 , a lightweight interface by Pivotal for Hawk ,that doesn’t use JNI at all.
2. Investigate if LOB Cli calls that do prepare and execute of statements to insert/update the LOB descriptor tables are being cached and reused when multiple LOB inserts are being done in the same session.
3. Investigate external LOBs as a solution for faster inserts/extracts for usage compared to internal LOBs.

Issue Links

• links to: GitHub Pull Request #1538