[PARQUET-589] Implement Chunked InMemoryInputStream for better memory usage

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: cpp-1.0.0
• Component/s: parquet-cpp
• Assignee: Deepak Majeti
• Reporter: Deepak Majeti
• Created: 21/Apr/16 20:33
• Updated: 23/Jun/24 03:28
• Resolved: 05/May/16 04:36

Description

Parquet-cpp when creating a Column Reader, reads the entire source into a buffer, which is then passed to the InMemoryInputStream. This prohibits reading multiple large parquet files simultaneously. The scope of this JIRA is to implement an InputStream that does not require the entire source to be read.