[CARBONDATA-2325] Page level uncompress and Query performance improvement for Unsafe No Dictionary

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Assignee: Unassigned
• Reporter: Kumar Vishal
• Created: 10/Apr/18 01:45
• Updated: 17/Apr/18 08:32
• Resolved: 17/Apr/18 08:32

Description

Page Level Decoder for query
Add page level on demand decoding, in current code, all pages of blocklet is getting uncompressed, because of this memory footprint is too high and causing OOM, Now added code to support page level decoding, one page will be decoding when all the records are processed next page data will be decoded. It will improve query performance for example limit query.
Unsafe No Dictionary(Unsafe variable length)
Optimized getRow(for Vector processing) And putArray method

Issue Links

• links to: GitHub Pull Request #2149