[CARBONDATA-2202] Introduce local dictionary encoding for dimensions

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.1
• Assignee: Chuanyin Xu
• Reporter: Chuanyin Xu
• Created: 26/Feb/18 02:01
• Updated: 06/Aug/18 03:10
• Resolved: 06/Aug/18 03:10

Description

Currently Carbondata will generate global dictionary for columns with 'dictionary_include' attribute.

A dimension column without that attribute will only be stored after some simple compression. These columns can also be dictionary encoded in file level (called ‘local dictionary’) to reduce data size.