[CARBONDATA-4084] Error when loading string field with high cardinary

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.1.0, 2.0.1
• Fix Version/s: 2.1.1
• Component/s: spark-integration
• Labels: patch
• Assignee: Unassigned
• Reporter: Nguyen Dinh Huynh
• Created: 14/Dec/20 15:36
• Updated: 17/Mar/21 02:57
• Resolved: 18/Dec/20 12:39

Description

When i am try load string field with more than 1M distinct value, some rows show strange value.

 

I'm trying with this setting: carbon.local.dictionary.enable=false then it works as expect. So seems like have some bugs on decoder fallback.