Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
None
Description
Allow user to pass local dictionary configuration in Create table statement.
LOCAL_DICTIONARY_ENABLE : enable or disable local dictionary generation for a table(default local dictionary generation will be true)
LOCAL_DICTIONARY_THRESHOLD: configuring the threshold value for local dictionary generation(default will be 1000)
LOCAL_DICTIONARY_INCLUDE**: list of columns for which user wants to generate local dictionary (default all the no dictionary string data type columns will be considered for generation)
LOCAL_DICTIONARY_EXCLUDE**: list of columns for which user does not want to generate local dictionary (default no string datatype no dictionary columns are excluded unless it is configured)
CREATE TABLE carbontable(
column1 string,
column2 string,
column3 LONG )
STORED BY 'carbondata'
TBLPROPERTIES('LOCAL_DICTIONARY_ENABLE'='true',’LOCAL_DICTIONARY_THRESHOLD=1000',
'LOCAL_DICTIONARY_INCLUDE'='column1','LOCAL_DICTIONARY_EXCLUDE'='column2')