Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2584 CarbonData Local Dictionary Support
  3. CARBONDATA-2585

Support Adding Local Dictionary configuration in Create table statement

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      Allow user to pass local dictionary configuration in Create table statement.

      LOCAL_DICTIONARY_ENABLE :  enable or disable local dictionary generation for a table(default local dictionary generation will be true)

      LOCAL_DICTIONARY_THRESHOLD: configuring the threshold value for local dictionary generation(default will be 1000)

      LOCAL_DICTIONARY_INCLUDE**: list of columns for which user wants to generate local dictionary (default all the no dictionary string data type columns will be considered for generation)

      LOCAL_DICTIONARY_EXCLUDE**: list of columns for which user does not want to generate local dictionary (default no string datatype no dictionary columns are excluded unless it is configured)

      CREATE TABLE carbontable(

      column1 string,

      column2 string,

      column3 LONG )

      STORED BY 'carbondata'

      TBLPROPERTIES('LOCAL_DICTIONARY_ENABLE'='true',’LOCAL_DICTIONARY_THRESHOLD=1000',

      'LOCAL_DICTIONARY_INCLUDE'='column1','LOCAL_DICTIONARY_EXCLUDE'='column2')

      Attachments

        Activity

          People

            akashrn5 Akash R Nilugal
            kumarvishal09 Kumar Vishal
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 32h 50m
                32h 50m