Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2842

Global sort local/preaggregate with Dictionary not working for S3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Configure AK/SK and Endpoint for S3 

      Now run Global sort 

       

      reate table c2 (rownumber string,name string,m1 int) stored by 'carbondata' tblproperties('DICTIONARY_INCLUDE'='name','sort_scope'='global_sort');
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (18.047 seconds)
      0: jdbc:hive2://ha-cluster/default> create datamap ag1 on table c2 using 'preaggregate' as select sum(m1),name from c2 group by name;
      Error: java.lang.Exception: DataLoad failure: Dictionary file does not exist: s3a://carbon/req/carbon_store_mrs_118_new/x1/c2/Metadata/a4d2bec1-0aa0-4908-82fa-c31863af9280.dict (state=,code=0)
      0: jdbc:hive2://ha-cluster/default>
      0: jdbc:hive2://ha-cluster/default>
      0: jdbc:hive2://ha-cluster/default>

       

       

      same Error when runs global dictionary loading also.

      Attachments

        Activity

          People

            Unassigned Unassigned
            Bjangir Babulal
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: