[CARBONDATA-1953] Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: Babulal
• Reporter: Babulal
• Created: 29/Dec/17 11:48
• Updated: 03/Jan/18 10:16
• Resolved: 03/Jan/18 10:16

Description

Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table

spark.sql("drop table if exists y ")
spark.sql("create table y(year int,month int,name string,salary int) stored by 'carbondata' tblproperties('NO_INVERTED_INDEX'='name','sort_scope'='Global_sort','table_blocksize'='23','Dictionary_include'='month','Dictionary_exclude'='year,name','sort_columns'='month,year,name')")
spark.sql("insert into y select 10,11,'babu',12")

spark.sql("create datamap y1_sum1 on table y using 'preaggregate' as select year,month,name,sum(salary) from y group by year,month,name")
spark.sql("desc formatted y").show(100,false)
spark.sql("desc formatted y_y1_sum1").show(100,false)

------

col_name

data_type

comment

----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

y_year	int	KEY COLUMN,NOINVERTEDINDEX,null
y_month	int	DICTIONARY, KEY COLUMN,NOINVERTEDINDEX,null
y_name	string	KEY COLUMN,null
y_salary_sum	bigint	MEASURE,null
##Detailed Table Information
Database Name	default
Table Name	y_y1_sum1
CARBON Store Path	D:\code\carbondata\myfork\incubator-carbondata/examples/spark2/target/store
Comment
Table Block Size	1024 MB
Table Data Size	1297
Table Index Size	1076
Last Update Time	1514546841061
SORT_SCOPE	LOCAL_SORT	LOCAL_SORT
Streaming	false
SORT_SCOPE	LOCAL_SORT

Issue Links

• links to: GitHub Pull Request #1742