Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
1.3.0
-
None
-
None
Description
After create datamap using
create datamap preagg2 on table PreAggMain using 'preaggregate' as select a as a1,sum(b) from PreAggMain group by a
it will error when select a1:
sql("select a1 from PreAggMain_preagg2").show()
It should throw error when create datamap.
code:
test("test pre agg create table 2") { sql("create datamap preagg2 on table PreAggMain using 'preaggregate' as select a as a1,sum(b) from PreAggMain group by a") checkExistence(sql("DESCRIBE FORMATTED PreAggMain_preagg2"), true, "preaggmain_a") checkExistence(sql("DESCRIBE FORMATTED PreAggMain_preagg2"), true, "preaggmain_b_sum") checkExistence(sql("DESCRIBE FORMATTED PreAggMain_preagg2"), false, "preaggmain_a1") sql("DESCRIBE FORMATTED PreAggMain_preagg2").show() sql("select * from PreAggMain_preagg2").show() sql("select a1 from PreAggMain_preagg2").show() sql("DESCRIBE FORMATTED PreAggMain").show() sql("select * from PreAggMain").show() sql("select a as a1,sum(b) from PreAggMain group by a").show() sql("drop datamap preagg2 on table PreAggMain") }
error:
+------------+----------------+ |preaggmain_a|preaggmain_b_sum| +------------+----------------+ +------------+----------------+ cannot resolve '`a1`' given input columns: [preaggmain_a, preaggmain_b_sum]; line 1 pos 7; 'Project ['a1] +- SubqueryAlias preaggmain_preagg2 +- Relation[preaggmain_a#101,preaggmain_b_sum#102] CarbonDatasourceHadoopRelation [ Database name :default, Table name :preaggmain_preagg2, Schema :Some(StructType(StructField(preaggmain_a,StringType,true), StructField(preaggmain_b_sum,DoubleType,true))) ] org.apache.spark.sql.AnalysisException: cannot resolve '`a1`' given input columns: [preaggmain_a, preaggmain_b_sum]; line 1 pos 7; 'Project ['a1] +- SubqueryAlias preaggmain_preagg2 +- Relation[preaggmain_a#101,preaggmain_b_sum#102] CarbonDatasourceHadoopRelation [ Database name :default, Table name :preaggmain_preagg2, Schema :Some(StructType(StructField(preaggmain_a,StringType,true), StructField(preaggmain_b_sum,DoubleType,true))) ] at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42) at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:88) at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:85)