Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2118

It throw error when select a1 after creating datamap uses like "as select a as a1,sum(b) from tablename"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.3.0
    • None
    • core, spark-integration
    • None

    Description

      After create datamap using

       create datamap preagg2 on table PreAggMain using 'preaggregate' as select a as a1,sum(b) from PreAggMain group by a
      

      it will error when select a1:

          sql("select a1 from PreAggMain_preagg2").show()
      

      It should throw error when create datamap.

      code:

      	  test("test pre agg create table 2") {
      	    sql("create datamap preagg2 on table PreAggMain using 'preaggregate' as select a as a1,sum(b) from PreAggMain group by a")
      	    checkExistence(sql("DESCRIBE FORMATTED PreAggMain_preagg2"), true, "preaggmain_a")
      	    checkExistence(sql("DESCRIBE FORMATTED PreAggMain_preagg2"), true, "preaggmain_b_sum")
      	    checkExistence(sql("DESCRIBE FORMATTED PreAggMain_preagg2"), false, "preaggmain_a1")
      	    sql("DESCRIBE FORMATTED PreAggMain_preagg2").show()
      	    sql("select * from PreAggMain_preagg2").show()
      	    sql("select a1 from PreAggMain_preagg2").show()
      	
      	    sql("DESCRIBE FORMATTED PreAggMain").show()
      	    sql("select * from PreAggMain").show()
      	    sql("select a as a1,sum(b) from PreAggMain group by a").show()
      	
      	    sql("drop datamap preagg2 on table PreAggMain")
      	  }
      

      error:

      	+------------+----------------+
      	|preaggmain_a|preaggmain_b_sum|
      	+------------+----------------+
      	+------------+----------------+
      	
      	
      	cannot resolve '`a1`' given input columns: [preaggmain_a, preaggmain_b_sum]; line 1 pos 7;
      	'Project ['a1]
      	+- SubqueryAlias preaggmain_preagg2
      	   +- Relation[preaggmain_a#101,preaggmain_b_sum#102] CarbonDatasourceHadoopRelation [ Database name :default, Table name :preaggmain_preagg2, Schema :Some(StructType(StructField(preaggmain_a,StringType,true), StructField(preaggmain_b_sum,DoubleType,true))) ]
      	
      	org.apache.spark.sql.AnalysisException: cannot resolve '`a1`' given input columns: [preaggmain_a, preaggmain_b_sum]; line 1 pos 7;
      	'Project ['a1]
      	+- SubqueryAlias preaggmain_preagg2
      	   +- Relation[preaggmain_a#101,preaggmain_b_sum#102] CarbonDatasourceHadoopRelation [ Database name :default, Table name :preaggmain_preagg2, Schema :Some(StructType(StructField(preaggmain_a,StringType,true), StructField(preaggmain_b_sum,DoubleType,true))) ]
      	
      		at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42)
      		at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:88)
      		at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:85)
      
      

      Attachments

        Activity

          People

            xubo245 Bo Xu
            xubo245 Bo Xu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: