[SPARK-7551] Don't split by dot if within backticks for DataFrame attribute resolution

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: SQL
• Target Version/s: 1.4.0
• Sprint: Spark 1.5 doc/QA sprint
• Assignee: Wenchen Fan
• Reporter: Reynold Xin
• Created: 12/May/15 00:08
• Updated: 06/Jan/18 08:13
• Resolved: 13/May/15 19:48

Description

DataFrame's resolve:

  protected[sql] def resolve(colName: String): NamedExpression = {
    queryExecution.analyzed.resolve(colName.split("\\."), sqlContext.analyzer.resolver).getOrElse {
      throw new AnalysisException(
        s"""Cannot resolve column name "$colName" among (${schema.fieldNames.mkString(", ")})""")
    }
  }

We should not split the parts quoted by backticks (`).

For example, `ab.cd`.`efg` should be split into two parts "ab.cd" and "efg".

Issue Links

• links to: [Github] Pull Request #6074 (cloud-fan)