[SPARK-18063] Failed to infer constraints over multiple aliases

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.2, 2.1.0
• Component/s: SQL
• Assignee: Xingbo Jiang
• Reporter: Xingbo Jiang
• Created: 22/Oct/16 06:33
• Updated: 26/Oct/16 18:13
• Resolved: 26/Oct/16 18:13

Description

The `UnaryNode.getAliasedConstraints` function fails to replace all expressions by their alias where constraints contains more than one expression to be replaced. For example:

val tr = LocalRelation('a.int, 'b.string, 'c.int)
val multiAlias = tr.where('a === 'c + 10).select('a.as('x), 'c.as('y))
multiAlias.analyze.constraints

currently outputs:

ExpressionSet(Seq(
    IsNotNull(resolveColumn(multiAlias.analyze, "x")),
    IsNotNull(resolveColumn(multiAlias.analyze, "y"))
)

The constraint

resolveColumn(multiAlias.analyze, "x") === resolveColumn(multiAlias.analyze, "y") + 10)

is missing.

Issue Links

• links to: [Github] Pull Request #15597 (jiangxb1987)