[SPARK-17712] Incorrect result due to invalid pushdown of data-independent filter beneath aggregate

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.2, 2.0.0, 2.0.2
• Fix Version/s: 2.0.2, 2.1.0
• Component/s: SQL
• Labels: correctness
• Assignee: Josh Rosen
• Reporter: Josh Rosen
• Created: 28/Sep/16 22:16
• Updated: 29/Sep/16 19:12
• Resolved: 29/Sep/16 02:05

Description

Let diamonds be a non-empty table. The following two queries should both return no rows, but the first returns a single row:

SELECT
1
FROM (
    SELECT
    count(*)
    FROM diamonds
) t1
WHERE
false

SELECT
1
FROM (
    SELECT
    *
    FROM diamonds
) t1
WHERE
false

Issue Links

• links to: [Github] Pull Request #15289 (JoshRosen)