[SPARK-32295] Add not null and size > 0 filters before inner explode to benefit from predicate pushdown

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Optimizer, SQL
• Labels: performance
• Assignee: Tanel Kiis
• Reporter: Tanel Kiis
• Created: 13/Jul/20 20:47
• Updated: 24/Nov/20 20:56
• Resolved: 13/Oct/20 11:12

Issue Links

• is related to: SPARK-33544 explode should not filter when used with CreateArray
• links to: [Github] Pull Request #29092 (tanelk)
• links to: [Github] Pull Request #29092 (tanelk)