[SPARK-28862] Read Impala view with UNION ALL operator

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.2.0
• Component/s: Build
• Labels: Failed Hive PySpark Read TABLE Union VIEW materializedviews memorymanager
• Assignee: Unassigned
• Reporter: francesco
• Created: 23/Aug/19 16:43
• Updated: 12/Dec/22 18:10
• Resolved: 26/Aug/19 03:31

Description

I would like to report an issue in pySpark 2.2.0 when it is used to read hive views that contain UNION ALL operator. 

 

I attach the error: 

WARN memory.TaskMemoryManager: Failed to allocate a page (67108864 bytes), try again. 

 

Is there any solution different from materializing this view? 

Thanks,