[SPARK-49318] Preempt low priority LCA internal error until the end of check analysis

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Xinyi Yu
• Reporter: Xinyi Yu
• Created: 20/Aug/24 05:04
• Updated: 25/Aug/24 06:13
• Resolved: 21/Aug/24 20:06

Description

For queries like

 

          
            |WITH group_counts AS (
            |  SELECT id, count(*) as Freq, CASE WHEN Freq <= 10 THEN "1" ELSE "2" END AS Group
            |  FROM values (123) as data(id)
            |  GROUP BY id
            |)
            |SELECT Group, count(*) * 100.0 / (select count(*) from group_counts) AS Percentage
            |FROM group_counts
            |Group BY Group
            |ORDER BY Freq DESC;

The root cause error should be the 'Order By Freq', instead of the LCA internal error. The LCA error should be preempted if there are other higher priority errors occur.

 

Issue Links

• links to: GitHub Pull Request #47813