[SPARK-37262] Not log empty aggregate and group by in JDBCScan

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0, 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Huaxin Gao
• Reporter: Huaxin Gao
• Created: 09/Nov/21 23:04
• Updated: 11/Nov/21 09:19
• Resolved: 11/Nov/21 09:19

Description

Address the comment https://github.com/apache/spark/pull/34451#discussion_r740220800

Current behavior:

Scan org.apache.spark.sql.execution.datasources.v2.jdbc.JDBCScan$$anon$1@72e75786 [NAME#1,SALARY#2] PushedAggregates: [], PushedFilters: [IsNotNull(SALARY), GreaterThan(SALARY,100.00)], PushedGroupby: [], ReadSchema: struct<NAME:string,SALARY:decimal(20,2)>

After the fix, it will be

Scan org.apache.spark.sql.execution.datasources.v2.jdbc.JDBCScan$$anon$1@72e75786 [NAME#1,SALARY#2] PushedFilters: [IsNotNull(SALARY), GreaterThan(SALARY,100.00)], ReadSchema: struct<NAME:string,SALARY:decimal(20,2)>

Issue Links

• links to: [Github] Pull Request #34540 (huaxingao)