[SPARK-22251] Metric "aggregate time" is incorrect when codegen is off

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.3.0
• Component/s: SQL
• Assignee: Ala Luszczak
• Reporter: Ala Luszczak
• Created: 11/Oct/17 14:08
• Updated: 12/Oct/17 15:07
• Resolved: 12/Oct/17 15:07

Description

When whole-stage codegen is off, metric "aggregate time" is not set correctly.

Repro:

1. spark.conf.set("spark.sql.codegen.wholeStage", false)
2. spark.range(5).crossJoin(spark.range(5)).toDF("a","b").groupBy("a").agg(sum("b")).show
3. In Spark UI > SQL you can see that "aggregate time total" is 0 in "HashAggregate" boxes

Issue Links

• links to: [Github] Pull Request #19473 (ala)