Major Description
In the Web UI when I’m running a query with limit clause, the duration of WholeStageCodegen operator is always 0 ms.
the corresponding feature is SPARK-13916, commitid: 76958d820f57d23e3cbb5b7205c680a5daea0499 . durationMs update only when we iterate the last row of partition, but when we only iterate a few rows, the duration will always be 0 ms
below code will repetition the issue:
spark.sql("use tpcds1g")
spark.sql("""
select i_item_sk from item
limit 100
""").collect
