[SPARK-47767] Show offset value in TakeOrderedAndProjectExec

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.5.0, 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: guihuawen
• Reporter: guihuawen
• Created: 08/Apr/24 16:24
• Updated: 18/Apr/24 07:04
• Resolved: 18/Apr/24 07:04

Description

Show the offset value in TakeOrderedAndProjectExec.

 

For example:

 

explain select * from test_limit_offset order by a  limit 2  offset 1;

plan

== Physical Plan ==

TakeOrderedAndProject(limit=3, orderBy=a#171 ASC NULLS FIRST, output=a#171)

+- Scan hive spark_catalog.bigdata_qa.test_limit_offset a#171, HiveTableRelation [`spark_catalog`.`test`.`test_limit_offset`, org.apache.hadoop.hive.ql.io.orc.OrcSerde, Data Cols: a#171, Partition Cols: []]

 

No offset is displayed. If it is displayed, it will be more user-friendly

 

Issue Links

• links to: GitHub Pull Request #45931