[SPARK-48037] SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.3.0, 4.0.0, 3.5.1, 3.4.3
• Fix Version/s: 4.0.0, 3.5.2, 3.4.4
• Component/s: Spark Core, SQL
• Labels: correctness pull-request-available
• Target Version/s: 4.0.0, 3.5.2, 3.4.4
• Assignee: dzcxzl
• Reporter: dzcxzl
• Created: 29/Apr/24 04:20
• Updated: 08/May/24 15:42
• Resolved: 07/May/24 17:15

Issue Links

• is related to: SPARK-36424 Support eliminate limits in AQE Optimizer
• links to: GitHub Pull Request #46273
• links to: GitHub Pull Request #46459
• links to: GitHub Pull Request #46464