[SPARK-29304] Input Bytes Metric for Datasource v2 is absent

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Input/Output
• Assignee: Unassigned
• Reporter: Kuhu Shukla
• Created: 30/Sep/19 14:20
• Updated: 04/Oct/19 08:28

Description

Input metrics while reading a simple CSV file with

spark.read.csv(....)

are absent.

Switching to v1 data source works. Adding the inputMetrics calculation from FileScanRDD to DataSourceRDD helps get the values.