-
Type:
Bug
-
Status: Open
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: 3.0.0
-
Fix Version/s: None
-
Component/s: Input/Output
-
Labels:None
Input metrics while reading a simple CSV file with
spark.read.csv(....)
are absent.
Switching to v1 data source works. Adding the inputMetrics calculation from FileScanRDD to DataSourceRDD helps get the values.