Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
In some cases, we see the Parquet reader as the bottleneck in reading from the file system. RWSpeedTest is able to read 10x faster than the Parquet reader so reading from disk is not the issue. This issue is to add more instrumentation to the Parquet reader so speed bottlenecks can be better diagnosed.