Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
Currently, Tuple creation mechanism of StorageManagerV2 is as follows:
1) At file scan, scheduled scanner reads data from disk, makes a Tuple, and insert it to the Tuple pool
2) next() of the scanner just pulls an already created Tuple from the Tuple pool asynchronously
Because of Tuple creation time, scanner cannot fully use its time to read disk, which results in less disk read bandwidth utilization
So, if Tuple creation role is moved to next() and scanners spend their whole time to read file at file scan,
we can fully utilize disk read bandwidth