Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Right now reader is a callable that is dumped into threadpool, and all the data loading for one request happens on one thread (in parallel with operator pipeline).
We might want to separate reading from HDFS/decompressing data, from decoding data and low-level row-level SARGs (that, and high level cache which is AWOL now, were the reasons for encoded data production separation from final VRB production)