Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
Description
In recent experiments, I confirmed that during ingestion, copying values from Tablets to MemTables can be very time-consuming, especially on some large servers.
Because the large servers are designed mainly for highly concurrent workloads, but not specialized for massive memory access.
To avoid massive memory operation during writing MemTables, I propose to also use TVList in
request structures like Tablets.
As a result, in some situations, the data arrays in the Tablets can be directly moved into MemTables, avoiding expensive memory copy.