Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
Security Level: public (Regular issues)
-
None
Description
tonysun83 showed me some profiling of the _changes feed which indicated that the coordinator process was spending about 1/3 of its time executing inside send_delayed_chunk. We can reduce the number of invocations of this function by buffering individual rows until we reach a (configurable) threshold for sending the data out the wire.
We'll of course want to be careful about continuous feeds; if we're in the "slow drip" portion of the feed we'll obviously want to emit right away instead of adding latency unnecessarily.