[MESOS-6971] Use arena allocation to improve protobuf message passing performance.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Labels: mesosphere performance tech-debt
• Epic Link: protobuf arenas
• Assignee: Dmitry Zhuk
• Reporter: Benjamin Mahler
• Created: 23/Jan/17 00:13
• Updated: 24/Oct/17 00:52
• Resolved: 24/Oct/17 00:52

Description

The protobuf message passing provided by ProtobufProcess provide const access of the message and/or its fields to the handler function.

This means that we can leverage the arena allocator provided by protobuf to reduce the memory allocation cost during de-serialization and improve cache efficiency.

This would require using protobuf 3.x with "proto2" syntax (which appears to be the default if unspecified) to maintain our existing "proto2" requirements. The upgrade to protobuf 3.x while keeping "proto2" syntax should be tackled via a separate ticket that blocks this one.

Issue Links

• is blocked by: MESOS-6138 Add 'syntax=proto2' to all .proto files in Mesos
• is blocked by: MESOS-5186 mesos.interface: Allow using protobuf 3.x
• is related to: MESOS-7706 Improve master failover time for large clusters.
• is related to: MESOS-6972 Improve performance of protobuf message passing by removing RepeatedPtrField to vector conversion.
• relates to: MESOS-5783 Use protobuf arena allocation to improve performance.