[YARN-6357] Implement putEntitiesAsync API in TimelineCollector

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: YARN-2928
• Fix Version/s: 2.9.0, YARN-5355, YARN-5355-branch-2, 3.0.0-alpha4
• Component/s: ATSv2, timelineserver
• Labels: yarn-5355-merge-blocker
• Target Version/s: YARN-5355
• Hadoop Flags: Reviewed
• Assignee: Haibo Chen
• Reporter: Joep Rottinghuis
• Created: 16/Mar/17 22:07
• Updated: 21/Oct/17 06:05
• Resolved: 28/Mar/17 22:36

Description

As discovered and discussed in YARN-5269 the TimelineCollector#putEntitiesAsync method is currently not implemented and TimelineCollector#putEntities is asynchronous.

TimelineV2ClientImpl#putEntities vs TimelineV2ClientImpl#putEntitiesAsync correctly call TimelineEntityDispatcher#dispatchEntities(boolean sync,... with the correct argument. This argument does seem to make it into the params, and on the server side TimelineCollectorWebService#putEntities correctly pulls the async parameter from the rest call. See line 156:

    boolean isAsync = async != null && async.trim().equalsIgnoreCase("true");

However, this is where the problem starts. It simply calls TimelineCollector#putEntities and ignores the value of isAsync. It should instead have called TimelineCollector#putEntitiesAsync, which is currently not implemented.
putEntities should call putEntitiesAsync and then after that call writer.flush()
The fact that we flush on close and we flush periodically should be more of a concern of avoiding data loss; close in case sync is never called and the periodic flush to guard against having data from slow writers get buffered for a long time and expose us to risk of loss in case the collector crashes with data in its buffers. Size-based flush is a different concern to avoid blowing up memory footprint.
The spooling behavior is also somewhat separate.
We have two separate methods on our API putEntities and putEntitiesAsync and they should have different behavior beyond waiting for the request to be sent.

Issue Links

• relates to: YARN-5269 Bubble exceptions and errors all the way up the calls, including to clients.
• relates to: YARN-6342 Make TimelineV2Client's drain timeout after stop configurable