[FLINK-9478] Use Yarn application proxy to communicate with Flink cluster

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Affects Version/s: 1.5.0
• Component/s: Command Line Client, Deployment / YARN, Runtime / REST
• Assignee: Unassigned
• Reporter: Till Rohrmann
• Created: 30/May/18 07:35
• Updated: 29/Jan/21 10:51
• Resolved: 29/Jan/21 10:51

Description

The Yarn AM proxy currently does not support PUT/POST/DELETE requests (see YARN-2084). Due to this limitation it is currently not possible for the Flink REST client to directly communicate with the Flink cluster through the Yarn proxy.

In order to circumvent this problem we could try to wrap all our REST calls in a GET request which is forwarded by the Yarn proxy. Maybe this can be achieved with X-HTTP methods override as described by http://fandry.blogspot.de/2012/03/x-http-header-method-override-and-rest.html.

Issue Links

• is blocked by: FLINK-9280 Extend JobSubmitHandler to accept jar files
• is related to: YARN-2031 YARN Proxy model doesn't support REST APIs in AMs