[FLINK-15053] Configurations with values contains space may cause TM failures on Yarn

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.0
• Component/s: Deployment / YARN, Runtime / Coordination
• Labels: pull-request-available
• Assignee: Yang Wang
• Reporter: Xintong Song
• Created: 04/Dec/19 14:10
• Updated: 07/Jan/20 08:19
• Resolved: 07/Jan/20 08:19

Description

Currently on Yarn setups, we are passing task executor specific configurations through dynamic properties in the starting command (see FLINK-13184).

If the value of configuration contains space, the dynamic properties may not be correctly parsed, which could cause task executor failures. On occurrence can be found in FLINK-15047.

It would be good to allow spaces when passing dynamic properties. E.g., surrounding the values with double quotation marks, or escaping special characters.

cc fly_in_gis

Issue Links

• causes: FLINK-15047 YarnDistributedCacheITCase is unstable
• relates to: FLINK-13184 Starting a TaskExecutor blocks the YarnResourceManager's main thread
• links to: GitHub Pull Request #10532