[FLINK-6581] Dynamic property parsing broken for YARN

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 1.4.0
• Fix Version/s: 1.2.2, 1.3.0, 1.4.0
• Component/s: Deployment / YARN
• Assignee: Till Rohrmann
• Reporter: Till Rohrmann
• Created: 15/May/17 09:20
• Updated: 16/May/17 22:42
• Resolved: 16/May/17 22:42

Description

The dynamic property parsing in YARN is broken. For example, the following dynamic property won't be parsed properly: -yDenv.java.opts="-DappName=foobar -Did=1". The result will be equivalent to -yDenv.java.opts="-DappName".

The problem is that FlinkYarnSessionCli#getDynamicProperties assumes that all dynamic properties have the form -D<KEY>=<VALUE> where <VALUE> does not contain any =.

I propose to change the parsing of the dynamic properties string such that it splits the key-value pair not via dynamicProperties.split("=") but that we split the dynamic properties string at the first occurrence of the =.

Issue Links

• links to: GitHub Pull Request #3903