[FLINK-17819] Yarn error unhelpful when forgetting HADOOP_CLASSPATH

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.9.3, 1.10.1
• Fix Version/s: 1.10.2, 1.11.0, 1.12.0
• Component/s: Deployment / YARN
• Labels: pull-request-available usability
• Assignee: Kostas Kloudas
• Reporter: Arvid Heise
• Created: 19/May/20 21:22
• Updated: 22/Jun/21 14:06
• Resolved: 28/May/20 19:23

Description

When running

flink run -m yarn-cluster -yjm 1768 -ytm 50072 -ys 32 ...

without some export HADOOP_CLASSPATH, we get the unhelpful message

Could not build the program from JAR file: JAR file does not exist: -yjm

I'd expect something like

yarn-cluster can only be used with exported HADOOP_CLASSPATH, see <url> for more information

 

I suggest to load a stub for YarnCluster deployment if the actual implementation fails to load, which prints this error when used.

Issue Links

• links to: GitHub Pull Request #12317
• links to: GitHub Pull Request #12395