[FLINK-25762] Native k8s- User defined system properties get overriden when cluster is deployed

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.13.0, 1.14.0, 1.15.0
• Component/s: Deployment / Kubernetes
• Labels: Flink flink-k8s kubernetes native-k8s native-kubernetes pull-request-available stale-assigned

Release Note

exec command order changed

From:

exec "$JAVA_RUN" $JVM_ARGS ${FLINK_ENV_JAVA_OPTS} "${log_setting[@]}" -classpath "`manglePathList "$FLINK_TM_CLASSPATH:$INTERNAL_HADOOP_CLASSPATHS"`" ${CLASS_TO_RUN} "${ARGS[@]}"

To

exec "$JAVA_RUN" $JVM_ARGS "${log_setting[@]}" "${FLINK_ENV_JAVA_OPTS}" -classpath "`manglePathList "$FLINK_TM_CLASSPATH:$INTERNAL_HADOOP_CLASSPATHS"`" ${CLASS_TO_RUN} "${ARGS[@]}"

• Assignee: Tamir Sagi
• Reporter: Tamir Sagi
• Created: 22/Jan/22 14:47
• Updated: 01/Aug/22 07:12

Description

Running Flink 1.14.2 in native k8s mode, User defined system properties get ignores. i.e,  -Dlog4j.configurationFile, it falls back to /opt/flink/conf/log4j-console.properties.

That happens due to the order of exec command provided in flink-console.sh file.

https://github.com/apache/flink/blob/release-1.14.2/flink-dist/src/main/flink-bin/bin/flink-console.sh#L114

exec "$JAVA_RUN" $JVM_ARGS ${FLINK_ENV_JAVA_OPTS} "${log_setting[@]}" -classpath "`manglePathList "$FLINK_TM_CLASSPATH:$INTERNAL_HADOOP_CLASSPATHS"`" ${CLASS_TO_RUN} "${ARGS[@]}"

Apart from logging, All user defined properties(FLINK_ENV_JAVA_OPTS) might get overriden by other args.

Discussion

https://lists.apache.org/thread/b24g1nd00q5pln5h9w2mh1s3ocxwb61b

Issue Links

• links to: GitHub Pull Request #18447