[FLINK-14630] Yarn tests no longer create jobmanager log files

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.0
• Component/s: Deployment / YARN, Tests
• Labels: pull-request-available
• Assignee: Kostas Kloudas
• Reporter: Till Rohrmann
• Created: 06/Nov/19 10:18
• Updated: 04/Dec/19 14:26
• Resolved: 08/Nov/19 08:50

Description

With FLINK-14502 we changed how log property files are being discovered by the YarnClusterDescriptor. In fact we moved the responsibility to the FlinkYarnSessionCli. This is problematic because the YarnTestBase creates for Yarn tests a configuration directory which contains the Flink configuration and the log property files. These files are no longer respected because the respective code path has been removed.

I think it is important to fix this problem so that our Yarn tests start to log again. Otherwise it becomes harder to debug Yarn problems and the tests can no longer check for the absence of exceptions in the logs.

Issue Links

• is caused by: FLINK-14502 Make ClusterDescriptor/ClusterSpecification creation configuration-based.
• is related to: FLINK-15055 YarnDistributedCacheITCase does not generate logs.
• links to: GitHub Pull Request #10115