[FLINK-16376] Using consistent method to get Yarn application directory

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 1.10.0
• Component/s: Deployment / YARN
• Labels: pull-request-available
• Assignee: jiasheng55
• Reporter: jiasheng55
• Created: 02/Mar/20 10:54
• Updated: 16/Jun/20 11:21
• Resolved: 16/Jun/20 08:48

Description

The Yarn application directory of Flink is "/user/

{user.name}

/.flink", but this logic is separated in different places.

1. org.apache.flink.yarn.YarnClusterDescriptor#getYarnFilesDir

	private Path getYarnFilesDir(final ApplicationId appId) throws IOException {
		final FileSystem fileSystem = FileSystem.get(yarnConfiguration);
		final Path homeDir = fileSystem.getHomeDirectory();
		return new Path(homeDir, ".flink/" + appId + '/');
	}

2. org.apache.flink.yarn.Utils#uploadLocalFileToRemote

		// copy resource to HDFS
		String suffix =
			".flink/"
				+ appId
				+ (relativeTargetPath.isEmpty() ? "" : "/" + relativeTargetPath)
				+ "/" + localSrcPath.getName();

		Path dst = new Path(homedir, suffix);

We can extract `getYarnFilesDir` method to `org.apache.flink.yarn.Utils`, and use this method to get Yarn application directory in all the other places.

Issue Links

• duplicates: FLINK-17515 Move YARN staging functionality to a separate class
• links to: GitHub Pull Request #11322
• links to: GitHub Pull Request #12600