[YARN-7584] Support resource profiles and fine-grained resource requests in native services

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Jonathan Hung
• Created: 29/Nov/17 23:52
• Updated: 04/Dec/17 18:20
• Resolved: 04/Dec/17 18:20

Description

Currently resource profiles does not appear to be supported:

    // Currently resource profile is not supported yet, so we will raise
    // validation error if only resource profile is specified
    if (StringUtils.isNotEmpty(resource.getProfile())) {
      throw new IllegalArgumentException(
          RestApiErrorMessages.ERROR_RESOURCE_PROFILE_NOT_SUPPORTED_YET);
    }

Also attempting to specify profiles in the service spec throws an exception since cpu default value is 1:

Exception in thread "main" java.lang.IllegalArgumentException: Cannot specify cpus/memory along with profile for component ps
	at org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateServiceResource(ServiceApiUtil.java:278)
	at org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateComponent(ServiceApiUtil.java:201)
	at org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateAndResolveService(ServiceApiUtil.java:174)
	at org.apache.hadoop.yarn.service.client.ServiceClient.actionCreate(ServiceClient.java:214)
	at org.apache.hadoop.yarn.service.client.ServiceClient.actionLaunch(ServiceClient.java:205)
	at org.apache.hadoop.yarn.client.cli.ApplicationCLI.run(ApplicationCLI.java:447)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.hadoop.yarn.client.cli.ApplicationCLI.main(ApplicationCLI.java:111)

Issue Links

• duplicates: YARN-7555 Support multiple resource types in YARN native services