[YUNIKORN-802] Supports to assign nodes to non-default partition

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: shim - kubernetes
• Labels: pull-request-available
• Assignee: Chia-Ping Tsai
• Reporter: Chia-Ping Tsai
• Created: 17/Aug/21 08:59
• Updated: 24/Oct/23 12:57

Description

see comment (https://issues.apache.org/jira/browse/YUNIKORN-22?focusedCommentId=17398860&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17398860)

Currently, all nodes are hardcode to be assigned to "default" partition. That brings two disadvantages.

1. we can't select specify nodes, which are used to execute spark job only, from a cluster
2. multi-partitions does not work since non-default partition can't get nodes

Future works:

1. support to change partition assignment of existent node (in this PR, the update request will be skipped)
2. support to remove existent node which had been reassigned (in this PR, removing such node cause error message "Failed to update non existing node ...")

Issue Links

• causes: YUNIKORN-1124 Avoid passing empty nodeAttributes in UpdateNode request
• links to: GitHub Pull Request #293
• links to: GitHub Pull Request #293