YARN-3926 adds the ability for administrators to configure custom resources, like GPUs. This JIRA is to add support to Spark for requesting resources other than CPU virtual cores and memory. See YARN-3926.
SPARK-23151Provide a distribution of Spark with Hadoop 3.0
YARN-3926[Umbrella] Extend the YARN resource model for easier resource-type management and profiles