[SPARK-47088] Utilize BigDecimal to calculate the GPU resource

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Bobby Wang
• Created: 19/Feb/24 00:07
• Updated: 26/Feb/24 02:19

Description

To prevent precision errors, the current method of calculating GPU resources involves multiplying by 1E16 to convert doubles to Longs. If needed, it will also convert Longs back to doubles. This approach introduces redundancy in the code, especially for test code.

More details can be found at https://github.com/apache/spark/pull/44690#discussion_r1482301112

Issue Links

• links to: GitHub Pull Request #45157