[SPARK-38888] Add `RocksDBProvider` similar to `LevelDBProvider`

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Spark Core, YARN
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 13/Apr/22 14:01
• Updated: 09/Sep/22 02:06
• Resolved: 09/Sep/22 02:06

Description

`LevelDBProvider` is used by `ExternalShuffleBlockResolver` and `YarnShuffleService`, a corresponding `RocksDB` implementation should be added

Issue Links

• is related to: SPARK-35781 Support Spark on Apple Silicon on macOS natively on Java 17
• links to: [Github] Pull Request #37610 (LuciferYang)