[SPARK-25509] SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.1, 2.4.0
• Fix Version/s: 2.3.3, 2.4.0
• Component/s: Spark Core
• Assignee: Rong Tang
• Reporter: Rong Tang
• Created: 21/Sep/18 17:13
• Updated: 26/Sep/18 15:40
• Resolved: 26/Sep/18 15:40

Description

SHS V2 cannot enabled in Windoes, because windows doesn't support POSIX permission. 

with exception: java.lang.UnsupportedOperationException: 'posix:permissions' not supported as initial attribute.

test case fails in windows without this fix.
org.apache.spark.deploy.history.HistoryServerDiskManagerSuite test("leasing space")

 

PR: https://github.com/apache/spark/pull/22520

 

Issue Links

• links to: [Github] Pull Request #22520 (jianjianjiao)
• links to: [Github] Pull Request #22520 (jianjianjiao)