Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
Reviewed
Description
Bug found while launching spark-shell.
Repro-steps :
1. Create a spark cluster with wasb-acls enabled.
2. Change spark history log directory configurations to wasb:///hdp/spark2-events
3. Launching the spark shell should fail.
The above scenario works fine with clusters that dont have wasb-acl authorization enabled.
Note : wasb:/// resolves correctly on fs shell.